2024-03-17T23:41:39.005 INFO:root:teuthology version: 0.0.1.dev262+ge691533 2024-03-17T23:41:39.005 DEBUG:teuthology.run:Teuthology command: teuthology --archive /home/teuthworker/archive/pdonnell-2024-03-17_23:17:27-fs-wip-batrick-testing-20240314.183243-distro-default-smithi/7608502 --owner scheduled_pdonnell@teuthology --description fs/verify/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu/{overrides ubuntu_latest}} mount/fuse objectstore-ec/bluestore-comp overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug session_timeout} ranks/5 tasks/fsstress validater/lockdep} --verbose --name pdonnell-2024-03-17_23:17:27-fs-wip-batrick-testing-20240314.183243-distro-default-smithi -- /home/teuthworker/archive/pdonnell-2024-03-17_23:17:27-fs-wip-batrick-testing-20240314.183243-distro-default-smithi/7608502/orig.config.yaml 2024-03-17T23:41:39.046 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-17T23:41:39.129 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/pdonnell-2024-03-17_23:17:27-fs-wip-batrick-testing-20240314.183243-distro-default-smithi/7608502 branch: wip-batrick-testing-20240314.183243 description: fs/verify/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu/{overrides ubuntu_latest}} mount/fuse objectstore-ec/bluestore-comp overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug session_timeout} ranks/5 tasks/fsstress validater/lockdep} email: pdonnell@redhat.com first_in_suite: false job_id: '7608502' kernel: kdb: true sha1: distro ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: pdonnell-2024-03-17_23:17:27-fs-wip-batrick-testing-20240314.183243-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: ubuntu os_version: '22.04' overrides: admin_socket: branch: wip-batrick-testing-20240314.183243 ceph: cephfs: max_mds: 5 session_timeout: 300 conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: lockdep: true mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bluestore block size: 96636764160 bluestore compression mode: aggressive bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - POOL_APP_NOT_ENABLED - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - mons down, quorum - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - MON_DOWN sha1: 3d78f5ba07bf18880172c07d4d7b4ac00c9d30af valgrind: exit_on_first_error: false ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} check-counter: counters: mds: - mds.exported - mds.imported install: ceph: flavor: default sha1: 3d78f5ba07bf18880172c07d4d7b4ac00c9d30af thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-batrick-testing-20240314.183243 sha1: c382027d5c66ef4e0aa1131ea3e8080c658d3184 owner: scheduled_pdonnell@teuthology priority: 75 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - mds.e - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - - mon.b - mon.c - mgr.x - mds.b - mds.d - mds.f - osd.4 - osd.5 - osd.6 - osd.7 seed: 4770 sha1: 3d78f5ba07bf18880172c07d4d7b4ac00c9d30af sleep_before_teardown: 0 subset: 498/512 suite: fs suite_branch: wip-batrick-testing-20240314.183243 suite_path: /home/teuthworker/src/github.com_batrick_ceph_c382027d5c66ef4e0aa1131ea3e8080c658d3184/qa suite_relpath: qa suite_repo: https://github.com/batrick/ceph suite_sha1: c382027d5c66ef4e0aa1131ea3e8080c658d3184 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi196.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAs0844wV6QQUoZJ+C60WiQCEh8h2X7JIthXaWrQMx9UwB8G87CQJrnIGKrPS1OwgRcON83HyicicbCIye/y7/E= smithi204.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBjRRYU3IlO5bGPT4dvCXd6tMqE52fMlYdvmWFVwJYCtALiTKQQTvQwrt03hevR32GVaaGTAWUPB6arxujLXlTI= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - ceph-fuse: null - workunit: clients: all: - suites/fsstress.sh timeout: 6h teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return false end - local function is_kdistro() return false end - local function is_fuse() return true end - local function syntax_version() return '' end teuthology_branch: main teuthology_sha1: e691533f9cbb33d85b2187bba20d7102f098636d timestamp: 2024-03-17_23:17:27 tube: smithi user: pdonnell verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-03-17T23:41:39.129 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_batrick_ceph_c382027d5c66ef4e0aa1131ea3e8080c658d3184/qa; will attempt to use it 2024-03-17T23:41:39.130 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_batrick_ceph_c382027d5c66ef4e0aa1131ea3e8080c658d3184/qa/tasks 2024-03-17T23:41:39.130 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-03-17T23:41:39.132 INFO:teuthology.task.internal:Checking packages... 2024-03-17T23:41:39.155 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash '3d78f5ba07bf18880172c07d4d7b4ac00c9d30af' 2024-03-17T23:41:39.155 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-03-17T23:41:39.155 INFO:teuthology.packaging:ref: None 2024-03-17T23:41:39.155 INFO:teuthology.packaging:tag: None 2024-03-17T23:41:39.155 INFO:teuthology.packaging:branch: wip-batrick-testing-20240314.183243 2024-03-17T23:41:39.155 INFO:teuthology.packaging:sha1: 3d78f5ba07bf18880172c07d4d7b4ac00c9d30af 2024-03-17T23:41:39.155 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=wip-batrick-testing-20240314.183243 2024-03-17T23:41:39.297 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-2162-g3d78f5ba-1jammy 2024-03-17T23:41:39.298 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-03-17T23:41:39.305 INFO:teuthology.task.internal:no buildpackages task found 2024-03-17T23:41:39.305 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-03-17T23:41:39.323 INFO:teuthology.task.internal:Saving configuration 2024-03-17T23:41:39.337 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-03-17T23:41:39.343 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-03-17T23:41:39.367 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi196.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-03-17_23:17:27-fs-wip-batrick-testing-20240314.183243-distro-default-smithi/7608502', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-03-17 23:35:50.401004', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIN0hAhfucYcYVZs2QI9cWLIbeUdvZJm2rBSgR545W2hy'} 2024-03-17T23:41:39.390 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi204.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-03-17_23:17:27-fs-wip-batrick-testing-20240314.183243-distro-default-smithi/7608502', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-03-17 23:35:50.399409', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAINK8exBC160H8a8fUuGS6w0mPbbLybUT5T82bg6pwHDd'} 2024-03-17T23:41:39.391 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-03-17T23:41:39.397 INFO:teuthology.task.internal:roles: ubuntu@smithi196.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'mds.e', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'] 2024-03-17T23:41:39.397 INFO:teuthology.task.internal:roles: ubuntu@smithi204.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'mds.f', 'osd.4', 'osd.5', 'osd.6', 'osd.7'] 2024-03-17T23:41:39.397 INFO:teuthology.run_tasks:Running task console_log... 2024-03-17T23:41:39.459 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fea879a84c0>, signals=[15]) 2024-03-17T23:41:39.459 INFO:teuthology.run_tasks:Running task internal.connect... 2024-03-17T23:41:39.466 INFO:teuthology.task.internal:Opening connections... 2024-03-17T23:41:39.466 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi196.front.sepia.ceph.com 2024-03-17T23:41:39.468 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-17T23:41:39.546 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi204.front.sepia.ceph.com 2024-03-17T23:41:39.547 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi204.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-17T23:41:39.625 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-03-17T23:41:39.632 DEBUG:teuthology.orchestra.run.smithi196:> uname -m 2024-03-17T23:41:39.637 INFO:teuthology.orchestra.run.smithi196.stdout:x86_64 2024-03-17T23:41:39.637 DEBUG:teuthology.orchestra.run.smithi196:> cat /etc/os-release 2024-03-17T23:41:39.684 INFO:teuthology.orchestra.run.smithi196.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-03-17T23:41:39.684 INFO:teuthology.orchestra.run.smithi196.stdout:NAME="Ubuntu" 2024-03-17T23:41:39.684 INFO:teuthology.orchestra.run.smithi196.stdout:VERSION_ID="22.04" 2024-03-17T23:41:39.684 INFO:teuthology.orchestra.run.smithi196.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-03-17T23:41:39.684 INFO:teuthology.orchestra.run.smithi196.stdout:VERSION_CODENAME=jammy 2024-03-17T23:41:39.684 INFO:teuthology.orchestra.run.smithi196.stdout:ID=ubuntu 2024-03-17T23:41:39.684 INFO:teuthology.orchestra.run.smithi196.stdout:ID_LIKE=debian 2024-03-17T23:41:39.684 INFO:teuthology.orchestra.run.smithi196.stdout:HOME_URL="https://www.ubuntu.com/" 2024-03-17T23:41:39.684 INFO:teuthology.orchestra.run.smithi196.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-03-17T23:41:39.684 INFO:teuthology.orchestra.run.smithi196.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-03-17T23:41:39.685 INFO:teuthology.orchestra.run.smithi196.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-03-17T23:41:39.685 INFO:teuthology.orchestra.run.smithi196.stdout:UBUNTU_CODENAME=jammy 2024-03-17T23:41:39.685 INFO:teuthology.lock.ops:Updating smithi196.front.sepia.ceph.com on lock server 2024-03-17T23:41:39.703 DEBUG:teuthology.orchestra.run.smithi204:> uname -m 2024-03-17T23:41:39.708 INFO:teuthology.orchestra.run.smithi204.stdout:x86_64 2024-03-17T23:41:39.709 DEBUG:teuthology.orchestra.run.smithi204:> cat /etc/os-release 2024-03-17T23:41:39.757 INFO:teuthology.orchestra.run.smithi204.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-03-17T23:41:39.757 INFO:teuthology.orchestra.run.smithi204.stdout:NAME="Ubuntu" 2024-03-17T23:41:39.757 INFO:teuthology.orchestra.run.smithi204.stdout:VERSION_ID="22.04" 2024-03-17T23:41:39.757 INFO:teuthology.orchestra.run.smithi204.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-03-17T23:41:39.757 INFO:teuthology.orchestra.run.smithi204.stdout:VERSION_CODENAME=jammy 2024-03-17T23:41:39.757 INFO:teuthology.orchestra.run.smithi204.stdout:ID=ubuntu 2024-03-17T23:41:39.757 INFO:teuthology.orchestra.run.smithi204.stdout:ID_LIKE=debian 2024-03-17T23:41:39.757 INFO:teuthology.orchestra.run.smithi204.stdout:HOME_URL="https://www.ubuntu.com/" 2024-03-17T23:41:39.758 INFO:teuthology.orchestra.run.smithi204.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-03-17T23:41:39.758 INFO:teuthology.orchestra.run.smithi204.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-03-17T23:41:39.758 INFO:teuthology.orchestra.run.smithi204.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-03-17T23:41:39.758 INFO:teuthology.orchestra.run.smithi204.stdout:UBUNTU_CODENAME=jammy 2024-03-17T23:41:39.758 INFO:teuthology.lock.ops:Updating smithi204.front.sepia.ceph.com on lock server 2024-03-17T23:41:39.778 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-03-17T23:41:39.788 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-03-17T23:41:39.793 INFO:teuthology.task.internal:Checking for old test directory... 2024-03-17T23:41:39.793 DEBUG:teuthology.orchestra.run.smithi196:> test '!' -e /home/ubuntu/cephtest 2024-03-17T23:41:39.795 DEBUG:teuthology.orchestra.run.smithi204:> test '!' -e /home/ubuntu/cephtest 2024-03-17T23:41:39.804 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-03-17T23:41:39.810 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-03-17T23:41:39.811 DEBUG:teuthology.orchestra.run.smithi196:> test -z $(ls -A /var/lib/ceph) 2024-03-17T23:41:39.842 DEBUG:teuthology.orchestra.run.smithi204:> test -z $(ls -A /var/lib/ceph) 2024-03-17T23:41:39.853 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-03-17T23:41:39.906 INFO:teuthology.run_tasks:Running task kernel... 2024-03-17T23:41:39.920 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2024-03-17T23:41:39.920 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mon.b': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2024-03-17T23:41:39.921 DEBUG:teuthology.orchestra.run.smithi196:> test -f /run/.containerenv -o -f /.dockerenv 2024-03-17T23:41:39.921 DEBUG:teuthology.orchestra.run.smithi204:> test -f /run/.containerenv -o -f /.dockerenv 2024-03-17T23:41:39.925 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-17T23:41:39.925 DEBUG:teuthology.orchestra.run.smithi196:> uname -r 2024-03-17T23:41:39.926 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-17T23:41:39.927 DEBUG:teuthology.orchestra.run.smithi204:> uname -r 2024-03-17T23:41:39.972 INFO:teuthology.orchestra.run.smithi196.stdout:5.15.0-56-generic 2024-03-17T23:41:39.972 INFO:teuthology.task.kernel:Running kernel on smithi196: 5.15.0-56-generic 2024-03-17T23:41:39.972 DEBUG:teuthology.orchestra.run.smithi196:> sudo apt-get clean 2024-03-17T23:41:39.973 INFO:teuthology.orchestra.run.smithi204.stdout:5.15.0-56-generic 2024-03-17T23:41:39.974 INFO:teuthology.task.kernel:Running kernel on smithi204: 5.15.0-56-generic 2024-03-17T23:41:39.974 DEBUG:teuthology.orchestra.run.smithi204:> sudo apt-get clean 2024-03-17T23:41:40.096 DEBUG:teuthology.orchestra.run.smithi196:> sudo apt-get update 2024-03-17T23:41:40.106 DEBUG:teuthology.orchestra.run.smithi204:> sudo apt-get update 2024-03-17T23:41:40.231 INFO:teuthology.orchestra.run.smithi196.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-03-17T23:41:40.243 INFO:teuthology.orchestra.run.smithi196.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [119 kB] 2024-03-17T23:41:40.267 INFO:teuthology.orchestra.run.smithi204.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-03-17T23:41:40.293 INFO:teuthology.orchestra.run.smithi204.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [119 kB] 2024-03-17T23:41:40.318 INFO:teuthology.orchestra.run.smithi196.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [109 kB] 2024-03-17T23:41:40.336 INFO:teuthology.orchestra.run.smithi196.stdout:Get:4 http://security.ubuntu.com/ubuntu jammy-security InRelease [110 kB] 2024-03-17T23:41:40.368 INFO:teuthology.orchestra.run.smithi204.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [109 kB] 2024-03-17T23:41:40.376 INFO:teuthology.orchestra.run.smithi204.stdout:Get:4 http://security.ubuntu.com/ubuntu jammy-security InRelease [110 kB] 2024-03-17T23:41:40.458 INFO:teuthology.orchestra.run.smithi196.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [587 kB] 2024-03-17T23:41:40.522 INFO:teuthology.orchestra.run.smithi204.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [587 kB] 2024-03-17T23:41:40.534 INFO:teuthology.orchestra.run.smithi196.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [1,462 kB] 2024-03-17T23:41:40.571 INFO:teuthology.orchestra.run.smithi196.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [285 kB] 2024-03-17T23:41:40.577 INFO:teuthology.orchestra.run.smithi196.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [16.1 kB] 2024-03-17T23:41:40.577 INFO:teuthology.orchestra.run.smithi196.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [35.3 kB] 2024-03-17T23:41:40.577 INFO:teuthology.orchestra.run.smithi196.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [1,559 kB] 2024-03-17T23:41:40.596 INFO:teuthology.orchestra.run.smithi196.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [259 kB] 2024-03-17T23:41:40.599 INFO:teuthology.orchestra.run.smithi196.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [520 B] 2024-03-17T23:41:40.599 INFO:teuthology.orchestra.run.smithi196.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,057 kB] 2024-03-17T23:41:40.608 INFO:teuthology.orchestra.run.smithi204.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [1,462 kB] 2024-03-17T23:41:40.610 INFO:teuthology.orchestra.run.smithi196.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [696 kB] 2024-03-17T23:41:40.652 INFO:teuthology.orchestra.run.smithi204.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [285 kB] 2024-03-17T23:41:40.658 INFO:teuthology.orchestra.run.smithi204.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [16.1 kB] 2024-03-17T23:41:40.658 INFO:teuthology.orchestra.run.smithi204.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [35.3 kB] 2024-03-17T23:41:40.660 INFO:teuthology.orchestra.run.smithi204.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [1,559 kB] 2024-03-17T23:41:40.672 INFO:teuthology.orchestra.run.smithi196.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [239 kB] 2024-03-17T23:41:40.674 INFO:teuthology.orchestra.run.smithi196.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [22.1 kB] 2024-03-17T23:41:40.674 INFO:teuthology.orchestra.run.smithi196.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [42.1 kB] 2024-03-17T23:41:40.675 INFO:teuthology.orchestra.run.smithi196.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,160 B] 2024-03-17T23:41:40.675 INFO:teuthology.orchestra.run.smithi196.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.1 kB] 2024-03-17T23:41:40.675 INFO:teuthology.orchestra.run.smithi196.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [472 B] 2024-03-17T23:41:40.675 INFO:teuthology.orchestra.run.smithi196.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.2 kB] 2024-03-17T23:41:40.676 INFO:teuthology.orchestra.run.smithi196.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.1 kB] 2024-03-17T23:41:40.676 INFO:teuthology.orchestra.run.smithi196.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.0 kB] 2024-03-17T23:41:40.682 INFO:teuthology.orchestra.run.smithi204.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [259 kB] 2024-03-17T23:41:40.685 INFO:teuthology.orchestra.run.smithi204.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [520 B] 2024-03-17T23:41:40.686 INFO:teuthology.orchestra.run.smithi204.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [696 kB] 2024-03-17T23:41:40.702 INFO:teuthology.orchestra.run.smithi196.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-03-17T23:41:40.718 INFO:teuthology.orchestra.run.smithi204.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,057 kB] 2024-03-17T23:41:40.729 INFO:teuthology.orchestra.run.smithi204.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [239 kB] 2024-03-17T23:41:40.732 INFO:teuthology.orchestra.run.smithi204.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [22.1 kB] 2024-03-17T23:41:40.733 INFO:teuthology.orchestra.run.smithi204.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,160 B] 2024-03-17T23:41:40.733 INFO:teuthology.orchestra.run.smithi204.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [42.1 kB] 2024-03-17T23:41:40.733 INFO:teuthology.orchestra.run.smithi196.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [28.4 kB] 2024-03-17T23:41:40.734 INFO:teuthology.orchestra.run.smithi204.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.1 kB] 2024-03-17T23:41:40.734 INFO:teuthology.orchestra.run.smithi196.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [17.2 kB] 2024-03-17T23:41:40.734 INFO:teuthology.orchestra.run.smithi196.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.2 kB] 2024-03-17T23:41:40.734 INFO:teuthology.orchestra.run.smithi196.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [644 B] 2024-03-17T23:41:40.735 INFO:teuthology.orchestra.run.smithi204.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [472 B] 2024-03-17T23:41:40.735 INFO:teuthology.orchestra.run.smithi204.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.1 kB] 2024-03-17T23:41:40.736 INFO:teuthology.orchestra.run.smithi204.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.2 kB] 2024-03-17T23:41:40.755 INFO:teuthology.orchestra.run.smithi204.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.0 kB] 2024-03-17T23:41:40.755 INFO:teuthology.orchestra.run.smithi204.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-03-17T23:41:40.755 INFO:teuthology.orchestra.run.smithi204.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [17.2 kB] 2024-03-17T23:41:40.756 INFO:teuthology.orchestra.run.smithi204.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [28.4 kB] 2024-03-17T23:41:40.756 INFO:teuthology.orchestra.run.smithi204.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.2 kB] 2024-03-17T23:41:40.756 INFO:teuthology.orchestra.run.smithi204.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [644 B] 2024-03-17T23:41:40.779 INFO:teuthology.orchestra.run.smithi196.stdout:Get:29 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [421 kB] 2024-03-17T23:41:40.825 INFO:teuthology.orchestra.run.smithi204.stdout:Get:29 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,246 kB] 2024-03-17T23:41:41.056 INFO:teuthology.orchestra.run.smithi196.stdout:Get:30 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,246 kB] 2024-03-17T23:41:41.221 INFO:teuthology.orchestra.run.smithi196.stdout:Get:31 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [225 kB] 2024-03-17T23:41:41.223 INFO:teuthology.orchestra.run.smithi204.stdout:Get:30 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [421 kB] 2024-03-17T23:41:41.233 INFO:teuthology.orchestra.run.smithi196.stdout:Get:32 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [11.4 kB] 2024-03-17T23:41:41.234 INFO:teuthology.orchestra.run.smithi196.stdout:Get:33 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [1,531 kB] 2024-03-17T23:41:41.241 INFO:teuthology.orchestra.run.smithi204.stdout:Get:31 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [225 kB] 2024-03-17T23:41:41.251 INFO:teuthology.orchestra.run.smithi204.stdout:Get:32 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [11.4 kB] 2024-03-17T23:41:41.252 INFO:teuthology.orchestra.run.smithi204.stdout:Get:33 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [33.7 kB] 2024-03-17T23:41:41.252 INFO:teuthology.orchestra.run.smithi204.stdout:Get:34 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [1,531 kB] 2024-03-17T23:41:41.314 INFO:teuthology.orchestra.run.smithi196.stdout:Get:34 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [33.7 kB] 2024-03-17T23:41:41.315 INFO:teuthology.orchestra.run.smithi196.stdout:Get:35 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [255 kB] 2024-03-17T23:41:41.323 INFO:teuthology.orchestra.run.smithi196.stdout:Get:36 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [520 B] 2024-03-17T23:41:41.323 INFO:teuthology.orchestra.run.smithi196.stdout:Get:37 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [598 kB] 2024-03-17T23:41:41.340 INFO:teuthology.orchestra.run.smithi196.stdout:Get:38 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [850 kB] 2024-03-17T23:41:41.344 INFO:teuthology.orchestra.run.smithi204.stdout:Get:35 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [255 kB] 2024-03-17T23:41:41.355 INFO:teuthology.orchestra.run.smithi204.stdout:Get:36 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [520 B] 2024-03-17T23:41:41.355 INFO:teuthology.orchestra.run.smithi204.stdout:Get:37 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [850 kB] 2024-03-17T23:41:41.387 INFO:teuthology.orchestra.run.smithi204.stdout:Get:38 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [598 kB] 2024-03-17T23:41:41.525 INFO:teuthology.orchestra.run.smithi196.stdout:Get:39 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [162 kB] 2024-03-17T23:41:41.563 INFO:teuthology.orchestra.run.smithi204.stdout:Get:39 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [162 kB] 2024-03-17T23:41:41.932 INFO:teuthology.orchestra.run.smithi196.stdout:Get:40 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [16.8 kB] 2024-03-17T23:41:41.938 INFO:teuthology.orchestra.run.smithi196.stdout:Get:41 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.1 kB] 2024-03-17T23:41:41.953 INFO:teuthology.orchestra.run.smithi196.stdout:Get:42 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-03-17T23:41:41.953 INFO:teuthology.orchestra.run.smithi196.stdout:Get:43 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,476 B] 2024-03-17T23:41:41.955 INFO:teuthology.orchestra.run.smithi196.stdout:Get:44 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [260 B] 2024-03-17T23:41:41.969 INFO:teuthology.orchestra.run.smithi204.stdout:Get:40 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [16.8 kB] 2024-03-17T23:41:41.975 INFO:teuthology.orchestra.run.smithi204.stdout:Get:41 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-03-17T23:41:41.975 INFO:teuthology.orchestra.run.smithi204.stdout:Get:42 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.1 kB] 2024-03-17T23:41:41.989 INFO:teuthology.orchestra.run.smithi204.stdout:Get:43 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,476 B] 2024-03-17T23:41:41.992 INFO:teuthology.orchestra.run.smithi204.stdout:Get:44 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [260 B] 2024-03-17T23:41:46.283 INFO:teuthology.orchestra.run.smithi204.stdout:Fetched 12.2 MB in 2s (6,794 kB/s) 2024-03-17T23:41:46.315 INFO:teuthology.orchestra.run.smithi196.stdout:Fetched 12.2 MB in 2s (6,779 kB/s) 2024-03-17T23:41:47.641 INFO:teuthology.orchestra.run.smithi196.stdout:Reading package lists... 2024-03-17T23:41:47.644 INFO:teuthology.orchestra.run.smithi204.stdout:Reading package lists... 2024-03-17T23:41:47.658 DEBUG:teuthology.orchestra.run.smithi196:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-03-17T23:41:47.662 DEBUG:teuthology.orchestra.run.smithi204:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-03-17T23:41:47.720 INFO:teuthology.orchestra.run.smithi196.stdout:Reading package lists... 2024-03-17T23:41:47.721 INFO:teuthology.orchestra.run.smithi204.stdout:Reading package lists... 2024-03-17T23:41:47.916 INFO:teuthology.orchestra.run.smithi204.stdout:Building dependency tree... 2024-03-17T23:41:47.917 INFO:teuthology.orchestra.run.smithi196.stdout:Building dependency tree... 2024-03-17T23:41:47.917 INFO:teuthology.orchestra.run.smithi204.stdout:Reading state information... 2024-03-17T23:41:47.918 INFO:teuthology.orchestra.run.smithi196.stdout:Reading state information... 2024-03-17T23:41:48.075 INFO:teuthology.orchestra.run.smithi204.stdout:The following packages were automatically installed and are no longer required: 2024-03-17T23:41:48.075 INFO:teuthology.orchestra.run.smithi204.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-03-17T23:41:48.075 INFO:teuthology.orchestra.run.smithi204.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-03-17T23:41:48.075 INFO:teuthology.orchestra.run.smithi204.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-03-17T23:41:48.075 INFO:teuthology.orchestra.run.smithi204.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-03-17T23:41:48.075 INFO:teuthology.orchestra.run.smithi204.stdout: python2.7-minimal 2024-03-17T23:41:48.076 INFO:teuthology.orchestra.run.smithi204.stdout:Use 'sudo apt autoremove' to remove them. 2024-03-17T23:41:48.076 INFO:teuthology.orchestra.run.smithi204.stdout:The following additional packages will be installed: 2024-03-17T23:41:48.076 INFO:teuthology.orchestra.run.smithi204.stdout: linux-generic linux-headers-5.15.0-100 linux-headers-5.15.0-100-generic 2024-03-17T23:41:48.076 INFO:teuthology.orchestra.run.smithi204.stdout: linux-headers-generic linux-image-5.15.0-100-generic 2024-03-17T23:41:48.077 INFO:teuthology.orchestra.run.smithi204.stdout: linux-modules-5.15.0-100-generic linux-modules-extra-5.15.0-100-generic 2024-03-17T23:41:48.078 INFO:teuthology.orchestra.run.smithi204.stdout:Suggested packages: 2024-03-17T23:41:48.078 INFO:teuthology.orchestra.run.smithi204.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-03-17T23:41:48.078 INFO:teuthology.orchestra.run.smithi204.stdout:Recommended packages: 2024-03-17T23:41:48.078 INFO:teuthology.orchestra.run.smithi204.stdout: thermald 2024-03-17T23:41:48.089 INFO:teuthology.orchestra.run.smithi196.stdout:The following packages were automatically installed and are no longer required: 2024-03-17T23:41:48.089 INFO:teuthology.orchestra.run.smithi196.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-03-17T23:41:48.089 INFO:teuthology.orchestra.run.smithi196.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-03-17T23:41:48.090 INFO:teuthology.orchestra.run.smithi196.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-03-17T23:41:48.090 INFO:teuthology.orchestra.run.smithi196.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-03-17T23:41:48.090 INFO:teuthology.orchestra.run.smithi196.stdout: python2.7-minimal 2024-03-17T23:41:48.091 INFO:teuthology.orchestra.run.smithi196.stdout:Use 'sudo apt autoremove' to remove them. 2024-03-17T23:41:48.092 INFO:teuthology.orchestra.run.smithi196.stdout:The following additional packages will be installed: 2024-03-17T23:41:48.092 INFO:teuthology.orchestra.run.smithi196.stdout: linux-generic linux-headers-5.15.0-100 linux-headers-5.15.0-100-generic 2024-03-17T23:41:48.092 INFO:teuthology.orchestra.run.smithi196.stdout: linux-headers-generic linux-image-5.15.0-100-generic 2024-03-17T23:41:48.092 INFO:teuthology.orchestra.run.smithi196.stdout: linux-modules-5.15.0-100-generic linux-modules-extra-5.15.0-100-generic 2024-03-17T23:41:48.094 INFO:teuthology.orchestra.run.smithi196.stdout:Suggested packages: 2024-03-17T23:41:48.094 INFO:teuthology.orchestra.run.smithi196.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-03-17T23:41:48.094 INFO:teuthology.orchestra.run.smithi196.stdout:Recommended packages: 2024-03-17T23:41:48.094 INFO:teuthology.orchestra.run.smithi196.stdout: thermald 2024-03-17T23:41:48.119 INFO:teuthology.orchestra.run.smithi204.stdout:The following NEW packages will be installed: 2024-03-17T23:41:48.119 INFO:teuthology.orchestra.run.smithi204.stdout: linux-headers-5.15.0-100 linux-headers-5.15.0-100-generic 2024-03-17T23:41:48.119 INFO:teuthology.orchestra.run.smithi204.stdout: linux-image-5.15.0-100-generic linux-modules-5.15.0-100-generic 2024-03-17T23:41:48.119 INFO:teuthology.orchestra.run.smithi204.stdout: linux-modules-extra-5.15.0-100-generic 2024-03-17T23:41:48.120 INFO:teuthology.orchestra.run.smithi204.stdout:The following packages will be upgraded: 2024-03-17T23:41:48.120 INFO:teuthology.orchestra.run.smithi204.stdout: linux-generic linux-headers-generic linux-image-generic 2024-03-17T23:41:48.147 INFO:teuthology.orchestra.run.smithi196.stdout:The following NEW packages will be installed: 2024-03-17T23:41:48.147 INFO:teuthology.orchestra.run.smithi196.stdout: linux-headers-5.15.0-100 linux-headers-5.15.0-100-generic 2024-03-17T23:41:48.147 INFO:teuthology.orchestra.run.smithi196.stdout: linux-image-5.15.0-100-generic linux-modules-5.15.0-100-generic 2024-03-17T23:41:48.148 INFO:teuthology.orchestra.run.smithi196.stdout: linux-modules-extra-5.15.0-100-generic 2024-03-17T23:41:48.149 INFO:teuthology.orchestra.run.smithi196.stdout:The following packages will be upgraded: 2024-03-17T23:41:48.150 INFO:teuthology.orchestra.run.smithi196.stdout: linux-generic linux-headers-generic linux-image-generic 2024-03-17T23:41:48.181 INFO:teuthology.orchestra.run.smithi204.stdout:3 upgraded, 5 newly installed, 0 to remove and 297 not upgraded. 2024-03-17T23:41:48.181 INFO:teuthology.orchestra.run.smithi204.stdout:Need to get 113 MB of archives. 2024-03-17T23:41:48.181 INFO:teuthology.orchestra.run.smithi204.stdout:After this operation, 582 MB of additional disk space will be used. 2024-03-17T23:41:48.181 INFO:teuthology.orchestra.run.smithi204.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-100-generic amd64 5.15.0-100.110 [22.6 MB] 2024-03-17T23:41:48.207 INFO:teuthology.orchestra.run.smithi196.stdout:3 upgraded, 5 newly installed, 0 to remove and 297 not upgraded. 2024-03-17T23:41:48.208 INFO:teuthology.orchestra.run.smithi196.stdout:Need to get 113 MB of archives. 2024-03-17T23:41:48.208 INFO:teuthology.orchestra.run.smithi196.stdout:After this operation, 582 MB of additional disk space will be used. 2024-03-17T23:41:48.208 INFO:teuthology.orchestra.run.smithi196.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-100-generic amd64 5.15.0-100.110 [22.6 MB] 2024-03-17T23:41:48.930 INFO:teuthology.orchestra.run.smithi204.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-100-generic amd64 5.15.0-100.110 [11.5 MB] 2024-03-17T23:41:48.989 INFO:teuthology.orchestra.run.smithi196.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-100-generic amd64 5.15.0-100.110 [11.5 MB] 2024-03-17T23:41:49.249 INFO:teuthology.orchestra.run.smithi204.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-100-generic amd64 5.15.0-100.110 [63.8 MB] 2024-03-17T23:41:49.299 INFO:teuthology.orchestra.run.smithi196.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-100-generic amd64 5.15.0-100.110 [63.8 MB] 2024-03-17T23:41:50.980 INFO:teuthology.orchestra.run.smithi204.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.100.97 [1,696 B] 2024-03-17T23:41:50.980 INFO:teuthology.orchestra.run.smithi204.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.100.97 [2,454 B] 2024-03-17T23:41:50.980 INFO:teuthology.orchestra.run.smithi204.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-100 all 5.15.0-100.110 [12.3 MB] 2024-03-17T23:41:51.346 INFO:teuthology.orchestra.run.smithi204.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-100-generic amd64 5.15.0-100.110 [2,858 kB] 2024-03-17T23:41:51.360 INFO:teuthology.orchestra.run.smithi196.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.100.97 [1,696 B] 2024-03-17T23:41:51.394 INFO:teuthology.orchestra.run.smithi204.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.100.97 [2,292 B] 2024-03-17T23:41:51.462 INFO:teuthology.orchestra.run.smithi196.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.100.97 [2,454 B] 2024-03-17T23:41:51.462 INFO:teuthology.orchestra.run.smithi196.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-100 all 5.15.0-100.110 [12.3 MB] 2024-03-17T23:41:51.659 INFO:teuthology.orchestra.run.smithi196.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-100-generic amd64 5.15.0-100.110 [2,858 kB] 2024-03-17T23:41:51.704 INFO:teuthology.orchestra.run.smithi196.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.100.97 [2,292 B] 2024-03-17T23:41:51.773 INFO:teuthology.orchestra.run.smithi204.stdout:Fetched 113 MB in 3s (34.6 MB/s) 2024-03-17T23:41:51.979 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package linux-modules-5.15.0-100-generic. 2024-03-17T23:41:52.095 INFO:teuthology.orchestra.run.smithi196.stdout:Fetched 113 MB in 4s (31.9 MB/s) 2024-03-17T23:41:52.254 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package linux-modules-5.15.0-100-generic. 2024-03-17T23:41:54.077 INFO:teuthology.orchestra.run.smithi204.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-03-17T23:41:54.082 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../0-linux-modules-5.15.0-100-generic_5.15.0-100.110_amd64.deb ... 2024-03-17T23:41:54.217 INFO:teuthology.orchestra.run.smithi196.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-03-17T23:41:54.221 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../0-linux-modules-5.15.0-100-generic_5.15.0-100.110_amd64.deb ... 2024-03-17T23:41:54.279 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking linux-modules-5.15.0-100-generic (5.15.0-100.110) ... 2024-03-17T23:41:54.310 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking linux-modules-5.15.0-100-generic (5.15.0-100.110) ... 2024-03-17T23:41:56.522 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package linux-image-5.15.0-100-generic. 2024-03-17T23:41:56.535 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package linux-image-5.15.0-100-generic. 2024-03-17T23:41:56.544 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../1-linux-image-5.15.0-100-generic_5.15.0-100.110_amd64.deb ... 2024-03-17T23:41:56.557 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../1-linux-image-5.15.0-100-generic_5.15.0-100.110_amd64.deb ... 2024-03-17T23:41:56.750 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking linux-image-5.15.0-100-generic (5.15.0-100.110) ... 2024-03-17T23:41:56.839 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking linux-image-5.15.0-100-generic (5.15.0-100.110) ... 2024-03-17T23:41:57.280 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-100-generic. 2024-03-17T23:41:57.301 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-100-generic_5.15.0-100.110_amd64.deb ... 2024-03-17T23:41:57.330 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking linux-modules-extra-5.15.0-100-generic (5.15.0-100.110) ... 2024-03-17T23:41:57.359 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-100-generic. 2024-03-17T23:41:57.379 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-100-generic_5.15.0-100.110_amd64.deb ... 2024-03-17T23:41:57.408 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking linux-modules-extra-5.15.0-100-generic (5.15.0-100.110) ... 2024-03-17T23:42:03.539 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../3-linux-generic_5.15.0.100.97_amd64.deb ... 2024-03-17T23:42:03.663 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking linux-generic (5.15.0.100.97) over (5.15.0.56.54) ... 2024-03-17T23:42:03.951 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../3-linux-generic_5.15.0.100.97_amd64.deb ... 2024-03-17T23:42:03.998 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.100.97_amd64.deb ... 2024-03-17T23:42:04.070 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking linux-generic (5.15.0.100.97) over (5.15.0.56.54) ... 2024-03-17T23:42:04.119 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking linux-image-generic (5.15.0.100.97) over (5.15.0.56.54) ... 2024-03-17T23:42:04.394 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.100.97_amd64.deb ... 2024-03-17T23:42:04.413 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package linux-headers-5.15.0-100. 2024-03-17T23:42:04.436 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../5-linux-headers-5.15.0-100_5.15.0-100.110_all.deb ... 2024-03-17T23:42:04.480 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking linux-headers-5.15.0-100 (5.15.0-100.110) ... 2024-03-17T23:42:04.515 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking linux-image-generic (5.15.0.100.97) over (5.15.0.56.54) ... 2024-03-17T23:42:04.852 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package linux-headers-5.15.0-100. 2024-03-17T23:42:04.874 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../5-linux-headers-5.15.0-100_5.15.0-100.110_all.deb ... 2024-03-17T23:42:04.918 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking linux-headers-5.15.0-100 (5.15.0-100.110) ... 2024-03-17T23:42:09.823 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package linux-headers-5.15.0-100-generic. 2024-03-17T23:42:09.859 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../6-linux-headers-5.15.0-100-generic_5.15.0-100.110_amd64.deb ... 2024-03-17T23:42:09.889 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking linux-headers-5.15.0-100-generic (5.15.0-100.110) ... 2024-03-17T23:42:10.466 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package linux-headers-5.15.0-100-generic. 2024-03-17T23:42:10.503 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../6-linux-headers-5.15.0-100-generic_5.15.0-100.110_amd64.deb ... 2024-03-17T23:42:10.550 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking linux-headers-5.15.0-100-generic (5.15.0-100.110) ... 2024-03-17T23:42:13.237 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.100.97_amd64.deb ... 2024-03-17T23:42:13.384 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking linux-headers-generic (5.15.0.100.97) over (5.15.0.56.54) ... 2024-03-17T23:42:13.726 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up linux-headers-5.15.0-100 (5.15.0-100.110) ... 2024-03-17T23:42:13.836 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.100.97_amd64.deb ... 2024-03-17T23:42:13.847 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up linux-headers-5.15.0-100-generic (5.15.0-100.110) ... 2024-03-17T23:42:13.962 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking linux-headers-generic (5.15.0.100.97) over (5.15.0.56.54) ... 2024-03-17T23:42:13.973 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up linux-headers-generic (5.15.0.100.97) ... 2024-03-17T23:42:14.077 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up linux-image-5.15.0-100-generic (5.15.0-100.110) ... 2024-03-17T23:42:14.312 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up linux-headers-5.15.0-100 (5.15.0-100.110) ... 2024-03-17T23:42:14.434 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up linux-headers-5.15.0-100-generic (5.15.0-100.110) ... 2024-03-17T23:42:14.552 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up linux-headers-generic (5.15.0.100.97) ... 2024-03-17T23:42:14.698 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up linux-image-5.15.0-100-generic (5.15.0-100.110) ... 2024-03-17T23:42:15.386 INFO:teuthology.orchestra.run.smithi196.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-03-17T23:42:15.386 INFO:teuthology.orchestra.run.smithi196.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-03-17T23:42:15.386 INFO:teuthology.orchestra.run.smithi196.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-100-generic 2024-03-17T23:42:15.386 INFO:teuthology.orchestra.run.smithi196.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-100-generic 2024-03-17T23:42:15.545 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up linux-modules-5.15.0-100-generic (5.15.0-100.110) ... 2024-03-17T23:42:16.152 INFO:teuthology.orchestra.run.smithi204.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-03-17T23:42:16.152 INFO:teuthology.orchestra.run.smithi204.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-03-17T23:42:16.152 INFO:teuthology.orchestra.run.smithi204.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-100-generic 2024-03-17T23:42:16.152 INFO:teuthology.orchestra.run.smithi204.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-100-generic 2024-03-17T23:42:16.596 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up linux-modules-5.15.0-100-generic (5.15.0-100.110) ... 2024-03-17T23:42:17.005 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up linux-modules-extra-5.15.0-100-generic (5.15.0-100.110) ... 2024-03-17T23:42:18.034 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up linux-modules-extra-5.15.0-100-generic (5.15.0-100.110) ... 2024-03-17T23:42:18.392 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up linux-image-generic (5.15.0.100.97) ... 2024-03-17T23:42:18.517 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up linux-generic (5.15.0.100.97) ... 2024-03-17T23:42:18.644 INFO:teuthology.orchestra.run.smithi196.stdout:Processing triggers for linux-image-5.15.0-100-generic (5.15.0-100.110) ... 2024-03-17T23:42:18.708 INFO:teuthology.orchestra.run.smithi196.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-03-17T23:42:18.708 INFO:teuthology.orchestra.run.smithi196.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-100-generic 2024-03-17T23:42:19.436 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up linux-image-generic (5.15.0.100.97) ... 2024-03-17T23:42:19.570 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up linux-generic (5.15.0.100.97) ... 2024-03-17T23:42:19.671 INFO:teuthology.orchestra.run.smithi204.stdout:Processing triggers for linux-image-5.15.0-100-generic (5.15.0-100.110) ... 2024-03-17T23:42:19.726 INFO:teuthology.orchestra.run.smithi204.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-03-17T23:42:19.726 INFO:teuthology.orchestra.run.smithi204.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-100-generic 2024-03-17T23:42:32.683 INFO:teuthology.orchestra.run.smithi196.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-03-17T23:42:32.683 INFO:teuthology.orchestra.run.smithi196.stdout:Sourcing file `/etc/default/grub' 2024-03-17T23:42:32.693 INFO:teuthology.orchestra.run.smithi196.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-03-17T23:42:32.711 INFO:teuthology.orchestra.run.smithi196.stdout:Generating grub configuration file ... 2024-03-17T23:42:32.993 INFO:teuthology.orchestra.run.smithi196.stdout:Found linux image: /boot/vmlinuz-5.15.0-100-generic 2024-03-17T23:42:33.010 INFO:teuthology.orchestra.run.smithi196.stdout:Found initrd image: /boot/initrd.img-5.15.0-100-generic 2024-03-17T23:42:33.290 INFO:teuthology.orchestra.run.smithi196.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-03-17T23:42:33.296 INFO:teuthology.orchestra.run.smithi196.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-03-17T23:42:33.370 INFO:teuthology.orchestra.run.smithi196.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-03-17T23:42:33.376 INFO:teuthology.orchestra.run.smithi196.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-03-17T23:42:33.537 INFO:teuthology.orchestra.run.smithi196.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-03-17T23:42:33.537 INFO:teuthology.orchestra.run.smithi196.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-03-17T23:42:33.537 INFO:teuthology.orchestra.run.smithi196.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-03-17T23:42:33.584 INFO:teuthology.orchestra.run.smithi196.stdout:done 2024-03-17T23:42:33.717 INFO:teuthology.orchestra.run.smithi204.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-03-17T23:42:33.717 INFO:teuthology.orchestra.run.smithi204.stdout:Sourcing file `/etc/default/grub' 2024-03-17T23:42:33.743 INFO:teuthology.orchestra.run.smithi204.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-03-17T23:42:33.762 INFO:teuthology.orchestra.run.smithi204.stdout:Generating grub configuration file ... 2024-03-17T23:42:34.024 DEBUG:teuthology.orchestra.run.smithi196:> dpkg -s linux-image-generic 2024-03-17T23:42:34.036 INFO:teuthology.orchestra.run.smithi204.stdout:Found linux image: /boot/vmlinuz-5.15.0-100-generic 2024-03-17T23:42:34.051 INFO:teuthology.orchestra.run.smithi204.stdout:Found initrd image: /boot/initrd.img-5.15.0-100-generic 2024-03-17T23:42:34.090 INFO:teuthology.orchestra.run.smithi196.stdout:Package: linux-image-generic 2024-03-17T23:42:34.090 INFO:teuthology.orchestra.run.smithi196.stdout:Status: install ok installed 2024-03-17T23:42:34.090 INFO:teuthology.orchestra.run.smithi196.stdout:Priority: optional 2024-03-17T23:42:34.090 INFO:teuthology.orchestra.run.smithi196.stdout:Section: kernel 2024-03-17T23:42:34.090 INFO:teuthology.orchestra.run.smithi196.stdout:Installed-Size: 21 2024-03-17T23:42:34.090 INFO:teuthology.orchestra.run.smithi196.stdout:Maintainer: Ubuntu Kernel Team 2024-03-17T23:42:34.090 INFO:teuthology.orchestra.run.smithi196.stdout:Architecture: amd64 2024-03-17T23:42:34.090 INFO:teuthology.orchestra.run.smithi196.stdout:Source: linux-meta 2024-03-17T23:42:34.090 INFO:teuthology.orchestra.run.smithi196.stdout:Version: 5.15.0.100.97 2024-03-17T23:42:34.090 INFO:teuthology.orchestra.run.smithi196.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.2), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-100), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.2) 2024-03-17T23:42:34.091 INFO:teuthology.orchestra.run.smithi196.stdout:Depends: linux-image-5.15.0-100-generic, linux-modules-extra-5.15.0-100-generic, linux-firmware, intel-microcode, amd64-microcode 2024-03-17T23:42:34.091 INFO:teuthology.orchestra.run.smithi196.stdout:Recommends: thermald 2024-03-17T23:42:34.091 INFO:teuthology.orchestra.run.smithi196.stdout:Description: Generic Linux kernel image 2024-03-17T23:42:34.091 INFO:teuthology.orchestra.run.smithi196.stdout: This package will always depend on the latest generic kernel image 2024-03-17T23:42:34.091 INFO:teuthology.orchestra.run.smithi196.stdout: available. 2024-03-17T23:42:34.091 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-100-generic 2024-03-17T23:42:34.091 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-03-17T23:42:34.092 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-03-17T23:42:34.092 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-03-17T23:42:34.092 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi196.front.sepia.ceph.com, path=None, version=distro) 2024-03-17T23:42:34.092 DEBUG:teuthology.orchestra.run.smithi196:> sudo apt-get clean 2024-03-17T23:42:34.279 DEBUG:teuthology.orchestra.run.smithi196:> sudo apt-get update 2024-03-17T23:42:34.363 INFO:teuthology.orchestra.run.smithi204.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-03-17T23:42:34.369 INFO:teuthology.orchestra.run.smithi204.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-03-17T23:42:34.435 INFO:teuthology.orchestra.run.smithi196.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-03-17T23:42:34.435 INFO:teuthology.orchestra.run.smithi196.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-03-17T23:42:34.437 INFO:teuthology.orchestra.run.smithi204.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-03-17T23:42:34.442 INFO:teuthology.orchestra.run.smithi204.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-03-17T23:42:34.447 INFO:teuthology.orchestra.run.smithi196.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-03-17T23:42:34.529 INFO:teuthology.orchestra.run.smithi196.stdout:Hit:4 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-03-17T23:42:34.603 INFO:teuthology.orchestra.run.smithi204.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-03-17T23:42:34.603 INFO:teuthology.orchestra.run.smithi204.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-03-17T23:42:34.604 INFO:teuthology.orchestra.run.smithi204.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-03-17T23:42:34.652 INFO:teuthology.orchestra.run.smithi204.stdout:done 2024-03-17T23:42:35.132 DEBUG:teuthology.orchestra.run.smithi204:> dpkg -s linux-image-generic 2024-03-17T23:42:35.156 INFO:teuthology.orchestra.run.smithi204.stdout:Package: linux-image-generic 2024-03-17T23:42:35.156 INFO:teuthology.orchestra.run.smithi204.stdout:Status: install ok installed 2024-03-17T23:42:35.156 INFO:teuthology.orchestra.run.smithi204.stdout:Priority: optional 2024-03-17T23:42:35.156 INFO:teuthology.orchestra.run.smithi204.stdout:Section: kernel 2024-03-17T23:42:35.156 INFO:teuthology.orchestra.run.smithi204.stdout:Installed-Size: 21 2024-03-17T23:42:35.156 INFO:teuthology.orchestra.run.smithi204.stdout:Maintainer: Ubuntu Kernel Team 2024-03-17T23:42:35.156 INFO:teuthology.orchestra.run.smithi204.stdout:Architecture: amd64 2024-03-17T23:42:35.157 INFO:teuthology.orchestra.run.smithi204.stdout:Source: linux-meta 2024-03-17T23:42:35.157 INFO:teuthology.orchestra.run.smithi204.stdout:Version: 5.15.0.100.97 2024-03-17T23:42:35.157 INFO:teuthology.orchestra.run.smithi204.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.2), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-100), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.2) 2024-03-17T23:42:35.157 INFO:teuthology.orchestra.run.smithi204.stdout:Depends: linux-image-5.15.0-100-generic, linux-modules-extra-5.15.0-100-generic, linux-firmware, intel-microcode, amd64-microcode 2024-03-17T23:42:35.157 INFO:teuthology.orchestra.run.smithi204.stdout:Recommends: thermald 2024-03-17T23:42:35.157 INFO:teuthology.orchestra.run.smithi204.stdout:Description: Generic Linux kernel image 2024-03-17T23:42:35.157 INFO:teuthology.orchestra.run.smithi204.stdout: This package will always depend on the latest generic kernel image 2024-03-17T23:42:35.157 INFO:teuthology.orchestra.run.smithi204.stdout: available. 2024-03-17T23:42:35.157 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-100-generic 2024-03-17T23:42:35.157 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-03-17T23:42:35.157 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-03-17T23:42:35.158 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2024-03-17T23:42:35.158 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi204.front.sepia.ceph.com, path=None, version=distro) 2024-03-17T23:42:35.158 DEBUG:teuthology.orchestra.run.smithi204:> sudo apt-get clean 2024-03-17T23:42:35.327 DEBUG:teuthology.orchestra.run.smithi204:> sudo apt-get update 2024-03-17T23:42:35.458 INFO:teuthology.orchestra.run.smithi204.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-03-17T23:42:35.470 INFO:teuthology.orchestra.run.smithi204.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-03-17T23:42:35.491 INFO:teuthology.orchestra.run.smithi204.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-03-17T23:42:35.663 INFO:teuthology.orchestra.run.smithi204.stdout:Hit:4 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-03-17T23:42:35.803 INFO:teuthology.orchestra.run.smithi196.stdout:Reading package lists... 2024-03-17T23:42:35.821 DEBUG:teuthology.orchestra.run.smithi196:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-03-17T23:42:35.872 INFO:teuthology.orchestra.run.smithi196.stdout:Reading package lists... 2024-03-17T23:42:36.045 INFO:teuthology.orchestra.run.smithi196.stdout:Building dependency tree... 2024-03-17T23:42:36.046 INFO:teuthology.orchestra.run.smithi196.stdout:Reading state information... 2024-03-17T23:42:36.198 INFO:teuthology.orchestra.run.smithi196.stdout:linux-image-generic is already the newest version (5.15.0.100.97). 2024-03-17T23:42:36.199 INFO:teuthology.orchestra.run.smithi196.stdout:The following packages were automatically installed and are no longer required: 2024-03-17T23:42:36.199 INFO:teuthology.orchestra.run.smithi196.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-03-17T23:42:36.199 INFO:teuthology.orchestra.run.smithi196.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-03-17T23:42:36.199 INFO:teuthology.orchestra.run.smithi196.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-03-17T23:42:36.199 INFO:teuthology.orchestra.run.smithi196.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-03-17T23:42:36.199 INFO:teuthology.orchestra.run.smithi196.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-03-17T23:42:36.199 INFO:teuthology.orchestra.run.smithi196.stdout:Use 'sudo apt autoremove' to remove them. 2024-03-17T23:42:36.238 INFO:teuthology.orchestra.run.smithi196.stdout:0 upgraded, 0 newly installed, 0 to remove and 297 not upgraded. 2024-03-17T23:42:36.239 DEBUG:teuthology.orchestra.run.smithi196:> dpkg -s linux-image-generic 2024-03-17T23:42:36.294 INFO:teuthology.orchestra.run.smithi196.stdout:Package: linux-image-generic 2024-03-17T23:42:36.294 INFO:teuthology.orchestra.run.smithi196.stdout:Status: install ok installed 2024-03-17T23:42:36.294 INFO:teuthology.orchestra.run.smithi196.stdout:Priority: optional 2024-03-17T23:42:36.294 INFO:teuthology.orchestra.run.smithi196.stdout:Section: kernel 2024-03-17T23:42:36.294 INFO:teuthology.orchestra.run.smithi196.stdout:Installed-Size: 21 2024-03-17T23:42:36.294 INFO:teuthology.orchestra.run.smithi196.stdout:Maintainer: Ubuntu Kernel Team 2024-03-17T23:42:36.294 INFO:teuthology.orchestra.run.smithi196.stdout:Architecture: amd64 2024-03-17T23:42:36.294 INFO:teuthology.orchestra.run.smithi196.stdout:Source: linux-meta 2024-03-17T23:42:36.295 INFO:teuthology.orchestra.run.smithi196.stdout:Version: 5.15.0.100.97 2024-03-17T23:42:36.295 INFO:teuthology.orchestra.run.smithi196.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.2), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-100), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.2) 2024-03-17T23:42:36.295 INFO:teuthology.orchestra.run.smithi196.stdout:Depends: linux-image-5.15.0-100-generic, linux-modules-extra-5.15.0-100-generic, linux-firmware, intel-microcode, amd64-microcode 2024-03-17T23:42:36.295 INFO:teuthology.orchestra.run.smithi196.stdout:Recommends: thermald 2024-03-17T23:42:36.295 INFO:teuthology.orchestra.run.smithi196.stdout:Description: Generic Linux kernel image 2024-03-17T23:42:36.295 INFO:teuthology.orchestra.run.smithi196.stdout: This package will always depend on the latest generic kernel image 2024-03-17T23:42:36.295 INFO:teuthology.orchestra.run.smithi196.stdout: available. 2024-03-17T23:42:36.295 DEBUG:teuthology.orchestra.run.smithi196:> mktemp 2024-03-17T23:42:36.338 INFO:teuthology.orchestra.run.smithi196.stdout:/tmp/tmp.ySoymPdUai 2024-03-17T23:42:36.339 DEBUG:teuthology.orchestra.run.smithi196:> sudo cp /boot/grub/grub.cfg /tmp/tmp.ySoymPdUai 2024-03-17T23:42:36.395 DEBUG:teuthology.orchestra.run.smithi196:> sudo chmod 0666 /tmp/tmp.ySoymPdUai 2024-03-17T23:42:36.519 DEBUG:teuthology.orchestra.remote:smithi196:/tmp/tmp.ySoymPdUai is 10KB 2024-03-17T23:42:36.531 DEBUG:teuthology.orchestra.run.smithi196:> rm -fr /tmp/tmp.ySoymPdUai 2024-03-17T23:42:36.536 DEBUG:teuthology.orchestra.run.smithi196:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-03-17T23:42:36.591 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2024-03-17T23:42:36.591 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-03-17T23:42:36.591 DEBUG:teuthology.orchestra.run.smithi196:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-03-17T23:42:36.657 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-100-generic 2024-03-17T23:42:36.658 DEBUG:teuthology.orchestra.run.smithi196:> sudo update-grub 2024-03-17T23:42:36.843 INFO:teuthology.orchestra.run.smithi204.stdout:Reading package lists... 2024-03-17T23:42:36.860 DEBUG:teuthology.orchestra.run.smithi204:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-03-17T23:42:36.914 INFO:teuthology.orchestra.run.smithi204.stdout:Reading package lists... 2024-03-17T23:42:37.099 INFO:teuthology.orchestra.run.smithi204.stdout:Building dependency tree... 2024-03-17T23:42:37.100 INFO:teuthology.orchestra.run.smithi204.stdout:Reading state information... 2024-03-17T23:42:37.253 INFO:teuthology.orchestra.run.smithi204.stdout:linux-image-generic is already the newest version (5.15.0.100.97). 2024-03-17T23:42:37.254 INFO:teuthology.orchestra.run.smithi204.stdout:The following packages were automatically installed and are no longer required: 2024-03-17T23:42:37.254 INFO:teuthology.orchestra.run.smithi204.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-03-17T23:42:37.254 INFO:teuthology.orchestra.run.smithi204.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-03-17T23:42:37.254 INFO:teuthology.orchestra.run.smithi204.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-03-17T23:42:37.254 INFO:teuthology.orchestra.run.smithi204.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-03-17T23:42:37.254 INFO:teuthology.orchestra.run.smithi204.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-03-17T23:42:37.255 INFO:teuthology.orchestra.run.smithi204.stdout:Use 'sudo apt autoremove' to remove them. 2024-03-17T23:42:37.292 INFO:teuthology.orchestra.run.smithi204.stdout:0 upgraded, 0 newly installed, 0 to remove and 297 not upgraded. 2024-03-17T23:42:37.294 DEBUG:teuthology.orchestra.run.smithi204:> dpkg -s linux-image-generic 2024-03-17T23:42:37.351 INFO:teuthology.orchestra.run.smithi204.stdout:Package: linux-image-generic 2024-03-17T23:42:37.351 INFO:teuthology.orchestra.run.smithi204.stdout:Status: install ok installed 2024-03-17T23:42:37.351 INFO:teuthology.orchestra.run.smithi204.stdout:Priority: optional 2024-03-17T23:42:37.351 INFO:teuthology.orchestra.run.smithi204.stdout:Section: kernel 2024-03-17T23:42:37.351 INFO:teuthology.orchestra.run.smithi204.stdout:Installed-Size: 21 2024-03-17T23:42:37.351 INFO:teuthology.orchestra.run.smithi204.stdout:Maintainer: Ubuntu Kernel Team 2024-03-17T23:42:37.351 INFO:teuthology.orchestra.run.smithi204.stdout:Architecture: amd64 2024-03-17T23:42:37.351 INFO:teuthology.orchestra.run.smithi204.stdout:Source: linux-meta 2024-03-17T23:42:37.352 INFO:teuthology.orchestra.run.smithi204.stdout:Version: 5.15.0.100.97 2024-03-17T23:42:37.352 INFO:teuthology.orchestra.run.smithi204.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.2), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-100), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.2) 2024-03-17T23:42:37.352 INFO:teuthology.orchestra.run.smithi204.stdout:Depends: linux-image-5.15.0-100-generic, linux-modules-extra-5.15.0-100-generic, linux-firmware, intel-microcode, amd64-microcode 2024-03-17T23:42:37.352 INFO:teuthology.orchestra.run.smithi204.stdout:Recommends: thermald 2024-03-17T23:42:37.352 INFO:teuthology.orchestra.run.smithi204.stdout:Description: Generic Linux kernel image 2024-03-17T23:42:37.352 INFO:teuthology.orchestra.run.smithi204.stdout: This package will always depend on the latest generic kernel image 2024-03-17T23:42:37.352 INFO:teuthology.orchestra.run.smithi204.stdout: available. 2024-03-17T23:42:37.352 DEBUG:teuthology.orchestra.run.smithi204:> mktemp 2024-03-17T23:42:37.396 INFO:teuthology.orchestra.run.smithi204.stdout:/tmp/tmp.5rWFPFBWLT 2024-03-17T23:42:37.396 DEBUG:teuthology.orchestra.run.smithi204:> sudo cp /boot/grub/grub.cfg /tmp/tmp.5rWFPFBWLT 2024-03-17T23:42:37.456 DEBUG:teuthology.orchestra.run.smithi204:> sudo chmod 0666 /tmp/tmp.5rWFPFBWLT 2024-03-17T23:42:37.576 DEBUG:teuthology.orchestra.remote:smithi204:/tmp/tmp.5rWFPFBWLT is 10KB 2024-03-17T23:42:37.588 DEBUG:teuthology.orchestra.run.smithi204:> rm -fr /tmp/tmp.5rWFPFBWLT 2024-03-17T23:42:37.593 DEBUG:teuthology.orchestra.run.smithi204:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-03-17T23:42:37.647 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2024-03-17T23:42:37.648 DEBUG:teuthology.orchestra.run.smithi204:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-03-17T23:42:37.648 DEBUG:teuthology.orchestra.run.smithi204:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-03-17T23:42:37.725 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-100-generic 2024-03-17T23:42:37.725 DEBUG:teuthology.orchestra.run.smithi204:> sudo update-grub 2024-03-17T23:42:37.854 INFO:teuthology.orchestra.run.smithi196.stderr:Sourcing file `/etc/default/grub' 2024-03-17T23:42:37.855 INFO:teuthology.orchestra.run.smithi196.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-03-17T23:42:37.858 INFO:teuthology.orchestra.run.smithi196.stderr:Generating grub configuration file ... 2024-03-17T23:42:38.040 INFO:teuthology.orchestra.run.smithi196.stderr:Found linux image: /boot/vmlinuz-5.15.0-100-generic 2024-03-17T23:42:38.046 INFO:teuthology.orchestra.run.smithi196.stderr:Found initrd image: /boot/initrd.img-5.15.0-100-generic 2024-03-17T23:42:38.279 INFO:teuthology.orchestra.run.smithi196.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-03-17T23:42:38.283 INFO:teuthology.orchestra.run.smithi196.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-03-17T23:42:38.321 INFO:teuthology.orchestra.run.smithi196.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-03-17T23:42:38.326 INFO:teuthology.orchestra.run.smithi196.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-03-17T23:42:38.439 INFO:teuthology.orchestra.run.smithi196.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-03-17T23:42:38.439 INFO:teuthology.orchestra.run.smithi196.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-03-17T23:42:38.439 INFO:teuthology.orchestra.run.smithi196.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-03-17T23:42:38.450 INFO:teuthology.orchestra.run.smithi196.stderr:done 2024-03-17T23:42:38.465 DEBUG:teuthology.orchestra.run.smithi196:> sudo shutdown -r now 2024-03-17T23:42:39.050 INFO:teuthology.orchestra.run.smithi204.stderr:Sourcing file `/etc/default/grub' 2024-03-17T23:42:39.052 INFO:teuthology.orchestra.run.smithi204.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-03-17T23:42:39.055 INFO:teuthology.orchestra.run.smithi204.stderr:Generating grub configuration file ... 2024-03-17T23:42:39.271 INFO:teuthology.orchestra.run.smithi204.stderr:Found linux image: /boot/vmlinuz-5.15.0-100-generic 2024-03-17T23:42:39.278 INFO:teuthology.orchestra.run.smithi204.stderr:Found initrd image: /boot/initrd.img-5.15.0-100-generic 2024-03-17T23:42:39.545 INFO:teuthology.orchestra.run.smithi204.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-03-17T23:42:39.550 INFO:teuthology.orchestra.run.smithi204.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-03-17T23:42:39.587 INFO:teuthology.orchestra.run.smithi204.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-03-17T23:42:39.591 INFO:teuthology.orchestra.run.smithi204.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-03-17T23:42:39.699 INFO:teuthology.orchestra.run.smithi204.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-03-17T23:42:39.699 INFO:teuthology.orchestra.run.smithi204.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-03-17T23:42:39.700 INFO:teuthology.orchestra.run.smithi204.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-03-17T23:42:39.719 INFO:teuthology.orchestra.run.smithi204.stderr:done 2024-03-17T23:42:39.721 DEBUG:teuthology.orchestra.run.smithi204:> sudo shutdown -r now 2024-03-17T23:43:08.494 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-03-17T23:43:08.495 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi196.front.sepia.ceph.com' 2024-03-17T23:43:08.496 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-17T23:43:09.725 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2024-03-17T23:43:09.726 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi204.front.sepia.ceph.com' 2024-03-17T23:43:09.726 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi204.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-17T23:43:27.007 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.196 2024-03-17T23:43:36.014 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi196.front.sepia.ceph.com' 2024-03-17T23:43:36.015 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-17T23:43:39.070 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.196 2024-03-17T23:43:44.414 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.204 2024-03-17T23:43:51.077 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi196.front.sepia.ceph.com' 2024-03-17T23:43:51.078 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-17T23:43:53.417 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi204.front.sepia.ceph.com' 2024-03-17T23:43:53.418 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi204.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-17T23:44:09.506 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.196 2024-03-17T23:44:24.518 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi196.front.sepia.ceph.com' 2024-03-17T23:44:24.519 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-17T23:44:24.816 DEBUG:teuthology.orchestra.run.smithi196:> true 2024-03-17T23:44:25.408 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi196.front.sepia.ceph.com' 2024-03-17T23:44:25.409 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-100-generic"... 2024-03-17T23:44:25.409 DEBUG:teuthology.orchestra.run.smithi196:> uname -r 2024-03-17T23:44:25.456 INFO:teuthology.orchestra.run.smithi196.stdout:5.15.0-100-generic 2024-03-17T23:44:25.456 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-100-generic vs 5.15.0-100-generic 2024-03-17T23:44:25.456 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-03-17T23:44:25.457 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-03-17T23:44:26.457 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-03-17T23:44:26.457 DEBUG:teuthology.orchestra.run.smithi196:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-03-17T23:44:26.774 INFO:teuthology.orchestra.run.smithi196.stdout:ttyS1 2024-03-17T23:44:26.798 DEBUG:teuthology.parallel:result is None 2024-03-17T23:44:53.421 DEBUG:teuthology.orchestra.remote:timed out 2024-03-17T23:45:05.422 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi204.front.sepia.ceph.com' 2024-03-17T23:45:05.435 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi204.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-17T23:45:05.622 DEBUG:teuthology.orchestra.run.smithi204:> true 2024-03-17T23:45:06.657 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi204.front.sepia.ceph.com' 2024-03-17T23:45:06.657 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.15.0-100-generic"... 2024-03-17T23:45:06.657 DEBUG:teuthology.orchestra.run.smithi204:> uname -r 2024-03-17T23:45:06.663 INFO:teuthology.orchestra.run.smithi204.stdout:5.15.0-100-generic 2024-03-17T23:45:06.663 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-100-generic vs 5.15.0-100-generic 2024-03-17T23:45:06.663 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-03-17T23:45:06.663 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-03-17T23:45:07.664 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-03-17T23:45:07.664 DEBUG:teuthology.orchestra.run.smithi204:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-03-17T23:45:07.745 INFO:teuthology.orchestra.run.smithi204.stdout:ttyS1 2024-03-17T23:45:07.769 DEBUG:teuthology.parallel:result is None 2024-03-17T23:45:07.770 INFO:teuthology.run_tasks:Running task internal.base... 2024-03-17T23:45:07.782 INFO:teuthology.task.internal:Creating test directory... 2024-03-17T23:45:07.782 DEBUG:teuthology.orchestra.run.smithi196:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-03-17T23:45:07.784 DEBUG:teuthology.orchestra.run.smithi204:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-03-17T23:45:07.790 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-03-17T23:45:07.801 INFO:teuthology.run_tasks:Running task internal.archive... 2024-03-17T23:45:07.814 INFO:teuthology.task.internal:Creating archive directory... 2024-03-17T23:45:07.814 DEBUG:teuthology.orchestra.run.smithi196:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-03-17T23:45:07.832 DEBUG:teuthology.orchestra.run.smithi204:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-03-17T23:45:07.855 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-03-17T23:45:07.865 INFO:teuthology.task.internal:Enabling coredump saving... 2024-03-17T23:45:07.865 DEBUG:teuthology.orchestra.run.smithi196:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-03-17T23:45:07.885 DEBUG:teuthology.orchestra.run.smithi204:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-03-17T23:45:07.904 INFO:teuthology.orchestra.run.smithi196.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-03-17T23:45:07.912 INFO:teuthology.orchestra.run.smithi196.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-03-17T23:45:07.914 INFO:teuthology.orchestra.run.smithi204.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-03-17T23:45:07.922 INFO:teuthology.orchestra.run.smithi204.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-03-17T23:45:07.924 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-03-17T23:45:07.936 INFO:teuthology.task.internal:Configuring sudo... 2024-03-17T23:45:07.936 DEBUG:teuthology.orchestra.run.smithi196:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-03-17T23:45:07.961 DEBUG:teuthology.orchestra.run.smithi204:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-03-17T23:45:07.979 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-03-17T23:45:07.988 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-03-17T23:45:07.989 DEBUG:teuthology.orchestra.run.smithi196:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-03-17T23:45:08.017 DEBUG:teuthology.orchestra.run.smithi204:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-03-17T23:45:08.025 DEBUG:teuthology.orchestra.run.smithi196:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-03-17T23:45:08.068 DEBUG:teuthology.orchestra.run.smithi196:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-03-17T23:45:08.116 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2024-03-17T23:45:08.116 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-03-17T23:45:08.175 DEBUG:teuthology.orchestra.run.smithi204:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-03-17T23:45:08.181 DEBUG:teuthology.orchestra.run.smithi204:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-03-17T23:45:08.228 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2024-03-17T23:45:08.228 DEBUG:teuthology.orchestra.run.smithi204:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-03-17T23:45:08.296 DEBUG:teuthology.orchestra.run.smithi196:> sudo service rsyslog restart 2024-03-17T23:45:08.298 DEBUG:teuthology.orchestra.run.smithi204:> sudo service rsyslog restart 2024-03-17T23:45:08.367 INFO:teuthology.run_tasks:Running task internal.timer... 2024-03-17T23:45:08.375 INFO:teuthology.task.internal:Starting timer... 2024-03-17T23:45:08.375 INFO:teuthology.run_tasks:Running task pcp... 2024-03-17T23:45:08.390 INFO:teuthology.run_tasks:Running task selinux... 2024-03-17T23:45:08.404 DEBUG:teuthology.task.selinux:Excluding smithi196: OS 'ubuntu' does not support SELinux 2024-03-17T23:45:08.404 DEBUG:teuthology.task.selinux:Excluding smithi204: OS 'ubuntu' does not support SELinux 2024-03-17T23:45:08.404 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-03-17T23:45:08.404 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2024-03-17T23:45:08.404 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-03-17T23:45:08.404 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-03-17T23:45:08.418 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-03-17T23:45:08.423 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-03-17T23:45:08.548 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-03-17T23:45:08.564 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-03-17T23:45:08.566 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi196.front.sepia.ceph.com,smithi204.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-03-17T23:52:11.440 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi196.front.sepia.ceph.com'), Remote(name='ubuntu@smithi204.front.sepia.ceph.com')] 2024-03-17T23:52:11.441 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi196.front.sepia.ceph.com' 2024-03-17T23:52:11.443 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-17T23:52:11.522 DEBUG:teuthology.orchestra.run.smithi196:> true 2024-03-17T23:52:11.598 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi196.front.sepia.ceph.com' 2024-03-17T23:52:11.599 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi204.front.sepia.ceph.com' 2024-03-17T23:52:11.599 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi204.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-17T23:52:11.681 DEBUG:teuthology.orchestra.run.smithi204:> true 2024-03-17T23:52:11.758 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi204.front.sepia.ceph.com' 2024-03-17T23:52:11.758 INFO:teuthology.run_tasks:Running task clock... 2024-03-17T23:52:11.769 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-03-17T23:52:11.769 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-03-17T23:52:11.770 DEBUG:teuthology.orchestra.run.smithi196:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-03-17T23:52:11.773 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-03-17T23:52:11.773 DEBUG:teuthology.orchestra.run.smithi204:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-03-17T23:52:11.798 INFO:teuthology.orchestra.run.smithi196.stdout:17 Mar 23:52:11 ntpd[17198]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-03-17T23:52:11.798 INFO:teuthology.orchestra.run.smithi196.stdout:17 Mar 23:52:11 ntpd[17198]: Command line: ntpd -gq 2024-03-17T23:52:11.798 INFO:teuthology.orchestra.run.smithi196.stdout:17 Mar 23:52:11 ntpd[17198]: ---------------------------------------------------- 2024-03-17T23:52:11.798 INFO:teuthology.orchestra.run.smithi196.stdout:17 Mar 23:52:11 ntpd[17198]: ntp-4 is maintained by Network Time Foundation, 2024-03-17T23:52:11.799 INFO:teuthology.orchestra.run.smithi196.stdout:17 Mar 23:52:11 ntpd[17198]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-03-17T23:52:11.799 INFO:teuthology.orchestra.run.smithi196.stdout:17 Mar 23:52:11 ntpd[17198]: corporation. Support and training for ntp-4 are 2024-03-17T23:52:11.799 INFO:teuthology.orchestra.run.smithi196.stdout:17 Mar 23:52:11 ntpd[17198]: available at https://www.nwtime.org/support 2024-03-17T23:52:11.799 INFO:teuthology.orchestra.run.smithi196.stdout:17 Mar 23:52:11 ntpd[17198]: ---------------------------------------------------- 2024-03-17T23:52:11.799 INFO:teuthology.orchestra.run.smithi196.stdout:17 Mar 23:52:11 ntpd[17198]: proto: precision = 0.045 usec (-24) 2024-03-17T23:52:11.799 INFO:teuthology.orchestra.run.smithi196.stdout:17 Mar 23:52:11 ntpd[17198]: basedate set to 2022-02-04 2024-03-17T23:52:11.800 INFO:teuthology.orchestra.run.smithi196.stdout:17 Mar 23:52:11 ntpd[17198]: gps base set to 2022-02-06 (week 2196) 2024-03-17T23:52:11.800 INFO:teuthology.orchestra.run.smithi196.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-03-17T23:52:11.800 INFO:teuthology.orchestra.run.smithi196.stdout:17 Mar 23:52:11 ntpd[17198]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-03-17T23:52:11.800 INFO:teuthology.orchestra.run.smithi196.stdout:17 Mar 23:52:11 ntpd[17198]: restrict ::: KOD does nothing without LIMITED. 2024-03-17T23:52:11.801 INFO:teuthology.orchestra.run.smithi196.stderr:restrict ::: KOD does nothing without LIMITED. 2024-03-17T23:52:11.802 INFO:teuthology.orchestra.run.smithi196.stdout:17 Mar 23:52:11 ntpd[17198]: Listen and drop on 0 v6wildcard [::]:123 2024-03-17T23:52:11.802 INFO:teuthology.orchestra.run.smithi196.stdout:17 Mar 23:52:11 ntpd[17198]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-03-17T23:52:11.802 INFO:teuthology.orchestra.run.smithi196.stdout:17 Mar 23:52:11 ntpd[17198]: Listen normally on 2 lo 127.0.0.1:123 2024-03-17T23:52:11.802 INFO:teuthology.orchestra.run.smithi196.stdout:17 Mar 23:52:11 ntpd[17198]: Listen normally on 3 enp3s0f1 172.21.15.196:123 2024-03-17T23:52:11.802 INFO:teuthology.orchestra.run.smithi196.stdout:17 Mar 23:52:11 ntpd[17198]: Listen normally on 4 lo [::1]:123 2024-03-17T23:52:11.802 INFO:teuthology.orchestra.run.smithi196.stdout:17 Mar 23:52:11 ntpd[17198]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:7f47%5]:123 2024-03-17T23:52:11.802 INFO:teuthology.orchestra.run.smithi196.stdout:17 Mar 23:52:11 ntpd[17198]: Listening on routing socket on fd #22 for interface updates 2024-03-17T23:52:11.827 INFO:teuthology.orchestra.run.smithi204.stdout:17 Mar 23:52:11 ntpd[17223]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-03-17T23:52:11.827 INFO:teuthology.orchestra.run.smithi204.stdout:17 Mar 23:52:11 ntpd[17223]: Command line: ntpd -gq 2024-03-17T23:52:11.827 INFO:teuthology.orchestra.run.smithi204.stdout:17 Mar 23:52:11 ntpd[17223]: ---------------------------------------------------- 2024-03-17T23:52:11.827 INFO:teuthology.orchestra.run.smithi204.stdout:17 Mar 23:52:11 ntpd[17223]: ntp-4 is maintained by Network Time Foundation, 2024-03-17T23:52:11.828 INFO:teuthology.orchestra.run.smithi204.stdout:17 Mar 23:52:11 ntpd[17223]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-03-17T23:52:11.828 INFO:teuthology.orchestra.run.smithi204.stdout:17 Mar 23:52:11 ntpd[17223]: corporation. Support and training for ntp-4 are 2024-03-17T23:52:11.828 INFO:teuthology.orchestra.run.smithi204.stdout:17 Mar 23:52:11 ntpd[17223]: available at https://www.nwtime.org/support 2024-03-17T23:52:11.828 INFO:teuthology.orchestra.run.smithi204.stdout:17 Mar 23:52:11 ntpd[17223]: ---------------------------------------------------- 2024-03-17T23:52:11.828 INFO:teuthology.orchestra.run.smithi204.stdout:17 Mar 23:52:11 ntpd[17223]: proto: precision = 0.043 usec (-24) 2024-03-17T23:52:11.828 INFO:teuthology.orchestra.run.smithi204.stdout:17 Mar 23:52:11 ntpd[17223]: basedate set to 2022-02-04 2024-03-17T23:52:11.828 INFO:teuthology.orchestra.run.smithi204.stdout:17 Mar 23:52:11 ntpd[17223]: gps base set to 2022-02-06 (week 2196) 2024-03-17T23:52:11.828 INFO:teuthology.orchestra.run.smithi204.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-03-17T23:52:11.829 INFO:teuthology.orchestra.run.smithi204.stdout:17 Mar 23:52:11 ntpd[17223]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-03-17T23:52:11.829 INFO:teuthology.orchestra.run.smithi204.stdout:17 Mar 23:52:11 ntpd[17223]: restrict ::: KOD does nothing without LIMITED. 2024-03-17T23:52:11.829 INFO:teuthology.orchestra.run.smithi204.stderr:restrict ::: KOD does nothing without LIMITED. 2024-03-17T23:52:11.830 INFO:teuthology.orchestra.run.smithi204.stdout:17 Mar 23:52:11 ntpd[17223]: Listen and drop on 0 v6wildcard [::]:123 2024-03-17T23:52:11.830 INFO:teuthology.orchestra.run.smithi204.stdout:17 Mar 23:52:11 ntpd[17223]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-03-17T23:52:11.830 INFO:teuthology.orchestra.run.smithi204.stdout:17 Mar 23:52:11 ntpd[17223]: Listen normally on 2 lo 127.0.0.1:123 2024-03-17T23:52:11.830 INFO:teuthology.orchestra.run.smithi204.stdout:17 Mar 23:52:11 ntpd[17223]: Listen normally on 3 enp3s0f1 172.21.15.204:123 2024-03-17T23:52:11.831 INFO:teuthology.orchestra.run.smithi204.stdout:17 Mar 23:52:11 ntpd[17223]: Listen normally on 4 lo [::1]:123 2024-03-17T23:52:11.831 INFO:teuthology.orchestra.run.smithi204.stdout:17 Mar 23:52:11 ntpd[17223]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:77ab%5]:123 2024-03-17T23:52:11.831 INFO:teuthology.orchestra.run.smithi204.stdout:17 Mar 23:52:11 ntpd[17223]: Listening on routing socket on fd #22 for interface updates 2024-03-17T23:52:12.799 INFO:teuthology.orchestra.run.smithi196.stderr:17 Mar 23:52:12 ntpd[17198]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-17T23:52:12.799 INFO:teuthology.orchestra.run.smithi196.stderr:17 Mar 23:52:12 ntpd[17198]: can't open /var/log/ntpstats/rawstats.20240317: Permission denied 2024-03-17T23:52:13.827 INFO:teuthology.orchestra.run.smithi204.stderr:17 Mar 23:52:13 ntpd[17223]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-17T23:52:13.827 INFO:teuthology.orchestra.run.smithi204.stderr:17 Mar 23:52:13 ntpd[17223]: can't open /var/log/ntpstats/rawstats.20240317: Permission denied 2024-03-17T23:52:14.800 INFO:teuthology.orchestra.run.smithi196.stderr:17 Mar 23:52:14 ntpd[17198]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-17T23:52:14.800 INFO:teuthology.orchestra.run.smithi196.stderr:17 Mar 23:52:14 ntpd[17198]: can't open /var/log/ntpstats/rawstats.20240317: Permission denied 2024-03-17T23:52:14.800 INFO:teuthology.orchestra.run.smithi196.stderr:17 Mar 23:52:14 ntpd[17198]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-17T23:52:14.800 INFO:teuthology.orchestra.run.smithi196.stderr:17 Mar 23:52:14 ntpd[17198]: can't open /var/log/ntpstats/rawstats.20240317: Permission denied 2024-03-17T23:52:14.800 INFO:teuthology.orchestra.run.smithi196.stderr:17 Mar 23:52:14 ntpd[17198]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-17T23:52:14.800 INFO:teuthology.orchestra.run.smithi196.stderr:17 Mar 23:52:14 ntpd[17198]: can't open /var/log/ntpstats/rawstats.20240317: Permission denied 2024-03-17T23:52:14.800 INFO:teuthology.orchestra.run.smithi196.stderr:17 Mar 23:52:14 ntpd[17198]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-03-17T23:52:14.800 INFO:teuthology.orchestra.run.smithi196.stderr:17 Mar 23:52:14 ntpd[17198]: can't open /var/log/ntpstats/peerstats.20240317: Permission denied 2024-03-17T23:52:14.800 INFO:teuthology.orchestra.run.smithi196.stderr:17 Mar 23:52:14 ntpd[17198]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-17T23:52:14.800 INFO:teuthology.orchestra.run.smithi196.stderr:17 Mar 23:52:14 ntpd[17198]: can't open /var/log/ntpstats/rawstats.20240317: Permission denied 2024-03-17T23:52:14.800 INFO:teuthology.orchestra.run.smithi196.stderr:17 Mar 23:52:14 ntpd[17198]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-03-17T23:52:14.800 INFO:teuthology.orchestra.run.smithi196.stderr:17 Mar 23:52:14 ntpd[17198]: can't open /var/log/ntpstats/peerstats.20240317: Permission denied 2024-03-17T23:52:14.827 INFO:teuthology.orchestra.run.smithi204.stderr:17 Mar 23:52:14 ntpd[17223]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-17T23:52:14.827 INFO:teuthology.orchestra.run.smithi204.stderr:17 Mar 23:52:14 ntpd[17223]: can't open /var/log/ntpstats/rawstats.20240317: Permission denied 2024-03-17T23:52:14.827 INFO:teuthology.orchestra.run.smithi204.stderr:17 Mar 23:52:14 ntpd[17223]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-17T23:52:14.827 INFO:teuthology.orchestra.run.smithi204.stderr:17 Mar 23:52:14 ntpd[17223]: can't open /var/log/ntpstats/rawstats.20240317: Permission denied 2024-03-17T23:52:14.827 INFO:teuthology.orchestra.run.smithi204.stderr:17 Mar 23:52:14 ntpd[17223]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-03-17T23:52:14.827 INFO:teuthology.orchestra.run.smithi204.stderr:17 Mar 23:52:14 ntpd[17223]: can't open /var/log/ntpstats/peerstats.20240317: Permission denied 2024-03-17T23:52:15.799 INFO:teuthology.orchestra.run.smithi196.stderr:17 Mar 23:52:15 ntpd[17198]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-17T23:52:15.799 INFO:teuthology.orchestra.run.smithi196.stderr:17 Mar 23:52:15 ntpd[17198]: can't open /var/log/ntpstats/rawstats.20240317: Permission denied 2024-03-17T23:52:15.799 INFO:teuthology.orchestra.run.smithi196.stderr:17 Mar 23:52:15 ntpd[17198]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-17T23:52:15.799 INFO:teuthology.orchestra.run.smithi196.stderr:17 Mar 23:52:15 ntpd[17198]: can't open /var/log/ntpstats/rawstats.20240317: Permission denied 2024-03-17T23:52:15.799 INFO:teuthology.orchestra.run.smithi196.stderr:17 Mar 23:52:15 ntpd[17198]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-03-17T23:52:15.800 INFO:teuthology.orchestra.run.smithi196.stderr:17 Mar 23:52:15 ntpd[17198]: can't open /var/log/ntpstats/peerstats.20240317: Permission denied 2024-03-17T23:52:16.800 INFO:teuthology.orchestra.run.smithi196.stderr:17 Mar 23:52:16 ntpd[17198]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-17T23:52:16.800 INFO:teuthology.orchestra.run.smithi196.stderr:17 Mar 23:52:16 ntpd[17198]: can't open /var/log/ntpstats/rawstats.20240317: Permission denied 2024-03-17T23:52:16.800 INFO:teuthology.orchestra.run.smithi196.stderr:17 Mar 23:52:16 ntpd[17198]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-17T23:52:16.800 INFO:teuthology.orchestra.run.smithi196.stderr:17 Mar 23:52:16 ntpd[17198]: can't open /var/log/ntpstats/rawstats.20240317: Permission denied 2024-03-17T23:52:16.800 INFO:teuthology.orchestra.run.smithi196.stderr:17 Mar 23:52:16 ntpd[17198]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-17T23:52:16.800 INFO:teuthology.orchestra.run.smithi196.stderr:17 Mar 23:52:16 ntpd[17198]: can't open /var/log/ntpstats/rawstats.20240317: Permission denied 2024-03-17T23:52:16.800 INFO:teuthology.orchestra.run.smithi196.stderr:17 Mar 23:52:16 ntpd[17198]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-03-17T23:52:16.800 INFO:teuthology.orchestra.run.smithi196.stderr:17 Mar 23:52:16 ntpd[17198]: can't open /var/log/ntpstats/peerstats.20240317: Permission denied 2024-03-17T23:52:16.800 INFO:teuthology.orchestra.run.smithi196.stderr:17 Mar 23:52:16 ntpd[17198]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-17T23:52:16.800 INFO:teuthology.orchestra.run.smithi196.stderr:17 Mar 23:52:16 ntpd[17198]: can't open /var/log/ntpstats/rawstats.20240317: Permission denied 2024-03-17T23:52:16.800 INFO:teuthology.orchestra.run.smithi196.stderr:17 Mar 23:52:16 ntpd[17198]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-03-17T23:52:16.801 INFO:teuthology.orchestra.run.smithi196.stderr:17 Mar 23:52:16 ntpd[17198]: can't open /var/log/ntpstats/peerstats.20240317: Permission denied 2024-03-17T23:52:16.828 INFO:teuthology.orchestra.run.smithi204.stderr:17 Mar 23:52:16 ntpd[17223]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-17T23:52:16.828 INFO:teuthology.orchestra.run.smithi204.stderr:17 Mar 23:52:16 ntpd[17223]: can't open /var/log/ntpstats/rawstats.20240317: Permission denied 2024-03-17T23:52:16.828 INFO:teuthology.orchestra.run.smithi204.stderr:17 Mar 23:52:16 ntpd[17223]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-17T23:52:16.828 INFO:teuthology.orchestra.run.smithi204.stderr:17 Mar 23:52:16 ntpd[17223]: can't open /var/log/ntpstats/rawstats.20240317: Permission denied 2024-03-17T23:52:16.828 INFO:teuthology.orchestra.run.smithi204.stderr:17 Mar 23:52:16 ntpd[17223]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-17T23:52:16.828 INFO:teuthology.orchestra.run.smithi204.stderr:17 Mar 23:52:16 ntpd[17223]: can't open /var/log/ntpstats/rawstats.20240317: Permission denied 2024-03-17T23:52:16.828 INFO:teuthology.orchestra.run.smithi204.stderr:17 Mar 23:52:16 ntpd[17223]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-17T23:52:16.828 INFO:teuthology.orchestra.run.smithi204.stderr:17 Mar 23:52:16 ntpd[17223]: can't open /var/log/ntpstats/rawstats.20240317: Permission denied 2024-03-17T23:52:16.828 INFO:teuthology.orchestra.run.smithi204.stderr:17 Mar 23:52:16 ntpd[17223]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-03-17T23:52:16.828 INFO:teuthology.orchestra.run.smithi204.stderr:17 Mar 23:52:16 ntpd[17223]: can't open /var/log/ntpstats/peerstats.20240317: Permission denied 2024-03-17T23:52:16.828 INFO:teuthology.orchestra.run.smithi204.stderr:17 Mar 23:52:16 ntpd[17223]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-17T23:52:16.829 INFO:teuthology.orchestra.run.smithi204.stderr:17 Mar 23:52:16 ntpd[17223]: can't open /var/log/ntpstats/rawstats.20240317: Permission denied 2024-03-17T23:52:16.829 INFO:teuthology.orchestra.run.smithi204.stderr:17 Mar 23:52:16 ntpd[17223]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-03-17T23:52:16.829 INFO:teuthology.orchestra.run.smithi204.stderr:17 Mar 23:52:16 ntpd[17223]: can't open /var/log/ntpstats/peerstats.20240317: Permission denied 2024-03-17T23:52:16.829 INFO:teuthology.orchestra.run.smithi204.stderr:17 Mar 23:52:16 ntpd[17223]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-17T23:52:16.829 INFO:teuthology.orchestra.run.smithi204.stderr:17 Mar 23:52:16 ntpd[17223]: can't open /var/log/ntpstats/rawstats.20240317: Permission denied 2024-03-17T23:52:16.829 INFO:teuthology.orchestra.run.smithi204.stderr:17 Mar 23:52:16 ntpd[17223]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-03-17T23:52:16.829 INFO:teuthology.orchestra.run.smithi204.stderr:17 Mar 23:52:16 ntpd[17223]: can't open /var/log/ntpstats/peerstats.20240317: Permission denied 2024-03-17T23:52:17.799 INFO:teuthology.orchestra.run.smithi196.stderr:17 Mar 23:52:17 ntpd[17198]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-17T23:52:17.799 INFO:teuthology.orchestra.run.smithi196.stderr:17 Mar 23:52:17 ntpd[17198]: can't open /var/log/ntpstats/rawstats.20240317: Permission denied 2024-03-17T23:52:17.799 INFO:teuthology.orchestra.run.smithi196.stderr:17 Mar 23:52:17 ntpd[17198]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-17T23:52:17.799 INFO:teuthology.orchestra.run.smithi196.stderr:17 Mar 23:52:17 ntpd[17198]: can't open /var/log/ntpstats/rawstats.20240317: Permission denied 2024-03-17T23:52:17.799 INFO:teuthology.orchestra.run.smithi196.stderr:17 Mar 23:52:17 ntpd[17198]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-03-17T23:52:17.799 INFO:teuthology.orchestra.run.smithi196.stderr:17 Mar 23:52:17 ntpd[17198]: can't open /var/log/ntpstats/peerstats.20240317: Permission denied 2024-03-17T23:52:18.799 INFO:teuthology.orchestra.run.smithi196.stderr:17 Mar 23:52:18 ntpd[17198]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-17T23:52:18.800 INFO:teuthology.orchestra.run.smithi196.stderr:17 Mar 23:52:18 ntpd[17198]: can't open /var/log/ntpstats/rawstats.20240317: Permission denied 2024-03-17T23:52:18.800 INFO:teuthology.orchestra.run.smithi196.stderr:17 Mar 23:52:18 ntpd[17198]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-17T23:52:18.800 INFO:teuthology.orchestra.run.smithi196.stderr:17 Mar 23:52:18 ntpd[17198]: can't open /var/log/ntpstats/rawstats.20240317: Permission denied 2024-03-17T23:52:18.800 INFO:teuthology.orchestra.run.smithi196.stderr:17 Mar 23:52:18 ntpd[17198]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-17T23:52:18.800 INFO:teuthology.orchestra.run.smithi196.stderr:17 Mar 23:52:18 ntpd[17198]: can't open /var/log/ntpstats/rawstats.20240317: Permission denied 2024-03-17T23:52:18.800 INFO:teuthology.orchestra.run.smithi196.stderr:17 Mar 23:52:18 ntpd[17198]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-03-17T23:52:18.800 INFO:teuthology.orchestra.run.smithi196.stderr:17 Mar 23:52:18 ntpd[17198]: can't open /var/log/ntpstats/peerstats.20240317: Permission denied 2024-03-17T23:52:18.800 INFO:teuthology.orchestra.run.smithi196.stderr:17 Mar 23:52:18 ntpd[17198]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-17T23:52:18.800 INFO:teuthology.orchestra.run.smithi196.stderr:17 Mar 23:52:18 ntpd[17198]: can't open /var/log/ntpstats/rawstats.20240317: Permission denied 2024-03-17T23:52:18.800 INFO:teuthology.orchestra.run.smithi196.stderr:17 Mar 23:52:18 ntpd[17198]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-03-17T23:52:18.800 INFO:teuthology.orchestra.run.smithi196.stderr:17 Mar 23:52:18 ntpd[17198]: can't open /var/log/ntpstats/peerstats.20240317: Permission denied 2024-03-17T23:52:18.828 INFO:teuthology.orchestra.run.smithi204.stderr:17 Mar 23:52:18 ntpd[17223]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-17T23:52:18.828 INFO:teuthology.orchestra.run.smithi204.stderr:17 Mar 23:52:18 ntpd[17223]: can't open /var/log/ntpstats/rawstats.20240317: Permission denied 2024-03-17T23:52:18.828 INFO:teuthology.orchestra.run.smithi204.stderr:17 Mar 23:52:18 ntpd[17223]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-17T23:52:18.828 INFO:teuthology.orchestra.run.smithi204.stderr:17 Mar 23:52:18 ntpd[17223]: can't open /var/log/ntpstats/rawstats.20240317: Permission denied 2024-03-17T23:52:18.828 INFO:teuthology.orchestra.run.smithi204.stderr:17 Mar 23:52:18 ntpd[17223]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-17T23:52:18.828 INFO:teuthology.orchestra.run.smithi204.stderr:17 Mar 23:52:18 ntpd[17223]: can't open /var/log/ntpstats/rawstats.20240317: Permission denied 2024-03-17T23:52:18.828 INFO:teuthology.orchestra.run.smithi204.stderr:17 Mar 23:52:18 ntpd[17223]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-17T23:52:18.828 INFO:teuthology.orchestra.run.smithi204.stderr:17 Mar 23:52:18 ntpd[17223]: can't open /var/log/ntpstats/rawstats.20240317: Permission denied 2024-03-17T23:52:18.828 INFO:teuthology.orchestra.run.smithi204.stderr:17 Mar 23:52:18 ntpd[17223]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-03-17T23:52:18.828 INFO:teuthology.orchestra.run.smithi204.stderr:17 Mar 23:52:18 ntpd[17223]: can't open /var/log/ntpstats/peerstats.20240317: Permission denied 2024-03-17T23:52:18.829 INFO:teuthology.orchestra.run.smithi204.stderr:17 Mar 23:52:18 ntpd[17223]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-17T23:52:18.829 INFO:teuthology.orchestra.run.smithi204.stderr:17 Mar 23:52:18 ntpd[17223]: can't open /var/log/ntpstats/rawstats.20240317: Permission denied 2024-03-17T23:52:18.829 INFO:teuthology.orchestra.run.smithi204.stderr:17 Mar 23:52:18 ntpd[17223]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-03-17T23:52:18.829 INFO:teuthology.orchestra.run.smithi204.stderr:17 Mar 23:52:18 ntpd[17223]: can't open /var/log/ntpstats/peerstats.20240317: Permission denied 2024-03-17T23:52:18.829 INFO:teuthology.orchestra.run.smithi204.stderr:17 Mar 23:52:18 ntpd[17223]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-17T23:52:18.829 INFO:teuthology.orchestra.run.smithi204.stderr:17 Mar 23:52:18 ntpd[17223]: can't open /var/log/ntpstats/rawstats.20240317: Permission denied 2024-03-17T23:52:18.829 INFO:teuthology.orchestra.run.smithi204.stderr:17 Mar 23:52:18 ntpd[17223]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-03-17T23:52:18.829 INFO:teuthology.orchestra.run.smithi204.stderr:17 Mar 23:52:18 ntpd[17223]: can't open /var/log/ntpstats/peerstats.20240317: Permission denied 2024-03-17T23:52:19.799 INFO:teuthology.orchestra.run.smithi196.stderr:17 Mar 23:52:19 ntpd[17198]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-17T23:52:19.799 INFO:teuthology.orchestra.run.smithi196.stderr:17 Mar 23:52:19 ntpd[17198]: can't open /var/log/ntpstats/rawstats.20240317: Permission denied 2024-03-17T23:52:19.799 INFO:teuthology.orchestra.run.smithi196.stderr:17 Mar 23:52:19 ntpd[17198]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-17T23:52:19.799 INFO:teuthology.orchestra.run.smithi196.stderr:17 Mar 23:52:19 ntpd[17198]: can't open /var/log/ntpstats/rawstats.20240317: Permission denied 2024-03-17T23:52:19.800 INFO:teuthology.orchestra.run.smithi196.stderr:17 Mar 23:52:19 ntpd[17198]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-03-17T23:52:19.800 INFO:teuthology.orchestra.run.smithi196.stderr:17 Mar 23:52:19 ntpd[17198]: can't open /var/log/ntpstats/peerstats.20240317: Permission denied 2024-03-17T23:52:20.799 INFO:teuthology.orchestra.run.smithi196.stderr:17 Mar 23:52:20 ntpd[17198]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-17T23:52:20.799 INFO:teuthology.orchestra.run.smithi196.stderr:17 Mar 23:52:20 ntpd[17198]: can't open /var/log/ntpstats/rawstats.20240317: Permission denied 2024-03-17T23:52:20.799 INFO:teuthology.orchestra.run.smithi196.stderr:17 Mar 23:52:20 ntpd[17198]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-17T23:52:20.800 INFO:teuthology.orchestra.run.smithi196.stderr:17 Mar 23:52:20 ntpd[17198]: can't open /var/log/ntpstats/rawstats.20240317: Permission denied 2024-03-17T23:52:20.800 INFO:teuthology.orchestra.run.smithi196.stderr:17 Mar 23:52:20 ntpd[17198]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-17T23:52:20.800 INFO:teuthology.orchestra.run.smithi196.stderr:17 Mar 23:52:20 ntpd[17198]: can't open /var/log/ntpstats/rawstats.20240317: Permission denied 2024-03-17T23:52:20.800 INFO:teuthology.orchestra.run.smithi196.stderr:17 Mar 23:52:20 ntpd[17198]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-03-17T23:52:20.800 INFO:teuthology.orchestra.run.smithi196.stderr:17 Mar 23:52:20 ntpd[17198]: can't open /var/log/ntpstats/peerstats.20240317: Permission denied 2024-03-17T23:52:20.800 INFO:teuthology.orchestra.run.smithi196.stdout:17 Mar 23:52:20 ntpd[17198]: ntpd: time slew -0.004331 s 2024-03-17T23:52:20.800 INFO:teuthology.orchestra.run.smithi196.stdout:ntpd: time slew -0.004331s 2024-03-17T23:52:20.801 INFO:teuthology.orchestra.run.smithi196.stderr:17 Mar 23:52:20 ntpd[17198]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-03-17T23:52:20.801 INFO:teuthology.orchestra.run.smithi196.stderr:17 Mar 23:52:20 ntpd[17198]: can't open /var/log/ntpstats/loopstats.20240317: Permission denied 2024-03-17T23:52:20.828 INFO:teuthology.orchestra.run.smithi204.stderr:17 Mar 23:52:20 ntpd[17223]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-17T23:52:20.828 INFO:teuthology.orchestra.run.smithi204.stderr:17 Mar 23:52:20 ntpd[17223]: can't open /var/log/ntpstats/rawstats.20240317: Permission denied 2024-03-17T23:52:20.828 INFO:teuthology.orchestra.run.smithi204.stderr:17 Mar 23:52:20 ntpd[17223]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-17T23:52:20.828 INFO:teuthology.orchestra.run.smithi204.stderr:17 Mar 23:52:20 ntpd[17223]: can't open /var/log/ntpstats/rawstats.20240317: Permission denied 2024-03-17T23:52:20.828 INFO:teuthology.orchestra.run.smithi204.stderr:17 Mar 23:52:20 ntpd[17223]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-17T23:52:20.828 INFO:teuthology.orchestra.run.smithi204.stderr:17 Mar 23:52:20 ntpd[17223]: can't open /var/log/ntpstats/rawstats.20240317: Permission denied 2024-03-17T23:52:20.828 INFO:teuthology.orchestra.run.smithi204.stderr:17 Mar 23:52:20 ntpd[17223]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-17T23:52:20.829 INFO:teuthology.orchestra.run.smithi204.stderr:17 Mar 23:52:20 ntpd[17223]: can't open /var/log/ntpstats/rawstats.20240317: Permission denied 2024-03-17T23:52:20.829 INFO:teuthology.orchestra.run.smithi204.stderr:17 Mar 23:52:20 ntpd[17223]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-03-17T23:52:20.829 INFO:teuthology.orchestra.run.smithi204.stderr:17 Mar 23:52:20 ntpd[17223]: can't open /var/log/ntpstats/peerstats.20240317: Permission denied 2024-03-17T23:52:20.829 INFO:teuthology.orchestra.run.smithi204.stderr:17 Mar 23:52:20 ntpd[17223]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-17T23:52:20.829 INFO:teuthology.orchestra.run.smithi204.stderr:17 Mar 23:52:20 ntpd[17223]: can't open /var/log/ntpstats/rawstats.20240317: Permission denied 2024-03-17T23:52:20.829 INFO:teuthology.orchestra.run.smithi204.stderr:17 Mar 23:52:20 ntpd[17223]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-03-17T23:52:20.829 INFO:teuthology.orchestra.run.smithi204.stderr:17 Mar 23:52:20 ntpd[17223]: can't open /var/log/ntpstats/peerstats.20240317: Permission denied 2024-03-17T23:52:20.829 INFO:teuthology.orchestra.run.smithi204.stderr:17 Mar 23:52:20 ntpd[17223]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-17T23:52:20.829 INFO:teuthology.orchestra.run.smithi204.stderr:17 Mar 23:52:20 ntpd[17223]: can't open /var/log/ntpstats/rawstats.20240317: Permission denied 2024-03-17T23:52:20.829 INFO:teuthology.orchestra.run.smithi204.stderr:17 Mar 23:52:20 ntpd[17223]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-03-17T23:52:20.829 INFO:teuthology.orchestra.run.smithi204.stderr:17 Mar 23:52:20 ntpd[17223]: can't open /var/log/ntpstats/peerstats.20240317: Permission denied 2024-03-17T23:52:20.830 INFO:teuthology.orchestra.run.smithi204.stdout:17 Mar 23:52:20 ntpd[17223]: ntpd: time slew -0.001883 s 2024-03-17T23:52:20.830 INFO:teuthology.orchestra.run.smithi204.stdout:ntpd: time slew -0.001883s 2024-03-17T23:52:20.830 INFO:teuthology.orchestra.run.smithi204.stderr:17 Mar 23:52:20 ntpd[17223]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-03-17T23:52:20.830 INFO:teuthology.orchestra.run.smithi204.stderr:17 Mar 23:52:20 ntpd[17223]: can't open /var/log/ntpstats/loopstats.20240317: Permission denied 2024-03-17T23:52:20.850 INFO:teuthology.orchestra.run.smithi196.stdout: remote refid st t when poll reach delay offset jitter 2024-03-17T23:52:20.850 INFO:teuthology.orchestra.run.smithi196.stdout:============================================================================== 2024-03-17T23:52:20.850 INFO:teuthology.orchestra.run.smithi196.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-03-17T23:52:20.850 INFO:teuthology.orchestra.run.smithi196.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-03-17T23:52:20.850 INFO:teuthology.orchestra.run.smithi196.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-03-17T23:52:20.850 INFO:teuthology.orchestra.run.smithi196.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-03-17T23:52:20.879 INFO:teuthology.orchestra.run.smithi204.stdout: remote refid st t when poll reach delay offset jitter 2024-03-17T23:52:20.879 INFO:teuthology.orchestra.run.smithi204.stdout:============================================================================== 2024-03-17T23:52:20.879 INFO:teuthology.orchestra.run.smithi204.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-03-17T23:52:20.879 INFO:teuthology.orchestra.run.smithi204.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-03-17T23:52:20.879 INFO:teuthology.orchestra.run.smithi204.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-03-17T23:52:20.879 INFO:teuthology.orchestra.run.smithi204.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-03-17T23:52:20.880 INFO:teuthology.run_tasks:Running task install... 2024-03-17T23:52:20.889 DEBUG:teuthology.task.install:project ceph 2024-03-17T23:52:20.889 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '3d78f5ba07bf18880172c07d4d7b4ac00c9d30af'}} 2024-03-17T23:52:20.889 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '3d78f5ba07bf18880172c07d4d7b4ac00c9d30af'} 2024-03-17T23:52:20.889 INFO:teuthology.task.install:Using flavor: default 2024-03-17T23:52:20.895 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-03-17T23:52:20.895 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-03-17T23:52:20.896 DEBUG:teuthology.orchestra.run.smithi196:> sudo apt-key list | grep Ceph 2024-03-17T23:52:20.896 DEBUG:teuthology.orchestra.run.smithi204:> sudo apt-key list | grep Ceph 2024-03-17T23:52:20.954 INFO:teuthology.orchestra.run.smithi196.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-03-17T23:52:20.981 INFO:teuthology.orchestra.run.smithi204.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-03-17T23:52:20.982 INFO:teuthology.orchestra.run.smithi196.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-03-17T23:52:20.982 INFO:teuthology.orchestra.run.smithi196.stdout:uid [ unknown] Ceph.com (release key) 2024-03-17T23:52:20.983 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2024-03-17T23:52:20.983 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2024-03-17T23:52:20.983 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=3d78f5ba07bf18880172c07d4d7b4ac00c9d30af 2024-03-17T23:52:21.009 INFO:teuthology.orchestra.run.smithi204.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-03-17T23:52:21.010 INFO:teuthology.orchestra.run.smithi204.stdout:uid [ unknown] Ceph.com (release key) 2024-03-17T23:52:21.010 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2024-03-17T23:52:21.010 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2024-03-17T23:52:21.010 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=3d78f5ba07bf18880172c07d4d7b4ac00c9d30af 2024-03-17T23:52:21.204 INFO:teuthology.task.install.deb:Pulling from https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20240314.183243/3d78f5ba07bf18880172c07d4d7b4ac00c9d30af/ubuntu/jammy/flavors/default/ 2024-03-17T23:52:21.204 INFO:teuthology.task.install.deb:Package version is 19.0.0-2162-g3d78f5ba-1jammy 2024-03-17T23:52:21.226 INFO:teuthology.task.install.deb:Pulling from https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20240314.183243/3d78f5ba07bf18880172c07d4d7b4ac00c9d30af/ubuntu/jammy/flavors/default/ 2024-03-17T23:52:21.226 INFO:teuthology.task.install.deb:Package version is 19.0.0-2162-g3d78f5ba-1jammy 2024-03-17T23:52:21.312 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2024-03-17T23:52:21.312 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-03-17T23:52:21.326 DEBUG:teuthology.orchestra.run.smithi196:> sudo apt-get update 2024-03-17T23:52:21.330 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2024-03-17T23:52:21.330 DEBUG:teuthology.orchestra.run.smithi204:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-03-17T23:52:21.347 DEBUG:teuthology.orchestra.run.smithi204:> sudo apt-get update 2024-03-17T23:52:21.504 INFO:teuthology.orchestra.run.smithi196.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-03-17T23:52:21.516 INFO:teuthology.orchestra.run.smithi196.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-03-17T23:52:21.536 INFO:teuthology.orchestra.run.smithi196.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-03-17T23:52:21.550 INFO:teuthology.orchestra.run.smithi196.stdout:Ign:4 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20240314.183243/3d78f5ba07bf18880172c07d4d7b4ac00c9d30af/ubuntu/jammy/flavors/default jammy InRelease 2024-03-17T23:52:21.560 INFO:teuthology.orchestra.run.smithi204.stdout:Ign:1 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20240314.183243/3d78f5ba07bf18880172c07d4d7b4ac00c9d30af/ubuntu/jammy/flavors/default jammy InRelease 2024-03-17T23:52:21.571 INFO:teuthology.orchestra.run.smithi196.stdout:Get:5 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20240314.183243/3d78f5ba07bf18880172c07d4d7b4ac00c9d30af/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-03-17T23:52:21.582 INFO:teuthology.orchestra.run.smithi204.stdout:Get:2 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20240314.183243/3d78f5ba07bf18880172c07d4d7b4ac00c9d30af/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-03-17T23:52:21.593 INFO:teuthology.orchestra.run.smithi196.stdout:Ign:6 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20240314.183243/3d78f5ba07bf18880172c07d4d7b4ac00c9d30af/ubuntu/jammy/flavors/default jammy Release.gpg 2024-03-17T23:52:21.605 INFO:teuthology.orchestra.run.smithi204.stdout:Ign:3 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20240314.183243/3d78f5ba07bf18880172c07d4d7b4ac00c9d30af/ubuntu/jammy/flavors/default jammy Release.gpg 2024-03-17T23:52:21.615 INFO:teuthology.orchestra.run.smithi196.stdout:Get:7 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20240314.183243/3d78f5ba07bf18880172c07d4d7b4ac00c9d30af/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,400 B] 2024-03-17T23:52:21.626 INFO:teuthology.orchestra.run.smithi204.stdout:Get:4 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20240314.183243/3d78f5ba07bf18880172c07d4d7b4ac00c9d30af/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,400 B] 2024-03-17T23:52:21.640 INFO:teuthology.orchestra.run.smithi196.stdout:Hit:8 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-03-17T23:52:21.642 INFO:teuthology.orchestra.run.smithi196.stdout:Get:9 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20240314.183243/3d78f5ba07bf18880172c07d4d7b4ac00c9d30af/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.8 kB] 2024-03-17T23:52:21.644 INFO:teuthology.orchestra.run.smithi204.stdout:Hit:5 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-03-17T23:52:21.644 INFO:teuthology.orchestra.run.smithi204.stdout:Hit:6 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-03-17T23:52:21.665 INFO:teuthology.orchestra.run.smithi204.stdout:Get:7 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20240314.183243/3d78f5ba07bf18880172c07d4d7b4ac00c9d30af/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.8 kB] 2024-03-17T23:52:21.713 INFO:teuthology.orchestra.run.smithi204.stdout:Hit:8 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-03-17T23:52:21.795 INFO:teuthology.orchestra.run.smithi204.stdout:Hit:9 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-03-17T23:52:21.836 INFO:teuthology.orchestra.run.smithi196.stdout:Fetched 28.9 kB in 0s (86.9 kB/s) 2024-03-17T23:52:22.024 INFO:teuthology.orchestra.run.smithi204.stdout:Fetched 28.9 kB in 0s (58.2 kB/s) 2024-03-17T23:52:22.743 INFO:teuthology.orchestra.run.smithi196.stdout:Reading package lists... 2024-03-17T23:52:22.759 DEBUG:teuthology.orchestra.run.smithi196:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.0.0-2162-g3d78f5ba-1jammy cephadm=19.0.0-2162-g3d78f5ba-1jammy ceph-mds=19.0.0-2162-g3d78f5ba-1jammy ceph-mgr=19.0.0-2162-g3d78f5ba-1jammy ceph-common=19.0.0-2162-g3d78f5ba-1jammy ceph-fuse=19.0.0-2162-g3d78f5ba-1jammy ceph-test=19.0.0-2162-g3d78f5ba-1jammy ceph-volume=19.0.0-2162-g3d78f5ba-1jammy radosgw=19.0.0-2162-g3d78f5ba-1jammy python3-rados=19.0.0-2162-g3d78f5ba-1jammy python3-rgw=19.0.0-2162-g3d78f5ba-1jammy python3-cephfs=19.0.0-2162-g3d78f5ba-1jammy python3-rbd=19.0.0-2162-g3d78f5ba-1jammy libcephfs2=19.0.0-2162-g3d78f5ba-1jammy libcephfs-dev=19.0.0-2162-g3d78f5ba-1jammy librados2=19.0.0-2162-g3d78f5ba-1jammy librbd1=19.0.0-2162-g3d78f5ba-1jammy rbd-fuse=19.0.0-2162-g3d78f5ba-1jammy python3-cephfs=19.0.0-2162-g3d78f5ba-1jammy cephfs-shell=19.0.0-2162-g3d78f5ba-1jammy cephfs-top=19.0.0-2162-g3d78f5ba-1jammy cephfs-mirror=19.0.0-2162-g3d78f5ba-1jammy 2024-03-17T23:52:22.820 INFO:teuthology.orchestra.run.smithi196.stdout:Reading package lists... 2024-03-17T23:52:22.982 INFO:teuthology.orchestra.run.smithi204.stdout:Reading package lists... 2024-03-17T23:52:22.999 DEBUG:teuthology.orchestra.run.smithi204:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.0.0-2162-g3d78f5ba-1jammy cephadm=19.0.0-2162-g3d78f5ba-1jammy ceph-mds=19.0.0-2162-g3d78f5ba-1jammy ceph-mgr=19.0.0-2162-g3d78f5ba-1jammy ceph-common=19.0.0-2162-g3d78f5ba-1jammy ceph-fuse=19.0.0-2162-g3d78f5ba-1jammy ceph-test=19.0.0-2162-g3d78f5ba-1jammy ceph-volume=19.0.0-2162-g3d78f5ba-1jammy radosgw=19.0.0-2162-g3d78f5ba-1jammy python3-rados=19.0.0-2162-g3d78f5ba-1jammy python3-rgw=19.0.0-2162-g3d78f5ba-1jammy python3-cephfs=19.0.0-2162-g3d78f5ba-1jammy python3-rbd=19.0.0-2162-g3d78f5ba-1jammy libcephfs2=19.0.0-2162-g3d78f5ba-1jammy libcephfs-dev=19.0.0-2162-g3d78f5ba-1jammy librados2=19.0.0-2162-g3d78f5ba-1jammy librbd1=19.0.0-2162-g3d78f5ba-1jammy rbd-fuse=19.0.0-2162-g3d78f5ba-1jammy python3-cephfs=19.0.0-2162-g3d78f5ba-1jammy cephfs-shell=19.0.0-2162-g3d78f5ba-1jammy cephfs-top=19.0.0-2162-g3d78f5ba-1jammy cephfs-mirror=19.0.0-2162-g3d78f5ba-1jammy 2024-03-17T23:52:23.015 INFO:teuthology.orchestra.run.smithi196.stdout:Building dependency tree... 2024-03-17T23:52:23.015 INFO:teuthology.orchestra.run.smithi196.stdout:Reading state information... 2024-03-17T23:52:23.058 INFO:teuthology.orchestra.run.smithi204.stdout:Reading package lists... 2024-03-17T23:52:23.192 INFO:teuthology.orchestra.run.smithi196.stdout:The following packages were automatically installed and are no longer required: 2024-03-17T23:52:23.193 INFO:teuthology.orchestra.run.smithi196.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-03-17T23:52:23.193 INFO:teuthology.orchestra.run.smithi196.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-03-17T23:52:23.193 INFO:teuthology.orchestra.run.smithi196.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-03-17T23:52:23.193 INFO:teuthology.orchestra.run.smithi196.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-03-17T23:52:23.193 INFO:teuthology.orchestra.run.smithi196.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-03-17T23:52:23.193 INFO:teuthology.orchestra.run.smithi196.stdout:Use 'sudo apt autoremove' to remove them. 2024-03-17T23:52:23.195 INFO:teuthology.orchestra.run.smithi196.stdout:The following additional packages will be installed: 2024-03-17T23:52:23.195 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-03-17T23:52:23.195 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-03-17T23:52:23.195 INFO:teuthology.orchestra.run.smithi196.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-03-17T23:52:23.196 INFO:teuthology.orchestra.run.smithi196.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-03-17T23:52:23.196 INFO:teuthology.orchestra.run.smithi196.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-03-17T23:52:23.196 INFO:teuthology.orchestra.run.smithi196.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-03-17T23:52:23.196 INFO:teuthology.orchestra.run.smithi196.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-03-17T23:52:23.196 INFO:teuthology.orchestra.run.smithi196.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-03-17T23:52:23.196 INFO:teuthology.orchestra.run.smithi196.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-03-17T23:52:23.196 INFO:teuthology.orchestra.run.smithi196.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-google-auth 2024-03-17T23:52:23.196 INFO:teuthology.orchestra.run.smithi196.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2024-03-17T23:52:23.196 INFO:teuthology.orchestra.run.smithi196.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2024-03-17T23:52:23.196 INFO:teuthology.orchestra.run.smithi196.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2024-03-17T23:52:23.196 INFO:teuthology.orchestra.run.smithi196.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2024-03-17T23:52:23.196 INFO:teuthology.orchestra.run.smithi196.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2024-03-17T23:52:23.197 INFO:teuthology.orchestra.run.smithi196.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2024-03-17T23:52:23.197 INFO:teuthology.orchestra.run.smithi196.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2024-03-17T23:52:23.197 INFO:teuthology.orchestra.run.smithi196.stdout: python3-pyperclip python3-pytest python3-repoze.lru python3-requests 2024-03-17T23:52:23.197 INFO:teuthology.orchestra.run.smithi196.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2024-03-17T23:52:23.197 INFO:teuthology.orchestra.run.smithi196.stdout: python3-simplejson python3-singledispatch python3-sklearn 2024-03-17T23:52:23.197 INFO:teuthology.orchestra.run.smithi196.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2024-03-17T23:52:23.197 INFO:teuthology.orchestra.run.smithi196.stdout: python3-toml python3-urllib3 python3-waitress python3-wcwidth python3-webob 2024-03-17T23:52:23.197 INFO:teuthology.orchestra.run.smithi196.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2024-03-17T23:52:23.197 INFO:teuthology.orchestra.run.smithi196.stdout: qttranslations5-l10n socat unzip xmlstarlet zip 2024-03-17T23:52:23.197 INFO:teuthology.orchestra.run.smithi196.stdout:Suggested packages: 2024-03-17T23:52:23.198 INFO:teuthology.orchestra.run.smithi196.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-03-17T23:52:23.198 INFO:teuthology.orchestra.run.smithi196.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-03-17T23:52:23.198 INFO:teuthology.orchestra.run.smithi196.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-03-17T23:52:23.198 INFO:teuthology.orchestra.run.smithi196.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-03-17T23:52:23.198 INFO:teuthology.orchestra.run.smithi196.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-03-17T23:52:23.198 INFO:teuthology.orchestra.run.smithi196.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-03-17T23:52:23.198 INFO:teuthology.orchestra.run.smithi196.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-03-17T23:52:23.198 INFO:teuthology.orchestra.run.smithi196.stdout:Recommended packages: 2024-03-17T23:52:23.198 INFO:teuthology.orchestra.run.smithi196.stdout: btrfs-tools 2024-03-17T23:52:23.251 INFO:teuthology.orchestra.run.smithi204.stdout:Building dependency tree... 2024-03-17T23:52:23.251 INFO:teuthology.orchestra.run.smithi204.stdout:Reading state information... 2024-03-17T23:52:23.304 INFO:teuthology.orchestra.run.smithi196.stdout:The following NEW packages will be installed: 2024-03-17T23:52:23.305 INFO:teuthology.orchestra.run.smithi196.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-03-17T23:52:23.305 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-03-17T23:52:23.305 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2024-03-17T23:52:23.305 INFO:teuthology.orchestra.run.smithi196.stdout: cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 2024-03-17T23:52:23.306 INFO:teuthology.orchestra.run.smithi196.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-03-17T23:52:23.307 INFO:teuthology.orchestra.run.smithi196.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librados2 2024-03-17T23:52:23.307 INFO:teuthology.orchestra.run.smithi196.stdout: libradosstriper1 librbd1 librdkafka1 libreadline-dev librgw2 2024-03-17T23:52:23.307 INFO:teuthology.orchestra.run.smithi196.stdout: libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec lua-socket lua5.1 2024-03-17T23:52:23.307 INFO:teuthology.orchestra.run.smithi196.stdout: luarocks nvme-cli pkg-config python-asyncssh-doc python-babel-localedata 2024-03-17T23:52:23.307 INFO:teuthology.orchestra.run.smithi196.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2024-03-17T23:52:23.307 INFO:teuthology.orchestra.run.smithi196.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2024-03-17T23:52:23.307 INFO:teuthology.orchestra.run.smithi196.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2024-03-17T23:52:23.307 INFO:teuthology.orchestra.run.smithi196.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2024-03-17T23:52:23.307 INFO:teuthology.orchestra.run.smithi196.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-03-17T23:52:23.307 INFO:teuthology.orchestra.run.smithi196.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-03-17T23:52:23.307 INFO:teuthology.orchestra.run.smithi196.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-03-17T23:52:23.307 INFO:teuthology.orchestra.run.smithi196.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-03-17T23:52:23.308 INFO:teuthology.orchestra.run.smithi196.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-03-17T23:52:23.308 INFO:teuthology.orchestra.run.smithi196.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-03-17T23:52:23.308 INFO:teuthology.orchestra.run.smithi196.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2024-03-17T23:52:23.308 INFO:teuthology.orchestra.run.smithi196.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2024-03-17T23:52:23.308 INFO:teuthology.orchestra.run.smithi196.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2024-03-17T23:52:23.308 INFO:teuthology.orchestra.run.smithi196.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-03-17T23:52:23.308 INFO:teuthology.orchestra.run.smithi196.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-03-17T23:52:23.308 INFO:teuthology.orchestra.run.smithi196.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-03-17T23:52:23.308 INFO:teuthology.orchestra.run.smithi196.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-03-17T23:52:23.308 INFO:teuthology.orchestra.run.smithi196.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2024-03-17T23:52:23.308 INFO:teuthology.orchestra.run.smithi196.stdout: socat unzip xmlstarlet zip 2024-03-17T23:52:23.374 INFO:teuthology.orchestra.run.smithi196.stdout:0 upgraded, 124 newly installed, 0 to remove and 284 not upgraded. 2024-03-17T23:52:23.375 INFO:teuthology.orchestra.run.smithi196.stdout:Need to get 178 MB of archives. 2024-03-17T23:52:23.375 INFO:teuthology.orchestra.run.smithi196.stdout:After this operation, 739 MB of additional disk space will be used. 2024-03-17T23:52:23.375 INFO:teuthology.orchestra.run.smithi196.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2024-03-17T23:52:23.395 INFO:teuthology.orchestra.run.smithi196.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-03-17T23:52:23.407 INFO:teuthology.orchestra.run.smithi196.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2024-03-17T23:52:23.423 INFO:teuthology.orchestra.run.smithi204.stdout:The following packages were automatically installed and are no longer required: 2024-03-17T23:52:23.423 INFO:teuthology.orchestra.run.smithi204.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-03-17T23:52:23.423 INFO:teuthology.orchestra.run.smithi204.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-03-17T23:52:23.423 INFO:teuthology.orchestra.run.smithi204.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-03-17T23:52:23.423 INFO:teuthology.orchestra.run.smithi204.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-03-17T23:52:23.424 INFO:teuthology.orchestra.run.smithi204.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-03-17T23:52:23.424 INFO:teuthology.orchestra.run.smithi204.stdout:Use 'sudo apt autoremove' to remove them. 2024-03-17T23:52:23.424 INFO:teuthology.orchestra.run.smithi204.stdout:The following additional packages will be installed: 2024-03-17T23:52:23.424 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-03-17T23:52:23.425 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-03-17T23:52:23.425 INFO:teuthology.orchestra.run.smithi204.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-03-17T23:52:23.425 INFO:teuthology.orchestra.run.smithi204.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-03-17T23:52:23.426 INFO:teuthology.orchestra.run.smithi204.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-03-17T23:52:23.426 INFO:teuthology.orchestra.run.smithi204.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-03-17T23:52:23.426 INFO:teuthology.orchestra.run.smithi204.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-03-17T23:52:23.426 INFO:teuthology.orchestra.run.smithi204.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-03-17T23:52:23.426 INFO:teuthology.orchestra.run.smithi204.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-03-17T23:52:23.426 INFO:teuthology.orchestra.run.smithi204.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-google-auth 2024-03-17T23:52:23.426 INFO:teuthology.orchestra.run.smithi204.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2024-03-17T23:52:23.426 INFO:teuthology.orchestra.run.smithi204.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2024-03-17T23:52:23.426 INFO:teuthology.orchestra.run.smithi204.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2024-03-17T23:52:23.426 INFO:teuthology.orchestra.run.smithi204.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2024-03-17T23:52:23.427 INFO:teuthology.orchestra.run.smithi204.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2024-03-17T23:52:23.427 INFO:teuthology.orchestra.run.smithi204.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2024-03-17T23:52:23.427 INFO:teuthology.orchestra.run.smithi204.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2024-03-17T23:52:23.427 INFO:teuthology.orchestra.run.smithi204.stdout: python3-pyperclip python3-pytest python3-repoze.lru python3-requests 2024-03-17T23:52:23.427 INFO:teuthology.orchestra.run.smithi204.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2024-03-17T23:52:23.427 INFO:teuthology.orchestra.run.smithi204.stdout: python3-simplejson python3-singledispatch python3-sklearn 2024-03-17T23:52:23.427 INFO:teuthology.orchestra.run.smithi204.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2024-03-17T23:52:23.427 INFO:teuthology.orchestra.run.smithi204.stdout: python3-toml python3-urllib3 python3-waitress python3-wcwidth python3-webob 2024-03-17T23:52:23.427 INFO:teuthology.orchestra.run.smithi204.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2024-03-17T23:52:23.427 INFO:teuthology.orchestra.run.smithi204.stdout: qttranslations5-l10n socat unzip xmlstarlet zip 2024-03-17T23:52:23.428 INFO:teuthology.orchestra.run.smithi204.stdout:Suggested packages: 2024-03-17T23:52:23.428 INFO:teuthology.orchestra.run.smithi204.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-03-17T23:52:23.428 INFO:teuthology.orchestra.run.smithi204.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-03-17T23:52:23.428 INFO:teuthology.orchestra.run.smithi204.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-03-17T23:52:23.428 INFO:teuthology.orchestra.run.smithi204.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-03-17T23:52:23.428 INFO:teuthology.orchestra.run.smithi204.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-03-17T23:52:23.428 INFO:teuthology.orchestra.run.smithi204.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-03-17T23:52:23.428 INFO:teuthology.orchestra.run.smithi204.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-03-17T23:52:23.428 INFO:teuthology.orchestra.run.smithi204.stdout:Recommended packages: 2024-03-17T23:52:23.428 INFO:teuthology.orchestra.run.smithi204.stdout: btrfs-tools 2024-03-17T23:52:23.456 INFO:teuthology.orchestra.run.smithi196.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-03-17T23:52:23.482 INFO:teuthology.orchestra.run.smithi196.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-03-17T23:52:23.485 INFO:teuthology.orchestra.run.smithi196.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-03-17T23:52:23.498 INFO:teuthology.orchestra.run.smithi196.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-03-17T23:52:23.526 INFO:teuthology.orchestra.run.smithi196.stdout:Get:8 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20240314.183243/3d78f5ba07bf18880172c07d4d7b4ac00c9d30af/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.0.0-2162-g3d78f5ba-1jammy [3,554 kB] 2024-03-17T23:52:23.533 INFO:teuthology.orchestra.run.smithi204.stdout:The following NEW packages will be installed: 2024-03-17T23:52:23.533 INFO:teuthology.orchestra.run.smithi204.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-03-17T23:52:23.533 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-03-17T23:52:23.533 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2024-03-17T23:52:23.535 INFO:teuthology.orchestra.run.smithi204.stdout: cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 2024-03-17T23:52:23.535 INFO:teuthology.orchestra.run.smithi204.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-03-17T23:52:23.535 INFO:teuthology.orchestra.run.smithi204.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librados2 2024-03-17T23:52:23.535 INFO:teuthology.orchestra.run.smithi204.stdout: libradosstriper1 librbd1 librdkafka1 libreadline-dev librgw2 2024-03-17T23:52:23.535 INFO:teuthology.orchestra.run.smithi204.stdout: libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec lua-socket lua5.1 2024-03-17T23:52:23.535 INFO:teuthology.orchestra.run.smithi204.stdout: luarocks nvme-cli pkg-config python-asyncssh-doc python-babel-localedata 2024-03-17T23:52:23.535 INFO:teuthology.orchestra.run.smithi204.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2024-03-17T23:52:23.535 INFO:teuthology.orchestra.run.smithi204.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2024-03-17T23:52:23.535 INFO:teuthology.orchestra.run.smithi204.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2024-03-17T23:52:23.536 INFO:teuthology.orchestra.run.smithi204.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2024-03-17T23:52:23.536 INFO:teuthology.orchestra.run.smithi204.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-03-17T23:52:23.536 INFO:teuthology.orchestra.run.smithi204.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-03-17T23:52:23.536 INFO:teuthology.orchestra.run.smithi204.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-03-17T23:52:23.536 INFO:teuthology.orchestra.run.smithi204.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-03-17T23:52:23.536 INFO:teuthology.orchestra.run.smithi204.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-03-17T23:52:23.536 INFO:teuthology.orchestra.run.smithi204.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-03-17T23:52:23.536 INFO:teuthology.orchestra.run.smithi204.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2024-03-17T23:52:23.536 INFO:teuthology.orchestra.run.smithi204.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2024-03-17T23:52:23.536 INFO:teuthology.orchestra.run.smithi204.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2024-03-17T23:52:23.536 INFO:teuthology.orchestra.run.smithi204.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-03-17T23:52:23.536 INFO:teuthology.orchestra.run.smithi204.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-03-17T23:52:23.536 INFO:teuthology.orchestra.run.smithi204.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-03-17T23:52:23.536 INFO:teuthology.orchestra.run.smithi204.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-03-17T23:52:23.536 INFO:teuthology.orchestra.run.smithi204.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2024-03-17T23:52:23.537 INFO:teuthology.orchestra.run.smithi204.stdout: socat unzip xmlstarlet zip 2024-03-17T23:52:23.551 INFO:teuthology.orchestra.run.smithi196.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-03-17T23:52:23.555 INFO:teuthology.orchestra.run.smithi196.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-03-17T23:52:23.567 INFO:teuthology.orchestra.run.smithi196.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-03-17T23:52:23.571 INFO:teuthology.orchestra.run.smithi196.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-03-17T23:52:23.572 INFO:teuthology.orchestra.run.smithi196.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-03-17T23:52:23.580 INFO:teuthology.orchestra.run.smithi196.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-03-17T23:52:23.582 INFO:teuthology.orchestra.run.smithi196.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-03-17T23:52:23.584 INFO:teuthology.orchestra.run.smithi196.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-03-17T23:52:23.586 INFO:teuthology.orchestra.run.smithi196.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-03-17T23:52:23.586 INFO:teuthology.orchestra.run.smithi196.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-03-17T23:52:23.597 INFO:teuthology.orchestra.run.smithi196.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-03-17T23:52:23.599 INFO:teuthology.orchestra.run.smithi196.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-03-17T23:52:23.600 INFO:teuthology.orchestra.run.smithi196.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-03-17T23:52:23.601 INFO:teuthology.orchestra.run.smithi196.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-03-17T23:52:23.601 INFO:teuthology.orchestra.run.smithi204.stdout:0 upgraded, 124 newly installed, 0 to remove and 284 not upgraded. 2024-03-17T23:52:23.601 INFO:teuthology.orchestra.run.smithi204.stdout:Need to get 178 MB of archives. 2024-03-17T23:52:23.601 INFO:teuthology.orchestra.run.smithi204.stdout:After this operation, 739 MB of additional disk space will be used. 2024-03-17T23:52:23.602 INFO:teuthology.orchestra.run.smithi204.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2024-03-17T23:52:23.617 INFO:teuthology.orchestra.run.smithi196.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-03-17T23:52:23.618 INFO:teuthology.orchestra.run.smithi196.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-03-17T23:52:23.618 INFO:teuthology.orchestra.run.smithi196.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-03-17T23:52:23.619 INFO:teuthology.orchestra.run.smithi196.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-03-17T23:52:23.619 INFO:teuthology.orchestra.run.smithi196.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-03-17T23:52:23.619 INFO:teuthology.orchestra.run.smithi196.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-03-17T23:52:23.622 INFO:teuthology.orchestra.run.smithi204.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-03-17T23:52:23.633 INFO:teuthology.orchestra.run.smithi204.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2024-03-17T23:52:23.638 INFO:teuthology.orchestra.run.smithi196.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-03-17T23:52:23.638 INFO:teuthology.orchestra.run.smithi196.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-03-17T23:52:23.640 INFO:teuthology.orchestra.run.smithi196.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-03-17T23:52:23.641 INFO:teuthology.orchestra.run.smithi196.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-03-17T23:52:23.658 INFO:teuthology.orchestra.run.smithi196.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-03-17T23:52:23.659 INFO:teuthology.orchestra.run.smithi196.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-03-17T23:52:23.660 INFO:teuthology.orchestra.run.smithi196.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-03-17T23:52:23.660 INFO:teuthology.orchestra.run.smithi196.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-03-17T23:52:23.660 INFO:teuthology.orchestra.run.smithi196.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2024-03-17T23:52:23.661 INFO:teuthology.orchestra.run.smithi196.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-03-17T23:52:23.679 INFO:teuthology.orchestra.run.smithi196.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-03-17T23:52:23.679 INFO:teuthology.orchestra.run.smithi196.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-03-17T23:52:23.683 INFO:teuthology.orchestra.run.smithi204.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-03-17T23:52:23.684 INFO:teuthology.orchestra.run.smithi196.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-03-17T23:52:23.684 INFO:teuthology.orchestra.run.smithi196.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-03-17T23:52:23.700 INFO:teuthology.orchestra.run.smithi196.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-03-17T23:52:23.700 INFO:teuthology.orchestra.run.smithi196.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-03-17T23:52:23.701 INFO:teuthology.orchestra.run.smithi196.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-03-17T23:52:23.703 INFO:teuthology.orchestra.run.smithi196.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2024-03-17T23:52:23.704 INFO:teuthology.orchestra.run.smithi196.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-03-17T23:52:23.705 INFO:teuthology.orchestra.run.smithi196.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-03-17T23:52:23.705 INFO:teuthology.orchestra.run.smithi204.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-03-17T23:52:23.710 INFO:teuthology.orchestra.run.smithi204.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-03-17T23:52:23.720 INFO:teuthology.orchestra.run.smithi196.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2024-03-17T23:52:23.723 INFO:teuthology.orchestra.run.smithi196.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-03-17T23:52:23.723 INFO:teuthology.orchestra.run.smithi204.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-03-17T23:52:23.723 INFO:teuthology.orchestra.run.smithi196.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-03-17T23:52:23.724 INFO:teuthology.orchestra.run.smithi196.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-03-17T23:52:23.741 INFO:teuthology.orchestra.run.smithi196.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-03-17T23:52:23.782 INFO:teuthology.orchestra.run.smithi204.stdout:Get:8 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20240314.183243/3d78f5ba07bf18880172c07d4d7b4ac00c9d30af/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.0.0-2162-g3d78f5ba-1jammy [3,554 kB] 2024-03-17T23:52:23.798 INFO:teuthology.orchestra.run.smithi204.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-03-17T23:52:23.805 INFO:teuthology.orchestra.run.smithi196.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-03-17T23:52:23.806 INFO:teuthology.orchestra.run.smithi196.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.1 [108 kB] 2024-03-17T23:52:23.808 INFO:teuthology.orchestra.run.smithi196.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-03-17T23:52:23.808 INFO:teuthology.orchestra.run.smithi196.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-03-17T23:52:23.809 INFO:teuthology.orchestra.run.smithi204.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-03-17T23:52:23.809 INFO:teuthology.orchestra.run.smithi196.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-03-17T23:52:23.829 INFO:teuthology.orchestra.run.smithi204.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-03-17T23:52:23.835 INFO:teuthology.orchestra.run.smithi204.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-03-17T23:52:23.836 INFO:teuthology.orchestra.run.smithi204.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-03-17T23:52:23.846 INFO:teuthology.orchestra.run.smithi196.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-03-17T23:52:23.848 INFO:teuthology.orchestra.run.smithi204.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-03-17T23:52:23.849 INFO:teuthology.orchestra.run.smithi196.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-03-17T23:52:23.849 INFO:teuthology.orchestra.run.smithi196.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-03-17T23:52:23.851 INFO:teuthology.orchestra.run.smithi204.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-03-17T23:52:23.854 INFO:teuthology.orchestra.run.smithi204.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-03-17T23:52:23.856 INFO:teuthology.orchestra.run.smithi204.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-03-17T23:52:23.857 INFO:teuthology.orchestra.run.smithi204.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-03-17T23:52:23.873 INFO:teuthology.orchestra.run.smithi196.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-03-17T23:52:23.873 INFO:teuthology.orchestra.run.smithi196.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-03-17T23:52:23.874 INFO:teuthology.orchestra.run.smithi204.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-03-17T23:52:23.877 INFO:teuthology.orchestra.run.smithi204.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-03-17T23:52:23.879 INFO:teuthology.orchestra.run.smithi196.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-03-17T23:52:23.879 INFO:teuthology.orchestra.run.smithi204.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-03-17T23:52:23.880 INFO:teuthology.orchestra.run.smithi196.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-03-17T23:52:23.880 INFO:teuthology.orchestra.run.smithi196.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-03-17T23:52:23.880 INFO:teuthology.orchestra.run.smithi204.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-03-17T23:52:23.881 INFO:teuthology.orchestra.run.smithi196.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-03-17T23:52:23.881 INFO:teuthology.orchestra.run.smithi196.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-03-17T23:52:23.882 INFO:teuthology.orchestra.run.smithi196.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-03-17T23:52:23.885 INFO:teuthology.orchestra.run.smithi196.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-03-17T23:52:23.894 INFO:teuthology.orchestra.run.smithi204.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-03-17T23:52:23.895 INFO:teuthology.orchestra.run.smithi204.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-03-17T23:52:23.895 INFO:teuthology.orchestra.run.smithi204.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-03-17T23:52:23.896 INFO:teuthology.orchestra.run.smithi204.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-03-17T23:52:23.896 INFO:teuthology.orchestra.run.smithi204.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-03-17T23:52:23.897 INFO:teuthology.orchestra.run.smithi204.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-03-17T23:52:23.899 INFO:teuthology.orchestra.run.smithi196.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-03-17T23:52:23.901 INFO:teuthology.orchestra.run.smithi196.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-03-17T23:52:23.902 INFO:teuthology.orchestra.run.smithi196.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-03-17T23:52:23.913 INFO:teuthology.orchestra.run.smithi204.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-03-17T23:52:23.914 INFO:teuthology.orchestra.run.smithi204.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-03-17T23:52:23.919 INFO:teuthology.orchestra.run.smithi204.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-03-17T23:52:23.920 INFO:teuthology.orchestra.run.smithi204.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-03-17T23:52:23.920 INFO:teuthology.orchestra.run.smithi196.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-03-17T23:52:23.924 INFO:teuthology.orchestra.run.smithi196.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2024-03-17T23:52:23.924 INFO:teuthology.orchestra.run.smithi196.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-03-17T23:52:23.925 INFO:teuthology.orchestra.run.smithi196.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-03-17T23:52:23.925 INFO:teuthology.orchestra.run.smithi196.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2024-03-17T23:52:23.931 INFO:teuthology.orchestra.run.smithi196.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-03-17T23:52:23.931 INFO:teuthology.orchestra.run.smithi196.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-03-17T23:52:23.933 INFO:teuthology.orchestra.run.smithi204.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-03-17T23:52:23.933 INFO:teuthology.orchestra.run.smithi204.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-03-17T23:52:23.935 INFO:teuthology.orchestra.run.smithi204.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-03-17T23:52:23.936 INFO:teuthology.orchestra.run.smithi204.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-03-17T23:52:23.936 INFO:teuthology.orchestra.run.smithi204.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2024-03-17T23:52:23.939 INFO:teuthology.orchestra.run.smithi204.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-03-17T23:52:23.941 INFO:teuthology.orchestra.run.smithi196.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-03-17T23:52:23.941 INFO:teuthology.orchestra.run.smithi196.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-03-17T23:52:23.942 INFO:teuthology.orchestra.run.smithi196.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-03-17T23:52:23.951 INFO:teuthology.orchestra.run.smithi196.stdout:Get:84 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20240314.183243/3d78f5ba07bf18880172c07d4d7b4ac00c9d30af/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.0.0-2162-g3d78f5ba-1jammy [3,225 kB] 2024-03-17T23:52:23.954 INFO:teuthology.orchestra.run.smithi204.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-03-17T23:52:23.955 INFO:teuthology.orchestra.run.smithi204.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-03-17T23:52:23.961 INFO:teuthology.orchestra.run.smithi196.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-03-17T23:52:23.963 INFO:teuthology.orchestra.run.smithi196.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-03-17T23:52:23.964 INFO:teuthology.orchestra.run.smithi196.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-03-17T23:52:23.965 INFO:teuthology.orchestra.run.smithi204.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-03-17T23:52:23.965 INFO:teuthology.orchestra.run.smithi204.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-03-17T23:52:23.972 INFO:teuthology.orchestra.run.smithi196.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-03-17T23:52:23.972 INFO:teuthology.orchestra.run.smithi196.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-03-17T23:52:23.973 INFO:teuthology.orchestra.run.smithi196.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-03-17T23:52:23.975 INFO:teuthology.orchestra.run.smithi204.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-03-17T23:52:23.975 INFO:teuthology.orchestra.run.smithi196.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-03-17T23:52:23.976 INFO:teuthology.orchestra.run.smithi204.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-03-17T23:52:23.978 INFO:teuthology.orchestra.run.smithi204.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-03-17T23:52:23.982 INFO:teuthology.orchestra.run.smithi204.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2024-03-17T23:52:23.985 INFO:teuthology.orchestra.run.smithi196.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-03-17T23:52:23.986 INFO:teuthology.orchestra.run.smithi204.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-03-17T23:52:23.986 INFO:teuthology.orchestra.run.smithi204.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-03-17T23:52:24.005 INFO:teuthology.orchestra.run.smithi204.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2024-03-17T23:52:24.009 INFO:teuthology.orchestra.run.smithi204.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-03-17T23:52:24.010 INFO:teuthology.orchestra.run.smithi204.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-03-17T23:52:24.012 INFO:teuthology.orchestra.run.smithi204.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-03-17T23:52:24.025 INFO:teuthology.orchestra.run.smithi204.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-03-17T23:52:24.098 INFO:teuthology.orchestra.run.smithi204.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-03-17T23:52:24.100 INFO:teuthology.orchestra.run.smithi204.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.1 [108 kB] 2024-03-17T23:52:24.101 INFO:teuthology.orchestra.run.smithi204.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-03-17T23:52:24.101 INFO:teuthology.orchestra.run.smithi204.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-03-17T23:52:24.102 INFO:teuthology.orchestra.run.smithi204.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-03-17T23:52:24.120 INFO:teuthology.orchestra.run.smithi204.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-03-17T23:52:24.122 INFO:teuthology.orchestra.run.smithi204.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-03-17T23:52:24.122 INFO:teuthology.orchestra.run.smithi204.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-03-17T23:52:24.139 INFO:teuthology.orchestra.run.smithi204.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-03-17T23:52:24.139 INFO:teuthology.orchestra.run.smithi204.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-03-17T23:52:24.144 INFO:teuthology.orchestra.run.smithi196.stdout:Get:93 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20240314.183243/3d78f5ba07bf18880172c07d4d7b4ac00c9d30af/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.0.0-2162-g3d78f5ba-1jammy [712 kB] 2024-03-17T23:52:24.148 INFO:teuthology.orchestra.run.smithi204.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-03-17T23:52:24.148 INFO:teuthology.orchestra.run.smithi204.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-03-17T23:52:24.149 INFO:teuthology.orchestra.run.smithi204.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-03-17T23:52:24.149 INFO:teuthology.orchestra.run.smithi204.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-03-17T23:52:24.149 INFO:teuthology.orchestra.run.smithi204.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-03-17T23:52:24.150 INFO:teuthology.orchestra.run.smithi204.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-03-17T23:52:24.153 INFO:teuthology.orchestra.run.smithi204.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-03-17T23:52:24.167 INFO:teuthology.orchestra.run.smithi204.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-03-17T23:52:24.169 INFO:teuthology.orchestra.run.smithi204.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-03-17T23:52:24.169 INFO:teuthology.orchestra.run.smithi204.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-03-17T23:52:24.177 INFO:teuthology.orchestra.run.smithi196.stdout:Get:94 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20240314.183243/3d78f5ba07bf18880172c07d4d7b4ac00c9d30af/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.0.0-2162-g3d78f5ba-1jammy [357 kB] 2024-03-17T23:52:24.185 INFO:teuthology.orchestra.run.smithi196.stdout:Get:95 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20240314.183243/3d78f5ba07bf18880172c07d4d7b4ac00c9d30af/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.0.0-2162-g3d78f5ba-1jammy [32.8 kB] 2024-03-17T23:52:24.186 INFO:teuthology.orchestra.run.smithi196.stdout:Get:96 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20240314.183243/3d78f5ba07bf18880172c07d4d7b4ac00c9d30af/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.0.0-2162-g3d78f5ba-1jammy [180 kB] 2024-03-17T23:52:24.190 INFO:teuthology.orchestra.run.smithi204.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-03-17T23:52:24.190 INFO:teuthology.orchestra.run.smithi204.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2024-03-17T23:52:24.190 INFO:teuthology.orchestra.run.smithi204.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-03-17T23:52:24.191 INFO:teuthology.orchestra.run.smithi204.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-03-17T23:52:24.191 INFO:teuthology.orchestra.run.smithi204.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2024-03-17T23:52:24.195 INFO:teuthology.orchestra.run.smithi204.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-03-17T23:52:24.196 INFO:teuthology.orchestra.run.smithi204.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-03-17T23:52:24.203 INFO:teuthology.orchestra.run.smithi196.stdout:Get:97 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20240314.183243/3d78f5ba07bf18880172c07d4d7b4ac00c9d30af/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.0.0-2162-g3d78f5ba-1jammy [64.6 kB] 2024-03-17T23:52:24.206 INFO:teuthology.orchestra.run.smithi204.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-03-17T23:52:24.207 INFO:teuthology.orchestra.run.smithi204.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-03-17T23:52:24.207 INFO:teuthology.orchestra.run.smithi204.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-03-17T23:52:24.208 INFO:teuthology.orchestra.run.smithi196.stdout:Get:98 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20240314.183243/3d78f5ba07bf18880172c07d4d7b4ac00c9d30af/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.0.0-2162-g3d78f5ba-1jammy [330 kB] 2024-03-17T23:52:24.216 INFO:teuthology.orchestra.run.smithi196.stdout:Get:99 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20240314.183243/3d78f5ba07bf18880172c07d4d7b4ac00c9d30af/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.0.0-2162-g3d78f5ba-1jammy [6,653 kB] 2024-03-17T23:52:24.226 INFO:teuthology.orchestra.run.smithi204.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-03-17T23:52:24.227 INFO:teuthology.orchestra.run.smithi204.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-03-17T23:52:24.228 INFO:teuthology.orchestra.run.smithi204.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-03-17T23:52:24.236 INFO:teuthology.orchestra.run.smithi204.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-03-17T23:52:24.236 INFO:teuthology.orchestra.run.smithi204.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-03-17T23:52:24.236 INFO:teuthology.orchestra.run.smithi204.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-03-17T23:52:24.238 INFO:teuthology.orchestra.run.smithi204.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-03-17T23:52:24.245 INFO:teuthology.orchestra.run.smithi204.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-03-17T23:52:24.465 INFO:teuthology.orchestra.run.smithi196.stdout:Get:100 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20240314.183243/3d78f5ba07bf18880172c07d4d7b4ac00c9d30af/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.0.0-2162-g3d78f5ba-1jammy [112 kB] 2024-03-17T23:52:24.467 INFO:teuthology.orchestra.run.smithi196.stdout:Get:101 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20240314.183243/3d78f5ba07bf18880172c07d4d7b4ac00c9d30af/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.0.0-2162-g3d78f5ba-1jammy [466 kB] 2024-03-17T23:52:24.482 INFO:teuthology.orchestra.run.smithi196.stdout:Get:102 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20240314.183243/3d78f5ba07bf18880172c07d4d7b4ac00c9d30af/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.0.0-2162-g3d78f5ba-1jammy [25.3 MB] 2024-03-17T23:52:25.470 INFO:teuthology.orchestra.run.smithi204.stdout:Get:92 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20240314.183243/3d78f5ba07bf18880172c07d4d7b4ac00c9d30af/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.0.0-2162-g3d78f5ba-1jammy [3,225 kB] 2024-03-17T23:52:25.485 INFO:teuthology.orchestra.run.smithi196.stdout:Get:103 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20240314.183243/3d78f5ba07bf18880172c07d4d7b4ac00c9d30af/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.0.0-2162-g3d78f5ba-1jammy [5,085 kB] 2024-03-17T23:52:25.571 INFO:teuthology.orchestra.run.smithi196.stdout:Get:104 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20240314.183243/3d78f5ba07bf18880172c07d4d7b4ac00c9d30af/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.0.0-2162-g3d78f5ba-1jammy [244 kB] 2024-03-17T23:52:25.586 INFO:teuthology.orchestra.run.smithi196.stdout:Get:105 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20240314.183243/3d78f5ba07bf18880172c07d4d7b4ac00c9d30af/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.0.0-2162-g3d78f5ba-1jammy [124 kB] 2024-03-17T23:52:25.590 INFO:teuthology.orchestra.run.smithi196.stdout:Get:106 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20240314.183243/3d78f5ba07bf18880172c07d4d7b4ac00c9d30af/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.0.0-2162-g3d78f5ba-1jammy [1,526 kB] 2024-03-17T23:52:25.641 INFO:teuthology.orchestra.run.smithi196.stdout:Get:107 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20240314.183243/3d78f5ba07bf18880172c07d4d7b4ac00c9d30af/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.0.0-2162-g3d78f5ba-1jammy [6,255 kB] 2024-03-17T23:52:25.896 INFO:teuthology.orchestra.run.smithi196.stdout:Get:108 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20240314.183243/3d78f5ba07bf18880172c07d4d7b4ac00c9d30af/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.0.0-2162-g3d78f5ba-1jammy [22.8 MB] 2024-03-17T23:52:26.365 INFO:teuthology.orchestra.run.smithi204.stdout:Get:93 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20240314.183243/3d78f5ba07bf18880172c07d4d7b4ac00c9d30af/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.0.0-2162-g3d78f5ba-1jammy [712 kB] 2024-03-17T23:52:26.560 INFO:teuthology.orchestra.run.smithi204.stdout:Get:94 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20240314.183243/3d78f5ba07bf18880172c07d4d7b4ac00c9d30af/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.0.0-2162-g3d78f5ba-1jammy [357 kB] 2024-03-17T23:52:26.679 INFO:teuthology.orchestra.run.smithi204.stdout:Get:95 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20240314.183243/3d78f5ba07bf18880172c07d4d7b4ac00c9d30af/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.0.0-2162-g3d78f5ba-1jammy [32.8 kB] 2024-03-17T23:52:26.681 INFO:teuthology.orchestra.run.smithi204.stdout:Get:96 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20240314.183243/3d78f5ba07bf18880172c07d4d7b4ac00c9d30af/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.0.0-2162-g3d78f5ba-1jammy [180 kB] 2024-03-17T23:52:26.739 INFO:teuthology.orchestra.run.smithi204.stdout:Get:97 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20240314.183243/3d78f5ba07bf18880172c07d4d7b4ac00c9d30af/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.0.0-2162-g3d78f5ba-1jammy [64.6 kB] 2024-03-17T23:52:26.752 INFO:teuthology.orchestra.run.smithi204.stdout:Get:98 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20240314.183243/3d78f5ba07bf18880172c07d4d7b4ac00c9d30af/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.0.0-2162-g3d78f5ba-1jammy [330 kB] 2024-03-17T23:52:26.807 INFO:teuthology.orchestra.run.smithi204.stdout:Get:99 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20240314.183243/3d78f5ba07bf18880172c07d4d7b4ac00c9d30af/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.0.0-2162-g3d78f5ba-1jammy [6,653 kB] 2024-03-17T23:52:26.841 INFO:teuthology.orchestra.run.smithi196.stdout:Get:109 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20240314.183243/3d78f5ba07bf18880172c07d4d7b4ac00c9d30af/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.0.0-2162-g3d78f5ba-1jammy [14.1 kB] 2024-03-17T23:52:26.841 INFO:teuthology.orchestra.run.smithi196.stdout:Get:110 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20240314.183243/3d78f5ba07bf18880172c07d4d7b4ac00c9d30af/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.0.0-2162-g3d78f5ba-1jammy [870 kB] 2024-03-17T23:52:26.858 INFO:teuthology.orchestra.run.smithi196.stdout:Get:111 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20240314.183243/3d78f5ba07bf18880172c07d4d7b4ac00c9d30af/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.0.0-2162-g3d78f5ba-1jammy [2,434 kB] 2024-03-17T23:52:26.900 INFO:teuthology.orchestra.run.smithi196.stdout:Get:112 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20240314.183243/3d78f5ba07bf18880172c07d4d7b4ac00c9d30af/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.0.0-2162-g3d78f5ba-1jammy [777 kB] 2024-03-17T23:52:26.910 INFO:teuthology.orchestra.run.smithi196.stdout:Get:113 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20240314.183243/3d78f5ba07bf18880172c07d4d7b4ac00c9d30af/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.0.0-2162-g3d78f5ba-1jammy [144 kB] 2024-03-17T23:52:26.911 INFO:teuthology.orchestra.run.smithi196.stdout:Get:114 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20240314.183243/3d78f5ba07bf18880172c07d4d7b4ac00c9d30af/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.0.0-2162-g3d78f5ba-1jammy [1,936 kB] 2024-03-17T23:52:26.970 INFO:teuthology.orchestra.run.smithi196.stdout:Get:115 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20240314.183243/3d78f5ba07bf18880172c07d4d7b4ac00c9d30af/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.0.0-2162-g3d78f5ba-1jammy [8,625 kB] 2024-03-17T23:52:27.293 INFO:teuthology.orchestra.run.smithi196.stdout:Get:116 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20240314.183243/3d78f5ba07bf18880172c07d4d7b4ac00c9d30af/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.0.0-2162-g3d78f5ba-1jammy [14.2 kB] 2024-03-17T23:52:27.294 INFO:teuthology.orchestra.run.smithi196.stdout:Get:117 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20240314.183243/3d78f5ba07bf18880172c07d4d7b4ac00c9d30af/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.0.0-2162-g3d78f5ba-1jammy [50.2 MB] 2024-03-17T23:52:28.786 INFO:teuthology.orchestra.run.smithi204.stdout:Get:100 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20240314.183243/3d78f5ba07bf18880172c07d4d7b4ac00c9d30af/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.0.0-2162-g3d78f5ba-1jammy [112 kB] 2024-03-17T23:52:28.789 INFO:teuthology.orchestra.run.smithi204.stdout:Get:101 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20240314.183243/3d78f5ba07bf18880172c07d4d7b4ac00c9d30af/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.0.0-2162-g3d78f5ba-1jammy [466 kB] 2024-03-17T23:52:28.949 INFO:teuthology.orchestra.run.smithi204.stdout:Get:102 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20240314.183243/3d78f5ba07bf18880172c07d4d7b4ac00c9d30af/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.0.0-2162-g3d78f5ba-1jammy [25.3 MB] 2024-03-17T23:52:29.402 INFO:teuthology.orchestra.run.smithi196.stdout:Get:118 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20240314.183243/3d78f5ba07bf18880172c07d4d7b4ac00c9d30af/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.0.0-2162-g3d78f5ba-1jammy [121 kB] 2024-03-17T23:52:29.405 INFO:teuthology.orchestra.run.smithi196.stdout:Get:119 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20240314.183243/3d78f5ba07bf18880172c07d4d7b4ac00c9d30af/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 19.0.0-2162-g3d78f5ba-1jammy [230 kB] 2024-03-17T23:52:29.409 INFO:teuthology.orchestra.run.smithi196.stdout:Get:120 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20240314.183243/3d78f5ba07bf18880172c07d4d7b4ac00c9d30af/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 19.0.0-2162-g3d78f5ba-1jammy [34.0 kB] 2024-03-17T23:52:29.411 INFO:teuthology.orchestra.run.smithi196.stdout:Get:121 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20240314.183243/3d78f5ba07bf18880172c07d4d7b4ac00c9d30af/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 19.0.0-2162-g3d78f5ba-1jammy [23.4 kB] 2024-03-17T23:52:29.411 INFO:teuthology.orchestra.run.smithi196.stdout:Get:122 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20240314.183243/3d78f5ba07bf18880172c07d4d7b4ac00c9d30af/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.0.0-2162-g3d78f5ba-1jammy [39.0 kB] 2024-03-17T23:52:29.412 INFO:teuthology.orchestra.run.smithi196.stdout:Get:123 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20240314.183243/3d78f5ba07bf18880172c07d4d7b4ac00c9d30af/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.0.0-2162-g3d78f5ba-1jammy [13.1 MB] 2024-03-17T23:52:29.787 INFO:teuthology.orchestra.run.smithi196.stdout:Get:124 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20240314.183243/3d78f5ba07bf18880172c07d4d7b4ac00c9d30af/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.0.0-2162-g3d78f5ba-1jammy [91.5 kB] 2024-03-17T23:52:30.391 INFO:teuthology.orchestra.run.smithi196.stdout:Fetched 178 MB in 6s (27.6 MB/s) 2024-03-17T23:52:30.595 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-pyperclip. 2024-03-17T23:52:30.697 INFO:teuthology.orchestra.run.smithi196.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165997 files and directories currently installed.) 2024-03-17T23:52:30.703 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2024-03-17T23:52:30.743 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2024-03-17T23:52:31.038 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-wcwidth. 2024-03-17T23:52:31.064 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-03-17T23:52:31.104 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-03-17T23:52:31.432 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-cmd2. 2024-03-17T23:52:31.459 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2024-03-17T23:52:31.499 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2024-03-17T23:52:31.835 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-03-17T23:52:31.861 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../003-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-03-17T23:52:31.944 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-03-17T23:52:32.289 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-03-17T23:52:32.315 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../004-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-03-17T23:52:32.355 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-03-17T23:52:32.708 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-03-17T23:52:32.734 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../005-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-03-17T23:52:32.775 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-03-17T23:52:32.778 INFO:teuthology.orchestra.run.smithi204.stdout:Get:103 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20240314.183243/3d78f5ba07bf18880172c07d4d7b4ac00c9d30af/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.0.0-2162-g3d78f5ba-1jammy [5,085 kB] 2024-03-17T23:52:33.145 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-03-17T23:52:33.171 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../006-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-03-17T23:52:33.220 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-03-17T23:52:33.352 INFO:teuthology.orchestra.run.smithi204.stdout:Get:104 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20240314.183243/3d78f5ba07bf18880172c07d4d7b4ac00c9d30af/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.0.0-2162-g3d78f5ba-1jammy [244 kB] 2024-03-17T23:52:33.364 INFO:teuthology.orchestra.run.smithi204.stdout:Get:105 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20240314.183243/3d78f5ba07bf18880172c07d4d7b4ac00c9d30af/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.0.0-2162-g3d78f5ba-1jammy [124 kB] 2024-03-17T23:52:33.389 INFO:teuthology.orchestra.run.smithi204.stdout:Get:106 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20240314.183243/3d78f5ba07bf18880172c07d4d7b4ac00c9d30af/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.0.0-2162-g3d78f5ba-1jammy [1,526 kB] 2024-03-17T23:52:33.568 INFO:teuthology.orchestra.run.smithi204.stdout:Get:107 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20240314.183243/3d78f5ba07bf18880172c07d4d7b4ac00c9d30af/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.0.0-2162-g3d78f5ba-1jammy [6,255 kB] 2024-03-17T23:52:33.598 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-03-17T23:52:33.624 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../007-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-03-17T23:52:33.673 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-03-17T23:52:34.018 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-03-17T23:52:34.044 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../008-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-03-17T23:52:34.084 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-03-17T23:52:34.293 INFO:teuthology.orchestra.run.smithi204.stdout:Get:108 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20240314.183243/3d78f5ba07bf18880172c07d4d7b4ac00c9d30af/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.0.0-2162-g3d78f5ba-1jammy [22.8 MB] 2024-03-17T23:52:34.454 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-03-17T23:52:34.480 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../009-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-03-17T23:52:34.520 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-03-17T23:52:34.806 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package librados2. 2024-03-17T23:52:34.830 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../010-librados2_19.0.0-2162-g3d78f5ba-1jammy_amd64.deb ... 2024-03-17T23:52:34.865 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking librados2 (19.0.0-2162-g3d78f5ba-1jammy) ... 2024-03-17T23:52:35.317 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package librbd1. 2024-03-17T23:52:35.344 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../011-librbd1_19.0.0-2162-g3d78f5ba-1jammy_amd64.deb ... 2024-03-17T23:52:35.384 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking librbd1 (19.0.0-2162-g3d78f5ba-1jammy) ... 2024-03-17T23:52:35.862 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package libcephfs2. 2024-03-17T23:52:35.889 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../012-libcephfs2_19.0.0-2162-g3d78f5ba-1jammy_amd64.deb ... 2024-03-17T23:52:35.928 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking libcephfs2 (19.0.0-2162-g3d78f5ba-1jammy) ... 2024-03-17T23:52:36.206 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-rados. 2024-03-17T23:52:36.232 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../013-python3-rados_19.0.0-2162-g3d78f5ba-1jammy_amd64.deb ... 2024-03-17T23:52:36.272 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-rados (19.0.0-2162-g3d78f5ba-1jammy) ... 2024-03-17T23:52:36.567 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-03-17T23:52:36.593 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../014-python3-ceph-argparse_19.0.0-2162-g3d78f5ba-1jammy_all.deb ... 2024-03-17T23:52:36.633 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-ceph-argparse (19.0.0-2162-g3d78f5ba-1jammy) ... 2024-03-17T23:52:36.820 INFO:teuthology.orchestra.run.smithi204.stdout:Get:109 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20240314.183243/3d78f5ba07bf18880172c07d4d7b4ac00c9d30af/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.0.0-2162-g3d78f5ba-1jammy [14.1 kB] 2024-03-17T23:52:36.820 INFO:teuthology.orchestra.run.smithi204.stdout:Get:110 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20240314.183243/3d78f5ba07bf18880172c07d4d7b4ac00c9d30af/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.0.0-2162-g3d78f5ba-1jammy [870 kB] 2024-03-17T23:52:36.869 INFO:teuthology.orchestra.run.smithi204.stdout:Get:111 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20240314.183243/3d78f5ba07bf18880172c07d4d7b4ac00c9d30af/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.0.0-2162-g3d78f5ba-1jammy [2,434 kB] 2024-03-17T23:52:36.877 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-cephfs. 2024-03-17T23:52:36.893 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../015-python3-cephfs_19.0.0-2162-g3d78f5ba-1jammy_amd64.deb ... 2024-03-17T23:52:36.936 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-cephfs (19.0.0-2162-g3d78f5ba-1jammy) ... 2024-03-17T23:52:37.089 INFO:teuthology.orchestra.run.smithi204.stdout:Get:112 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20240314.183243/3d78f5ba07bf18880172c07d4d7b4ac00c9d30af/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.0.0-2162-g3d78f5ba-1jammy [777 kB] 2024-03-17T23:52:37.160 INFO:teuthology.orchestra.run.smithi204.stdout:Get:113 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20240314.183243/3d78f5ba07bf18880172c07d4d7b4ac00c9d30af/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.0.0-2162-g3d78f5ba-1jammy [144 kB] 2024-03-17T23:52:37.189 INFO:teuthology.orchestra.run.smithi204.stdout:Get:114 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20240314.183243/3d78f5ba07bf18880172c07d4d7b4ac00c9d30af/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.0.0-2162-g3d78f5ba-1jammy [1,936 kB] 2024-03-17T23:52:37.247 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-ceph-common. 2024-03-17T23:52:37.273 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../016-python3-ceph-common_19.0.0-2162-g3d78f5ba-1jammy_all.deb ... 2024-03-17T23:52:37.313 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-ceph-common (19.0.0-2162-g3d78f5ba-1jammy) ... 2024-03-17T23:52:37.377 INFO:teuthology.orchestra.run.smithi204.stdout:Get:115 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20240314.183243/3d78f5ba07bf18880172c07d4d7b4ac00c9d30af/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.0.0-2162-g3d78f5ba-1jammy [8,625 kB] 2024-03-17T23:52:37.641 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-prettytable. 2024-03-17T23:52:37.668 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../017-python3-prettytable_2.5.0-2_all.deb ... 2024-03-17T23:52:37.708 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-03-17T23:52:37.969 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-rbd. 2024-03-17T23:52:37.995 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../018-python3-rbd_19.0.0-2162-g3d78f5ba-1jammy_amd64.deb ... 2024-03-17T23:52:38.035 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-rbd (19.0.0-2162-g3d78f5ba-1jammy) ... 2024-03-17T23:52:38.101 INFO:teuthology.orchestra.run.smithi204.stdout:Get:116 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20240314.183243/3d78f5ba07bf18880172c07d4d7b4ac00c9d30af/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.0.0-2162-g3d78f5ba-1jammy [14.2 kB] 2024-03-17T23:52:38.102 INFO:teuthology.orchestra.run.smithi204.stdout:Get:117 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20240314.183243/3d78f5ba07bf18880172c07d4d7b4ac00c9d30af/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.0.0-2162-g3d78f5ba-1jammy [50.2 MB] 2024-03-17T23:52:38.346 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-03-17T23:52:38.373 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../019-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-03-17T23:52:38.404 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-03-17T23:52:38.699 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-03-17T23:52:38.714 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../020-libreadline-dev_8.1.2-1_amd64.deb ... 2024-03-17T23:52:38.757 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-03-17T23:52:39.043 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-03-17T23:52:39.059 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../021-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-03-17T23:52:39.102 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-03-17T23:52:39.664 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package lua5.1. 2024-03-17T23:52:39.690 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../022-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-03-17T23:52:39.730 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-03-17T23:52:40.050 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package lua-any. 2024-03-17T23:52:40.077 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../023-lua-any_27ubuntu1_all.deb ... 2024-03-17T23:52:40.116 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking lua-any (27ubuntu1) ... 2024-03-17T23:52:40.319 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package zip. 2024-03-17T23:52:40.334 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../024-zip_3.0-12build2_amd64.deb ... 2024-03-17T23:52:40.369 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking zip (3.0-12build2) ... 2024-03-17T23:52:40.663 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package unzip. 2024-03-17T23:52:40.690 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../025-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-03-17T23:52:40.730 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-03-17T23:52:41.134 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package luarocks. 2024-03-17T23:52:41.161 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../026-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-03-17T23:52:41.200 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-03-17T23:52:41.387 INFO:teuthology.orchestra.run.smithi204.stdout:Get:118 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20240314.183243/3d78f5ba07bf18880172c07d4d7b4ac00c9d30af/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.0.0-2162-g3d78f5ba-1jammy [121 kB] 2024-03-17T23:52:41.390 INFO:teuthology.orchestra.run.smithi204.stdout:Get:119 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20240314.183243/3d78f5ba07bf18880172c07d4d7b4ac00c9d30af/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 19.0.0-2162-g3d78f5ba-1jammy [230 kB] 2024-03-17T23:52:41.396 INFO:teuthology.orchestra.run.smithi204.stdout:Get:120 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20240314.183243/3d78f5ba07bf18880172c07d4d7b4ac00c9d30af/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 19.0.0-2162-g3d78f5ba-1jammy [34.0 kB] 2024-03-17T23:52:41.397 INFO:teuthology.orchestra.run.smithi204.stdout:Get:121 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20240314.183243/3d78f5ba07bf18880172c07d4d7b4ac00c9d30af/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 19.0.0-2162-g3d78f5ba-1jammy [23.4 kB] 2024-03-17T23:52:41.398 INFO:teuthology.orchestra.run.smithi204.stdout:Get:122 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20240314.183243/3d78f5ba07bf18880172c07d4d7b4ac00c9d30af/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.0.0-2162-g3d78f5ba-1jammy [39.0 kB] 2024-03-17T23:52:41.399 INFO:teuthology.orchestra.run.smithi204.stdout:Get:123 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20240314.183243/3d78f5ba07bf18880172c07d4d7b4ac00c9d30af/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.0.0-2162-g3d78f5ba-1jammy [13.1 MB] 2024-03-17T23:52:41.591 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package librgw2. 2024-03-17T23:52:41.618 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../027-librgw2_19.0.0-2162-g3d78f5ba-1jammy_amd64.deb ... 2024-03-17T23:52:41.658 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking librgw2 (19.0.0-2162-g3d78f5ba-1jammy) ... 2024-03-17T23:52:41.805 INFO:teuthology.orchestra.run.smithi204.stdout:Get:124 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20240314.183243/3d78f5ba07bf18880172c07d4d7b4ac00c9d30af/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.0.0-2162-g3d78f5ba-1jammy [91.5 kB] 2024-03-17T23:52:42.227 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-rgw. 2024-03-17T23:52:42.254 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../028-python3-rgw_19.0.0-2162-g3d78f5ba-1jammy_amd64.deb ... 2024-03-17T23:52:42.302 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-rgw (19.0.0-2162-g3d78f5ba-1jammy) ... 2024-03-17T23:52:42.421 INFO:teuthology.orchestra.run.smithi204.stdout:Fetched 178 MB in 18s (9,769 kB/s) 2024-03-17T23:52:42.535 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python3-pyperclip. 2024-03-17T23:52:42.591 INFO:teuthology.orchestra.run.smithi204.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165997 files and directories currently installed.) 2024-03-17T23:52:42.596 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2024-03-17T23:52:42.634 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2024-03-17T23:52:42.721 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package liboath0:amd64. 2024-03-17T23:52:42.748 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../029-liboath0_2.6.7-3build1_amd64.deb ... 2024-03-17T23:52:42.796 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-03-17T23:52:42.878 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python3-wcwidth. 2024-03-17T23:52:42.893 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-03-17T23:52:42.936 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-03-17T23:52:43.108 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package libradosstriper1. 2024-03-17T23:52:43.134 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../030-libradosstriper1_19.0.0-2162-g3d78f5ba-1jammy_amd64.deb ... 2024-03-17T23:52:43.174 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking libradosstriper1 (19.0.0-2162-g3d78f5ba-1jammy) ... 2024-03-17T23:52:43.264 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python3-cmd2. 2024-03-17T23:52:43.291 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2024-03-17T23:52:43.331 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2024-03-17T23:52:43.602 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package ceph-common. 2024-03-17T23:52:43.629 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../031-ceph-common_19.0.0-2162-g3d78f5ba-1jammy_amd64.deb ... 2024-03-17T23:52:43.677 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking ceph-common (19.0.0-2162-g3d78f5ba-1jammy) ... 2024-03-17T23:52:43.684 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-03-17T23:52:43.710 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../003-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-03-17T23:52:43.793 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-03-17T23:52:44.146 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-03-17T23:52:44.172 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../004-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-03-17T23:52:44.213 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-03-17T23:52:44.530 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-03-17T23:52:44.556 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../005-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-03-17T23:52:44.591 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-03-17T23:52:45.044 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-03-17T23:52:45.071 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../006-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-03-17T23:52:45.107 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package ceph-base. 2024-03-17T23:52:45.120 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-03-17T23:52:45.134 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../032-ceph-base_19.0.0-2162-g3d78f5ba-1jammy_amd64.deb ... 2024-03-17T23:52:45.192 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking ceph-base (19.0.0-2162-g3d78f5ba-1jammy) ... 2024-03-17T23:52:45.539 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-03-17T23:52:45.566 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../007-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-03-17T23:52:45.606 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-03-17T23:52:45.761 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-03-17T23:52:45.777 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../033-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-03-17T23:52:45.811 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-03-17T23:52:45.967 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-03-17T23:52:45.994 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../008-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-03-17T23:52:46.034 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-03-17T23:52:46.081 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-cheroot. 2024-03-17T23:52:46.108 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../034-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-03-17T23:52:46.147 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-03-17T23:52:46.354 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-03-17T23:52:46.380 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../009-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-03-17T23:52:46.412 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-03-17T23:52:46.442 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-03-17T23:52:46.469 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../035-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-03-17T23:52:46.500 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-03-17T23:52:46.723 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package librados2. 2024-03-17T23:52:46.749 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../010-librados2_19.0.0-2162-g3d78f5ba-1jammy_amd64.deb ... 2024-03-17T23:52:46.790 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking librados2 (19.0.0-2162-g3d78f5ba-1jammy) ... 2024-03-17T23:52:46.795 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-jaraco.text. 2024-03-17T23:52:46.822 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../036-python3-jaraco.text_3.6.0-2_all.deb ... 2024-03-17T23:52:46.861 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-03-17T23:52:47.164 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-03-17T23:52:47.191 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../037-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-03-17T23:52:47.230 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-03-17T23:52:47.426 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package librbd1. 2024-03-17T23:52:47.453 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../011-librbd1_19.0.0-2162-g3d78f5ba-1jammy_amd64.deb ... 2024-03-17T23:52:47.493 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking librbd1 (19.0.0-2162-g3d78f5ba-1jammy) ... 2024-03-17T23:52:47.502 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-tempora. 2024-03-17T23:52:47.529 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../038-python3-tempora_4.1.2-1_all.deb ... 2024-03-17T23:52:47.569 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-03-17T23:52:47.871 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-portend. 2024-03-17T23:52:47.898 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../039-python3-portend_3.0.0-1_all.deb ... 2024-03-17T23:52:47.929 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package libcephfs2. 2024-03-17T23:52:47.938 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-03-17T23:52:47.955 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../012-libcephfs2_19.0.0-2162-g3d78f5ba-1jammy_amd64.deb ... 2024-03-17T23:52:47.995 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking libcephfs2 (19.0.0-2162-g3d78f5ba-1jammy) ... 2024-03-17T23:52:48.241 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-03-17T23:52:48.264 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python3-rados. 2024-03-17T23:52:48.268 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../040-python3-zc.lockfile_2.0-1_all.deb ... 2024-03-17T23:52:48.280 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../013-python3-rados_19.0.0-2162-g3d78f5ba-1jammy_amd64.deb ... 2024-03-17T23:52:48.307 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-03-17T23:52:48.314 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python3-rados (19.0.0-2162-g3d78f5ba-1jammy) ... 2024-03-17T23:52:48.585 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-cherrypy3. 2024-03-17T23:52:48.612 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../041-python3-cherrypy3_18.6.1-4_all.deb ... 2024-03-17T23:52:48.634 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-03-17T23:52:48.643 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-03-17T23:52:48.660 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../014-python3-ceph-argparse_19.0.0-2162-g3d78f5ba-1jammy_all.deb ... 2024-03-17T23:52:48.701 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python3-ceph-argparse (19.0.0-2162-g3d78f5ba-1jammy) ... 2024-03-17T23:52:48.953 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python3-cephfs. 2024-03-17T23:52:48.979 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../015-python3-cephfs_19.0.0-2162-g3d78f5ba-1jammy_amd64.deb ... 2024-03-17T23:52:49.016 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-natsort. 2024-03-17T23:52:49.020 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python3-cephfs (19.0.0-2162-g3d78f5ba-1jammy) ... 2024-03-17T23:52:49.043 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../042-python3-natsort_8.0.2-1_all.deb ... 2024-03-17T23:52:49.088 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-03-17T23:52:49.331 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python3-ceph-common. 2024-03-17T23:52:49.357 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../016-python3-ceph-common_19.0.0-2162-g3d78f5ba-1jammy_all.deb ... 2024-03-17T23:52:49.397 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python3-ceph-common (19.0.0-2162-g3d78f5ba-1jammy) ... 2024-03-17T23:52:49.399 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-logutils. 2024-03-17T23:52:49.427 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../043-python3-logutils_0.3.3-8_all.deb ... 2024-03-17T23:52:49.466 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-03-17T23:52:49.719 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-markupsafe. 2024-03-17T23:52:49.726 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python3-prettytable. 2024-03-17T23:52:49.734 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../044-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-03-17T23:52:49.752 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../017-python3-prettytable_2.5.0-2_all.deb ... 2024-03-17T23:52:49.769 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-03-17T23:52:49.792 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-03-17T23:52:50.053 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python3-rbd. 2024-03-17T23:52:50.068 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../018-python3-rbd_19.0.0-2162-g3d78f5ba-1jammy_amd64.deb ... 2024-03-17T23:52:50.072 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-mako. 2024-03-17T23:52:50.100 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../045-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-03-17T23:52:50.103 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python3-rbd (19.0.0-2162-g3d78f5ba-1jammy) ... 2024-03-17T23:52:50.138 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-03-17T23:52:50.439 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-03-17T23:52:50.466 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../019-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-03-17T23:52:50.466 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-simplegeneric. 2024-03-17T23:52:50.493 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../046-python3-simplegeneric_0.8.1-3_all.deb ... 2024-03-17T23:52:50.506 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-03-17T23:52:50.533 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-03-17T23:52:50.792 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-03-17T23:52:50.818 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../020-libreadline-dev_8.1.2-1_amd64.deb ... 2024-03-17T23:52:50.836 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-singledispatch. 2024-03-17T23:52:50.859 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-03-17T23:52:50.862 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../047-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-03-17T23:52:50.902 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-03-17T23:52:51.170 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-03-17T23:52:51.171 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-webob. 2024-03-17T23:52:51.185 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../021-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-03-17T23:52:51.198 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../048-python3-webob_1%3a1.8.6-1.1_all.deb ... 2024-03-17T23:52:51.228 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-03-17T23:52:51.229 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2024-03-17T23:52:51.515 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package lua5.1. 2024-03-17T23:52:51.530 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../022-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-03-17T23:52:51.549 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-waitress. 2024-03-17T23:52:51.573 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-03-17T23:52:51.576 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../049-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-03-17T23:52:51.618 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-03-17T23:52:51.918 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package lua-any. 2024-03-17T23:52:51.927 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-tempita. 2024-03-17T23:52:51.933 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../023-lua-any_27ubuntu1_all.deb ... 2024-03-17T23:52:51.954 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../050-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-03-17T23:52:51.977 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking lua-any (27ubuntu1) ... 2024-03-17T23:52:51.994 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-03-17T23:52:52.237 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package zip. 2024-03-17T23:52:52.252 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../024-zip_3.0-12build2_amd64.deb ... 2024-03-17T23:52:52.296 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking zip (3.0-12build2) ... 2024-03-17T23:52:52.321 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-paste. 2024-03-17T23:52:52.348 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../051-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-03-17T23:52:52.388 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-03-17T23:52:52.691 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-03-17T23:52:52.715 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package unzip. 2024-03-17T23:52:52.718 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../052-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-03-17T23:52:52.731 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../025-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-03-17T23:52:52.757 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-03-17T23:52:52.765 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-03-17T23:52:53.086 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-pastedeploy. 2024-03-17T23:52:53.113 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../053-python3-pastedeploy_2.1.1-1_all.deb ... 2024-03-17T23:52:53.152 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-03-17T23:52:53.161 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package luarocks. 2024-03-17T23:52:53.187 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../026-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-03-17T23:52:53.228 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-03-17T23:52:53.463 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-webtest. 2024-03-17T23:52:53.490 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../054-python3-webtest_2.0.35-1_all.deb ... 2024-03-17T23:52:53.530 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-03-17T23:52:53.619 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package librgw2. 2024-03-17T23:52:53.645 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../027-librgw2_19.0.0-2162-g3d78f5ba-1jammy_amd64.deb ... 2024-03-17T23:52:53.685 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking librgw2 (19.0.0-2162-g3d78f5ba-1jammy) ... 2024-03-17T23:52:53.799 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-pecan. 2024-03-17T23:52:53.826 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../055-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-03-17T23:52:53.865 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-03-17T23:52:54.170 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-certifi. 2024-03-17T23:52:54.197 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../056-python3-certifi_2020.6.20-1_all.deb ... 2024-03-17T23:52:54.221 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python3-rgw. 2024-03-17T23:52:54.228 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-03-17T23:52:54.236 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../028-python3-rgw_19.0.0-2162-g3d78f5ba-1jammy_amd64.deb ... 2024-03-17T23:52:54.271 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python3-rgw (19.0.0-2162-g3d78f5ba-1jammy) ... 2024-03-17T23:52:54.532 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package liboath0:amd64. 2024-03-17T23:52:54.539 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-idna. 2024-03-17T23:52:54.558 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../029-liboath0_2.6.7-3build1_amd64.deb ... 2024-03-17T23:52:54.566 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../057-python3-idna_3.3-1_all.deb ... 2024-03-17T23:52:54.599 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-03-17T23:52:54.606 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-idna (3.3-1) ... 2024-03-17T23:52:54.927 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package libradosstriper1. 2024-03-17T23:52:54.953 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../030-libradosstriper1_19.0.0-2162-g3d78f5ba-1jammy_amd64.deb ... 2024-03-17T23:52:54.993 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking libradosstriper1 (19.0.0-2162-g3d78f5ba-1jammy) ... 2024-03-17T23:52:55.125 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-urllib3. 2024-03-17T23:52:55.152 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../058-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-03-17T23:52:55.209 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-03-17T23:52:55.422 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package ceph-common. 2024-03-17T23:52:55.448 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../031-ceph-common_19.0.0-2162-g3d78f5ba-1jammy_amd64.deb ... 2024-03-17T23:52:55.488 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking ceph-common (19.0.0-2162-g3d78f5ba-1jammy) ... 2024-03-17T23:52:55.537 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-requests. 2024-03-17T23:52:55.564 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../059-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-03-17T23:52:55.603 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-03-17T23:52:55.914 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-werkzeug. 2024-03-17T23:52:55.941 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../060-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2024-03-17T23:52:55.981 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-03-17T23:52:56.259 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-03-17T23:52:56.275 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../061-ceph-mgr-modules-core_19.0.0-2162-g3d78f5ba-1jammy_all.deb ... 2024-03-17T23:52:56.317 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking ceph-mgr-modules-core (19.0.0-2162-g3d78f5ba-1jammy) ... 2024-03-17T23:52:56.769 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package ceph-base. 2024-03-17T23:52:56.795 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../032-ceph-base_19.0.0-2162-g3d78f5ba-1jammy_amd64.deb ... 2024-03-17T23:52:57.172 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-03-17T23:52:57.200 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../062-libsqlite3-mod-ceph_19.0.0-2162-g3d78f5ba-1jammy_amd64.deb ... 2024-03-17T23:52:57.303 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking ceph-base (19.0.0-2162-g3d78f5ba-1jammy) ... 2024-03-17T23:52:57.539 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking libsqlite3-mod-ceph (19.0.0-2162-g3d78f5ba-1jammy) ... 2024-03-17T23:52:57.850 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-bcrypt. 2024-03-17T23:52:57.877 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../063-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-03-17T23:52:57.916 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-03-17T23:52:58.140 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-03-17T23:52:58.167 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../033-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-03-17T23:52:58.206 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-03-17T23:52:58.219 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-openssl. 2024-03-17T23:52:58.247 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../064-python3-openssl_21.0.0-1_all.deb ... 2024-03-17T23:52:58.286 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-03-17T23:52:58.518 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python3-cheroot. 2024-03-17T23:52:58.545 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../034-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-03-17T23:52:58.581 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package ceph-mgr. 2024-03-17T23:52:58.584 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-03-17T23:52:58.607 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../065-ceph-mgr_19.0.0-2162-g3d78f5ba-1jammy_amd64.deb ... 2024-03-17T23:52:58.638 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking ceph-mgr (19.0.0-2162-g3d78f5ba-1jammy) ... 2024-03-17T23:52:58.904 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-03-17T23:52:58.931 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../035-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-03-17T23:52:58.971 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-03-17T23:52:59.042 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package ceph-mon. 2024-03-17T23:52:59.069 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../066-ceph-mon_19.0.0-2162-g3d78f5ba-1jammy_amd64.deb ... 2024-03-17T23:52:59.108 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking ceph-mon (19.0.0-2162-g3d78f5ba-1jammy) ... 2024-03-17T23:52:59.282 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python3-jaraco.text. 2024-03-17T23:52:59.309 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../036-python3-jaraco.text_3.6.0-2_all.deb ... 2024-03-17T23:52:59.348 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-03-17T23:52:59.610 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-03-17T23:52:59.625 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../037-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-03-17T23:52:59.660 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-03-17T23:52:59.812 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package ceph-osd. 2024-03-17T23:52:59.839 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../067-ceph-osd_19.0.0-2162-g3d78f5ba-1jammy_amd64.deb ... 2024-03-17T23:52:59.886 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking ceph-osd (19.0.0-2162-g3d78f5ba-1jammy) ... 2024-03-17T23:52:59.979 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python3-tempora. 2024-03-17T23:53:00.006 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../038-python3-tempora_4.1.2-1_all.deb ... 2024-03-17T23:53:00.046 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-03-17T23:53:00.332 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python3-portend. 2024-03-17T23:53:00.358 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../039-python3-portend_3.0.0-1_all.deb ... 2024-03-17T23:53:00.398 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-03-17T23:53:00.693 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-03-17T23:53:00.720 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../040-python3-zc.lockfile_2.0-1_all.deb ... 2024-03-17T23:53:00.760 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-03-17T23:53:00.956 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package ceph. 2024-03-17T23:53:00.983 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../068-ceph_19.0.0-2162-g3d78f5ba-1jammy_amd64.deb ... 2024-03-17T23:53:01.012 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python3-cherrypy3. 2024-03-17T23:53:01.022 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking ceph (19.0.0-2162-g3d78f5ba-1jammy) ... 2024-03-17T23:53:01.028 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../041-python3-cherrypy3_18.6.1-4_all.deb ... 2024-03-17T23:53:01.062 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-03-17T23:53:01.359 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package ceph-fuse. 2024-03-17T23:53:01.386 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../069-ceph-fuse_19.0.0-2162-g3d78f5ba-1jammy_amd64.deb ... 2024-03-17T23:53:01.391 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python3-natsort. 2024-03-17T23:53:01.418 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../042-python3-natsort_8.0.2-1_all.deb ... 2024-03-17T23:53:01.425 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking ceph-fuse (19.0.0-2162-g3d78f5ba-1jammy) ... 2024-03-17T23:53:01.457 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-03-17T23:53:01.744 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python3-logutils. 2024-03-17T23:53:01.770 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../043-python3-logutils_0.3.3-8_all.deb ... 2024-03-17T23:53:01.802 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-03-17T23:53:01.878 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package ceph-mds. 2024-03-17T23:53:01.905 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../070-ceph-mds_19.0.0-2162-g3d78f5ba-1jammy_amd64.deb ... 2024-03-17T23:53:01.953 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking ceph-mds (19.0.0-2162-g3d78f5ba-1jammy) ... 2024-03-17T23:53:02.089 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python3-markupsafe. 2024-03-17T23:53:02.115 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../044-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-03-17T23:53:02.155 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-03-17T23:53:02.331 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package cephadm. 2024-03-17T23:53:02.358 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../071-cephadm_19.0.0-2162-g3d78f5ba-1jammy_amd64.deb ... 2024-03-17T23:53:02.397 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking cephadm (19.0.0-2162-g3d78f5ba-1jammy) ... 2024-03-17T23:53:02.458 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python3-mako. 2024-03-17T23:53:02.484 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../045-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-03-17T23:53:02.524 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-03-17T23:53:02.692 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-asyncssh. 2024-03-17T23:53:02.719 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../072-python3-asyncssh_2.5.0-1_all.deb ... 2024-03-17T23:53:02.767 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-03-17T23:53:02.853 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python3-simplegeneric. 2024-03-17T23:53:02.879 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../046-python3-simplegeneric_0.8.1-3_all.deb ... 2024-03-17T23:53:02.919 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-03-17T23:53:03.078 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python-babel-localedata. 2024-03-17T23:53:03.094 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../073-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-03-17T23:53:03.127 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-03-17T23:53:03.164 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python3-singledispatch. 2024-03-17T23:53:03.190 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../047-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-03-17T23:53:03.230 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-03-17T23:53:03.533 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python3-webob. 2024-03-17T23:53:03.560 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../048-python3-webob_1%3a1.8.6-1.1_all.deb ... 2024-03-17T23:53:03.600 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2024-03-17T23:53:03.986 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python3-waitress. 2024-03-17T23:53:04.013 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../049-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-03-17T23:53:04.056 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-03-17T23:53:04.116 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-babel. 2024-03-17T23:53:04.143 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../074-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-03-17T23:53:04.182 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-03-17T23:53:04.339 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python3-tempita. 2024-03-17T23:53:04.354 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../050-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-03-17T23:53:04.389 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-03-17T23:53:04.510 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-jinja2. 2024-03-17T23:53:04.537 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../075-python3-jinja2_3.0.3-1ubuntu0.1_all.deb ... 2024-03-17T23:53:04.577 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-03-17T23:53:04.667 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python3-paste. 2024-03-17T23:53:04.693 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../051-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-03-17T23:53:04.733 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-03-17T23:53:04.921 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-03-17T23:53:04.949 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../076-ceph-mgr-cephadm_19.0.0-2162-g3d78f5ba-1jammy_all.deb ... 2024-03-17T23:53:04.988 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking ceph-mgr-cephadm (19.0.0-2162-g3d78f5ba-1jammy) ... 2024-03-17T23:53:05.062 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-03-17T23:53:05.077 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../052-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-03-17T23:53:05.120 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-03-17T23:53:05.316 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-repoze.lru. 2024-03-17T23:53:05.343 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../077-python3-repoze.lru_0.7-2_all.deb ... 2024-03-17T23:53:05.405 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-03-17T23:53:05.406 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python3-pastedeploy. 2024-03-17T23:53:05.433 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../053-python3-pastedeploy_2.1.1-1_all.deb ... 2024-03-17T23:53:05.464 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-03-17T23:53:05.719 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-routes. 2024-03-17T23:53:05.734 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python3-webtest. 2024-03-17T23:53:05.746 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../078-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-03-17T23:53:05.749 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../054-python3-webtest_2.0.35-1_all.deb ... 2024-03-17T23:53:05.785 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-03-17T23:53:05.792 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-03-17T23:53:06.104 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python3-pecan. 2024-03-17T23:53:06.121 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-03-17T23:53:06.130 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../055-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-03-17T23:53:06.149 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../079-ceph-mgr-dashboard_19.0.0-2162-g3d78f5ba-1jammy_all.deb ... 2024-03-17T23:53:06.170 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-03-17T23:53:06.188 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking ceph-mgr-dashboard (19.0.0-2162-g3d78f5ba-1jammy) ... 2024-03-17T23:53:06.525 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python3-certifi. 2024-03-17T23:53:06.551 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../056-python3-certifi_2020.6.20-1_all.deb ... 2024-03-17T23:53:06.591 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-03-17T23:53:06.624 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-03-17T23:53:06.652 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../080-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-03-17T23:53:06.682 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-03-17T23:53:06.911 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python3-idna. 2024-03-17T23:53:06.938 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../057-python3-idna_3.3-1_all.deb ... 2024-03-17T23:53:06.986 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python3-idna (3.3-1) ... 2024-03-17T23:53:07.161 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-joblib. 2024-03-17T23:53:07.188 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../081-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-03-17T23:53:07.227 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-03-17T23:53:07.272 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python3-urllib3. 2024-03-17T23:53:07.299 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../058-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-03-17T23:53:07.339 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-03-17T23:53:07.589 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-03-17T23:53:07.616 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../082-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-03-17T23:53:07.700 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python3-requests. 2024-03-17T23:53:07.727 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../059-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-03-17T23:53:07.749 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-03-17T23:53:07.767 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-03-17T23:53:08.021 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python3-werkzeug. 2024-03-17T23:53:08.036 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-sklearn. 2024-03-17T23:53:08.046 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../060-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2024-03-17T23:53:08.063 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../083-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-03-17T23:53:08.102 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-03-17T23:53:08.261 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-03-17T23:53:08.556 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-03-17T23:53:08.572 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../061-ceph-mgr-modules-core_19.0.0-2162-g3d78f5ba-1jammy_all.deb ... 2024-03-17T23:53:08.606 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking ceph-mgr-modules-core (19.0.0-2162-g3d78f5ba-1jammy) ... 2024-03-17T23:53:08.761 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-03-17T23:53:08.788 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../084-ceph-mgr-diskprediction-local_19.0.0-2162-g3d78f5ba-1jammy_all.deb ... 2024-03-17T23:53:08.827 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking ceph-mgr-diskprediction-local (19.0.0-2162-g3d78f5ba-1jammy) ... 2024-03-17T23:53:08.995 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-03-17T23:53:09.021 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../062-libsqlite3-mod-ceph_19.0.0-2162-g3d78f5ba-1jammy_amd64.deb ... 2024-03-17T23:53:09.061 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking libsqlite3-mod-ceph (19.0.0-2162-g3d78f5ba-1jammy) ... 2024-03-17T23:53:09.380 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python3-bcrypt. 2024-03-17T23:53:09.407 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../063-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-03-17T23:53:09.447 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-03-17T23:53:09.716 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python3-openssl. 2024-03-17T23:53:09.743 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../064-python3-openssl_21.0.0-1_all.deb ... 2024-03-17T23:53:09.755 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-cachetools. 2024-03-17T23:53:09.774 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-03-17T23:53:09.782 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../085-python3-cachetools_5.0.0-1_all.deb ... 2024-03-17T23:53:09.821 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-03-17T23:53:10.095 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package ceph-mgr. 2024-03-17T23:53:10.108 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-pyasn1. 2024-03-17T23:53:10.121 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../065-ceph-mgr_19.0.0-2162-g3d78f5ba-1jammy_amd64.deb ... 2024-03-17T23:53:10.135 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../086-python3-pyasn1_0.4.8-1_all.deb ... 2024-03-17T23:53:10.161 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking ceph-mgr (19.0.0-2162-g3d78f5ba-1jammy) ... 2024-03-17T23:53:10.174 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-03-17T23:53:10.511 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-03-17T23:53:10.538 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../087-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-03-17T23:53:10.556 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package ceph-mon. 2024-03-17T23:53:10.577 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-03-17T23:53:10.582 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../066-ceph-mon_19.0.0-2162-g3d78f5ba-1jammy_amd64.deb ... 2024-03-17T23:53:10.622 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking ceph-mon (19.0.0-2162-g3d78f5ba-1jammy) ... 2024-03-17T23:53:10.889 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-rsa. 2024-03-17T23:53:10.916 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../088-python3-rsa_4.8-1_all.deb ... 2024-03-17T23:53:10.955 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-rsa (4.8-1) ... 2024-03-17T23:53:11.185 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package ceph-osd. 2024-03-17T23:53:11.211 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../067-ceph-osd_19.0.0-2162-g3d78f5ba-1jammy_amd64.deb ... 2024-03-17T23:53:11.251 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking ceph-osd (19.0.0-2162-g3d78f5ba-1jammy) ... 2024-03-17T23:53:11.267 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-google-auth. 2024-03-17T23:53:11.294 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../089-python3-google-auth_1.5.1-3_all.deb ... 2024-03-17T23:53:11.342 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-03-17T23:53:11.720 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-03-17T23:53:11.747 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../090-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-03-17T23:53:11.795 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-03-17T23:53:12.173 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-websocket. 2024-03-17T23:53:12.200 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../091-python3-websocket_1.2.3-1_all.deb ... 2024-03-17T23:53:12.248 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-03-17T23:53:12.312 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package ceph. 2024-03-17T23:53:12.328 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../068-ceph_19.0.0-2162-g3d78f5ba-1jammy_amd64.deb ... 2024-03-17T23:53:12.371 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking ceph (19.0.0-2162-g3d78f5ba-1jammy) ... 2024-03-17T23:53:12.584 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-kubernetes. 2024-03-17T23:53:12.612 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../092-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-03-17T23:53:12.651 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-03-17T23:53:12.690 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package ceph-fuse. 2024-03-17T23:53:12.717 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../069-ceph-fuse_19.0.0-2162-g3d78f5ba-1jammy_amd64.deb ... 2024-03-17T23:53:12.756 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking ceph-fuse (19.0.0-2162-g3d78f5ba-1jammy) ... 2024-03-17T23:53:13.151 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package ceph-mds. 2024-03-17T23:53:13.178 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../070-ceph-mds_19.0.0-2162-g3d78f5ba-1jammy_amd64.deb ... 2024-03-17T23:53:13.218 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking ceph-mds (19.0.0-2162-g3d78f5ba-1jammy) ... 2024-03-17T23:53:13.331 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-03-17T23:53:13.359 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../093-ceph-mgr-k8sevents_19.0.0-2162-g3d78f5ba-1jammy_all.deb ... 2024-03-17T23:53:13.397 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking ceph-mgr-k8sevents (19.0.0-2162-g3d78f5ba-1jammy) ... 2024-03-17T23:53:13.623 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package cephadm. 2024-03-17T23:53:13.650 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../071-cephadm_19.0.0-2162-g3d78f5ba-1jammy_amd64.deb ... 2024-03-17T23:53:13.689 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking cephadm (19.0.0-2162-g3d78f5ba-1jammy) ... 2024-03-17T23:53:13.734 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package libonig5:amd64. 2024-03-17T23:53:13.762 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../094-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-03-17T23:53:13.808 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-03-17T23:53:14.009 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python3-asyncssh. 2024-03-17T23:53:14.036 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../072-python3-asyncssh_2.5.0-1_all.deb ... 2024-03-17T23:53:14.089 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-03-17T23:53:14.153 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package libjq1:amd64. 2024-03-17T23:53:14.181 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../095-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-03-17T23:53:14.220 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-03-17T23:53:14.395 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python-babel-localedata. 2024-03-17T23:53:14.410 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../073-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-03-17T23:53:14.453 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-03-17T23:53:14.489 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package jq. 2024-03-17T23:53:14.504 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../096-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-03-17T23:53:14.547 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-03-17T23:53:14.783 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package socat. 2024-03-17T23:53:14.799 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../097-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-03-17T23:53:14.832 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-03-17T23:53:15.094 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package xmlstarlet. 2024-03-17T23:53:15.111 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../098-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-03-17T23:53:15.152 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-03-17T23:53:15.484 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python3-babel. 2024-03-17T23:53:15.506 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package ceph-test. 2024-03-17T23:53:15.510 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../074-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-03-17T23:53:15.522 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../099-ceph-test_19.0.0-2162-g3d78f5ba-1jammy_amd64.deb ... 2024-03-17T23:53:15.550 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-03-17T23:53:15.556 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking ceph-test (19.0.0-2162-g3d78f5ba-1jammy) ... 2024-03-17T23:53:15.853 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python3-jinja2. 2024-03-17T23:53:15.880 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../075-python3-jinja2_3.0.3-1ubuntu0.1_all.deb ... 2024-03-17T23:53:15.919 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-03-17T23:53:16.298 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-03-17T23:53:16.325 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../076-ceph-mgr-cephadm_19.0.0-2162-g3d78f5ba-1jammy_all.deb ... 2024-03-17T23:53:16.431 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking ceph-mgr-cephadm (19.0.0-2162-g3d78f5ba-1jammy) ... 2024-03-17T23:53:16.784 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python3-repoze.lru. 2024-03-17T23:53:16.812 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../077-python3-repoze.lru_0.7-2_all.deb ... 2024-03-17T23:53:16.851 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-03-17T23:53:17.137 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python3-routes. 2024-03-17T23:53:17.164 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../078-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-03-17T23:53:17.204 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-03-17T23:53:17.541 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-03-17T23:53:17.567 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../079-ceph-mgr-dashboard_19.0.0-2162-g3d78f5ba-1jammy_all.deb ... 2024-03-17T23:53:17.607 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking ceph-mgr-dashboard (19.0.0-2162-g3d78f5ba-1jammy) ... 2024-03-17T23:53:18.002 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package ceph-volume. 2024-03-17T23:53:18.030 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../100-ceph-volume_19.0.0-2162-g3d78f5ba-1jammy_all.deb ... 2024-03-17T23:53:18.043 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-03-17T23:53:18.059 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../080-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-03-17T23:53:18.068 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking ceph-volume (19.0.0-2162-g3d78f5ba-1jammy) ... 2024-03-17T23:53:18.102 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-03-17T23:53:18.448 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package cephfs-mirror. 2024-03-17T23:53:18.475 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../101-cephfs-mirror_19.0.0-2162-g3d78f5ba-1jammy_amd64.deb ... 2024-03-17T23:53:18.514 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking cephfs-mirror (19.0.0-2162-g3d78f5ba-1jammy) ... 2024-03-17T23:53:18.773 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python3-joblib. 2024-03-17T23:53:18.791 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-colorama. 2024-03-17T23:53:18.800 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../081-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-03-17T23:53:18.808 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../102-python3-colorama_0.4.4-1_all.deb ... 2024-03-17T23:53:18.839 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-03-17T23:53:18.841 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-colorama (0.4.4-1) ... 2024-03-17T23:53:19.094 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package cephfs-shell. 2024-03-17T23:53:19.110 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../103-cephfs-shell_19.0.0-2162-g3d78f5ba-1jammy_all.deb ... 2024-03-17T23:53:19.152 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking cephfs-shell (19.0.0-2162-g3d78f5ba-1jammy) ... 2024-03-17T23:53:19.226 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-03-17T23:53:19.253 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../082-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-03-17T23:53:19.378 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-03-17T23:53:19.438 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package cephfs-top. 2024-03-17T23:53:19.463 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../104-cephfs-top_19.0.0-2162-g3d78f5ba-1jammy_all.deb ... 2024-03-17T23:53:19.505 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking cephfs-top (19.0.0-2162-g3d78f5ba-1jammy) ... 2024-03-17T23:53:19.673 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python3-sklearn. 2024-03-17T23:53:19.700 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../083-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-03-17T23:53:19.739 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-03-17T23:53:19.757 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package libcephfs-dev. 2024-03-17T23:53:19.785 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../105-libcephfs-dev_19.0.0-2162-g3d78f5ba-1jammy_amd64.deb ... 2024-03-17T23:53:19.823 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking libcephfs-dev (19.0.0-2162-g3d78f5ba-1jammy) ... 2024-03-17T23:53:20.126 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package lua-socket:amd64. 2024-03-17T23:53:20.142 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../106-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-03-17T23:53:20.184 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-03-17T23:53:20.424 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-03-17T23:53:20.451 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../084-ceph-mgr-diskprediction-local_19.0.0-2162-g3d78f5ba-1jammy_all.deb ... 2024-03-17T23:53:20.490 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking ceph-mgr-diskprediction-local (19.0.0-2162-g3d78f5ba-1jammy) ... 2024-03-17T23:53:20.522 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package lua-sec:amd64. 2024-03-17T23:53:20.550 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../107-lua-sec_1.0.2-1_amd64.deb ... 2024-03-17T23:53:20.588 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-03-17T23:53:20.959 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package nvme-cli. 2024-03-17T23:53:20.989 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../108-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2024-03-17T23:53:21.034 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2024-03-17T23:53:21.452 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python3-cachetools. 2024-03-17T23:53:21.455 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package pkg-config. 2024-03-17T23:53:21.468 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../085-python3-cachetools_5.0.0-1_all.deb ... 2024-03-17T23:53:21.483 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../109-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-03-17T23:53:21.501 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-03-17T23:53:21.522 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-03-17T23:53:21.805 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python3-pyasn1. 2024-03-17T23:53:21.808 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-03-17T23:53:21.832 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../086-python3-pyasn1_0.4.8-1_all.deb ... 2024-03-17T23:53:21.836 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../110-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-03-17T23:53:21.866 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-03-17T23:53:21.871 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-03-17T23:53:22.225 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-03-17T23:53:22.252 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../087-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-03-17T23:53:22.277 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-iniconfig. 2024-03-17T23:53:22.291 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-03-17T23:53:22.294 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../111-python3-iniconfig_1.1.1-2_all.deb ... 2024-03-17T23:53:22.335 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-03-17T23:53:22.586 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python3-rsa. 2024-03-17T23:53:22.613 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../088-python3-rsa_4.8-1_all.deb ... 2024-03-17T23:53:22.630 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-pastescript. 2024-03-17T23:53:22.652 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python3-rsa (4.8-1) ... 2024-03-17T23:53:22.658 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../112-python3-pastescript_2.0.2-4_all.deb ... 2024-03-17T23:53:22.696 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-03-17T23:53:22.973 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python3-google-auth. 2024-03-17T23:53:23.000 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../089-python3-google-auth_1.5.1-3_all.deb ... 2024-03-17T23:53:23.008 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-pluggy. 2024-03-17T23:53:23.024 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../113-python3-pluggy_0.13.0-7.1_all.deb ... 2024-03-17T23:53:23.032 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-03-17T23:53:23.058 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-03-17T23:53:23.326 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-03-17T23:53:23.342 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../090-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-03-17T23:53:23.352 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-psutil. 2024-03-17T23:53:23.376 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-03-17T23:53:23.380 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../114-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-03-17T23:53:23.419 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-03-17T23:53:23.663 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python3-websocket. 2024-03-17T23:53:23.690 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../091-python3-websocket_1.2.3-1_all.deb ... 2024-03-17T23:53:23.729 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-03-17T23:53:23.755 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-py. 2024-03-17T23:53:23.783 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../115-python3-py_1.10.0-1_all.deb ... 2024-03-17T23:53:23.821 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-py (1.10.0-1) ... 2024-03-17T23:53:24.041 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python3-kubernetes. 2024-03-17T23:53:24.068 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../092-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-03-17T23:53:24.107 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-03-17T23:53:24.133 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-pygments. 2024-03-17T23:53:24.161 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../116-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-03-17T23:53:24.199 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-03-17T23:53:24.597 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-pyinotify. 2024-03-17T23:53:24.625 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../117-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-03-17T23:53:24.655 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-03-17T23:53:24.780 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-03-17T23:53:24.796 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../093-ceph-mgr-k8sevents_19.0.0-2162-g3d78f5ba-1jammy_all.deb ... 2024-03-17T23:53:24.838 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking ceph-mgr-k8sevents (19.0.0-2162-g3d78f5ba-1jammy) ... 2024-03-17T23:53:24.958 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-toml. 2024-03-17T23:53:24.985 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../118-python3-toml_0.10.2-1_all.deb ... 2024-03-17T23:53:25.024 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-03-17T23:53:25.175 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package libonig5:amd64. 2024-03-17T23:53:25.202 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../094-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-03-17T23:53:25.241 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-03-17T23:53:25.327 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-pytest. 2024-03-17T23:53:25.355 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../119-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-03-17T23:53:25.393 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-03-17T23:53:25.569 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package libjq1:amd64. 2024-03-17T23:53:25.596 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../095-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-03-17T23:53:25.636 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-03-17T23:53:25.739 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-simplejson. 2024-03-17T23:53:25.767 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../120-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-03-17T23:53:25.805 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-03-17T23:53:25.863 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package jq. 2024-03-17T23:53:25.880 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../096-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-03-17T23:53:25.914 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-03-17T23:53:26.099 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-03-17T23:53:26.115 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../121-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-03-17T23:53:26.157 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-03-17T23:53:26.158 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package socat. 2024-03-17T23:53:26.186 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../097-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-03-17T23:53:26.225 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-03-17T23:53:26.553 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package xmlstarlet. 2024-03-17T23:53:26.568 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../098-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-03-17T23:53:26.611 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-03-17T23:53:26.887 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package radosgw. 2024-03-17T23:53:26.914 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../122-radosgw_19.0.0-2162-g3d78f5ba-1jammy_amd64.deb ... 2024-03-17T23:53:26.953 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking radosgw (19.0.0-2162-g3d78f5ba-1jammy) ... 2024-03-17T23:53:26.999 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package ceph-test. 2024-03-17T23:53:27.027 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../099-ceph-test_19.0.0-2162-g3d78f5ba-1jammy_amd64.deb ... 2024-03-17T23:53:27.065 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking ceph-test (19.0.0-2162-g3d78f5ba-1jammy) ... 2024-03-17T23:53:27.714 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package rbd-fuse. 2024-03-17T23:53:27.730 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../123-rbd-fuse_19.0.0-2162-g3d78f5ba-1jammy_amd64.deb ... 2024-03-17T23:53:27.764 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking rbd-fuse (19.0.0-2162-g3d78f5ba-1jammy) ... 2024-03-17T23:53:28.051 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-03-17T23:53:28.302 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-03-17T23:53:28.428 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2024-03-17T23:53:28.687 INFO:teuthology.orchestra.run.smithi196.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-03-17T23:53:29.022 INFO:teuthology.orchestra.run.smithi196.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-03-17T23:53:29.489 INFO:teuthology.orchestra.run.smithi196.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-03-17T23:53:29.545 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package ceph-volume. 2024-03-17T23:53:29.572 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up cephadm (19.0.0-2162-g3d78f5ba-1jammy) ... 2024-03-17T23:53:29.572 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../100-ceph-volume_19.0.0-2162-g3d78f5ba-1jammy_all.deb ... 2024-03-17T23:53:29.611 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking ceph-volume (19.0.0-2162-g3d78f5ba-1jammy) ... 2024-03-17T23:53:29.983 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package cephfs-mirror. 2024-03-17T23:53:30.010 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../101-cephfs-mirror_19.0.0-2162-g3d78f5ba-1jammy_amd64.deb ... 2024-03-17T23:53:30.049 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking cephfs-mirror (19.0.0-2162-g3d78f5ba-1jammy) ... 2024-03-17T23:53:30.180 INFO:teuthology.orchestra.run.smithi196.stdout:Adding system user cephadm....done 2024-03-17T23:53:30.343 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python3-colorama. 2024-03-17T23:53:30.359 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../102-python3-colorama_0.4.4-1_all.deb ... 2024-03-17T23:53:30.393 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python3-colorama (0.4.4-1) ... 2024-03-17T23:53:30.407 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-03-17T23:53:30.663 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package cephfs-shell. 2024-03-17T23:53:30.690 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../103-cephfs-shell_19.0.0-2162-g3d78f5ba-1jammy_all.deb ... 2024-03-17T23:53:30.729 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking cephfs-shell (19.0.0-2162-g3d78f5ba-1jammy) ... 2024-03-17T23:53:30.800 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-03-17T23:53:30.957 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package cephfs-top. 2024-03-17T23:53:30.973 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../104-cephfs-top_19.0.0-2162-g3d78f5ba-1jammy_all.deb ... 2024-03-17T23:53:31.015 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking cephfs-top (19.0.0-2162-g3d78f5ba-1jammy) ... 2024-03-17T23:53:31.147 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-03-17T23:53:31.267 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package libcephfs-dev. 2024-03-17T23:53:31.284 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../105-libcephfs-dev_19.0.0-2162-g3d78f5ba-1jammy_amd64.deb ... 2024-03-17T23:53:31.326 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking libcephfs-dev (19.0.0-2162-g3d78f5ba-1jammy) ... 2024-03-17T23:53:31.356 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-03-17T23:53:31.637 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package lua-socket:amd64. 2024-03-17T23:53:31.658 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-03-17T23:53:31.665 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../106-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-03-17T23:53:31.704 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-03-17T23:53:31.909 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-03-17T23:53:32.017 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package lua-sec:amd64. 2024-03-17T23:53:32.035 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-py (1.10.0-1) ... 2024-03-17T23:53:32.045 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../107-lua-sec_1.0.2-1_amd64.deb ... 2024-03-17T23:53:32.083 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-03-17T23:53:32.320 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-03-17T23:53:32.437 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package nvme-cli. 2024-03-17T23:53:32.465 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../108-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2024-03-17T23:53:32.504 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2024-03-17T23:53:32.689 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-03-17T23:53:32.926 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package pkg-config. 2024-03-17T23:53:32.939 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-colorama (0.4.4-1) ... 2024-03-17T23:53:32.954 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../109-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-03-17T23:53:32.992 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-03-17T23:53:33.191 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-03-17T23:53:33.237 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-03-17T23:53:33.253 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../110-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-03-17T23:53:33.295 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-03-17T23:53:33.458 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-03-17T23:53:33.710 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-03-17T23:53:33.749 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python3-iniconfig. 2024-03-17T23:53:33.776 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../111-python3-iniconfig_1.1.1-2_all.deb ... 2024-03-17T23:53:33.815 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-03-17T23:53:33.953 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-03-17T23:53:34.101 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python3-pastescript. 2024-03-17T23:53:34.129 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../112-python3-pastescript_2.0.2-4_all.deb ... 2024-03-17T23:53:34.167 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-03-17T23:53:34.196 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-03-17T23:53:34.447 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-ceph-argparse (19.0.0-2162-g3d78f5ba-1jammy) ... 2024-03-17T23:53:34.480 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python3-pluggy. 2024-03-17T23:53:34.508 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../113-python3-pluggy_0.13.0-7.1_all.deb ... 2024-03-17T23:53:34.537 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-03-17T23:53:34.706 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-03-17T23:53:34.840 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-03-17T23:53:34.849 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python3-psutil. 2024-03-17T23:53:34.877 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../114-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-03-17T23:53:34.915 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-03-17T23:53:34.966 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2024-03-17T23:53:35.225 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-03-17T23:53:35.269 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python3-py. 2024-03-17T23:53:35.297 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../115-python3-py_1.10.0-1_all.deb ... 2024-03-17T23:53:35.335 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python3-py (1.10.0-1) ... 2024-03-17T23:53:35.351 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-03-17T23:53:35.603 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-03-17T23:53:35.655 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python3-pygments. 2024-03-17T23:53:35.683 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../116-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-03-17T23:53:35.730 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-03-17T23:53:35.988 INFO:teuthology.orchestra.run.smithi196.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-03-17T23:53:36.017 INFO:teuthology.orchestra.run.smithi196.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-03-17T23:53:36.072 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-03-17T23:53:36.193 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python3-pyinotify. 2024-03-17T23:53:36.198 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-03-17T23:53:36.221 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../117-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-03-17T23:53:36.259 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-03-17T23:53:36.566 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-03-17T23:53:36.579 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python3-toml. 2024-03-17T23:53:36.606 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../118-python3-toml_0.10.2-1_all.deb ... 2024-03-17T23:53:36.645 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-03-17T23:53:36.692 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-03-17T23:53:36.915 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python3-pytest. 2024-03-17T23:53:36.943 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../119-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-03-17T23:53:36.968 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-03-17T23:53:36.973 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-03-17T23:53:37.236 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-03-17T23:53:37.327 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python3-simplejson. 2024-03-17T23:53:37.355 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../120-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-03-17T23:53:37.393 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-03-17T23:53:37.529 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up zip (3.0-12build2) ... 2024-03-17T23:53:37.629 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-03-17T23:53:37.671 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-03-17T23:53:37.687 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../121-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-03-17T23:53:37.729 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-03-17T23:53:38.298 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-03-17T23:53:38.442 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package radosgw. 2024-03-17T23:53:38.470 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../122-radosgw_19.0.0-2162-g3d78f5ba-1jammy_amd64.deb ... 2024-03-17T23:53:38.500 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking radosgw (19.0.0-2162-g3d78f5ba-1jammy) ... 2024-03-17T23:53:38.566 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-03-17T23:53:38.692 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-03-17T23:53:38.818 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-03-17T23:53:39.111 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-03-17T23:53:39.303 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package rbd-fuse. 2024-03-17T23:53:39.319 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../123-rbd-fuse_19.0.0-2162-g3d78f5ba-1jammy_amd64.deb ... 2024-03-17T23:53:39.361 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking rbd-fuse (19.0.0-2162-g3d78f5ba-1jammy) ... 2024-03-17T23:53:39.478 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-03-17T23:53:39.675 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-03-17T23:53:39.704 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-03-17T23:53:39.958 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-03-17T23:53:40.068 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2024-03-17T23:53:40.072 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-03-17T23:53:40.328 INFO:teuthology.orchestra.run.smithi204.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-03-17T23:53:40.365 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2024-03-17T23:53:40.666 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-03-17T23:53:40.674 INFO:teuthology.orchestra.run.smithi204.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-03-17T23:53:41.009 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-03-17T23:53:41.111 INFO:teuthology.orchestra.run.smithi204.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-03-17T23:53:41.186 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up cephadm (19.0.0-2162-g3d78f5ba-1jammy) ... 2024-03-17T23:53:41.277 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-03-17T23:53:41.378 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-ceph-common (19.0.0-2162-g3d78f5ba-1jammy) ... 2024-03-17T23:53:41.662 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-idna (3.3-1) ... 2024-03-17T23:53:41.744 INFO:teuthology.orchestra.run.smithi204.stdout:Adding system user cephadm....done 2024-03-17T23:53:41.926 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-03-17T23:53:41.980 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-03-17T23:53:42.202 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-03-17T23:53:42.453 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-03-17T23:53:42.579 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-03-17T23:53:42.848 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-03-17T23:53:43.099 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-03-17T23:53:43.144 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-03-17T23:53:43.200 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python3-py (1.10.0-1) ... 2024-03-17T23:53:43.379 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-03-17T23:53:43.488 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-toml (0.10.2-1) ... 2024-03-17T23:53:43.501 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-03-17T23:53:43.739 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-03-17T23:53:43.862 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-03-17T23:53:43.865 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-03-17T23:53:43.991 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-03-17T23:53:44.130 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python3-colorama (0.4.4-1) ... 2024-03-17T23:53:44.292 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-03-17T23:53:44.544 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-03-17T23:53:44.732 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-03-17T23:53:44.778 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-03-17T23:53:44.887 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-03-17T23:53:44.991 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-03-17T23:53:45.180 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-03-17T23:53:45.218 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-03-17T23:53:45.439 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-03-17T23:53:45.601 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-03-17T23:53:45.699 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-03-17T23:53:45.886 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-03-17T23:53:45.958 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-03-17T23:53:46.171 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python3-ceph-argparse (19.0.0-2162-g3d78f5ba-1jammy) ... 2024-03-17T23:53:46.209 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-03-17T23:53:46.447 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-03-17T23:53:46.469 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-03-17T23:53:46.557 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-03-17T23:53:46.595 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-03-17T23:53:46.658 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2024-03-17T23:53:46.871 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-03-17T23:53:46.900 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-03-17T23:53:46.997 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-03-17T23:53:47.026 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-03-17T23:53:47.281 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2024-03-17T23:53:47.286 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-03-17T23:53:47.582 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-03-17T23:53:47.681 INFO:teuthology.orchestra.run.smithi204.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-03-17T23:53:47.717 INFO:teuthology.orchestra.run.smithi204.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-03-17T23:53:47.781 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-03-17T23:53:47.850 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-03-17T23:53:47.882 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-03-17T23:53:47.976 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-03-17T23:53:48.110 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-03-17T23:53:48.199 INFO:teuthology.orchestra.run.smithi196.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-03-17T23:53:48.233 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-03-17T23:53:48.351 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-03-17T23:53:48.420 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-03-17T23:53:48.521 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-03-17T23:53:48.619 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-03-17T23:53:48.878 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-03-17T23:53:48.889 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-03-17T23:53:49.140 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up lua-any (27ubuntu1) ... 2024-03-17T23:53:49.180 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up zip (3.0-12build2) ... 2024-03-17T23:53:49.266 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-portend (3.0.0-1) ... 2024-03-17T23:53:49.314 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-03-17T23:53:49.534 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-03-17T23:53:49.643 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-03-17T23:53:49.952 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-03-17T23:53:49.999 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-03-17T23:53:50.237 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-03-17T23:53:50.242 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-03-17T23:53:50.368 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-03-17T23:53:50.494 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-03-17T23:53:50.505 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-03-17T23:53:50.732 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-rsa (4.8-1) ... 2024-03-17T23:53:50.804 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-03-17T23:53:51.000 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-03-17T23:53:51.196 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-03-17T23:53:51.260 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-03-17T23:53:51.456 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-03-17T23:53:51.520 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-03-17T23:53:51.808 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-03-17T23:53:51.888 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-03-17T23:53:52.084 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2024-03-17T23:53:52.173 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-03-17T23:53:52.427 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-03-17T23:53:52.706 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-03-17T23:53:52.770 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-03-17T23:53:53.021 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-03-17T23:53:53.068 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up librados2 (19.0.0-2162-g3d78f5ba-1jammy) ... 2024-03-17T23:53:53.156 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python3-ceph-common (19.0.0-2162-g3d78f5ba-1jammy) ... 2024-03-17T23:53:53.202 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up libsqlite3-mod-ceph (19.0.0-2162-g3d78f5ba-1jammy) ... 2024-03-17T23:53:53.303 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-03-17T23:53:53.449 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python3-idna (3.3-1) ... 2024-03-17T23:53:53.606 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up libcephfs2 (19.0.0-2162-g3d78f5ba-1jammy) ... 2024-03-17T23:53:53.732 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up libradosstriper1 (19.0.0-2162-g3d78f5ba-1jammy) ... 2024-03-17T23:53:53.742 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-03-17T23:53:53.858 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-03-17T23:53:54.151 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up librbd1 (19.0.0-2162-g3d78f5ba-1jammy) ... 2024-03-17T23:53:54.286 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up ceph-mgr-modules-core (19.0.0-2162-g3d78f5ba-1jammy) ... 2024-03-17T23:53:54.387 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up ceph-fuse (19.0.0-2162-g3d78f5ba-1jammy) ... 2024-03-17T23:53:54.585 INFO:teuthology.orchestra.run.smithi196.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-03-17T23:53:54.585 INFO:teuthology.orchestra.run.smithi196.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-03-17T23:53:54.948 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-03-17T23:53:55.138 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up libcephfs-dev (19.0.0-2162-g3d78f5ba-1jammy) ... 2024-03-17T23:53:55.166 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-03-17T23:53:55.264 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-rados (19.0.0-2162-g3d78f5ba-1jammy) ... 2024-03-17T23:53:55.292 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python3-toml (0.10.2-1) ... 2024-03-17T23:53:55.424 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up librgw2 (19.0.0-2162-g3d78f5ba-1jammy) ... 2024-03-17T23:53:55.551 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-03-17T23:53:55.558 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up cephfs-top (19.0.0-2162-g3d78f5ba-1jammy) ... 2024-03-17T23:53:55.677 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-03-17T23:53:55.804 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-03-17T23:53:56.026 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-03-17T23:53:56.097 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-03-17T23:53:56.350 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-03-17T23:53:56.593 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-03-17T23:53:56.719 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-03-17T23:53:57.028 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-03-17T23:53:57.213 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-rbd (19.0.0-2162-g3d78f5ba-1jammy) ... 2024-03-17T23:53:57.296 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-03-17T23:53:57.339 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up rbd-fuse (19.0.0-2162-g3d78f5ba-1jammy) ... 2024-03-17T23:53:57.465 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-rgw (19.0.0-2162-g3d78f5ba-1jammy) ... 2024-03-17T23:53:57.556 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-03-17T23:53:57.591 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-cephfs (19.0.0-2162-g3d78f5ba-1jammy) ... 2024-03-17T23:53:57.717 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up cephfs-shell (19.0.0-2162-g3d78f5ba-1jammy) ... 2024-03-17T23:53:57.790 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-03-17T23:53:57.851 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up ceph-common (19.0.0-2162-g3d78f5ba-1jammy) ... 2024-03-17T23:53:58.025 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-03-17T23:53:58.276 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-03-17T23:53:58.352 INFO:teuthology.orchestra.run.smithi196.stdout:Adding group ceph....done 2024-03-17T23:53:58.402 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-03-17T23:53:58.687 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-03-17T23:53:58.736 INFO:teuthology.orchestra.run.smithi196.stdout:Adding system user ceph....done 2024-03-17T23:53:58.829 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-03-17T23:53:58.888 INFO:teuthology.orchestra.run.smithi196.stdout:Setting system user ceph properties....done 2024-03-17T23:53:58.903 INFO:teuthology.orchestra.run.smithi196.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-03-17T23:53:59.039 INFO:teuthology.orchestra.run.smithi196.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-03-17T23:53:59.122 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2024-03-17T23:53:59.369 INFO:teuthology.orchestra.run.smithi196.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-03-17T23:53:59.431 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-03-17T23:53:59.666 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-03-17T23:53:59.792 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-03-17T23:53:59.868 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up cephfs-mirror (19.0.0-2162-g3d78f5ba-1jammy) ... 2024-03-17T23:53:59.918 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-03-17T23:54:00.008 INFO:teuthology.orchestra.run.smithi204.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-03-17T23:54:00.071 INFO:teuthology.orchestra.run.smithi196.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-03-17T23:54:00.071 INFO:teuthology.orchestra.run.smithi196.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-03-17T23:54:00.270 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-03-17T23:54:00.396 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-03-17T23:54:00.536 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up ceph-test (19.0.0-2162-g3d78f5ba-1jammy) ... 2024-03-17T23:54:00.663 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up radosgw (19.0.0-2162-g3d78f5ba-1jammy) ... 2024-03-17T23:54:00.798 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-03-17T23:54:01.040 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up lua-any (27ubuntu1) ... 2024-03-17T23:54:01.154 INFO:teuthology.orchestra.run.smithi196.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-03-17T23:54:01.154 INFO:teuthology.orchestra.run.smithi196.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-03-17T23:54:01.158 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python3-portend (3.0.0-1) ... 2024-03-17T23:54:01.417 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-03-17T23:54:01.544 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-03-17T23:54:01.647 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up ceph-base (19.0.0-2162-g3d78f5ba-1jammy) ... 2024-03-17T23:54:01.861 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-03-17T23:54:02.024 INFO:teuthology.orchestra.run.smithi196.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-03-17T23:54:02.154 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-03-17T23:54:02.430 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-03-17T23:54:02.499 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up ceph-mds (19.0.0-2162-g3d78f5ba-1jammy) ... 2024-03-17T23:54:02.642 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python3-rsa (4.8-1) ... 2024-03-17T23:54:02.724 INFO:teuthology.orchestra.run.smithi196.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-03-17T23:54:02.724 INFO:teuthology.orchestra.run.smithi196.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-03-17T23:54:02.918 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-03-17T23:54:03.195 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-03-17T23:54:03.201 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up ceph-mgr (19.0.0-2162-g3d78f5ba-1jammy) ... 2024-03-17T23:54:03.438 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-03-17T23:54:03.598 INFO:teuthology.orchestra.run.smithi196.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-03-17T23:54:03.598 INFO:teuthology.orchestra.run.smithi196.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-03-17T23:54:03.815 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-03-17T23:54:04.064 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up ceph-osd (19.0.0-2162-g3d78f5ba-1jammy) ... 2024-03-17T23:54:04.100 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-03-17T23:54:04.361 INFO:teuthology.orchestra.run.smithi196.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-03-17T23:54:04.361 INFO:teuthology.orchestra.run.smithi196.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-03-17T23:54:04.444 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-03-17T23:54:04.570 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up librados2 (19.0.0-2162-g3d78f5ba-1jammy) ... 2024-03-17T23:54:04.696 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up libsqlite3-mod-ceph (19.0.0-2162-g3d78f5ba-1jammy) ... 2024-03-17T23:54:04.822 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-03-17T23:54:04.965 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up ceph-mgr-k8sevents (19.0.0-2162-g3d78f5ba-1jammy) ... 2024-03-17T23:54:05.109 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up libcephfs2 (19.0.0-2162-g3d78f5ba-1jammy) ... 2024-03-17T23:54:05.149 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up ceph-mgr-diskprediction-local (19.0.0-2162-g3d78f5ba-1jammy) ... 2024-03-17T23:54:05.260 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up libradosstriper1 (19.0.0-2162-g3d78f5ba-1jammy) ... 2024-03-17T23:54:05.309 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up ceph-mon (19.0.0-2162-g3d78f5ba-1jammy) ... 2024-03-17T23:54:05.386 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-03-17T23:54:05.525 INFO:teuthology.orchestra.run.smithi196.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-03-17T23:54:05.525 INFO:teuthology.orchestra.run.smithi196.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-03-17T23:54:05.662 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up librbd1 (19.0.0-2162-g3d78f5ba-1jammy) ... 2024-03-17T23:54:05.789 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up ceph-mgr-modules-core (19.0.0-2162-g3d78f5ba-1jammy) ... 2024-03-17T23:54:05.915 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up ceph-fuse (19.0.0-2162-g3d78f5ba-1jammy) ... 2024-03-17T23:54:05.993 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up ceph-mgr-cephadm (19.0.0-2162-g3d78f5ba-1jammy) ... 2024-03-17T23:54:06.111 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up ceph (19.0.0-2162-g3d78f5ba-1jammy) ... 2024-03-17T23:54:06.128 INFO:teuthology.orchestra.run.smithi204.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-03-17T23:54:06.128 INFO:teuthology.orchestra.run.smithi204.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-03-17T23:54:06.212 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up ceph-mgr-dashboard (19.0.0-2162-g3d78f5ba-1jammy) ... 2024-03-17T23:54:06.338 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up ceph-volume (19.0.0-2162-g3d78f5ba-1jammy) ... 2024-03-17T23:54:06.624 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up libcephfs-dev (19.0.0-2162-g3d78f5ba-1jammy) ... 2024-03-17T23:54:06.691 INFO:teuthology.orchestra.run.smithi196.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-03-17T23:54:06.792 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python3-rados (19.0.0-2162-g3d78f5ba-1jammy) ... 2024-03-17T23:54:06.800 INFO:teuthology.orchestra.run.smithi196.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-03-17T23:54:06.910 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up librgw2 (19.0.0-2162-g3d78f5ba-1jammy) ... 2024-03-17T23:54:06.978 INFO:teuthology.orchestra.run.smithi196.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-03-17T23:54:07.028 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up cephfs-top (19.0.0-2162-g3d78f5ba-1jammy) ... 2024-03-17T23:54:07.163 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-03-17T23:54:07.944 INFO:teuthology.orchestra.run.smithi196.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-03-17T23:54:08.384 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python3-rbd (19.0.0-2162-g3d78f5ba-1jammy) ... 2024-03-17T23:54:08.494 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up rbd-fuse (19.0.0-2162-g3d78f5ba-1jammy) ... 2024-03-17T23:54:08.582 INFO:teuthology.orchestra.run.smithi196.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-03-17T23:54:08.585 DEBUG:teuthology.orchestra.run.smithi196:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2024-03-17T23:54:08.595 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python3-rgw (19.0.0-2162-g3d78f5ba-1jammy) ... 2024-03-17T23:54:08.639 INFO:teuthology.orchestra.run.smithi196.stdout:Reading package lists... 2024-03-17T23:54:08.704 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python3-cephfs (19.0.0-2162-g3d78f5ba-1jammy) ... 2024-03-17T23:54:08.830 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up cephfs-shell (19.0.0-2162-g3d78f5ba-1jammy) ... 2024-03-17T23:54:08.840 INFO:teuthology.orchestra.run.smithi196.stdout:Building dependency tree... 2024-03-17T23:54:08.841 INFO:teuthology.orchestra.run.smithi196.stdout:Reading state information... 2024-03-17T23:54:08.956 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up ceph-common (19.0.0-2162-g3d78f5ba-1jammy) ... 2024-03-17T23:54:08.996 INFO:teuthology.orchestra.run.smithi196.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2024-03-17T23:54:08.997 INFO:teuthology.orchestra.run.smithi196.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2024-03-17T23:54:08.997 INFO:teuthology.orchestra.run.smithi196.stdout:util-linux is already the newest version (2.37.2-4ubuntu3). 2024-03-17T23:54:08.997 INFO:teuthology.orchestra.run.smithi196.stdout:uuid-dev is already the newest version (2.37.2-4ubuntu3). 2024-03-17T23:54:08.997 INFO:teuthology.orchestra.run.smithi196.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2024-03-17T23:54:08.997 INFO:teuthology.orchestra.run.smithi196.stdout:The following packages were automatically installed and are no longer required: 2024-03-17T23:54:08.997 INFO:teuthology.orchestra.run.smithi196.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-03-17T23:54:08.997 INFO:teuthology.orchestra.run.smithi196.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-03-17T23:54:08.997 INFO:teuthology.orchestra.run.smithi196.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-03-17T23:54:08.997 INFO:teuthology.orchestra.run.smithi196.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-03-17T23:54:08.998 INFO:teuthology.orchestra.run.smithi196.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-03-17T23:54:08.998 INFO:teuthology.orchestra.run.smithi196.stdout:Use 'sudo apt autoremove' to remove them. 2024-03-17T23:54:08.998 INFO:teuthology.orchestra.run.smithi196.stdout:The following additional packages will be installed: 2024-03-17T23:54:08.998 INFO:teuthology.orchestra.run.smithi196.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2024-03-17T23:54:08.998 INFO:teuthology.orchestra.run.smithi196.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2024-03-17T23:54:08.999 INFO:teuthology.orchestra.run.smithi196.stdout: libqmi-proxy libssl3 libteamdctl0 modemmanager network-manager-pptp 2024-03-17T23:54:08.999 INFO:teuthology.orchestra.run.smithi196.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2024-03-17T23:54:08.999 INFO:teuthology.orchestra.run.smithi196.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2024-03-17T23:54:09.000 INFO:teuthology.orchestra.run.smithi196.stdout:Suggested packages: 2024-03-17T23:54:09.000 INFO:teuthology.orchestra.run.smithi196.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2024-03-17T23:54:09.000 INFO:teuthology.orchestra.run.smithi196.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial wpagui 2024-03-17T23:54:09.000 INFO:teuthology.orchestra.run.smithi196.stdout: libengine-pkcs11-openssl 2024-03-17T23:54:09.036 INFO:teuthology.orchestra.run.smithi196.stdout:The following NEW packages will be installed: 2024-03-17T23:54:09.037 INFO:teuthology.orchestra.run.smithi196.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2024-03-17T23:54:09.037 INFO:teuthology.orchestra.run.smithi196.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2024-03-17T23:54:09.038 INFO:teuthology.orchestra.run.smithi196.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2024-03-17T23:54:09.038 INFO:teuthology.orchestra.run.smithi196.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2024-03-17T23:54:09.038 INFO:teuthology.orchestra.run.smithi196.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2024-03-17T23:54:09.038 INFO:teuthology.orchestra.run.smithi196.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2024-03-17T23:54:09.038 INFO:teuthology.orchestra.run.smithi196.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2024-03-17T23:54:09.039 INFO:teuthology.orchestra.run.smithi196.stdout:The following packages will be upgraded: 2024-03-17T23:54:09.039 INFO:teuthology.orchestra.run.smithi196.stdout: libssl3 2024-03-17T23:54:09.242 INFO:teuthology.orchestra.run.smithi196.stdout:1 upgraded, 39 newly installed, 0 to remove and 283 not upgraded. 2024-03-17T23:54:09.243 INFO:teuthology.orchestra.run.smithi196.stdout:Need to get 54.6 MB of archives. 2024-03-17T23:54:09.243 INFO:teuthology.orchestra.run.smithi196.stdout:After this operation, 202 MB of additional disk space will be used. 2024-03-17T23:54:09.243 INFO:teuthology.orchestra.run.smithi196.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2024-03-17T23:54:09.645 INFO:teuthology.orchestra.run.smithi204.stdout:Adding group ceph....done 2024-03-17T23:54:09.727 INFO:teuthology.orchestra.run.smithi196.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.15 [1,905 kB] 2024-03-17T23:54:09.954 INFO:teuthology.orchestra.run.smithi204.stdout:Adding system user ceph....done 2024-03-17T23:54:09.985 INFO:teuthology.orchestra.run.smithi196.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2024-03-17T23:54:10.019 INFO:teuthology.orchestra.run.smithi196.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2024-03-17T23:54:10.021 INFO:teuthology.orchestra.run.smithi196.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2024-03-17T23:54:10.026 INFO:teuthology.orchestra.run.smithi196.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 indent amd64 2.2.12-1ubuntu0.22.04.1 [90.8 kB] 2024-03-17T23:54:10.030 INFO:teuthology.orchestra.run.smithi196.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2024-03-17T23:54:10.030 INFO:teuthology.orchestra.run.smithi196.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libbluetooth3 amd64 5.64-0ubuntu1.1 [87.0 kB] 2024-03-17T23:54:10.033 INFO:teuthology.orchestra.run.smithi196.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2024-03-17T23:54:10.036 INFO:teuthology.orchestra.run.smithi196.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2024-03-17T23:54:10.201 INFO:teuthology.orchestra.run.smithi196.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2024-03-17T23:54:10.202 INFO:teuthology.orchestra.run.smithi196.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2024-03-17T23:54:10.365 INFO:teuthology.orchestra.run.smithi204.stdout:Setting system user ceph properties....done 2024-03-17T23:54:10.385 INFO:teuthology.orchestra.run.smithi204.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-03-17T23:54:10.446 INFO:teuthology.orchestra.run.smithi196.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1.1 [24.0 MB] 2024-03-17T23:54:10.521 INFO:teuthology.orchestra.run.smithi204.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-03-17T23:54:10.851 INFO:teuthology.orchestra.run.smithi204.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-03-17T23:54:11.454 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up cephfs-mirror (19.0.0-2162-g3d78f5ba-1jammy) ... 2024-03-17T23:54:11.576 INFO:teuthology.orchestra.run.smithi196.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2024-03-17T23:54:11.581 INFO:teuthology.orchestra.run.smithi196.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2024-03-17T23:54:11.581 INFO:teuthology.orchestra.run.smithi196.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.3 [263 kB] 2024-03-17T23:54:11.588 INFO:teuthology.orchestra.run.smithi196.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/main amd64 libndp0 amd64 1.8-0ubuntu3 [12.3 kB] 2024-03-17T23:54:11.588 INFO:teuthology.orchestra.run.smithi196.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2024-03-17T23:54:11.599 INFO:teuthology.orchestra.run.smithi196.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.11-0ubuntu0.22.04.1 [144 kB] 2024-03-17T23:54:11.603 INFO:teuthology.orchestra.run.smithi196.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2024-03-17T23:54:11.619 INFO:teuthology.orchestra.run.smithi196.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2024-03-17T23:54:11.729 INFO:teuthology.orchestra.run.smithi204.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-03-17T23:54:11.729 INFO:teuthology.orchestra.run.smithi204.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-03-17T23:54:11.783 INFO:teuthology.orchestra.run.smithi196.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.15 [2,376 kB] 2024-03-17T23:54:12.230 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up ceph-test (19.0.0-2162-g3d78f5ba-1jammy) ... 2024-03-17T23:54:12.356 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up radosgw (19.0.0-2162-g3d78f5ba-1jammy) ... 2024-03-17T23:54:12.516 INFO:teuthology.orchestra.run.smithi196.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2024-03-17T23:54:12.516 INFO:teuthology.orchestra.run.smithi196.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.3 [1,094 kB] 2024-03-17T23:54:12.543 INFO:teuthology.orchestra.run.smithi196.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2024-03-17T23:54:12.620 INFO:teuthology.orchestra.run.smithi196.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2024-03-17T23:54:12.628 INFO:teuthology.orchestra.run.smithi196.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2024-03-17T23:54:12.629 INFO:teuthology.orchestra.run.smithi196.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2024-03-17T23:54:12.634 INFO:teuthology.orchestra.run.smithi196.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2024-03-17T23:54:12.634 INFO:teuthology.orchestra.run.smithi196.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.11-0ubuntu0.22.04.1 [1,222 kB] 2024-03-17T23:54:12.658 INFO:teuthology.orchestra.run.smithi196.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2024-03-17T23:54:12.661 INFO:teuthology.orchestra.run.smithi196.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.11-0ubuntu0.22.04.1 [16.2 MB] 2024-03-17T23:54:12.820 INFO:teuthology.orchestra.run.smithi204.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-03-17T23:54:12.820 INFO:teuthology.orchestra.run.smithi204.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-03-17T23:54:13.308 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up ceph-base (19.0.0-2162-g3d78f5ba-1jammy) ... 2024-03-17T23:54:13.363 INFO:teuthology.orchestra.run.smithi196.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2024-03-17T23:54:13.450 INFO:teuthology.orchestra.run.smithi196.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2024-03-17T23:54:13.451 INFO:teuthology.orchestra.run.smithi196.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2024-03-17T23:54:13.451 INFO:teuthology.orchestra.run.smithi196.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2024-03-17T23:54:13.545 INFO:teuthology.orchestra.run.smithi196.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2024-03-17T23:54:13.560 INFO:teuthology.orchestra.run.smithi196.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2 [1,481 kB] 2024-03-17T23:54:13.626 INFO:teuthology.orchestra.run.smithi204.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-03-17T23:54:14.008 INFO:teuthology.orchestra.run.smithi196.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2024-03-17T23:54:14.011 INFO:teuthology.orchestra.run.smithi196.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2024-03-17T23:54:14.126 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up ceph-mds (19.0.0-2162-g3d78f5ba-1jammy) ... 2024-03-17T23:54:14.418 INFO:teuthology.orchestra.run.smithi196.stdout:Preconfiguring packages ... 2024-03-17T23:54:14.419 INFO:teuthology.orchestra.run.smithi204.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-03-17T23:54:14.420 INFO:teuthology.orchestra.run.smithi204.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-03-17T23:54:14.571 INFO:teuthology.orchestra.run.smithi196.stdout:Fetched 54.6 MB in 5s (11.0 MB/s) 2024-03-17T23:54:14.711 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package flex. 2024-03-17T23:54:14.814 INFO:teuthology.orchestra.run.smithi196.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173660 files and directories currently installed.) 2024-03-17T23:54:14.820 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2024-03-17T23:54:14.868 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking flex (2.6.4-8build2) ... 2024-03-17T23:54:14.897 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up ceph-mgr (19.0.0-2162-g3d78f5ba-1jammy) ... 2024-03-17T23:54:15.112 INFO:teuthology.orchestra.run.smithi204.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-03-17T23:54:15.113 INFO:teuthology.orchestra.run.smithi204.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-03-17T23:54:15.609 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.15_amd64.deb ... 2024-03-17T23:54:15.634 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up ceph-osd (19.0.0-2162-g3d78f5ba-1jammy) ... 2024-03-17T23:54:15.773 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.15) over (3.0.2-0ubuntu1.7) ... 2024-03-17T23:54:15.889 INFO:teuthology.orchestra.run.smithi204.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-03-17T23:54:15.889 INFO:teuthology.orchestra.run.smithi204.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-03-17T23:54:16.192 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.15) ... 2024-03-17T23:54:16.453 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up ceph-mgr-k8sevents (19.0.0-2162-g3d78f5ba-1jammy) ... 2024-03-17T23:54:16.579 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up ceph-mgr-diskprediction-local (19.0.0-2162-g3d78f5ba-1jammy) ... 2024-03-17T23:54:16.758 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package bison. 2024-03-17T23:54:16.838 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up ceph-mon (19.0.0-2162-g3d78f5ba-1jammy) ... 2024-03-17T23:54:16.861 INFO:teuthology.orchestra.run.smithi196.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173733 files and directories currently installed.) 2024-03-17T23:54:16.867 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2024-03-17T23:54:16.918 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2024-03-17T23:54:17.052 INFO:teuthology.orchestra.run.smithi204.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-03-17T23:54:17.052 INFO:teuthology.orchestra.run.smithi204.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-03-17T23:54:17.327 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package liblzo2-2:amd64. 2024-03-17T23:54:17.355 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2024-03-17T23:54:17.393 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2024-03-17T23:54:17.564 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up ceph-mgr-cephadm (19.0.0-2162-g3d78f5ba-1jammy) ... 2024-03-17T23:54:17.688 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package dump. 2024-03-17T23:54:17.707 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up ceph (19.0.0-2162-g3d78f5ba-1jammy) ... 2024-03-17T23:54:17.716 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2024-03-17T23:54:17.746 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking dump (0.4b47-3) ... 2024-03-17T23:54:17.842 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up ceph-mgr-dashboard (19.0.0-2162-g3d78f5ba-1jammy) ... 2024-03-17T23:54:17.985 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up ceph-volume (19.0.0-2162-g3d78f5ba-1jammy) ... 2024-03-17T23:54:18.008 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package indent. 2024-03-17T23:54:18.023 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../03-indent_2.2.12-1ubuntu0.22.04.1_amd64.deb ... 2024-03-17T23:54:18.066 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking indent (2.2.12-1ubuntu0.22.04.1) ... 2024-03-17T23:54:18.313 INFO:teuthology.orchestra.run.smithi204.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-03-17T23:54:18.329 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-03-17T23:54:18.345 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2024-03-17T23:54:18.387 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2024-03-17T23:54:18.422 INFO:teuthology.orchestra.run.smithi204.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-03-17T23:54:18.549 INFO:teuthology.orchestra.run.smithi204.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-03-17T23:54:18.674 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package libbluetooth3:amd64. 2024-03-17T23:54:18.702 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1.1_amd64.deb ... 2024-03-17T23:54:18.732 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2024-03-17T23:54:18.993 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-03-17T23:54:19.021 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2024-03-17T23:54:19.059 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2024-03-17T23:54:19.308 INFO:teuthology.orchestra.run.smithi204.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-03-17T23:54:19.438 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package libfl2:amd64. 2024-03-17T23:54:19.466 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2024-03-17T23:54:19.504 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2024-03-17T23:54:19.740 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package libfl-dev:amd64. 2024-03-17T23:54:19.756 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2024-03-17T23:54:19.790 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2024-03-17T23:54:19.970 INFO:teuthology.orchestra.run.smithi204.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-03-17T23:54:19.973 DEBUG:teuthology.orchestra.run.smithi204:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2024-03-17T23:54:20.009 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package libjson-perl. 2024-03-17T23:54:20.025 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2024-03-17T23:54:20.031 INFO:teuthology.orchestra.run.smithi204.stdout:Reading package lists... 2024-03-17T23:54:20.067 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking libjson-perl (4.04000-1) ... 2024-03-17T23:54:20.226 INFO:teuthology.orchestra.run.smithi204.stdout:Building dependency tree... 2024-03-17T23:54:20.226 INFO:teuthology.orchestra.run.smithi204.stdout:Reading state information... 2024-03-17T23:54:20.387 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package libllvm14:amd64. 2024-03-17T23:54:20.401 INFO:teuthology.orchestra.run.smithi204.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2024-03-17T23:54:20.402 INFO:teuthology.orchestra.run.smithi204.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2024-03-17T23:54:20.402 INFO:teuthology.orchestra.run.smithi204.stdout:util-linux is already the newest version (2.37.2-4ubuntu3). 2024-03-17T23:54:20.402 INFO:teuthology.orchestra.run.smithi204.stdout:uuid-dev is already the newest version (2.37.2-4ubuntu3). 2024-03-17T23:54:20.402 INFO:teuthology.orchestra.run.smithi204.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2024-03-17T23:54:20.402 INFO:teuthology.orchestra.run.smithi204.stdout:The following packages were automatically installed and are no longer required: 2024-03-17T23:54:20.402 INFO:teuthology.orchestra.run.smithi204.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-03-17T23:54:20.402 INFO:teuthology.orchestra.run.smithi204.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-03-17T23:54:20.402 INFO:teuthology.orchestra.run.smithi204.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-03-17T23:54:20.403 INFO:teuthology.orchestra.run.smithi204.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-03-17T23:54:20.403 INFO:teuthology.orchestra.run.smithi204.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-03-17T23:54:20.403 INFO:teuthology.orchestra.run.smithi204.stdout:Use 'sudo apt autoremove' to remove them. 2024-03-17T23:54:20.403 INFO:teuthology.orchestra.run.smithi204.stdout:The following additional packages will be installed: 2024-03-17T23:54:20.404 INFO:teuthology.orchestra.run.smithi204.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2024-03-17T23:54:20.404 INFO:teuthology.orchestra.run.smithi204.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2024-03-17T23:54:20.404 INFO:teuthology.orchestra.run.smithi204.stdout: libqmi-proxy libssl3 libteamdctl0 modemmanager network-manager-pptp 2024-03-17T23:54:20.404 INFO:teuthology.orchestra.run.smithi204.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2024-03-17T23:54:20.404 INFO:teuthology.orchestra.run.smithi204.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2024-03-17T23:54:20.405 INFO:teuthology.orchestra.run.smithi204.stdout:Suggested packages: 2024-03-17T23:54:20.406 INFO:teuthology.orchestra.run.smithi204.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2024-03-17T23:54:20.406 INFO:teuthology.orchestra.run.smithi204.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial wpagui 2024-03-17T23:54:20.406 INFO:teuthology.orchestra.run.smithi204.stdout: libengine-pkcs11-openssl 2024-03-17T23:54:20.415 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1.1_amd64.deb ... 2024-03-17T23:54:20.444 INFO:teuthology.orchestra.run.smithi204.stdout:The following NEW packages will be installed: 2024-03-17T23:54:20.444 INFO:teuthology.orchestra.run.smithi204.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2024-03-17T23:54:20.444 INFO:teuthology.orchestra.run.smithi204.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2024-03-17T23:54:20.445 INFO:teuthology.orchestra.run.smithi204.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2024-03-17T23:54:20.445 INFO:teuthology.orchestra.run.smithi204.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2024-03-17T23:54:20.445 INFO:teuthology.orchestra.run.smithi204.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2024-03-17T23:54:20.445 INFO:teuthology.orchestra.run.smithi204.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2024-03-17T23:54:20.445 INFO:teuthology.orchestra.run.smithi204.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2024-03-17T23:54:20.446 INFO:teuthology.orchestra.run.smithi204.stdout:The following packages will be upgraded: 2024-03-17T23:54:20.447 INFO:teuthology.orchestra.run.smithi204.stdout: libssl3 2024-03-17T23:54:20.453 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-03-17T23:54:20.628 INFO:teuthology.orchestra.run.smithi204.stdout:1 upgraded, 39 newly installed, 0 to remove and 283 not upgraded. 2024-03-17T23:54:20.628 INFO:teuthology.orchestra.run.smithi204.stdout:Need to get 54.6 MB of archives. 2024-03-17T23:54:20.629 INFO:teuthology.orchestra.run.smithi204.stdout:After this operation, 202 MB of additional disk space will be used. 2024-03-17T23:54:20.629 INFO:teuthology.orchestra.run.smithi204.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2024-03-17T23:54:21.116 INFO:teuthology.orchestra.run.smithi204.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.15 [1,905 kB] 2024-03-17T23:54:21.374 INFO:teuthology.orchestra.run.smithi204.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2024-03-17T23:54:21.408 INFO:teuthology.orchestra.run.smithi204.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2024-03-17T23:54:21.410 INFO:teuthology.orchestra.run.smithi204.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2024-03-17T23:54:21.415 INFO:teuthology.orchestra.run.smithi204.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 indent amd64 2.2.12-1ubuntu0.22.04.1 [90.8 kB] 2024-03-17T23:54:21.418 INFO:teuthology.orchestra.run.smithi204.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2024-03-17T23:54:21.419 INFO:teuthology.orchestra.run.smithi204.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libbluetooth3 amd64 5.64-0ubuntu1.1 [87.0 kB] 2024-03-17T23:54:21.422 INFO:teuthology.orchestra.run.smithi204.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2024-03-17T23:54:21.424 INFO:teuthology.orchestra.run.smithi204.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2024-03-17T23:54:21.589 INFO:teuthology.orchestra.run.smithi204.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2024-03-17T23:54:21.590 INFO:teuthology.orchestra.run.smithi204.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2024-03-17T23:54:21.844 INFO:teuthology.orchestra.run.smithi204.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1.1 [24.0 MB] 2024-03-17T23:54:22.114 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2024-03-17T23:54:22.142 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-03-17T23:54:22.181 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-03-17T23:54:22.450 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package libmbim-proxy. 2024-03-17T23:54:22.466 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-03-17T23:54:22.500 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-03-17T23:54:22.803 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package libmm-glib0:amd64. 2024-03-17T23:54:22.833 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-03-17T23:54:22.869 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-03-17T23:54:23.015 INFO:teuthology.orchestra.run.smithi204.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2024-03-17T23:54:23.020 INFO:teuthology.orchestra.run.smithi204.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2024-03-17T23:54:23.020 INFO:teuthology.orchestra.run.smithi204.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.3 [263 kB] 2024-03-17T23:54:23.027 INFO:teuthology.orchestra.run.smithi204.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/main amd64 libndp0 amd64 1.8-0ubuntu3 [12.3 kB] 2024-03-17T23:54:23.027 INFO:teuthology.orchestra.run.smithi204.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2024-03-17T23:54:23.038 INFO:teuthology.orchestra.run.smithi204.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.11-0ubuntu0.22.04.1 [144 kB] 2024-03-17T23:54:23.042 INFO:teuthology.orchestra.run.smithi204.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2024-03-17T23:54:23.060 INFO:teuthology.orchestra.run.smithi204.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2024-03-17T23:54:23.224 INFO:teuthology.orchestra.run.smithi204.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.15 [2,376 kB] 2024-03-17T23:54:23.239 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package libndp0:amd64. 2024-03-17T23:54:23.267 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3_amd64.deb ... 2024-03-17T23:54:23.305 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3) ... 2024-03-17T23:54:23.608 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package libnm0:amd64. 2024-03-17T23:54:23.636 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2024-03-17T23:54:23.666 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-03-17T23:54:23.951 INFO:teuthology.orchestra.run.smithi204.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2024-03-17T23:54:23.952 INFO:teuthology.orchestra.run.smithi204.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.3 [1,094 kB] 2024-03-17T23:54:23.978 INFO:teuthology.orchestra.run.smithi204.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2024-03-17T23:54:24.053 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package libpq5:amd64. 2024-03-17T23:54:24.055 INFO:teuthology.orchestra.run.smithi204.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2024-03-17T23:54:24.064 INFO:teuthology.orchestra.run.smithi204.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2024-03-17T23:54:24.065 INFO:teuthology.orchestra.run.smithi204.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2024-03-17T23:54:24.067 INFO:teuthology.orchestra.run.smithi204.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2024-03-17T23:54:24.068 INFO:teuthology.orchestra.run.smithi204.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.11-0ubuntu0.22.04.1 [1,222 kB] 2024-03-17T23:54:24.080 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../16-libpq5_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-03-17T23:54:24.095 INFO:teuthology.orchestra.run.smithi204.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2024-03-17T23:54:24.098 INFO:teuthology.orchestra.run.smithi204.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.11-0ubuntu0.22.04.1 [16.2 MB] 2024-03-17T23:54:24.119 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking libpq5:amd64 (14.11-0ubuntu0.22.04.1) ... 2024-03-17T23:54:24.472 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2024-03-17T23:54:24.500 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-03-17T23:54:24.538 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-03-17T23:54:24.804 INFO:teuthology.orchestra.run.smithi204.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2024-03-17T23:54:24.816 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package libqmi-proxy. 2024-03-17T23:54:24.832 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-03-17T23:54:24.865 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-03-17T23:54:24.888 INFO:teuthology.orchestra.run.smithi204.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2024-03-17T23:54:24.888 INFO:teuthology.orchestra.run.smithi204.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2024-03-17T23:54:24.889 INFO:teuthology.orchestra.run.smithi204.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2024-03-17T23:54:24.980 INFO:teuthology.orchestra.run.smithi204.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2024-03-17T23:54:24.995 INFO:teuthology.orchestra.run.smithi204.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2 [1,481 kB] 2024-03-17T23:54:25.076 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-03-17T23:54:25.104 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.15_amd64.deb ... 2024-03-17T23:54:25.143 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.15) ... 2024-03-17T23:54:25.445 INFO:teuthology.orchestra.run.smithi204.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2024-03-17T23:54:25.447 INFO:teuthology.orchestra.run.smithi204.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2024-03-17T23:54:25.655 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package libteamdctl0:amd64. 2024-03-17T23:54:25.683 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2024-03-17T23:54:25.721 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2024-03-17T23:54:25.853 INFO:teuthology.orchestra.run.smithi204.stdout:Preconfiguring packages ... 2024-03-17T23:54:26.019 INFO:teuthology.orchestra.run.smithi204.stdout:Fetched 54.6 MB in 5s (10.9 MB/s) 2024-03-17T23:54:26.074 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package modemmanager. 2024-03-17T23:54:26.102 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-03-17T23:54:26.140 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package flex. 2024-03-17T23:54:26.140 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-03-17T23:54:26.237 INFO:teuthology.orchestra.run.smithi204.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173660 files and directories currently installed.) 2024-03-17T23:54:26.242 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2024-03-17T23:54:26.296 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking flex (2.6.4-8build2) ... 2024-03-17T23:54:26.755 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package network-manager. 2024-03-17T23:54:26.782 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2024-03-17T23:54:26.830 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2024-03-17T23:54:26.864 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.15_amd64.deb ... 2024-03-17T23:54:27.036 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.15) over (3.0.2-0ubuntu1.7) ... 2024-03-17T23:54:27.437 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package ppp. 2024-03-17T23:54:27.455 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.15) ... 2024-03-17T23:54:27.465 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2024-03-17T23:54:27.751 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2024-03-17T23:54:27.971 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package bison. 2024-03-17T23:54:28.024 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package pptp-linux. 2024-03-17T23:54:28.041 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2024-03-17T23:54:28.074 INFO:teuthology.orchestra.run.smithi204.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173733 files and directories currently installed.) 2024-03-17T23:54:28.080 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2024-03-17T23:54:28.082 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2024-03-17T23:54:28.115 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2024-03-17T23:54:28.335 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package network-manager-pptp. 2024-03-17T23:54:28.363 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2024-03-17T23:54:28.401 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2024-03-17T23:54:28.499 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package liblzo2-2:amd64. 2024-03-17T23:54:28.527 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2024-03-17T23:54:28.566 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2024-03-17T23:54:28.713 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package postgresql-client-common. 2024-03-17T23:54:28.741 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2024-03-17T23:54:28.779 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking postgresql-client-common (238) ... 2024-03-17T23:54:28.886 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package dump. 2024-03-17T23:54:28.914 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2024-03-17T23:54:28.952 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking dump (0.4b47-3) ... 2024-03-17T23:54:29.058 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package postgresql-client-14. 2024-03-17T23:54:29.086 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../27-postgresql-client-14_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-03-17T23:54:29.124 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking postgresql-client-14 (14.11-0ubuntu0.22.04.1) ... 2024-03-17T23:54:29.264 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package indent. 2024-03-17T23:54:29.280 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../03-indent_2.2.12-1ubuntu0.22.04.1_amd64.deb ... 2024-03-17T23:54:29.322 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking indent (2.2.12-1ubuntu0.22.04.1) ... 2024-03-17T23:54:29.550 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-03-17T23:54:29.566 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2024-03-17T23:54:29.600 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2024-03-17T23:54:29.638 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package postgresql-common. 2024-03-17T23:54:29.666 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2024-03-17T23:54:29.714 INFO:teuthology.orchestra.run.smithi196.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2024-03-17T23:54:29.744 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking postgresql-common (238) ... 2024-03-17T23:54:29.929 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package libbluetooth3:amd64. 2024-03-17T23:54:29.956 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1.1_amd64.deb ... 2024-03-17T23:54:29.995 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2024-03-17T23:54:30.187 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package postgresql-14. 2024-03-17T23:54:30.214 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../29-postgresql-14_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-03-17T23:54:30.256 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-03-17T23:54:30.257 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking postgresql-14 (14.11-0ubuntu0.22.04.1) ... 2024-03-17T23:54:30.272 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2024-03-17T23:54:30.315 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2024-03-17T23:54:30.610 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package libfl2:amd64. 2024-03-17T23:54:30.638 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2024-03-17T23:54:30.668 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2024-03-17T23:54:30.904 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package libfl-dev:amd64. 2024-03-17T23:54:30.920 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2024-03-17T23:54:30.962 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2024-03-17T23:54:31.215 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package libjson-perl. 2024-03-17T23:54:31.243 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2024-03-17T23:54:31.281 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking libjson-perl (4.04000-1) ... 2024-03-17T23:54:31.585 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package libllvm14:amd64. 2024-03-17T23:54:31.612 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1.1_amd64.deb ... 2024-03-17T23:54:31.622 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package postgresql. 2024-03-17T23:54:31.651 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-03-17T23:54:31.652 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2024-03-17T23:54:31.689 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking postgresql (14+238) ... 2024-03-17T23:54:31.916 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package postgresql-client. 2024-03-17T23:54:31.933 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2024-03-17T23:54:31.974 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking postgresql-client (14+238) ... 2024-03-17T23:54:32.218 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package postgresql-contrib. 2024-03-17T23:54:32.234 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2024-03-17T23:54:32.276 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking postgresql-contrib (14+238) ... 2024-03-17T23:54:32.546 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package tcl8.6. 2024-03-17T23:54:32.562 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2024-03-17T23:54:32.604 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2024-03-17T23:54:32.839 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package tcl. 2024-03-17T23:54:32.856 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2024-03-17T23:54:32.902 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking tcl (8.6.11+1build2) ... 2024-03-17T23:54:33.221 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2024-03-17T23:54:33.249 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-03-17T23:54:33.251 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package wpasupplicant. 2024-03-17T23:54:33.279 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2_amd64.deb ... 2024-03-17T23:54:33.279 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-03-17T23:54:33.317 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2) ... 2024-03-17T23:54:33.548 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package libmbim-proxy. 2024-03-17T23:54:33.564 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-03-17T23:54:33.606 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-03-17T23:54:33.705 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package usb-modeswitch-data. 2024-03-17T23:54:33.721 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2024-03-17T23:54:33.763 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2024-03-17T23:54:33.943 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package libmm-glib0:amd64. 2024-03-17T23:54:33.970 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-03-17T23:54:34.009 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-03-17T23:54:34.183 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package usb-modeswitch. 2024-03-17T23:54:34.211 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2024-03-17T23:54:34.304 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2024-03-17T23:54:34.312 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package libndp0:amd64. 2024-03-17T23:54:34.340 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3_amd64.deb ... 2024-03-17T23:54:34.371 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3) ... 2024-03-17T23:54:34.663 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up postgresql-client-common (238) ... 2024-03-17T23:54:34.690 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package libnm0:amd64. 2024-03-17T23:54:34.718 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2024-03-17T23:54:34.756 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-03-17T23:54:34.872 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up flex (2.6.4-8build2) ... 2024-03-17T23:54:35.007 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2024-03-17T23:54:35.110 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package libpq5:amd64. 2024-03-17T23:54:35.137 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../16-libpq5_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-03-17T23:54:35.158 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up libpq5:amd64 (14.11-0ubuntu0.22.04.1) ... 2024-03-17T23:54:35.176 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking libpq5:amd64 (14.11-0ubuntu0.22.04.1) ... 2024-03-17T23:54:35.308 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2024-03-17T23:54:35.443 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2024-03-17T23:54:35.504 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2024-03-17T23:54:35.532 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-03-17T23:54:35.570 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-03-17T23:54:35.602 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up postgresql-client-14 (14.11-0ubuntu0.22.04.1) ... 2024-03-17T23:54:35.857 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package libqmi-proxy. 2024-03-17T23:54:35.884 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-03-17T23:54:35.923 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-03-17T23:54:36.113 INFO:teuthology.orchestra.run.smithi196.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2024-03-17T23:54:36.193 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-03-17T23:54:36.208 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2) ... 2024-03-17T23:54:36.220 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.15_amd64.deb ... 2024-03-17T23:54:36.259 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.15) ... 2024-03-17T23:54:36.590 INFO:teuthology.orchestra.run.smithi196.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2024-03-17T23:54:36.590 INFO:teuthology.orchestra.run.smithi196.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2024-03-17T23:54:36.796 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package libteamdctl0:amd64. 2024-03-17T23:54:36.824 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2024-03-17T23:54:36.871 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2024-03-17T23:54:37.102 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2024-03-17T23:54:37.229 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.15) ... 2024-03-17T23:54:37.241 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package modemmanager. 2024-03-17T23:54:37.268 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-03-17T23:54:37.307 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-03-17T23:54:37.354 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2024-03-17T23:54:37.480 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2024-03-17T23:54:37.615 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2024-03-17T23:54:37.766 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-03-17T23:54:37.917 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2024-03-17T23:54:37.955 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package network-manager. 2024-03-17T23:54:37.983 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2024-03-17T23:54:38.030 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2024-03-17T23:54:38.673 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-03-17T23:54:38.807 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up dump (0.4b47-3) ... 2024-03-17T23:54:38.830 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package ppp. 2024-03-17T23:54:38.858 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2024-03-17T23:54:38.917 INFO:teuthology.orchestra.run.smithi196.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2024-03-17T23:54:39.000 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-03-17T23:54:39.130 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2024-03-17T23:54:39.159 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2024-03-17T23:54:39.310 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up tcl (8.6.11+1build2) ... 2024-03-17T23:54:39.436 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up libjson-perl (4.04000-1) ... 2024-03-17T23:54:39.460 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package pptp-linux. 2024-03-17T23:54:39.488 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2024-03-17T23:54:39.526 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2024-03-17T23:54:39.562 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2024-03-17T23:54:39.771 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package network-manager-pptp. 2024-03-17T23:54:39.787 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2024-03-17T23:54:39.820 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2024-03-17T23:54:40.054 INFO:teuthology.orchestra.run.smithi196.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2024-03-17T23:54:40.107 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package postgresql-client-common. 2024-03-17T23:54:40.123 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up indent (2.2.12-1ubuntu0.22.04.1) ... 2024-03-17T23:54:40.135 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2024-03-17T23:54:40.173 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking postgresql-client-common (238) ... 2024-03-17T23:54:40.249 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2024-03-17T23:54:40.458 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3) ... 2024-03-17T23:54:40.478 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package postgresql-client-14. 2024-03-17T23:54:40.505 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../27-postgresql-client-14_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-03-17T23:54:40.544 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking postgresql-client-14 (14.11-0ubuntu0.22.04.1) ... 2024-03-17T23:54:40.609 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-03-17T23:54:40.769 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2024-03-17T23:54:40.945 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up postgresql-client (14+238) ... 2024-03-17T23:54:41.071 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2024-03-17T23:54:41.132 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package postgresql-common. 2024-03-17T23:54:41.161 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2024-03-17T23:54:41.216 INFO:teuthology.orchestra.run.smithi204.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2024-03-17T23:54:41.238 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking postgresql-common (238) ... 2024-03-17T23:54:41.543 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-03-17T23:54:41.543 INFO:teuthology.orchestra.run.smithi196.stdout:The following network interfaces were found in /etc/network/interfaces 2024-03-17T23:54:41.543 INFO:teuthology.orchestra.run.smithi196.stdout:which means they are currently configured by ifupdown: 2024-03-17T23:54:41.543 INFO:teuthology.orchestra.run.smithi196.stdout:- enp3s0f1 2024-03-17T23:54:41.543 INFO:teuthology.orchestra.run.smithi196.stdout:If you want to manage those interfaces with NetworkManager instead 2024-03-17T23:54:41.543 INFO:teuthology.orchestra.run.smithi196.stdout:remove their configuration from /etc/network/interfaces. 2024-03-17T23:54:41.544 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-03-17T23:54:41.659 INFO:teuthology.orchestra.run.smithi196.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2024-03-17T23:54:41.698 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package postgresql-14. 2024-03-17T23:54:41.727 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../29-postgresql-14_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-03-17T23:54:41.768 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking postgresql-14 (14.11-0ubuntu0.22.04.1) ... 2024-03-17T23:54:41.982 INFO:teuthology.orchestra.run.smithi196.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2024-03-17T23:54:42.333 INFO:teuthology.orchestra.run.smithi196.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2024-03-17T23:54:42.841 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-03-17T23:54:42.992 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2024-03-17T23:54:43.118 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2024-03-17T23:54:43.119 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package postgresql. 2024-03-17T23:54:43.136 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2024-03-17T23:54:43.177 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking postgresql (14+238) ... 2024-03-17T23:54:43.244 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up postgresql-common (238) ... 2024-03-17T23:54:43.421 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package postgresql-client. 2024-03-17T23:54:43.449 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2024-03-17T23:54:43.487 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking postgresql-client (14+238) ... 2024-03-17T23:54:43.756 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package postgresql-contrib. 2024-03-17T23:54:43.772 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2024-03-17T23:54:43.815 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking postgresql-contrib (14+238) ... 2024-03-17T23:54:44.084 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package tcl8.6. 2024-03-17T23:54:44.112 INFO:teuthology.orchestra.run.smithi196.stdout:Adding user postgres to group ssl-cert 2024-03-17T23:54:44.112 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2024-03-17T23:54:44.142 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2024-03-17T23:54:44.351 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-03-17T23:54:44.351 INFO:teuthology.orchestra.run.smithi196.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2024-03-17T23:54:44.422 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package tcl. 2024-03-17T23:54:44.450 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2024-03-17T23:54:44.494 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking tcl (8.6.11+1build2) ... 2024-03-17T23:54:44.547 INFO:teuthology.orchestra.run.smithi196.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2024-03-17T23:54:44.547 INFO:teuthology.orchestra.run.smithi196.stdout:Removing obsolete dictionary files: 2024-03-17T23:54:44.842 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package wpasupplicant. 2024-03-17T23:54:44.870 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2_amd64.deb ... 2024-03-17T23:54:44.908 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2) ... 2024-03-17T23:54:45.110 INFO:teuthology.orchestra.run.smithi196.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2024-03-17T23:54:45.237 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package usb-modeswitch-data. 2024-03-17T23:54:45.254 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2024-03-17T23:54:45.296 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2024-03-17T23:54:45.520 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up postgresql-14 (14.11-0ubuntu0.22.04.1) ... 2024-03-17T23:54:45.674 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package usb-modeswitch. 2024-03-17T23:54:45.702 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2024-03-17T23:54:45.748 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2024-03-17T23:54:45.842 INFO:teuthology.orchestra.run.smithi196.stdout:Creating new PostgreSQL cluster 14/main ... 2024-03-17T23:54:45.859 INFO:teuthology.orchestra.run.smithi196.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2024-03-17T23:54:45.907 INFO:teuthology.orchestra.run.smithi196.stdout:The files belonging to this database system will be owned by user "postgres". 2024-03-17T23:54:45.907 INFO:teuthology.orchestra.run.smithi196.stdout:This user must also own the server process. 2024-03-17T23:54:45.907 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-03-17T23:54:45.907 INFO:teuthology.orchestra.run.smithi196.stdout:The database cluster will be initialized with locale "en_US". 2024-03-17T23:54:45.907 INFO:teuthology.orchestra.run.smithi196.stdout:The default database encoding has accordingly been set to "LATIN1". 2024-03-17T23:54:45.908 INFO:teuthology.orchestra.run.smithi196.stdout:The default text search configuration will be set to "english". 2024-03-17T23:54:45.908 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-03-17T23:54:45.908 INFO:teuthology.orchestra.run.smithi196.stdout:Data page checksums are disabled. 2024-03-17T23:54:45.908 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-03-17T23:54:45.908 INFO:teuthology.orchestra.run.smithi196.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2024-03-17T23:54:45.908 INFO:teuthology.orchestra.run.smithi196.stdout:creating subdirectories ... ok 2024-03-17T23:54:45.908 INFO:teuthology.orchestra.run.smithi196.stdout:selecting dynamic shared memory implementation ... posix 2024-03-17T23:54:45.920 INFO:teuthology.orchestra.run.smithi196.stdout:selecting default max_connections ... 100 2024-03-17T23:54:45.941 INFO:teuthology.orchestra.run.smithi196.stdout:selecting default shared_buffers ... 128MB 2024-03-17T23:54:45.950 INFO:teuthology.orchestra.run.smithi196.stdout:selecting default time zone ... Etc/UTC 2024-03-17T23:54:45.951 INFO:teuthology.orchestra.run.smithi196.stdout:creating configuration files ... ok 2024-03-17T23:54:46.044 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up postgresql-client-common (238) ... 2024-03-17T23:54:46.067 INFO:teuthology.orchestra.run.smithi196.stdout:running bootstrap script ... ok 2024-03-17T23:54:46.672 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up flex (2.6.4-8build2) ... 2024-03-17T23:54:46.683 INFO:teuthology.orchestra.run.smithi196.stdout:performing post-bootstrap initialization ... ok 2024-03-17T23:54:46.798 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2024-03-17T23:54:46.924 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up libpq5:amd64 (14.11-0ubuntu0.22.04.1) ... 2024-03-17T23:54:47.050 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2024-03-17T23:54:47.193 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2024-03-17T23:54:47.318 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up postgresql-client-14 (14.11-0ubuntu0.22.04.1) ... 2024-03-17T23:54:47.339 INFO:teuthology.orchestra.run.smithi196.stdout:syncing data to disk ... ok 2024-03-17T23:54:47.729 INFO:teuthology.orchestra.run.smithi196.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2024-03-17T23:54:47.807 INFO:teuthology.orchestra.run.smithi204.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2024-03-17T23:54:47.883 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2) ... 2024-03-17T23:54:48.327 INFO:teuthology.orchestra.run.smithi204.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2024-03-17T23:54:48.327 INFO:teuthology.orchestra.run.smithi204.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2024-03-17T23:54:48.811 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2024-03-17T23:54:48.912 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.15) ... 2024-03-17T23:54:49.013 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2024-03-17T23:54:49.139 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2024-03-17T23:54:49.265 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2024-03-17T23:54:49.391 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-03-17T23:54:49.517 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2024-03-17T23:54:50.122 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-03-17T23:54:50.248 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up dump (0.4b47-3) ... 2024-03-17T23:54:50.342 INFO:teuthology.orchestra.run.smithi204.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2024-03-17T23:54:50.408 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-03-17T23:54:50.493 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-03-17T23:54:50.534 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2024-03-17T23:54:50.627 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up postgresql-contrib (14+238) ... 2024-03-17T23:54:50.660 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up tcl (8.6.11+1build2) ... 2024-03-17T23:54:50.753 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up postgresql (14+238) ... 2024-03-17T23:54:50.786 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up libjson-perl (4.04000-1) ... 2024-03-17T23:54:50.879 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-03-17T23:54:50.895 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2024-03-17T23:54:50.977 INFO:teuthology.orchestra.run.smithi204.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2024-03-17T23:54:51.005 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-03-17T23:54:51.047 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up indent (2.2.12-1ubuntu0.22.04.1) ... 2024-03-17T23:54:51.173 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2024-03-17T23:54:51.259 INFO:teuthology.orchestra.run.smithi196.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2024-03-17T23:54:51.259 INFO:teuthology.orchestra.run.smithi196.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2024-03-17T23:54:51.383 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3) ... 2024-03-17T23:54:51.525 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-03-17T23:54:51.652 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2024-03-17T23:54:51.824 INFO:teuthology.orchestra.run.smithi196.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2024-03-17T23:54:52.151 INFO:teuthology.orchestra.run.smithi196.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-03-17T23:54:52.212 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up postgresql-client (14+238) ... 2024-03-17T23:54:52.303 INFO:teuthology.orchestra.run.smithi196.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-03-17T23:54:52.313 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2024-03-17T23:54:52.757 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-03-17T23:54:52.758 INFO:teuthology.orchestra.run.smithi204.stdout:The following network interfaces were found in /etc/network/interfaces 2024-03-17T23:54:52.758 INFO:teuthology.orchestra.run.smithi204.stdout:which means they are currently configured by ifupdown: 2024-03-17T23:54:52.758 INFO:teuthology.orchestra.run.smithi204.stdout:- enp3s0f1 2024-03-17T23:54:52.758 INFO:teuthology.orchestra.run.smithi204.stdout:If you want to manage those interfaces with NetworkManager instead 2024-03-17T23:54:52.758 INFO:teuthology.orchestra.run.smithi204.stdout:remove their configuration from /etc/network/interfaces. 2024-03-17T23:54:52.758 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-03-17T23:54:52.881 INFO:teuthology.orchestra.run.smithi204.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2024-03-17T23:54:53.208 INFO:teuthology.orchestra.run.smithi204.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2024-03-17T23:54:53.547 INFO:teuthology.orchestra.run.smithi204.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2024-03-17T23:54:53.555 INFO:teuthology.orchestra.run.smithi196.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2024-03-17T23:54:53.663 INFO:teuthology.orchestra.run.smithi196.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-03-17T23:54:54.049 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-03-17T23:54:54.127 INFO:teuthology.orchestra.run.smithi196.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-03-17T23:54:54.133 DEBUG:teuthology.parallel:result is None 2024-03-17T23:54:54.192 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2024-03-17T23:54:54.318 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2024-03-17T23:54:54.444 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up postgresql-common (238) ... 2024-03-17T23:54:55.317 INFO:teuthology.orchestra.run.smithi204.stdout:Adding user postgres to group ssl-cert 2024-03-17T23:54:55.536 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-03-17T23:54:55.536 INFO:teuthology.orchestra.run.smithi204.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2024-03-17T23:54:55.709 INFO:teuthology.orchestra.run.smithi204.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2024-03-17T23:54:55.709 INFO:teuthology.orchestra.run.smithi204.stdout:Removing obsolete dictionary files: 2024-03-17T23:54:56.244 INFO:teuthology.orchestra.run.smithi204.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2024-03-17T23:54:56.612 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up postgresql-14 (14.11-0ubuntu0.22.04.1) ... 2024-03-17T23:54:56.921 INFO:teuthology.orchestra.run.smithi204.stdout:Creating new PostgreSQL cluster 14/main ... 2024-03-17T23:54:56.941 INFO:teuthology.orchestra.run.smithi204.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2024-03-17T23:54:56.984 INFO:teuthology.orchestra.run.smithi204.stdout:The files belonging to this database system will be owned by user "postgres". 2024-03-17T23:54:56.985 INFO:teuthology.orchestra.run.smithi204.stdout:This user must also own the server process. 2024-03-17T23:54:56.985 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-03-17T23:54:56.985 INFO:teuthology.orchestra.run.smithi204.stdout:The database cluster will be initialized with locale "en_US". 2024-03-17T23:54:56.985 INFO:teuthology.orchestra.run.smithi204.stdout:The default database encoding has accordingly been set to "LATIN1". 2024-03-17T23:54:56.985 INFO:teuthology.orchestra.run.smithi204.stdout:The default text search configuration will be set to "english". 2024-03-17T23:54:56.985 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-03-17T23:54:56.985 INFO:teuthology.orchestra.run.smithi204.stdout:Data page checksums are disabled. 2024-03-17T23:54:56.985 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-03-17T23:54:56.985 INFO:teuthology.orchestra.run.smithi204.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2024-03-17T23:54:56.986 INFO:teuthology.orchestra.run.smithi204.stdout:creating subdirectories ... ok 2024-03-17T23:54:56.986 INFO:teuthology.orchestra.run.smithi204.stdout:selecting dynamic shared memory implementation ... posix 2024-03-17T23:54:57.000 INFO:teuthology.orchestra.run.smithi204.stdout:selecting default max_connections ... 100 2024-03-17T23:54:57.019 INFO:teuthology.orchestra.run.smithi204.stdout:selecting default shared_buffers ... 128MB 2024-03-17T23:54:57.029 INFO:teuthology.orchestra.run.smithi204.stdout:selecting default time zone ... Etc/UTC 2024-03-17T23:54:57.029 INFO:teuthology.orchestra.run.smithi204.stdout:creating configuration files ... ok 2024-03-17T23:54:57.142 INFO:teuthology.orchestra.run.smithi204.stdout:running bootstrap script ... ok 2024-03-17T23:54:57.767 INFO:teuthology.orchestra.run.smithi204.stdout:performing post-bootstrap initialization ... ok 2024-03-17T23:54:58.473 INFO:teuthology.orchestra.run.smithi204.stdout:syncing data to disk ... ok 2024-03-17T23:54:58.845 INFO:teuthology.orchestra.run.smithi204.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2024-03-17T23:55:01.619 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-03-17T23:55:01.728 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up postgresql-contrib (14+238) ... 2024-03-17T23:55:01.829 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up postgresql (14+238) ... 2024-03-17T23:55:01.947 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-03-17T23:55:02.089 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-03-17T23:55:02.341 INFO:teuthology.orchestra.run.smithi204.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2024-03-17T23:55:02.341 INFO:teuthology.orchestra.run.smithi204.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2024-03-17T23:55:02.892 INFO:teuthology.orchestra.run.smithi204.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2024-03-17T23:55:03.194 INFO:teuthology.orchestra.run.smithi204.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-03-17T23:55:03.346 INFO:teuthology.orchestra.run.smithi204.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-03-17T23:55:04.616 INFO:teuthology.orchestra.run.smithi204.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2024-03-17T23:55:04.715 INFO:teuthology.orchestra.run.smithi204.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-03-17T23:55:05.177 INFO:teuthology.orchestra.run.smithi204.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-03-17T23:55:05.182 DEBUG:teuthology.parallel:result is None 2024-03-17T23:55:05.183 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=3d78f5ba07bf18880172c07d4d7b4ac00c9d30af 2024-03-17T23:55:05.329 DEBUG:teuthology.orchestra.run.smithi196:> dpkg-query -W -f '${Version}' ceph 2024-03-17T23:55:05.349 INFO:teuthology.orchestra.run.smithi196.stdout:19.0.0-2162-g3d78f5ba-1jammy 2024-03-17T23:55:05.349 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-2162-g3d78f5ba-1jammy 2024-03-17T23:55:05.350 INFO:teuthology.task.install:The correct ceph version 19.0.0-2162-g3d78f5ba-1jammy is installed. 2024-03-17T23:55:05.351 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=3d78f5ba07bf18880172c07d4d7b4ac00c9d30af 2024-03-17T23:55:05.562 DEBUG:teuthology.orchestra.run.smithi204:> dpkg-query -W -f '${Version}' ceph 2024-03-17T23:55:05.582 INFO:teuthology.orchestra.run.smithi204.stdout:19.0.0-2162-g3d78f5ba-1jammy 2024-03-17T23:55:05.582 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-2162-g3d78f5ba-1jammy 2024-03-17T23:55:05.582 INFO:teuthology.task.install:The correct ceph version 19.0.0-2162-g3d78f5ba-1jammy is installed. 2024-03-17T23:55:05.584 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-03-17T23:55:05.584 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2024-03-17T23:55:05.584 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-03-17T23:55:05.599 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2024-03-17T23:55:05.599 DEBUG:teuthology.orchestra.run.smithi204:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-03-17T23:55:05.640 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-03-17T23:55:05.640 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2024-03-17T23:55:05.640 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd of=/usr/bin/daemon-helper 2024-03-17T23:55:05.652 DEBUG:teuthology.orchestra.run.smithi196:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-03-17T23:55:05.707 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2024-03-17T23:55:05.707 DEBUG:teuthology.orchestra.run.smithi204:> sudo dd of=/usr/bin/daemon-helper 2024-03-17T23:55:05.720 DEBUG:teuthology.orchestra.run.smithi204:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-03-17T23:55:05.773 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-03-17T23:55:05.773 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2024-03-17T23:55:05.773 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd of=/usr/bin/adjust-ulimits 2024-03-17T23:55:05.786 DEBUG:teuthology.orchestra.run.smithi196:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-03-17T23:55:05.838 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2024-03-17T23:55:05.838 DEBUG:teuthology.orchestra.run.smithi204:> sudo dd of=/usr/bin/adjust-ulimits 2024-03-17T23:55:05.851 DEBUG:teuthology.orchestra.run.smithi204:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-03-17T23:55:05.906 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-03-17T23:55:05.906 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2024-03-17T23:55:05.906 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd of=/usr/bin/stdin-killer 2024-03-17T23:55:05.919 DEBUG:teuthology.orchestra.run.smithi196:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-03-17T23:55:05.975 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2024-03-17T23:55:05.975 DEBUG:teuthology.orchestra.run.smithi204:> sudo dd of=/usr/bin/stdin-killer 2024-03-17T23:55:05.988 DEBUG:teuthology.orchestra.run.smithi204:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-03-17T23:55:06.046 INFO:teuthology.run_tasks:Running task ceph... 2024-03-17T23:55:06.127 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-03-17T23:55:06.127 DEBUG:teuthology.orchestra.run.smithi196:> sudo chmod 777 /var/log/ceph 2024-03-17T23:55:06.130 DEBUG:teuthology.orchestra.run.smithi204:> sudo chmod 777 /var/log/ceph 2024-03-17T23:55:06.143 INFO:tasks.ceph:Disabling ceph logrotate... 2024-03-17T23:55:06.143 DEBUG:teuthology.orchestra.run.smithi196:> sudo rm -f -- /etc/logrotate.d/ceph 2024-03-17T23:55:06.185 DEBUG:teuthology.orchestra.run.smithi204:> sudo rm -f -- /etc/logrotate.d/ceph 2024-03-17T23:55:06.197 INFO:tasks.ceph:Creating extra log directories... 2024-03-17T23:55:06.197 DEBUG:teuthology.orchestra.run.smithi196:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-03-17T23:55:06.237 DEBUG:teuthology.orchestra.run.smithi204:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-03-17T23:55:06.255 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-03-17T23:55:06.256 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-03-17T23:55:06.256 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-03-17T23:55:06.256 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2024-03-17T23:55:06.256 DEBUG:teuthology.orchestra.run.smithi196:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-03-17T23:55:06.292 DEBUG:teuthology.orchestra.run.smithi196:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-03-17T23:55:06.366 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2024-03-17T23:55:06.366 DEBUG:teuthology.orchestra.run.smithi204:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-03-17T23:55:06.372 DEBUG:teuthology.orchestra.run.smithi204:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-03-17T23:55:06.452 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-03-17T23:55:06.452 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'lockdep': True}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'mons down, quorum', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-03-17T23:55:06.452 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/pdonnell-2024-03-17_23:17:27-fs-wip-batrick-testing-20240314.183243-distro-default-smithi/7608502', 'branch': 'wip-batrick-testing-20240314.183243', 'description': 'fs/verify/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu/{overrides ubuntu_latest}} mount/fuse objectstore-ec/bluestore-comp overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug session_timeout} ranks/5 tasks/fsstress validater/lockdep}', 'email': 'pdonnell@redhat.com', 'first_in_suite': False, 'job_id': '7608502', 'kernel': {'kdb': True, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'pdonnell-2024-03-17_23:17:27-fs-wip-batrick-testing-20240314.183243-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'ubuntu', 'os_version': '22.04', 'overrides': {'admin_socket': {'branch': 'wip-batrick-testing-20240314.183243'}, 'ceph': {'cephfs': {'max_mds': 5, 'session_timeout': 300}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'lockdep': True}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'mons down, quorum', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN'], 'sha1': '3d78f5ba07bf18880172c07d4d7b4ac00c9d30af', 'valgrind': {'exit_on_first_error': False}}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}}}, 'check-counter': {'counters': {'mds': ['mds.exported', 'mds.imported']}}, 'install': {'ceph': {'flavor': 'default', 'sha1': '3d78f5ba07bf18880172c07d4d7b4ac00c9d30af'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-batrick-testing-20240314.183243', 'sha1': 'c382027d5c66ef4e0aa1131ea3e8080c658d3184'}}, 'owner': 'scheduled_pdonnell@teuthology', 'priority': 75, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'mds.e', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'mds.f', 'osd.4', 'osd.5', 'osd.6', 'osd.7']], 'seed': 4770, 'sha1': '3d78f5ba07bf18880172c07d4d7b4ac00c9d30af', 'sleep_before_teardown': 0, 'subset': '498/512', 'suite': 'fs', 'suite_branch': 'wip-batrick-testing-20240314.183243', 'suite_path': '/home/teuthworker/src/github.com_batrick_ceph_c382027d5c66ef4e0aa1131ea3e8080c658d3184/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/batrick/ceph', 'suite_sha1': 'c382027d5c66ef4e0aa1131ea3e8080c658d3184', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi196.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAs0844wV6QQUoZJ+C60WiQCEh8h2X7JIthXaWrQMx9UwB8G87CQJrnIGKrPS1OwgRcON83HyicicbCIye/y7/E=', 'smithi204.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBjRRYU3IlO5bGPT4dvCXd6tMqE52fMlYdvmWFVwJYCtALiTKQQTvQwrt03hevR32GVaaGTAWUPB6arxujLXlTI='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '3d78f5ba07bf18880172c07d4d7b4ac00c9d30af'}}, {'ceph': {'create_rbd_pool': False, 'cephfs': {'max_mds': 5, 'session_timeout': 300}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'lockdep': True}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'mons down, quorum', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN'], 'sha1': '3d78f5ba07bf18880172c07d4d7b4ac00c9d30af', 'valgrind': {'exit_on_first_error': False}, 'cluster': 'ceph'}}, {'ceph-fuse': None}, {'workunit': {'clients': {'all': ['suites/fsstress.sh']}, 'timeout': '6h'}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ['local function is_kupstream() return false end', 'local function is_kdistro() return false end', 'local function is_fuse() return true end', "local function syntax_version() return '' end"]}, 'teuthology_branch': 'main', 'teuthology_sha1': 'e691533f9cbb33d85b2187bba20d7102f098636d', 'timestamp': '2024-03-17_23:17:27', 'tube': 'smithi', 'user': 'pdonnell', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885'} 2024-03-17T23:55:06.453 DEBUG:teuthology.orchestra.run.smithi196:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-03-17T23:55:06.455 DEBUG:teuthology.orchestra.run.smithi204:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-03-17T23:55:06.495 DEBUG:teuthology.orchestra.run.smithi196:> sudo install -d -m0777 -- /var/run/ceph 2024-03-17T23:55:06.501 DEBUG:teuthology.orchestra.run.smithi204:> sudo install -d -m0777 -- /var/run/ceph 2024-03-17T23:55:06.551 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2024-03-17T23:55:06.551 DEBUG:teuthology.orchestra.run.smithi196:> dd if=/scratch_devs of=/dev/stdout 2024-03-17T23:55:06.560 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-03-17T23:55:06.560 DEBUG:teuthology.orchestra.run.smithi196:> stat /dev/vg_nvme/lv_1 2024-03-17T23:55:06.608 INFO:teuthology.orchestra.run.smithi196.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-03-17T23:55:06.608 INFO:teuthology.orchestra.run.smithi196.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-17T23:55:06.609 INFO:teuthology.orchestra.run.smithi196.stdout:Device: 5h/5d Inode: 879 Links: 1 2024-03-17T23:55:06.609 INFO:teuthology.orchestra.run.smithi196.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-17T23:55:06.609 INFO:teuthology.orchestra.run.smithi196.stdout:Access: 2024-03-17 23:48:54.604435665 +0000 2024-03-17T23:55:06.609 INFO:teuthology.orchestra.run.smithi196.stdout:Modify: 2024-03-17 23:48:54.376437577 +0000 2024-03-17T23:55:06.609 INFO:teuthology.orchestra.run.smithi196.stdout:Change: 2024-03-17 23:48:54.376437577 +0000 2024-03-17T23:55:06.609 INFO:teuthology.orchestra.run.smithi196.stdout: Birth: - 2024-03-17T23:55:06.609 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-03-17T23:55:06.662 INFO:teuthology.orchestra.run.smithi196.stderr:1+0 records in 2024-03-17T23:55:06.662 INFO:teuthology.orchestra.run.smithi196.stderr:1+0 records out 2024-03-17T23:55:06.662 INFO:teuthology.orchestra.run.smithi196.stderr:512 bytes copied, 0.000384477 s, 1.3 MB/s 2024-03-17T23:55:06.663 DEBUG:teuthology.orchestra.run.smithi196:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-03-17T23:55:06.713 DEBUG:teuthology.orchestra.run.smithi196:> stat /dev/vg_nvme/lv_2 2024-03-17T23:55:06.760 INFO:teuthology.orchestra.run.smithi196.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-03-17T23:55:06.760 INFO:teuthology.orchestra.run.smithi196.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-17T23:55:06.760 INFO:teuthology.orchestra.run.smithi196.stdout:Device: 5h/5d Inode: 893 Links: 1 2024-03-17T23:55:06.760 INFO:teuthology.orchestra.run.smithi196.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-17T23:55:06.760 INFO:teuthology.orchestra.run.smithi196.stdout:Access: 2024-03-17 23:48:55.108431440 +0000 2024-03-17T23:55:06.760 INFO:teuthology.orchestra.run.smithi196.stdout:Modify: 2024-03-17 23:48:54.828433788 +0000 2024-03-17T23:55:06.761 INFO:teuthology.orchestra.run.smithi196.stdout:Change: 2024-03-17 23:48:54.828433788 +0000 2024-03-17T23:55:06.761 INFO:teuthology.orchestra.run.smithi196.stdout: Birth: - 2024-03-17T23:55:06.761 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-03-17T23:55:06.814 INFO:teuthology.orchestra.run.smithi196.stderr:1+0 records in 2024-03-17T23:55:06.815 INFO:teuthology.orchestra.run.smithi196.stderr:1+0 records out 2024-03-17T23:55:06.815 INFO:teuthology.orchestra.run.smithi196.stderr:512 bytes copied, 0.00045033 s, 1.1 MB/s 2024-03-17T23:55:06.816 DEBUG:teuthology.orchestra.run.smithi196:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-03-17T23:55:06.865 DEBUG:teuthology.orchestra.run.smithi196:> stat /dev/vg_nvme/lv_3 2024-03-17T23:55:06.912 INFO:teuthology.orchestra.run.smithi196.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-03-17T23:55:06.912 INFO:teuthology.orchestra.run.smithi196.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-17T23:55:06.912 INFO:teuthology.orchestra.run.smithi196.stdout:Device: 5h/5d Inode: 910 Links: 1 2024-03-17T23:55:06.912 INFO:teuthology.orchestra.run.smithi196.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-17T23:55:06.912 INFO:teuthology.orchestra.run.smithi196.stdout:Access: 2024-03-17 23:48:55.348429428 +0000 2024-03-17T23:55:06.912 INFO:teuthology.orchestra.run.smithi196.stdout:Modify: 2024-03-17 23:48:55.344429461 +0000 2024-03-17T23:55:06.912 INFO:teuthology.orchestra.run.smithi196.stdout:Change: 2024-03-17 23:48:55.344429461 +0000 2024-03-17T23:55:06.912 INFO:teuthology.orchestra.run.smithi196.stdout: Birth: - 2024-03-17T23:55:06.912 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-03-17T23:55:06.966 INFO:teuthology.orchestra.run.smithi196.stderr:1+0 records in 2024-03-17T23:55:06.966 INFO:teuthology.orchestra.run.smithi196.stderr:1+0 records out 2024-03-17T23:55:06.966 INFO:teuthology.orchestra.run.smithi196.stderr:512 bytes copied, 0.000429791 s, 1.2 MB/s 2024-03-17T23:55:06.968 DEBUG:teuthology.orchestra.run.smithi196:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-03-17T23:55:07.017 DEBUG:teuthology.orchestra.run.smithi196:> stat /dev/vg_nvme/lv_4 2024-03-17T23:55:07.064 INFO:teuthology.orchestra.run.smithi196.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-03-17T23:55:07.064 INFO:teuthology.orchestra.run.smithi196.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-17T23:55:07.064 INFO:teuthology.orchestra.run.smithi196.stdout:Device: 5h/5d Inode: 930 Links: 1 2024-03-17T23:55:07.064 INFO:teuthology.orchestra.run.smithi196.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-17T23:55:07.064 INFO:teuthology.orchestra.run.smithi196.stdout:Access: 2024-03-17 23:48:56.116422988 +0000 2024-03-17T23:55:07.064 INFO:teuthology.orchestra.run.smithi196.stdout:Modify: 2024-03-17 23:48:55.836425336 +0000 2024-03-17T23:55:07.064 INFO:teuthology.orchestra.run.smithi196.stdout:Change: 2024-03-17 23:48:55.836425336 +0000 2024-03-17T23:55:07.064 INFO:teuthology.orchestra.run.smithi196.stdout: Birth: - 2024-03-17T23:55:07.064 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-03-17T23:55:07.118 INFO:teuthology.orchestra.run.smithi196.stderr:1+0 records in 2024-03-17T23:55:07.118 INFO:teuthology.orchestra.run.smithi196.stderr:1+0 records out 2024-03-17T23:55:07.118 INFO:teuthology.orchestra.run.smithi196.stderr:512 bytes copied, 0.000385703 s, 1.3 MB/s 2024-03-17T23:55:07.119 DEBUG:teuthology.orchestra.run.smithi196:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-03-17T23:55:07.169 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-03-17T23:55:07.170 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2024-03-17T23:55:07.170 DEBUG:teuthology.orchestra.run.smithi204:> dd if=/scratch_devs of=/dev/stdout 2024-03-17T23:55:07.176 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-03-17T23:55:07.176 DEBUG:teuthology.orchestra.run.smithi204:> stat /dev/vg_nvme/lv_1 2024-03-17T23:55:07.224 INFO:teuthology.orchestra.run.smithi204.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-03-17T23:55:07.224 INFO:teuthology.orchestra.run.smithi204.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-17T23:55:07.224 INFO:teuthology.orchestra.run.smithi204.stdout:Device: 5h/5d Inode: 893 Links: 1 2024-03-17T23:55:07.224 INFO:teuthology.orchestra.run.smithi204.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-17T23:55:07.224 INFO:teuthology.orchestra.run.smithi204.stdout:Access: 2024-03-17 23:48:54.685092794 +0000 2024-03-17T23:55:07.224 INFO:teuthology.orchestra.run.smithi204.stdout:Modify: 2024-03-17 23:48:54.401095331 +0000 2024-03-17T23:55:07.225 INFO:teuthology.orchestra.run.smithi204.stdout:Change: 2024-03-17 23:48:54.401095331 +0000 2024-03-17T23:55:07.225 INFO:teuthology.orchestra.run.smithi204.stdout: Birth: - 2024-03-17T23:55:07.225 DEBUG:teuthology.orchestra.run.smithi204:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-03-17T23:55:07.277 INFO:teuthology.orchestra.run.smithi204.stderr:1+0 records in 2024-03-17T23:55:07.278 INFO:teuthology.orchestra.run.smithi204.stderr:1+0 records out 2024-03-17T23:55:07.278 INFO:teuthology.orchestra.run.smithi204.stderr:512 bytes copied, 0.000379006 s, 1.4 MB/s 2024-03-17T23:55:07.279 DEBUG:teuthology.orchestra.run.smithi204:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-03-17T23:55:07.328 DEBUG:teuthology.orchestra.run.smithi204:> stat /dev/vg_nvme/lv_2 2024-03-17T23:55:07.375 INFO:teuthology.orchestra.run.smithi204.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-03-17T23:55:07.375 INFO:teuthology.orchestra.run.smithi204.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-17T23:55:07.375 INFO:teuthology.orchestra.run.smithi204.stdout:Device: 5h/5d Inode: 909 Links: 1 2024-03-17T23:55:07.375 INFO:teuthology.orchestra.run.smithi204.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-17T23:55:07.375 INFO:teuthology.orchestra.run.smithi204.stdout:Access: 2024-03-17 23:48:55.157088579 +0000 2024-03-17T23:55:07.376 INFO:teuthology.orchestra.run.smithi204.stdout:Modify: 2024-03-17 23:48:54.913090758 +0000 2024-03-17T23:55:07.376 INFO:teuthology.orchestra.run.smithi204.stdout:Change: 2024-03-17 23:48:54.913090758 +0000 2024-03-17T23:55:07.376 INFO:teuthology.orchestra.run.smithi204.stdout: Birth: - 2024-03-17T23:55:07.376 DEBUG:teuthology.orchestra.run.smithi204:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-03-17T23:55:07.429 INFO:teuthology.orchestra.run.smithi204.stderr:1+0 records in 2024-03-17T23:55:07.429 INFO:teuthology.orchestra.run.smithi204.stderr:1+0 records out 2024-03-17T23:55:07.429 INFO:teuthology.orchestra.run.smithi204.stderr:512 bytes copied, 0.000443397 s, 1.2 MB/s 2024-03-17T23:55:07.431 DEBUG:teuthology.orchestra.run.smithi204:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-03-17T23:55:07.480 DEBUG:teuthology.orchestra.run.smithi204:> stat /dev/vg_nvme/lv_3 2024-03-17T23:55:07.526 INFO:teuthology.orchestra.run.smithi204.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-03-17T23:55:07.527 INFO:teuthology.orchestra.run.smithi204.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-17T23:55:07.527 INFO:teuthology.orchestra.run.smithi204.stdout:Device: 5h/5d Inode: 927 Links: 1 2024-03-17T23:55:07.527 INFO:teuthology.orchestra.run.smithi204.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-17T23:55:07.527 INFO:teuthology.orchestra.run.smithi204.stdout:Access: 2024-03-17 23:48:55.641084255 +0000 2024-03-17T23:55:07.527 INFO:teuthology.orchestra.run.smithi204.stdout:Modify: 2024-03-17 23:48:55.397086434 +0000 2024-03-17T23:55:07.527 INFO:teuthology.orchestra.run.smithi204.stdout:Change: 2024-03-17 23:48:55.397086434 +0000 2024-03-17T23:55:07.527 INFO:teuthology.orchestra.run.smithi204.stdout: Birth: - 2024-03-17T23:55:07.527 DEBUG:teuthology.orchestra.run.smithi204:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-03-17T23:55:07.581 INFO:teuthology.orchestra.run.smithi204.stderr:1+0 records in 2024-03-17T23:55:07.581 INFO:teuthology.orchestra.run.smithi204.stderr:1+0 records out 2024-03-17T23:55:07.581 INFO:teuthology.orchestra.run.smithi204.stderr:512 bytes copied, 0.000357916 s, 1.4 MB/s 2024-03-17T23:55:07.582 DEBUG:teuthology.orchestra.run.smithi204:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-03-17T23:55:07.632 DEBUG:teuthology.orchestra.run.smithi204:> stat /dev/vg_nvme/lv_4 2024-03-17T23:55:07.683 INFO:teuthology.orchestra.run.smithi204.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-03-17T23:55:07.683 INFO:teuthology.orchestra.run.smithi204.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-17T23:55:07.683 INFO:teuthology.orchestra.run.smithi204.stdout:Device: 5h/5d Inode: 944 Links: 1 2024-03-17T23:55:07.683 INFO:teuthology.orchestra.run.smithi204.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-17T23:55:07.683 INFO:teuthology.orchestra.run.smithi204.stdout:Access: 2024-03-17 23:48:56.113080039 +0000 2024-03-17T23:55:07.683 INFO:teuthology.orchestra.run.smithi204.stdout:Modify: 2024-03-17 23:48:55.865082254 +0000 2024-03-17T23:55:07.683 INFO:teuthology.orchestra.run.smithi204.stdout:Change: 2024-03-17 23:48:55.865082254 +0000 2024-03-17T23:55:07.683 INFO:teuthology.orchestra.run.smithi204.stdout: Birth: - 2024-03-17T23:55:07.683 DEBUG:teuthology.orchestra.run.smithi204:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-03-17T23:55:07.736 INFO:teuthology.orchestra.run.smithi204.stderr:1+0 records in 2024-03-17T23:55:07.736 INFO:teuthology.orchestra.run.smithi204.stderr:1+0 records out 2024-03-17T23:55:07.737 INFO:teuthology.orchestra.run.smithi204.stderr:512 bytes copied, 0.000327311 s, 1.6 MB/s 2024-03-17T23:55:07.738 DEBUG:teuthology.orchestra.run.smithi204:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-03-17T23:55:07.788 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-03-17T23:55:07.788 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi196.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi204.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-03-17T23:55:07.788 INFO:tasks.ceph:Generating config... 2024-03-17T23:55:07.789 INFO:tasks.ceph:[client] client mount timeout = 600 2024-03-17T23:55:07.789 INFO:tasks.ceph:[client] debug client = 20 2024-03-17T23:55:07.789 INFO:tasks.ceph:[client] debug ms = 1 2024-03-17T23:55:07.790 INFO:tasks.ceph:[client] rados mon op timeout = 900 2024-03-17T23:55:07.790 INFO:tasks.ceph:[client] rados osd op timeout = 900 2024-03-17T23:55:07.790 INFO:tasks.ceph:[global] lockdep = True 2024-03-17T23:55:07.790 INFO:tasks.ceph:[mds] debug mds = 20 2024-03-17T23:55:07.790 INFO:tasks.ceph:[mds] debug mds balancer = 20 2024-03-17T23:55:07.790 INFO:tasks.ceph:[mds] debug ms = 1 2024-03-17T23:55:07.790 INFO:tasks.ceph:[mds] mds debug frag = True 2024-03-17T23:55:07.790 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2024-03-17T23:55:07.790 INFO:tasks.ceph:[mds] mds op complaint time = 180 2024-03-17T23:55:07.790 INFO:tasks.ceph:[mds] mds verify scatter = True 2024-03-17T23:55:07.790 INFO:tasks.ceph:[mds] osd op complaint time = 180 2024-03-17T23:55:07.790 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2024-03-17T23:55:07.790 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2024-03-17T23:55:07.790 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-03-17T23:55:07.791 INFO:tasks.ceph:[mgr] debug ms = 1 2024-03-17T23:55:07.791 INFO:tasks.ceph:[mon] debug mon = 20 2024-03-17T23:55:07.791 INFO:tasks.ceph:[mon] debug ms = 1 2024-03-17T23:55:07.791 INFO:tasks.ceph:[mon] debug paxos = 20 2024-03-17T23:55:07.791 INFO:tasks.ceph:[mon] mon op complaint time = 120 2024-03-17T23:55:07.791 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-03-17T23:55:07.791 INFO:tasks.ceph:[osd] bluestore compression mode = aggressive 2024-03-17T23:55:07.791 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-03-17T23:55:07.791 INFO:tasks.ceph:[osd] debug bluefs = 20 2024-03-17T23:55:07.791 INFO:tasks.ceph:[osd] debug bluestore = 20 2024-03-17T23:55:07.791 INFO:tasks.ceph:[osd] debug ms = 1 2024-03-17T23:55:07.791 INFO:tasks.ceph:[osd] debug osd = 20 2024-03-17T23:55:07.791 INFO:tasks.ceph:[osd] debug rocksdb = 10 2024-03-17T23:55:07.791 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-03-17T23:55:07.792 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-03-17T23:55:07.792 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-03-17T23:55:07.792 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-03-17T23:55:07.792 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-03-17T23:55:07.792 INFO:tasks.ceph:[osd] osd op complaint time = 180 2024-03-17T23:55:07.792 INFO:tasks.ceph:Setting up mon.a... 2024-03-17T23:55:07.792 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-03-17T23:55:07.826 INFO:teuthology.orchestra.run.smithi196.stdout:creating /etc/ceph/ceph.keyring 2024-03-17T23:55:07.849 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-03-17T23:55:07.928 DEBUG:teuthology.orchestra.run.smithi196:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-03-17T23:55:07.983 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.196'), ('mon.b', '172.21.15.204'), ('mon.c', '[v2:172.21.15.204:3301,v1:172.21.15.204:6790]')] 2024-03-17T23:55:07.983 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.196,172.21.15.204,[v2:172.21.15.204:3301,v1:172.21.15.204:6790]', 'lockdep': True}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.e': {}, 'mds.b': {}, 'mds.d': {}, 'mds.f': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2024-03-17T23:55:07.984 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2024-03-17T23:55:07.984 DEBUG:teuthology.orchestra.run.smithi196:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-03-17T23:55:08.028 DEBUG:teuthology.orchestra.run.smithi196:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.196 --add b 172.21.15.204 --addv c '[v2:172.21.15.204:3301,v1:172.21.15.204:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-03-17T23:55:08.113 INFO:teuthology.orchestra.run.smithi196.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-03-17T23:55:08.113 INFO:teuthology.orchestra.run.smithi196.stdout:monmaptool: generated fsid b80f9c80-17ad-4126-8957-4c0c46f5b803 2024-03-17T23:55:08.113 INFO:teuthology.orchestra.run.smithi196.stdout:setting min_mon_release = quincy 2024-03-17T23:55:08.113 INFO:teuthology.orchestra.run.smithi196.stdout:epoch 0 2024-03-17T23:55:08.113 INFO:teuthology.orchestra.run.smithi196.stdout:fsid b80f9c80-17ad-4126-8957-4c0c46f5b803 2024-03-17T23:55:08.113 INFO:teuthology.orchestra.run.smithi196.stdout:last_changed 2024-03-17T23:55:08.115707+0000 2024-03-17T23:55:08.113 INFO:teuthology.orchestra.run.smithi196.stdout:created 2024-03-17T23:55:08.115707+0000 2024-03-17T23:55:08.113 INFO:teuthology.orchestra.run.smithi196.stdout:min_mon_release 17 (quincy) 2024-03-17T23:55:08.113 INFO:teuthology.orchestra.run.smithi196.stdout:election_strategy: 1 2024-03-17T23:55:08.113 INFO:teuthology.orchestra.run.smithi196.stdout:0: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.a 2024-03-17T23:55:08.114 INFO:teuthology.orchestra.run.smithi196.stdout:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-03-17T23:55:08.114 INFO:teuthology.orchestra.run.smithi196.stdout:2: [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] mon.c 2024-03-17T23:55:08.114 INFO:teuthology.orchestra.run.smithi196.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-03-17T23:55:08.115 DEBUG:teuthology.orchestra.run.smithi196:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-03-17T23:55:08.160 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID b80f9c80-17ad-4126-8957-4c0c46f5b803... 2024-03-17T23:55:08.161 DEBUG:teuthology.orchestra.run.smithi196:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-03-17T23:55:08.205 DEBUG:teuthology.orchestra.run.smithi204:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-03-17T23:55:08.235 INFO:teuthology.orchestra.run.smithi196.stdout:[global] 2024-03-17T23:55:08.235 INFO:teuthology.orchestra.run.smithi196.stdout: chdir = "" 2024-03-17T23:55:08.235 INFO:teuthology.orchestra.run.smithi196.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-03-17T23:55:08.235 INFO:teuthology.orchestra.run.smithi196.stdout: auth supported = cephx 2024-03-17T23:55:08.235 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-03-17T23:55:08.236 INFO:teuthology.orchestra.run.smithi196.stdout: filestore xattr use omap = true 2024-03-17T23:55:08.236 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-03-17T23:55:08.236 INFO:teuthology.orchestra.run.smithi196.stdout: mon clock drift allowed = 1.000 2024-03-17T23:55:08.236 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-03-17T23:55:08.236 INFO:teuthology.orchestra.run.smithi196.stdout: osd crush chooseleaf type = 0 2024-03-17T23:55:08.236 INFO:teuthology.orchestra.run.smithi196.stdout: auth debug = true 2024-03-17T23:55:08.236 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-03-17T23:55:08.236 INFO:teuthology.orchestra.run.smithi196.stdout: ms die on old message = true 2024-03-17T23:55:08.236 INFO:teuthology.orchestra.run.smithi196.stdout: ms die on bug = true 2024-03-17T23:55:08.236 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-03-17T23:55:08.236 INFO:teuthology.orchestra.run.smithi196.stdout: mon max pg per osd = 10000 # >= luminous 2024-03-17T23:55:08.236 INFO:teuthology.orchestra.run.smithi196.stdout: mon pg warn max object skew = 0 2024-03-17T23:55:08.236 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-03-17T23:55:08.236 INFO:teuthology.orchestra.run.smithi196.stdout: # disable pg_autoscaler by default for new pools 2024-03-17T23:55:08.237 INFO:teuthology.orchestra.run.smithi196.stdout: osd_pool_default_pg_autoscale_mode = off 2024-03-17T23:55:08.237 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-03-17T23:55:08.237 INFO:teuthology.orchestra.run.smithi196.stdout: osd pool default size = 2 2024-03-17T23:55:08.237 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-03-17T23:55:08.237 INFO:teuthology.orchestra.run.smithi196.stdout: mon osd allow primary affinity = true 2024-03-17T23:55:08.237 INFO:teuthology.orchestra.run.smithi196.stdout: mon osd allow pg remap = true 2024-03-17T23:55:08.237 INFO:teuthology.orchestra.run.smithi196.stdout: mon warn on legacy crush tunables = false 2024-03-17T23:55:08.237 INFO:teuthology.orchestra.run.smithi196.stdout: mon warn on crush straw calc version zero = false 2024-03-17T23:55:08.237 INFO:teuthology.orchestra.run.smithi196.stdout: mon warn on no sortbitwise = false 2024-03-17T23:55:08.237 INFO:teuthology.orchestra.run.smithi196.stdout: mon warn on osd down out interval zero = false 2024-03-17T23:55:08.237 INFO:teuthology.orchestra.run.smithi196.stdout: mon warn on too few osds = false 2024-03-17T23:55:08.237 INFO:teuthology.orchestra.run.smithi196.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-03-17T23:55:08.237 INFO:teuthology.orchestra.run.smithi196.stdout: mon_warn_on_pool_no_redundancy = false 2024-03-17T23:55:08.237 INFO:teuthology.orchestra.run.smithi196.stdout: mon_allow_pool_size_one = true 2024-03-17T23:55:08.237 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-03-17T23:55:08.238 INFO:teuthology.orchestra.run.smithi196.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-03-17T23:55:08.238 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-03-17T23:55:08.238 INFO:teuthology.orchestra.run.smithi196.stdout: osd default data pool replay window = 5 2024-03-17T23:55:08.238 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-03-17T23:55:08.238 INFO:teuthology.orchestra.run.smithi196.stdout: mon allow pool delete = true 2024-03-17T23:55:08.238 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-03-17T23:55:08.238 INFO:teuthology.orchestra.run.smithi196.stdout: mon cluster log file level = debug 2024-03-17T23:55:08.238 INFO:teuthology.orchestra.run.smithi196.stdout: debug asserts on shutdown = true 2024-03-17T23:55:08.238 INFO:teuthology.orchestra.run.smithi196.stdout: mon health detail to clog = false 2024-03-17T23:55:08.238 INFO:teuthology.orchestra.run.smithi196.stdout: mon host = "172.21.15.196,172.21.15.204,[v2:172.21.15.204:3301,v1:172.21.15.204:6790]" 2024-03-17T23:55:08.238 INFO:teuthology.orchestra.run.smithi196.stdout: lockdep = True 2024-03-17T23:55:08.238 INFO:teuthology.orchestra.run.smithi196.stdout: fsid = b80f9c80-17ad-4126-8957-4c0c46f5b803 2024-03-17T23:55:08.238 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-03-17T23:55:08.239 INFO:teuthology.orchestra.run.smithi196.stdout:[osd] 2024-03-17T23:55:08.239 INFO:teuthology.orchestra.run.smithi196.stdout: osd journal size = 100 2024-03-17T23:55:08.239 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-03-17T23:55:08.239 INFO:teuthology.orchestra.run.smithi196.stdout: osd scrub load threshold = 5.0 2024-03-17T23:55:08.239 INFO:teuthology.orchestra.run.smithi196.stdout: osd scrub max interval = 600 2024-03-17T23:55:08.239 INFO:teuthology.orchestra.run.smithi196.stdout: osd mclock profile = high_recovery_ops 2024-03-17T23:55:08.239 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-03-17T23:55:08.239 INFO:teuthology.orchestra.run.smithi196.stdout: osd recover clone overlap = true 2024-03-17T23:55:08.239 INFO:teuthology.orchestra.run.smithi196.stdout: osd recovery max chunk = 1048576 2024-03-17T23:55:08.239 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-03-17T23:55:08.239 INFO:teuthology.orchestra.run.smithi196.stdout: osd debug shutdown = true 2024-03-17T23:55:08.239 INFO:teuthology.orchestra.run.smithi196.stdout: osd debug op order = true 2024-03-17T23:55:08.239 INFO:teuthology.orchestra.run.smithi196.stdout: osd debug verify stray on activate = true 2024-03-17T23:55:08.240 INFO:teuthology.orchestra.run.smithi196.stdout: osd debug trim objects = true 2024-03-17T23:55:08.240 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-03-17T23:55:08.240 INFO:teuthology.orchestra.run.smithi196.stdout: osd open classes on start = true 2024-03-17T23:55:08.240 INFO:teuthology.orchestra.run.smithi196.stdout: osd debug pg log writeout = true 2024-03-17T23:55:08.240 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-03-17T23:55:08.240 INFO:teuthology.orchestra.run.smithi196.stdout: osd deep scrub update digest min age = 30 2024-03-17T23:55:08.240 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-03-17T23:55:08.240 INFO:teuthology.orchestra.run.smithi196.stdout: osd map max advance = 10 2024-03-17T23:55:08.240 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-03-17T23:55:08.240 INFO:teuthology.orchestra.run.smithi196.stdout: journal zero on create = true 2024-03-17T23:55:08.240 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-03-17T23:55:08.240 INFO:teuthology.orchestra.run.smithi196.stdout: filestore ondisk finisher threads = 3 2024-03-17T23:55:08.240 INFO:teuthology.orchestra.run.smithi196.stdout: filestore apply finisher threads = 3 2024-03-17T23:55:08.240 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-03-17T23:55:08.241 INFO:teuthology.orchestra.run.smithi196.stdout: bdev debug aio = true 2024-03-17T23:55:08.241 INFO:teuthology.orchestra.run.smithi196.stdout: osd debug misdirected ops = true 2024-03-17T23:55:08.241 INFO:teuthology.orchestra.run.smithi196.stdout: bluestore block size = 96636764160 2024-03-17T23:55:08.241 INFO:teuthology.orchestra.run.smithi196.stdout: bluestore compression mode = aggressive 2024-03-17T23:55:08.241 INFO:teuthology.orchestra.run.smithi196.stdout: bluestore fsck on mount = True 2024-03-17T23:55:08.241 INFO:teuthology.orchestra.run.smithi196.stdout: debug bluefs = 20 2024-03-17T23:55:08.241 INFO:teuthology.orchestra.run.smithi196.stdout: debug bluestore = 20 2024-03-17T23:55:08.241 INFO:teuthology.orchestra.run.smithi196.stdout: debug ms = 1 2024-03-17T23:55:08.241 INFO:teuthology.orchestra.run.smithi196.stdout: debug osd = 20 2024-03-17T23:55:08.241 INFO:teuthology.orchestra.run.smithi196.stdout: debug rocksdb = 10 2024-03-17T23:55:08.241 INFO:teuthology.orchestra.run.smithi196.stdout: mon osd backfillfull_ratio = 0.85 2024-03-17T23:55:08.241 INFO:teuthology.orchestra.run.smithi196.stdout: mon osd full ratio = 0.9 2024-03-17T23:55:08.241 INFO:teuthology.orchestra.run.smithi196.stdout: mon osd nearfull ratio = 0.8 2024-03-17T23:55:08.241 INFO:teuthology.orchestra.run.smithi196.stdout: osd failsafe full ratio = 0.95 2024-03-17T23:55:08.241 INFO:teuthology.orchestra.run.smithi196.stdout: osd objectstore = bluestore 2024-03-17T23:55:08.241 INFO:teuthology.orchestra.run.smithi196.stdout: osd op complaint time = 180 2024-03-17T23:55:08.242 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-03-17T23:55:08.242 INFO:teuthology.orchestra.run.smithi196.stdout:[mgr] 2024-03-17T23:55:08.242 INFO:teuthology.orchestra.run.smithi196.stdout: debug ms = 1 2024-03-17T23:55:08.242 INFO:teuthology.orchestra.run.smithi196.stdout: debug mgr = 20 2024-03-17T23:55:08.242 INFO:teuthology.orchestra.run.smithi196.stdout: debug mon = 20 2024-03-17T23:55:08.242 INFO:teuthology.orchestra.run.smithi196.stdout: debug auth = 20 2024-03-17T23:55:08.242 INFO:teuthology.orchestra.run.smithi196.stdout: mon reweight min pgs per osd = 4 2024-03-17T23:55:08.242 INFO:teuthology.orchestra.run.smithi196.stdout: mon reweight min bytes per osd = 10 2024-03-17T23:55:08.242 INFO:teuthology.orchestra.run.smithi196.stdout: mgr/telemetry/nag = false 2024-03-17T23:55:08.242 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-03-17T23:55:08.242 INFO:teuthology.orchestra.run.smithi196.stdout:[mon] 2024-03-17T23:55:08.242 INFO:teuthology.orchestra.run.smithi196.stdout: debug ms = 1 2024-03-17T23:55:08.242 INFO:teuthology.orchestra.run.smithi196.stdout: debug mon = 20 2024-03-17T23:55:08.242 INFO:teuthology.orchestra.run.smithi196.stdout: debug paxos = 20 2024-03-17T23:55:08.243 INFO:teuthology.orchestra.run.smithi196.stdout: debug auth = 20 2024-03-17T23:55:08.243 INFO:teuthology.orchestra.run.smithi196.stdout: mon data avail warn = 5 2024-03-17T23:55:08.243 INFO:teuthology.orchestra.run.smithi196.stdout: mon mgr mkfs grace = 240 2024-03-17T23:55:08.243 INFO:teuthology.orchestra.run.smithi196.stdout: mon reweight min pgs per osd = 4 2024-03-17T23:55:08.243 INFO:teuthology.orchestra.run.smithi196.stdout: mon osd reporter subtree level = osd 2024-03-17T23:55:08.243 INFO:teuthology.orchestra.run.smithi196.stdout: mon osd prime pg temp = true 2024-03-17T23:55:08.243 INFO:teuthology.orchestra.run.smithi196.stdout: mon reweight min bytes per osd = 10 2024-03-17T23:55:08.243 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-03-17T23:55:08.243 INFO:teuthology.orchestra.run.smithi196.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-03-17T23:55:08.243 INFO:teuthology.orchestra.run.smithi196.stdout: auth mon ticket ttl = 660 # 11m 2024-03-17T23:55:08.243 INFO:teuthology.orchestra.run.smithi196.stdout: auth service ticket ttl = 240 # 4m 2024-03-17T23:55:08.243 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-03-17T23:55:08.243 INFO:teuthology.orchestra.run.smithi196.stdout: # don't complain about insecure global_id in the test suite 2024-03-17T23:55:08.243 INFO:teuthology.orchestra.run.smithi196.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-03-17T23:55:08.243 INFO:teuthology.orchestra.run.smithi196.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-03-17T23:55:08.244 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-03-17T23:55:08.244 INFO:teuthology.orchestra.run.smithi196.stdout: # 1m isn't quite enough 2024-03-17T23:55:08.244 INFO:teuthology.orchestra.run.smithi196.stdout: mon_down_mkfs_grace = 2m 2024-03-17T23:55:08.244 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-03-17T23:55:08.244 INFO:teuthology.orchestra.run.smithi196.stdout: mon_warn_on_filestore_osds = false 2024-03-17T23:55:08.244 INFO:teuthology.orchestra.run.smithi196.stdout: mon op complaint time = 120 2024-03-17T23:55:08.244 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-03-17T23:55:08.244 INFO:teuthology.orchestra.run.smithi196.stdout:[client] 2024-03-17T23:55:08.244 INFO:teuthology.orchestra.run.smithi196.stdout: rgw cache enabled = true 2024-03-17T23:55:08.244 INFO:teuthology.orchestra.run.smithi196.stdout: rgw enable ops log = true 2024-03-17T23:55:08.244 INFO:teuthology.orchestra.run.smithi196.stdout: rgw enable usage log = true 2024-03-17T23:55:08.244 INFO:teuthology.orchestra.run.smithi196.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-03-17T23:55:08.244 INFO:teuthology.orchestra.run.smithi196.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-03-17T23:55:08.244 INFO:teuthology.orchestra.run.smithi196.stdout: client mount timeout = 600 2024-03-17T23:55:08.244 INFO:teuthology.orchestra.run.smithi196.stdout: debug client = 20 2024-03-17T23:55:08.245 INFO:teuthology.orchestra.run.smithi196.stdout: debug ms = 1 2024-03-17T23:55:08.245 INFO:teuthology.orchestra.run.smithi196.stdout: rados mon op timeout = 900 2024-03-17T23:55:08.245 INFO:teuthology.orchestra.run.smithi196.stdout: rados osd op timeout = 900 2024-03-17T23:55:08.245 INFO:teuthology.orchestra.run.smithi196.stdout:[mon.a] 2024-03-17T23:55:08.245 INFO:teuthology.orchestra.run.smithi196.stdout:[mon.b] 2024-03-17T23:55:08.245 INFO:teuthology.orchestra.run.smithi196.stdout:[mon.c] 2024-03-17T23:55:08.245 INFO:teuthology.orchestra.run.smithi196.stdout:[mds.a] 2024-03-17T23:55:08.245 INFO:teuthology.orchestra.run.smithi196.stdout:[mds.c] 2024-03-17T23:55:08.245 INFO:teuthology.orchestra.run.smithi196.stdout:[mds.e] 2024-03-17T23:55:08.245 INFO:teuthology.orchestra.run.smithi196.stdout:[mds.b] 2024-03-17T23:55:08.245 INFO:teuthology.orchestra.run.smithi196.stdout:[mds.d] 2024-03-17T23:55:08.245 INFO:teuthology.orchestra.run.smithi196.stdout:[mds.f] 2024-03-17T23:55:08.245 INFO:teuthology.orchestra.run.smithi196.stdout:[mds] 2024-03-17T23:55:08.245 INFO:teuthology.orchestra.run.smithi196.stdout: debug mds = 20 2024-03-17T23:55:08.245 INFO:teuthology.orchestra.run.smithi196.stdout: debug mds balancer = 20 2024-03-17T23:55:08.245 INFO:teuthology.orchestra.run.smithi196.stdout: debug ms = 1 2024-03-17T23:55:08.246 INFO:teuthology.orchestra.run.smithi196.stdout: mds debug frag = True 2024-03-17T23:55:08.246 INFO:teuthology.orchestra.run.smithi196.stdout: mds debug scatterstat = True 2024-03-17T23:55:08.246 INFO:teuthology.orchestra.run.smithi196.stdout: mds op complaint time = 180 2024-03-17T23:55:08.246 INFO:teuthology.orchestra.run.smithi196.stdout: mds verify scatter = True 2024-03-17T23:55:08.246 INFO:teuthology.orchestra.run.smithi196.stdout: osd op complaint time = 180 2024-03-17T23:55:08.246 INFO:teuthology.orchestra.run.smithi196.stdout: rados mon op timeout = 900 2024-03-17T23:55:08.246 INFO:teuthology.orchestra.run.smithi196.stdout: rados osd op timeout = 900 2024-03-17T23:55:08.247 INFO:teuthology.orchestra.run.smithi204.stdout:[global] 2024-03-17T23:55:08.247 INFO:teuthology.orchestra.run.smithi204.stdout: chdir = "" 2024-03-17T23:55:08.248 INFO:teuthology.orchestra.run.smithi204.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-03-17T23:55:08.248 INFO:teuthology.orchestra.run.smithi204.stdout: auth supported = cephx 2024-03-17T23:55:08.248 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-03-17T23:55:08.248 INFO:teuthology.orchestra.run.smithi204.stdout: filestore xattr use omap = true 2024-03-17T23:55:08.248 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-03-17T23:55:08.248 INFO:teuthology.orchestra.run.smithi204.stdout: mon clock drift allowed = 1.000 2024-03-17T23:55:08.248 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-03-17T23:55:08.248 INFO:teuthology.orchestra.run.smithi204.stdout: osd crush chooseleaf type = 0 2024-03-17T23:55:08.248 INFO:teuthology.orchestra.run.smithi204.stdout: auth debug = true 2024-03-17T23:55:08.248 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-03-17T23:55:08.248 INFO:teuthology.orchestra.run.smithi204.stdout: ms die on old message = true 2024-03-17T23:55:08.248 INFO:teuthology.orchestra.run.smithi204.stdout: ms die on bug = true 2024-03-17T23:55:08.249 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-03-17T23:55:08.249 INFO:teuthology.orchestra.run.smithi204.stdout: mon max pg per osd = 10000 # >= luminous 2024-03-17T23:55:08.249 INFO:teuthology.orchestra.run.smithi204.stdout: mon pg warn max object skew = 0 2024-03-17T23:55:08.249 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-03-17T23:55:08.249 INFO:teuthology.orchestra.run.smithi204.stdout: # disable pg_autoscaler by default for new pools 2024-03-17T23:55:08.249 INFO:teuthology.orchestra.run.smithi204.stdout: osd_pool_default_pg_autoscale_mode = off 2024-03-17T23:55:08.249 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-03-17T23:55:08.249 INFO:teuthology.orchestra.run.smithi204.stdout: osd pool default size = 2 2024-03-17T23:55:08.249 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-03-17T23:55:08.249 INFO:teuthology.orchestra.run.smithi204.stdout: mon osd allow primary affinity = true 2024-03-17T23:55:08.249 INFO:teuthology.orchestra.run.smithi204.stdout: mon osd allow pg remap = true 2024-03-17T23:55:08.249 INFO:teuthology.orchestra.run.smithi204.stdout: mon warn on legacy crush tunables = false 2024-03-17T23:55:08.249 INFO:teuthology.orchestra.run.smithi204.stdout: mon warn on crush straw calc version zero = false 2024-03-17T23:55:08.249 INFO:teuthology.orchestra.run.smithi204.stdout: mon warn on no sortbitwise = false 2024-03-17T23:55:08.250 INFO:teuthology.orchestra.run.smithi204.stdout: mon warn on osd down out interval zero = false 2024-03-17T23:55:08.250 INFO:teuthology.orchestra.run.smithi204.stdout: mon warn on too few osds = false 2024-03-17T23:55:08.250 INFO:teuthology.orchestra.run.smithi204.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-03-17T23:55:08.250 INFO:teuthology.orchestra.run.smithi204.stdout: mon_warn_on_pool_no_redundancy = false 2024-03-17T23:55:08.250 INFO:teuthology.orchestra.run.smithi204.stdout: mon_allow_pool_size_one = true 2024-03-17T23:55:08.250 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-03-17T23:55:08.250 INFO:teuthology.orchestra.run.smithi204.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-03-17T23:55:08.250 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-03-17T23:55:08.250 INFO:teuthology.orchestra.run.smithi204.stdout: osd default data pool replay window = 5 2024-03-17T23:55:08.250 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-03-17T23:55:08.250 INFO:teuthology.orchestra.run.smithi204.stdout: mon allow pool delete = true 2024-03-17T23:55:08.250 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-03-17T23:55:08.250 INFO:teuthology.orchestra.run.smithi204.stdout: mon cluster log file level = debug 2024-03-17T23:55:08.251 INFO:teuthology.orchestra.run.smithi204.stdout: debug asserts on shutdown = true 2024-03-17T23:55:08.251 INFO:teuthology.orchestra.run.smithi204.stdout: mon health detail to clog = false 2024-03-17T23:55:08.251 INFO:teuthology.orchestra.run.smithi204.stdout: mon host = "172.21.15.196,172.21.15.204,[v2:172.21.15.204:3301,v1:172.21.15.204:6790]" 2024-03-17T23:55:08.251 INFO:teuthology.orchestra.run.smithi204.stdout: lockdep = True 2024-03-17T23:55:08.251 INFO:teuthology.orchestra.run.smithi204.stdout: fsid = b80f9c80-17ad-4126-8957-4c0c46f5b803 2024-03-17T23:55:08.251 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-03-17T23:55:08.251 INFO:teuthology.orchestra.run.smithi204.stdout:[osd] 2024-03-17T23:55:08.251 INFO:teuthology.orchestra.run.smithi204.stdout: osd journal size = 100 2024-03-17T23:55:08.251 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-03-17T23:55:08.251 INFO:teuthology.orchestra.run.smithi204.stdout: osd scrub load threshold = 5.0 2024-03-17T23:55:08.251 INFO:teuthology.orchestra.run.smithi204.stdout: osd scrub max interval = 600 2024-03-17T23:55:08.251 INFO:teuthology.orchestra.run.smithi204.stdout: osd mclock profile = high_recovery_ops 2024-03-17T23:55:08.251 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-03-17T23:55:08.251 INFO:teuthology.orchestra.run.smithi204.stdout: osd recover clone overlap = true 2024-03-17T23:55:08.252 INFO:teuthology.orchestra.run.smithi204.stdout: osd recovery max chunk = 1048576 2024-03-17T23:55:08.252 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-03-17T23:55:08.252 INFO:teuthology.orchestra.run.smithi204.stdout: osd debug shutdown = true 2024-03-17T23:55:08.252 INFO:teuthology.orchestra.run.smithi204.stdout: osd debug op order = true 2024-03-17T23:55:08.252 INFO:teuthology.orchestra.run.smithi204.stdout: osd debug verify stray on activate = true 2024-03-17T23:55:08.252 INFO:teuthology.orchestra.run.smithi204.stdout: osd debug trim objects = true 2024-03-17T23:55:08.252 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-03-17T23:55:08.252 INFO:teuthology.orchestra.run.smithi204.stdout: osd open classes on start = true 2024-03-17T23:55:08.252 INFO:teuthology.orchestra.run.smithi204.stdout: osd debug pg log writeout = true 2024-03-17T23:55:08.252 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-03-17T23:55:08.252 INFO:teuthology.orchestra.run.smithi204.stdout: osd deep scrub update digest min age = 30 2024-03-17T23:55:08.252 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-03-17T23:55:08.252 INFO:teuthology.orchestra.run.smithi204.stdout: osd map max advance = 10 2024-03-17T23:55:08.252 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-03-17T23:55:08.253 INFO:teuthology.orchestra.run.smithi204.stdout: journal zero on create = true 2024-03-17T23:55:08.253 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-03-17T23:55:08.253 INFO:teuthology.orchestra.run.smithi204.stdout: filestore ondisk finisher threads = 3 2024-03-17T23:55:08.253 INFO:teuthology.orchestra.run.smithi204.stdout: filestore apply finisher threads = 3 2024-03-17T23:55:08.253 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-03-17T23:55:08.253 INFO:teuthology.orchestra.run.smithi204.stdout: bdev debug aio = true 2024-03-17T23:55:08.253 INFO:teuthology.orchestra.run.smithi204.stdout: osd debug misdirected ops = true 2024-03-17T23:55:08.253 INFO:teuthology.orchestra.run.smithi204.stdout: bluestore block size = 96636764160 2024-03-17T23:55:08.253 INFO:teuthology.orchestra.run.smithi204.stdout: bluestore compression mode = aggressive 2024-03-17T23:55:08.253 INFO:teuthology.orchestra.run.smithi204.stdout: bluestore fsck on mount = True 2024-03-17T23:55:08.253 INFO:teuthology.orchestra.run.smithi204.stdout: debug bluefs = 20 2024-03-17T23:55:08.253 INFO:teuthology.orchestra.run.smithi204.stdout: debug bluestore = 20 2024-03-17T23:55:08.253 INFO:teuthology.orchestra.run.smithi204.stdout: debug ms = 1 2024-03-17T23:55:08.253 INFO:teuthology.orchestra.run.smithi204.stdout: debug osd = 20 2024-03-17T23:55:08.253 INFO:teuthology.orchestra.run.smithi204.stdout: debug rocksdb = 10 2024-03-17T23:55:08.254 INFO:teuthology.orchestra.run.smithi204.stdout: mon osd backfillfull_ratio = 0.85 2024-03-17T23:55:08.254 INFO:teuthology.orchestra.run.smithi204.stdout: mon osd full ratio = 0.9 2024-03-17T23:55:08.254 INFO:teuthology.orchestra.run.smithi204.stdout: mon osd nearfull ratio = 0.8 2024-03-17T23:55:08.254 INFO:teuthology.orchestra.run.smithi204.stdout: osd failsafe full ratio = 0.95 2024-03-17T23:55:08.254 INFO:teuthology.orchestra.run.smithi204.stdout: osd objectstore = bluestore 2024-03-17T23:55:08.254 INFO:teuthology.orchestra.run.smithi204.stdout: osd op complaint time = 180 2024-03-17T23:55:08.254 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-03-17T23:55:08.254 INFO:teuthology.orchestra.run.smithi204.stdout:[mgr] 2024-03-17T23:55:08.254 INFO:teuthology.orchestra.run.smithi204.stdout: debug ms = 1 2024-03-17T23:55:08.254 INFO:teuthology.orchestra.run.smithi204.stdout: debug mgr = 20 2024-03-17T23:55:08.254 INFO:teuthology.orchestra.run.smithi204.stdout: debug mon = 20 2024-03-17T23:55:08.254 INFO:teuthology.orchestra.run.smithi204.stdout: debug auth = 20 2024-03-17T23:55:08.254 INFO:teuthology.orchestra.run.smithi204.stdout: mon reweight min pgs per osd = 4 2024-03-17T23:55:08.254 INFO:teuthology.orchestra.run.smithi204.stdout: mon reweight min bytes per osd = 10 2024-03-17T23:55:08.255 INFO:teuthology.orchestra.run.smithi204.stdout: mgr/telemetry/nag = false 2024-03-17T23:55:08.255 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-03-17T23:55:08.255 INFO:teuthology.orchestra.run.smithi204.stdout:[mon] 2024-03-17T23:55:08.255 INFO:teuthology.orchestra.run.smithi204.stdout: debug ms = 1 2024-03-17T23:55:08.255 INFO:teuthology.orchestra.run.smithi204.stdout: debug mon = 20 2024-03-17T23:55:08.255 INFO:teuthology.orchestra.run.smithi204.stdout: debug paxos = 20 2024-03-17T23:55:08.255 INFO:teuthology.orchestra.run.smithi204.stdout: debug auth = 20 2024-03-17T23:55:08.255 INFO:teuthology.orchestra.run.smithi204.stdout: mon data avail warn = 5 2024-03-17T23:55:08.255 INFO:teuthology.orchestra.run.smithi204.stdout: mon mgr mkfs grace = 240 2024-03-17T23:55:08.255 INFO:teuthology.orchestra.run.smithi204.stdout: mon reweight min pgs per osd = 4 2024-03-17T23:55:08.255 INFO:teuthology.orchestra.run.smithi204.stdout: mon osd reporter subtree level = osd 2024-03-17T23:55:08.255 INFO:teuthology.orchestra.run.smithi204.stdout: mon osd prime pg temp = true 2024-03-17T23:55:08.255 INFO:teuthology.orchestra.run.smithi204.stdout: mon reweight min bytes per osd = 10 2024-03-17T23:55:08.255 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-03-17T23:55:08.256 INFO:teuthology.orchestra.run.smithi204.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-03-17T23:55:08.256 INFO:teuthology.orchestra.run.smithi204.stdout: auth mon ticket ttl = 660 # 11m 2024-03-17T23:55:08.256 INFO:teuthology.orchestra.run.smithi204.stdout: auth service ticket ttl = 240 # 4m 2024-03-17T23:55:08.256 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-03-17T23:55:08.256 INFO:teuthology.orchestra.run.smithi204.stdout: # don't complain about insecure global_id in the test suite 2024-03-17T23:55:08.256 INFO:teuthology.orchestra.run.smithi204.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-03-17T23:55:08.256 INFO:teuthology.orchestra.run.smithi204.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-03-17T23:55:08.256 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-03-17T23:55:08.256 INFO:teuthology.orchestra.run.smithi204.stdout: # 1m isn't quite enough 2024-03-17T23:55:08.256 INFO:teuthology.orchestra.run.smithi204.stdout: mon_down_mkfs_grace = 2m 2024-03-17T23:55:08.256 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-03-17T23:55:08.256 INFO:teuthology.orchestra.run.smithi204.stdout: mon_warn_on_filestore_osds = false 2024-03-17T23:55:08.256 INFO:teuthology.orchestra.run.smithi204.stdout: mon op complaint time = 120 2024-03-17T23:55:08.256 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-03-17T23:55:08.256 INFO:teuthology.orchestra.run.smithi204.stdout:[client] 2024-03-17T23:55:08.257 INFO:teuthology.orchestra.run.smithi204.stdout: rgw cache enabled = true 2024-03-17T23:55:08.257 INFO:teuthology.orchestra.run.smithi204.stdout: rgw enable ops log = true 2024-03-17T23:55:08.257 INFO:teuthology.orchestra.run.smithi204.stdout: rgw enable usage log = true 2024-03-17T23:55:08.257 INFO:teuthology.orchestra.run.smithi204.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-03-17T23:55:08.257 INFO:teuthology.orchestra.run.smithi204.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-03-17T23:55:08.257 INFO:teuthology.orchestra.run.smithi204.stdout: client mount timeout = 600 2024-03-17T23:55:08.257 INFO:teuthology.orchestra.run.smithi204.stdout: debug client = 20 2024-03-17T23:55:08.257 INFO:teuthology.orchestra.run.smithi204.stdout: debug ms = 1 2024-03-17T23:55:08.257 INFO:teuthology.orchestra.run.smithi204.stdout: rados mon op timeout = 900 2024-03-17T23:55:08.257 INFO:teuthology.orchestra.run.smithi204.stdout: rados osd op timeout = 900 2024-03-17T23:55:08.257 INFO:teuthology.orchestra.run.smithi204.stdout:[mon.a] 2024-03-17T23:55:08.257 INFO:teuthology.orchestra.run.smithi204.stdout:[mon.b] 2024-03-17T23:55:08.257 INFO:teuthology.orchestra.run.smithi204.stdout:[mon.c] 2024-03-17T23:55:08.257 INFO:teuthology.orchestra.run.smithi204.stdout:[mds.a] 2024-03-17T23:55:08.258 INFO:teuthology.orchestra.run.smithi204.stdout:[mds.c] 2024-03-17T23:55:08.258 INFO:teuthology.orchestra.run.smithi204.stdout:[mds.e] 2024-03-17T23:55:08.258 INFO:teuthology.orchestra.run.smithi204.stdout:[mds.b] 2024-03-17T23:55:08.258 INFO:teuthology.orchestra.run.smithi204.stdout:[mds.d] 2024-03-17T23:55:08.258 INFO:teuthology.orchestra.run.smithi204.stdout:[mds.f] 2024-03-17T23:55:08.258 INFO:teuthology.orchestra.run.smithi204.stdout:[mds] 2024-03-17T23:55:08.258 INFO:teuthology.orchestra.run.smithi204.stdout: debug mds = 20 2024-03-17T23:55:08.258 INFO:teuthology.orchestra.run.smithi204.stdout: debug mds balancer = 20 2024-03-17T23:55:08.258 INFO:teuthology.orchestra.run.smithi204.stdout: debug ms = 1 2024-03-17T23:55:08.258 INFO:teuthology.orchestra.run.smithi204.stdout: mds debug frag = True 2024-03-17T23:55:08.258 INFO:teuthology.orchestra.run.smithi204.stdout: mds debug scatterstat = True 2024-03-17T23:55:08.258 INFO:teuthology.orchestra.run.smithi204.stdout: mds op complaint time = 180 2024-03-17T23:55:08.258 INFO:teuthology.orchestra.run.smithi204.stdout: mds verify scatter = True 2024-03-17T23:55:08.258 INFO:teuthology.orchestra.run.smithi204.stdout: osd op complaint time = 180 2024-03-17T23:55:08.259 INFO:teuthology.orchestra.run.smithi204.stdout: rados mon op timeout = 900 2024-03-17T23:55:08.259 INFO:teuthology.orchestra.run.smithi204.stdout: rados osd op timeout = 900 2024-03-17T23:55:08.259 INFO:tasks.ceph:Creating admin key on mon.a... 2024-03-17T23:55:08.259 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-03-17T23:55:08.339 INFO:tasks.ceph:Copying monmap to all nodes... 2024-03-17T23:55:08.339 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2024-03-17T23:55:08.339 DEBUG:teuthology.orchestra.run.smithi196:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-03-17T23:55:08.345 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2024-03-17T23:55:08.345 DEBUG:teuthology.orchestra.run.smithi196:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-03-17T23:55:08.392 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi196.front.sepia.ceph.com 2024-03-17T23:55:08.392 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2024-03-17T23:55:08.392 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd of=/etc/ceph/ceph.keyring 2024-03-17T23:55:08.392 DEBUG:teuthology.orchestra.run.smithi196:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-03-17T23:55:08.460 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2024-03-17T23:55:08.460 DEBUG:teuthology.orchestra.run.smithi196:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-03-17T23:55:08.508 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi204.front.sepia.ceph.com 2024-03-17T23:55:08.508 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2024-03-17T23:55:08.508 DEBUG:teuthology.orchestra.run.smithi204:> sudo dd of=/etc/ceph/ceph.keyring 2024-03-17T23:55:08.508 DEBUG:teuthology.orchestra.run.smithi204:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-03-17T23:55:08.530 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2024-03-17T23:55:08.530 DEBUG:teuthology.orchestra.run.smithi204:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-03-17T23:55:08.579 INFO:tasks.ceph:Setting up mon nodes... 2024-03-17T23:55:08.580 INFO:tasks.ceph:Setting up mgr nodes... 2024-03-17T23:55:08.580 DEBUG:teuthology.orchestra.run.smithi196:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-03-17T23:55:08.623 INFO:teuthology.orchestra.run.smithi196.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-03-17T23:55:08.626 DEBUG:teuthology.orchestra.run.smithi204:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-03-17T23:55:08.668 INFO:teuthology.orchestra.run.smithi204.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-03-17T23:55:08.689 INFO:tasks.ceph:Setting up mds nodes... 2024-03-17T23:55:08.689 DEBUG:teuthology.orchestra.run.smithi196:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-03-17T23:55:08.731 INFO:teuthology.orchestra.run.smithi196.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-03-17T23:55:08.734 DEBUG:teuthology.orchestra.run.smithi196:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-03-17T23:55:08.786 DEBUG:teuthology.orchestra.run.smithi196:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-03-17T23:55:08.866 INFO:teuthology.orchestra.run.smithi196.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-03-17T23:55:08.869 DEBUG:teuthology.orchestra.run.smithi196:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-03-17T23:55:08.923 DEBUG:teuthology.orchestra.run.smithi196:> sudo mkdir -p /var/lib/ceph/mds/ceph-e && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.e /var/lib/ceph/mds/ceph-e/keyring 2024-03-17T23:55:09.006 INFO:teuthology.orchestra.run.smithi196.stdout:creating /var/lib/ceph/mds/ceph-e/keyring 2024-03-17T23:55:09.009 DEBUG:teuthology.orchestra.run.smithi196:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-e 2024-03-17T23:55:09.064 DEBUG:teuthology.orchestra.run.smithi204:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-03-17T23:55:09.107 INFO:teuthology.orchestra.run.smithi204.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-03-17T23:55:09.110 DEBUG:teuthology.orchestra.run.smithi204:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-03-17T23:55:09.162 DEBUG:teuthology.orchestra.run.smithi204:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2024-03-17T23:55:09.247 INFO:teuthology.orchestra.run.smithi204.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2024-03-17T23:55:09.250 DEBUG:teuthology.orchestra.run.smithi204:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2024-03-17T23:55:09.307 DEBUG:teuthology.orchestra.run.smithi204:> sudo mkdir -p /var/lib/ceph/mds/ceph-f && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.f /var/lib/ceph/mds/ceph-f/keyring 2024-03-17T23:55:09.395 INFO:teuthology.orchestra.run.smithi204.stdout:creating /var/lib/ceph/mds/ceph-f/keyring 2024-03-17T23:55:09.398 DEBUG:teuthology.orchestra.run.smithi204:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-f 2024-03-17T23:55:09.458 INFO:tasks.ceph_client:Setting up client nodes... 2024-03-17T23:55:09.458 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-03-17T23:55:09.494 INFO:teuthology.orchestra.run.smithi196.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-03-17T23:55:09.505 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-03-17T23:55:09.506 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi196.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi204.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-03-17T23:55:09.506 DEBUG:teuthology.orchestra.run.smithi196:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-03-17T23:55:09.560 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-03-17T23:55:09.560 INFO:tasks.ceph:role: osd.0 2024-03-17T23:55:09.560 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi196.front.sepia.ceph.com 2024-03-17T23:55:09.560 DEBUG:teuthology.orchestra.run.smithi196:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-03-17T23:55:09.623 INFO:teuthology.orchestra.run.smithi196.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-03-17T23:55:09.623 INFO:teuthology.orchestra.run.smithi196.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-17T23:55:09.624 INFO:teuthology.orchestra.run.smithi196.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-17T23:55:09.624 INFO:teuthology.orchestra.run.smithi196.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-03-17T23:55:09.624 INFO:teuthology.orchestra.run.smithi196.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-17T23:55:09.624 INFO:teuthology.orchestra.run.smithi196.stdout: = sunit=0 swidth=0 blks 2024-03-17T23:55:09.624 INFO:teuthology.orchestra.run.smithi196.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-17T23:55:09.624 INFO:teuthology.orchestra.run.smithi196.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-03-17T23:55:09.624 INFO:teuthology.orchestra.run.smithi196.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-17T23:55:09.624 INFO:teuthology.orchestra.run.smithi196.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-17T23:55:10.109 INFO:teuthology.orchestra.run.smithi196.stdout:Discarding blocks...Done. 2024-03-17T23:55:10.110 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi196.front.sepia.ceph.com -o noatime 2024-03-17T23:55:10.111 DEBUG:teuthology.orchestra.run.smithi196:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-03-17T23:55:10.269 DEBUG:teuthology.orchestra.run.smithi196:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-03-17T23:55:10.280 INFO:teuthology.orchestra.run.smithi196.stderr:sudo: /sbin/restorecon: command not found 2024-03-17T23:55:10.281 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-17T23:55:10.281 DEBUG:teuthology.orchestra.run.smithi196:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-03-17T23:55:10.336 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-03-17T23:55:10.336 INFO:tasks.ceph:role: osd.1 2024-03-17T23:55:10.336 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi196.front.sepia.ceph.com 2024-03-17T23:55:10.336 DEBUG:teuthology.orchestra.run.smithi196:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-03-17T23:55:10.399 INFO:teuthology.orchestra.run.smithi196.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-03-17T23:55:10.399 INFO:teuthology.orchestra.run.smithi196.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-17T23:55:10.400 INFO:teuthology.orchestra.run.smithi196.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-17T23:55:10.400 INFO:teuthology.orchestra.run.smithi196.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-03-17T23:55:10.400 INFO:teuthology.orchestra.run.smithi196.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-17T23:55:10.400 INFO:teuthology.orchestra.run.smithi196.stdout: = sunit=0 swidth=0 blks 2024-03-17T23:55:10.400 INFO:teuthology.orchestra.run.smithi196.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-17T23:55:10.400 INFO:teuthology.orchestra.run.smithi196.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-03-17T23:55:10.400 INFO:teuthology.orchestra.run.smithi196.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-17T23:55:10.400 INFO:teuthology.orchestra.run.smithi196.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-17T23:55:10.857 INFO:teuthology.orchestra.run.smithi196.stdout:Discarding blocks...Done. 2024-03-17T23:55:10.860 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi196.front.sepia.ceph.com -o noatime 2024-03-17T23:55:10.860 DEBUG:teuthology.orchestra.run.smithi196:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-03-17T23:55:10.962 DEBUG:teuthology.orchestra.run.smithi196:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-03-17T23:55:10.972 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-17T23:55:10.972 INFO:teuthology.orchestra.run.smithi196.stderr:sudo: /sbin/restorecon: command not found 2024-03-17T23:55:10.972 DEBUG:teuthology.orchestra.run.smithi196:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-03-17T23:55:11.025 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-03-17T23:55:11.026 INFO:tasks.ceph:role: osd.2 2024-03-17T23:55:11.026 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi196.front.sepia.ceph.com 2024-03-17T23:55:11.026 DEBUG:teuthology.orchestra.run.smithi196:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-03-17T23:55:11.086 INFO:teuthology.orchestra.run.smithi196.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-03-17T23:55:11.086 INFO:teuthology.orchestra.run.smithi196.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-17T23:55:11.087 INFO:teuthology.orchestra.run.smithi196.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-17T23:55:11.087 INFO:teuthology.orchestra.run.smithi196.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-03-17T23:55:11.087 INFO:teuthology.orchestra.run.smithi196.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-17T23:55:11.087 INFO:teuthology.orchestra.run.smithi196.stdout: = sunit=0 swidth=0 blks 2024-03-17T23:55:11.087 INFO:teuthology.orchestra.run.smithi196.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-17T23:55:11.087 INFO:teuthology.orchestra.run.smithi196.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-03-17T23:55:11.087 INFO:teuthology.orchestra.run.smithi196.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-17T23:55:11.087 INFO:teuthology.orchestra.run.smithi196.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-17T23:55:11.550 INFO:teuthology.orchestra.run.smithi196.stdout:Discarding blocks...Done. 2024-03-17T23:55:11.552 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi196.front.sepia.ceph.com -o noatime 2024-03-17T23:55:11.552 DEBUG:teuthology.orchestra.run.smithi196:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-03-17T23:55:11.699 DEBUG:teuthology.orchestra.run.smithi196:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-03-17T23:55:11.709 INFO:teuthology.orchestra.run.smithi196.stderr:sudo: /sbin/restorecon: command not found 2024-03-17T23:55:11.710 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-17T23:55:11.710 DEBUG:teuthology.orchestra.run.smithi196:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-03-17T23:55:11.763 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-03-17T23:55:11.763 INFO:tasks.ceph:role: osd.3 2024-03-17T23:55:11.763 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi196.front.sepia.ceph.com 2024-03-17T23:55:11.764 DEBUG:teuthology.orchestra.run.smithi196:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-03-17T23:55:11.828 INFO:teuthology.orchestra.run.smithi196.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-03-17T23:55:11.828 INFO:teuthology.orchestra.run.smithi196.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-17T23:55:11.828 INFO:teuthology.orchestra.run.smithi196.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-17T23:55:11.828 INFO:teuthology.orchestra.run.smithi196.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-03-17T23:55:11.828 INFO:teuthology.orchestra.run.smithi196.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-17T23:55:11.828 INFO:teuthology.orchestra.run.smithi196.stdout: = sunit=0 swidth=0 blks 2024-03-17T23:55:11.828 INFO:teuthology.orchestra.run.smithi196.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-17T23:55:11.828 INFO:teuthology.orchestra.run.smithi196.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-03-17T23:55:11.828 INFO:teuthology.orchestra.run.smithi196.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-17T23:55:11.828 INFO:teuthology.orchestra.run.smithi196.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-17T23:55:12.332 INFO:teuthology.orchestra.run.smithi196.stdout:Discarding blocks...Done. 2024-03-17T23:55:12.335 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi196.front.sepia.ceph.com -o noatime 2024-03-17T23:55:12.335 DEBUG:teuthology.orchestra.run.smithi196:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-03-17T23:55:12.468 DEBUG:teuthology.orchestra.run.smithi196:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-03-17T23:55:12.479 INFO:teuthology.orchestra.run.smithi196.stderr:sudo: /sbin/restorecon: command not found 2024-03-17T23:55:12.480 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-17T23:55:12.481 DEBUG:teuthology.orchestra.run.smithi196:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-17T23:55:12.590 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:12.590+0000 7fe4431747c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-03-17T23:55:12.592 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:12.594+0000 7fe4431747c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-03-17T23:55:12.593 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:12.594+0000 7fe4431747c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-03-17T23:55:12.593 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:12.594+0000 7fe4431747c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-03-17T23:55:12.593 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:12.594+0000 7fe4431747c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-03-17T23:55:12.593 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:12.594+0000 7fe4431747c0 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-03-17T23:55:15.556 DEBUG:teuthology.orchestra.run.smithi196:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-03-17T23:55:15.569 DEBUG:teuthology.orchestra.run.smithi196:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-17T23:55:15.650 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:15.650+0000 7fd016c427c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-03-17T23:55:15.651 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:15.650+0000 7fd016c427c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-03-17T23:55:15.651 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:15.650+0000 7fd016c427c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-03-17T23:55:15.651 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:15.650+0000 7fd016c427c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-03-17T23:55:15.651 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:15.650+0000 7fd016c427c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-03-17T23:55:15.652 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:15.654+0000 7fd016c427c0 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-03-17T23:55:18.615 DEBUG:teuthology.orchestra.run.smithi196:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-03-17T23:55:18.676 DEBUG:teuthology.orchestra.run.smithi196:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-17T23:55:18.758 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:18.758+0000 7f87099f87c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-03-17T23:55:18.759 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:18.758+0000 7f87099f87c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-03-17T23:55:18.759 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:18.758+0000 7f87099f87c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-03-17T23:55:18.759 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:18.758+0000 7f87099f87c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-03-17T23:55:18.759 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:18.758+0000 7f87099f87c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-03-17T23:55:18.760 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:18.762+0000 7f87099f87c0 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-03-17T23:55:21.751 DEBUG:teuthology.orchestra.run.smithi196:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-03-17T23:55:21.809 DEBUG:teuthology.orchestra.run.smithi196:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-17T23:55:21.890 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:21.890+0000 7f0df4df67c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-03-17T23:55:21.891 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:21.890+0000 7f0df4df67c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-03-17T23:55:21.891 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:21.890+0000 7f0df4df67c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-03-17T23:55:21.891 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:21.890+0000 7f0df4df67c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-03-17T23:55:21.891 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:21.890+0000 7f0df4df67c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-03-17T23:55:21.891 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:21.890+0000 7f0df4df67c0 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-03-17T23:55:24.866 DEBUG:teuthology.orchestra.run.smithi196:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-03-17T23:55:24.921 DEBUG:teuthology.orchestra.run.smithi204:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-03-17T23:55:24.935 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-03-17T23:55:24.935 INFO:tasks.ceph:role: osd.4 2024-03-17T23:55:24.935 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi204.front.sepia.ceph.com 2024-03-17T23:55:24.935 DEBUG:teuthology.orchestra.run.smithi204:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-03-17T23:55:24.998 INFO:teuthology.orchestra.run.smithi204.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-03-17T23:55:24.998 INFO:teuthology.orchestra.run.smithi204.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-17T23:55:24.998 INFO:teuthology.orchestra.run.smithi204.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-17T23:55:24.998 INFO:teuthology.orchestra.run.smithi204.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-03-17T23:55:24.998 INFO:teuthology.orchestra.run.smithi204.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-17T23:55:24.998 INFO:teuthology.orchestra.run.smithi204.stdout: = sunit=0 swidth=0 blks 2024-03-17T23:55:24.999 INFO:teuthology.orchestra.run.smithi204.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-17T23:55:24.999 INFO:teuthology.orchestra.run.smithi204.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-03-17T23:55:24.999 INFO:teuthology.orchestra.run.smithi204.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-17T23:55:24.999 INFO:teuthology.orchestra.run.smithi204.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-17T23:55:25.451 INFO:teuthology.orchestra.run.smithi204.stdout:Discarding blocks...Done. 2024-03-17T23:55:25.453 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi204.front.sepia.ceph.com -o noatime 2024-03-17T23:55:25.453 DEBUG:teuthology.orchestra.run.smithi204:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-03-17T23:55:25.540 DEBUG:teuthology.orchestra.run.smithi204:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-03-17T23:55:25.592 INFO:teuthology.orchestra.run.smithi204.stderr:sudo: /sbin/restorecon: command not found 2024-03-17T23:55:25.593 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-17T23:55:25.593 DEBUG:teuthology.orchestra.run.smithi204:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-03-17T23:55:25.646 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-03-17T23:55:25.646 INFO:tasks.ceph:role: osd.5 2024-03-17T23:55:25.646 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi204.front.sepia.ceph.com 2024-03-17T23:55:25.646 DEBUG:teuthology.orchestra.run.smithi204:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-03-17T23:55:25.711 INFO:teuthology.orchestra.run.smithi204.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-03-17T23:55:25.711 INFO:teuthology.orchestra.run.smithi204.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-17T23:55:25.711 INFO:teuthology.orchestra.run.smithi204.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-17T23:55:25.711 INFO:teuthology.orchestra.run.smithi204.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-03-17T23:55:25.711 INFO:teuthology.orchestra.run.smithi204.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-17T23:55:25.711 INFO:teuthology.orchestra.run.smithi204.stdout: = sunit=0 swidth=0 blks 2024-03-17T23:55:25.711 INFO:teuthology.orchestra.run.smithi204.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-17T23:55:25.711 INFO:teuthology.orchestra.run.smithi204.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-03-17T23:55:25.711 INFO:teuthology.orchestra.run.smithi204.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-17T23:55:25.711 INFO:teuthology.orchestra.run.smithi204.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-17T23:55:26.180 INFO:teuthology.orchestra.run.smithi204.stdout:Discarding blocks...Done. 2024-03-17T23:55:26.181 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi204.front.sepia.ceph.com -o noatime 2024-03-17T23:55:26.182 DEBUG:teuthology.orchestra.run.smithi204:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-03-17T23:55:26.330 DEBUG:teuthology.orchestra.run.smithi204:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-03-17T23:55:26.341 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-17T23:55:26.342 INFO:teuthology.orchestra.run.smithi204.stderr:sudo: /sbin/restorecon: command not found 2024-03-17T23:55:26.342 DEBUG:teuthology.orchestra.run.smithi204:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-03-17T23:55:26.398 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-03-17T23:55:26.398 INFO:tasks.ceph:role: osd.6 2024-03-17T23:55:26.398 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi204.front.sepia.ceph.com 2024-03-17T23:55:26.398 DEBUG:teuthology.orchestra.run.smithi204:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-03-17T23:55:26.463 INFO:teuthology.orchestra.run.smithi204.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-03-17T23:55:26.463 INFO:teuthology.orchestra.run.smithi204.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-17T23:55:26.463 INFO:teuthology.orchestra.run.smithi204.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-17T23:55:26.463 INFO:teuthology.orchestra.run.smithi204.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-03-17T23:55:26.463 INFO:teuthology.orchestra.run.smithi204.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-17T23:55:26.463 INFO:teuthology.orchestra.run.smithi204.stdout: = sunit=0 swidth=0 blks 2024-03-17T23:55:26.463 INFO:teuthology.orchestra.run.smithi204.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-17T23:55:26.463 INFO:teuthology.orchestra.run.smithi204.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-03-17T23:55:26.463 INFO:teuthology.orchestra.run.smithi204.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-17T23:55:26.463 INFO:teuthology.orchestra.run.smithi204.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-17T23:55:26.940 INFO:teuthology.orchestra.run.smithi204.stdout:Discarding blocks...Done. 2024-03-17T23:55:26.942 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi204.front.sepia.ceph.com -o noatime 2024-03-17T23:55:26.943 DEBUG:teuthology.orchestra.run.smithi204:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-03-17T23:55:27.091 DEBUG:teuthology.orchestra.run.smithi204:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-03-17T23:55:27.102 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-17T23:55:27.103 INFO:teuthology.orchestra.run.smithi204.stderr:sudo: /sbin/restorecon: command not found 2024-03-17T23:55:27.103 DEBUG:teuthology.orchestra.run.smithi204:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-03-17T23:55:27.158 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-03-17T23:55:27.158 INFO:tasks.ceph:role: osd.7 2024-03-17T23:55:27.158 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi204.front.sepia.ceph.com 2024-03-17T23:55:27.158 DEBUG:teuthology.orchestra.run.smithi204:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-03-17T23:55:27.227 INFO:teuthology.orchestra.run.smithi204.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-03-17T23:55:27.227 INFO:teuthology.orchestra.run.smithi204.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-17T23:55:27.227 INFO:teuthology.orchestra.run.smithi204.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-17T23:55:27.227 INFO:teuthology.orchestra.run.smithi204.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-03-17T23:55:27.227 INFO:teuthology.orchestra.run.smithi204.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-17T23:55:27.227 INFO:teuthology.orchestra.run.smithi204.stdout: = sunit=0 swidth=0 blks 2024-03-17T23:55:27.227 INFO:teuthology.orchestra.run.smithi204.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-17T23:55:27.227 INFO:teuthology.orchestra.run.smithi204.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-03-17T23:55:27.227 INFO:teuthology.orchestra.run.smithi204.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-17T23:55:27.227 INFO:teuthology.orchestra.run.smithi204.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-17T23:55:27.671 INFO:teuthology.orchestra.run.smithi204.stdout:Discarding blocks...Done. 2024-03-17T23:55:27.672 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi204.front.sepia.ceph.com -o noatime 2024-03-17T23:55:27.673 DEBUG:teuthology.orchestra.run.smithi204:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-03-17T23:55:27.774 DEBUG:teuthology.orchestra.run.smithi204:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-03-17T23:55:27.784 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-17T23:55:27.784 INFO:teuthology.orchestra.run.smithi204.stderr:sudo: /sbin/restorecon: command not found 2024-03-17T23:55:27.784 DEBUG:teuthology.orchestra.run.smithi204:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-17T23:55:27.901 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:27.895+0000 7fa282ea77c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-03-17T23:55:27.902 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:27.895+0000 7fa282ea77c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-03-17T23:55:27.902 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:27.895+0000 7fa282ea77c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-03-17T23:55:27.902 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:27.895+0000 7fa282ea77c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-03-17T23:55:27.902 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:27.899+0000 7fa282ea77c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-03-17T23:55:27.908 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:27.903+0000 7fa282ea77c0 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-03-17T23:55:30.883 DEBUG:teuthology.orchestra.run.smithi204:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-03-17T23:55:30.897 DEBUG:teuthology.orchestra.run.smithi204:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-17T23:55:30.976 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:30.971+0000 7f39a22de7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-03-17T23:55:30.976 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:30.971+0000 7f39a22de7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-03-17T23:55:30.977 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:30.971+0000 7f39a22de7c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-03-17T23:55:30.977 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:30.971+0000 7f39a22de7c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-03-17T23:55:30.977 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:30.971+0000 7f39a22de7c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-03-17T23:55:30.977 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:30.971+0000 7f39a22de7c0 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-03-17T23:55:33.999 DEBUG:teuthology.orchestra.run.smithi204:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-03-17T23:55:34.055 DEBUG:teuthology.orchestra.run.smithi204:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-17T23:55:34.137 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:34.131+0000 7f1cbb4167c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-03-17T23:55:34.138 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:34.131+0000 7f1cbb4167c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-03-17T23:55:34.138 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:34.131+0000 7f1cbb4167c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-03-17T23:55:34.138 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:34.131+0000 7f1cbb4167c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-03-17T23:55:34.138 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:34.131+0000 7f1cbb4167c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-03-17T23:55:34.138 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:34.131+0000 7f1cbb4167c0 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-03-17T23:55:36.454 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T23:55:36.457 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T23:55:37.143 DEBUG:teuthology.orchestra.run.smithi204:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-03-17T23:55:37.157 DEBUG:teuthology.orchestra.run.smithi204:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-17T23:55:37.241 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:37.235+0000 7fd6ee7f87c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-03-17T23:55:37.241 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:37.235+0000 7fd6ee7f87c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-03-17T23:55:37.241 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:37.235+0000 7fd6ee7f87c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-03-17T23:55:37.241 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:37.235+0000 7fd6ee7f87c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-03-17T23:55:37.242 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:37.235+0000 7fd6ee7f87c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-03-17T23:55:37.242 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:37.235+0000 7fd6ee7f87c0 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-03-17T23:55:40.210 DEBUG:teuthology.orchestra.run.smithi204:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-03-17T23:55:40.267 INFO:tasks.ceph:Reading keys from all nodes... 2024-03-17T23:55:40.267 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2024-03-17T23:55:40.267 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-03-17T23:55:40.281 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2024-03-17T23:55:40.281 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-03-17T23:55:40.335 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2024-03-17T23:55:40.335 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-03-17T23:55:40.391 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2024-03-17T23:55:40.391 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd if=/var/lib/ceph/mds/ceph-e/keyring of=/dev/stdout 2024-03-17T23:55:40.447 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2024-03-17T23:55:40.447 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-03-17T23:55:40.503 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2024-03-17T23:55:40.503 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-03-17T23:55:40.559 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2024-03-17T23:55:40.560 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-03-17T23:55:40.615 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2024-03-17T23:55:40.615 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-03-17T23:55:40.670 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2024-03-17T23:55:40.671 DEBUG:teuthology.orchestra.run.smithi204:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-03-17T23:55:40.684 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2024-03-17T23:55:40.684 DEBUG:teuthology.orchestra.run.smithi204:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-03-17T23:55:40.739 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2024-03-17T23:55:40.739 DEBUG:teuthology.orchestra.run.smithi204:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2024-03-17T23:55:40.794 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2024-03-17T23:55:40.794 DEBUG:teuthology.orchestra.run.smithi204:> sudo dd if=/var/lib/ceph/mds/ceph-f/keyring of=/dev/stdout 2024-03-17T23:55:40.850 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2024-03-17T23:55:40.850 DEBUG:teuthology.orchestra.run.smithi204:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-03-17T23:55:40.901 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2024-03-17T23:55:40.902 DEBUG:teuthology.orchestra.run.smithi204:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-03-17T23:55:40.958 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2024-03-17T23:55:40.958 DEBUG:teuthology.orchestra.run.smithi204:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-03-17T23:55:41.013 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2024-03-17T23:55:41.013 DEBUG:teuthology.orchestra.run.smithi204:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-03-17T23:55:41.066 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2024-03-17T23:55:41.066 DEBUG:teuthology.orchestra.run.smithi196:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-03-17T23:55:41.071 INFO:tasks.ceph:Adding keys to all mons... 2024-03-17T23:55:41.072 DEBUG:teuthology.orchestra.run.smithi196:> sudo tee -a /etc/ceph/ceph.keyring 2024-03-17T23:55:41.116 DEBUG:teuthology.orchestra.run.smithi204:> sudo tee -a /etc/ceph/ceph.keyring 2024-03-17T23:55:41.126 INFO:teuthology.orchestra.run.smithi196.stdout:[mgr.y] 2024-03-17T23:55:41.126 INFO:teuthology.orchestra.run.smithi196.stdout: key = AQDcgvdlQN5SJRAAn3Y9hANfDyh1uS/2oZjiEg== 2024-03-17T23:55:41.126 INFO:teuthology.orchestra.run.smithi196.stdout:[mds.a] 2024-03-17T23:55:41.126 INFO:teuthology.orchestra.run.smithi196.stdout: key = AQDcgvdlIL7KKxAAUT0gNkb9oHQGvK36pFJROA== 2024-03-17T23:55:41.126 INFO:teuthology.orchestra.run.smithi196.stdout:[mds.c] 2024-03-17T23:55:41.126 INFO:teuthology.orchestra.run.smithi196.stdout: key = AQDcgvdl3fPKMxAAkE06UvzXhHay33Y8zTjDjA== 2024-03-17T23:55:41.126 INFO:teuthology.orchestra.run.smithi196.stdout:[mds.e] 2024-03-17T23:55:41.127 INFO:teuthology.orchestra.run.smithi196.stdout: key = AQDdgvdl4H2HABAArzcK+lebCt1+teC2qN4N9A== 2024-03-17T23:55:41.127 INFO:teuthology.orchestra.run.smithi196.stdout:[osd.0] 2024-03-17T23:55:41.127 INFO:teuthology.orchestra.run.smithi196.stdout: key = AQDggvdlhoZVIxAACukatUtXL7OioNB1afhmNg== 2024-03-17T23:55:41.127 INFO:teuthology.orchestra.run.smithi196.stdout:[osd.1] 2024-03-17T23:55:41.127 INFO:teuthology.orchestra.run.smithi196.stdout: key = AQDjgvdlgVD1JhAAO7qewZYYFa9C3Hqcod9iEw== 2024-03-17T23:55:41.127 INFO:teuthology.orchestra.run.smithi196.stdout:[osd.2] 2024-03-17T23:55:41.127 INFO:teuthology.orchestra.run.smithi196.stdout: key = AQDmgvdlx71jLRAAbqdFzq2I/q/mVLQmUFpPqw== 2024-03-17T23:55:41.127 INFO:teuthology.orchestra.run.smithi196.stdout:[osd.3] 2024-03-17T23:55:41.127 INFO:teuthology.orchestra.run.smithi196.stdout: key = AQDpgvdlJjM6NRAAWhFehEjUcdiFmEjkZfdsfg== 2024-03-17T23:55:41.127 INFO:teuthology.orchestra.run.smithi196.stdout:[mgr.x] 2024-03-17T23:55:41.127 INFO:teuthology.orchestra.run.smithi196.stdout: key = AQDcgvdl5qrfJxAABj4++4p30YUgccIf/hkXBw== 2024-03-17T23:55:41.127 INFO:teuthology.orchestra.run.smithi196.stdout:[mds.b] 2024-03-17T23:55:41.127 INFO:teuthology.orchestra.run.smithi196.stdout: key = AQDdgvdlSMFvBhAAwvgjbiagTFCbPh6logcYrg== 2024-03-17T23:55:41.127 INFO:teuthology.orchestra.run.smithi196.stdout:[mds.d] 2024-03-17T23:55:41.127 INFO:teuthology.orchestra.run.smithi196.stdout: key = AQDdgvdl4l7QDhAAnGVkj4VjsZSxVUMyqPunzw== 2024-03-17T23:55:41.128 INFO:teuthology.orchestra.run.smithi196.stdout:[mds.f] 2024-03-17T23:55:41.128 INFO:teuthology.orchestra.run.smithi196.stdout: key = AQDdgvdlvKagFxAAE/Wclsq0+5PUvGmtUXo5ZA== 2024-03-17T23:55:41.128 INFO:teuthology.orchestra.run.smithi196.stdout:[osd.4] 2024-03-17T23:55:41.128 INFO:teuthology.orchestra.run.smithi196.stdout: key = AQDvgvdlJJS/NRAA+xJD3FEqd8m2eLiiWsnjew== 2024-03-17T23:55:41.128 INFO:teuthology.orchestra.run.smithi196.stdout:[osd.5] 2024-03-17T23:55:41.128 INFO:teuthology.orchestra.run.smithi196.stdout: key = AQDygvdlo/45OhAAlNv7HOvbKTZxrrBXsGN4LA== 2024-03-17T23:55:41.128 INFO:teuthology.orchestra.run.smithi196.stdout:[osd.6] 2024-03-17T23:55:41.128 INFO:teuthology.orchestra.run.smithi196.stdout: key = AQD2gvdljUg4CBAAuOsvDXDUeCt/6YdS66zbIA== 2024-03-17T23:55:41.128 INFO:teuthology.orchestra.run.smithi196.stdout:[osd.7] 2024-03-17T23:55:41.128 INFO:teuthology.orchestra.run.smithi196.stdout: key = AQD5gvdlTEdmDhAAMRpCU3X/6AzaVsJ1J3u6wg== 2024-03-17T23:55:41.128 INFO:teuthology.orchestra.run.smithi196.stdout:[client.0] 2024-03-17T23:55:41.128 INFO:teuthology.orchestra.run.smithi196.stdout: key = AQDdgvdlX0qoHRAAlULmKMm1yd1F/+TqDA5JfA== 2024-03-17T23:55:41.129 INFO:teuthology.orchestra.run.smithi204.stdout:[mgr.y] 2024-03-17T23:55:41.130 INFO:teuthology.orchestra.run.smithi204.stdout: key = AQDcgvdlQN5SJRAAn3Y9hANfDyh1uS/2oZjiEg== 2024-03-17T23:55:41.130 INFO:teuthology.orchestra.run.smithi204.stdout:[mds.a] 2024-03-17T23:55:41.130 INFO:teuthology.orchestra.run.smithi204.stdout: key = AQDcgvdlIL7KKxAAUT0gNkb9oHQGvK36pFJROA== 2024-03-17T23:55:41.130 INFO:teuthology.orchestra.run.smithi204.stdout:[mds.c] 2024-03-17T23:55:41.130 INFO:teuthology.orchestra.run.smithi204.stdout: key = AQDcgvdl3fPKMxAAkE06UvzXhHay33Y8zTjDjA== 2024-03-17T23:55:41.130 INFO:teuthology.orchestra.run.smithi204.stdout:[mds.e] 2024-03-17T23:55:41.130 INFO:teuthology.orchestra.run.smithi204.stdout: key = AQDdgvdl4H2HABAArzcK+lebCt1+teC2qN4N9A== 2024-03-17T23:55:41.130 INFO:teuthology.orchestra.run.smithi204.stdout:[osd.0] 2024-03-17T23:55:41.130 INFO:teuthology.orchestra.run.smithi204.stdout: key = AQDggvdlhoZVIxAACukatUtXL7OioNB1afhmNg== 2024-03-17T23:55:41.130 INFO:teuthology.orchestra.run.smithi204.stdout:[osd.1] 2024-03-17T23:55:41.130 INFO:teuthology.orchestra.run.smithi204.stdout: key = AQDjgvdlgVD1JhAAO7qewZYYFa9C3Hqcod9iEw== 2024-03-17T23:55:41.130 INFO:teuthology.orchestra.run.smithi204.stdout:[osd.2] 2024-03-17T23:55:41.130 INFO:teuthology.orchestra.run.smithi204.stdout: key = AQDmgvdlx71jLRAAbqdFzq2I/q/mVLQmUFpPqw== 2024-03-17T23:55:41.130 INFO:teuthology.orchestra.run.smithi204.stdout:[osd.3] 2024-03-17T23:55:41.131 INFO:teuthology.orchestra.run.smithi204.stdout: key = AQDpgvdlJjM6NRAAWhFehEjUcdiFmEjkZfdsfg== 2024-03-17T23:55:41.131 INFO:teuthology.orchestra.run.smithi204.stdout:[mgr.x] 2024-03-17T23:55:41.131 INFO:teuthology.orchestra.run.smithi204.stdout: key = AQDcgvdl5qrfJxAABj4++4p30YUgccIf/hkXBw== 2024-03-17T23:55:41.131 INFO:teuthology.orchestra.run.smithi204.stdout:[mds.b] 2024-03-17T23:55:41.131 INFO:teuthology.orchestra.run.smithi204.stdout: key = AQDdgvdlSMFvBhAAwvgjbiagTFCbPh6logcYrg== 2024-03-17T23:55:41.131 INFO:teuthology.orchestra.run.smithi204.stdout:[mds.d] 2024-03-17T23:55:41.131 INFO:teuthology.orchestra.run.smithi204.stdout: key = AQDdgvdl4l7QDhAAnGVkj4VjsZSxVUMyqPunzw== 2024-03-17T23:55:41.131 INFO:teuthology.orchestra.run.smithi204.stdout:[mds.f] 2024-03-17T23:55:41.131 INFO:teuthology.orchestra.run.smithi204.stdout: key = AQDdgvdlvKagFxAAE/Wclsq0+5PUvGmtUXo5ZA== 2024-03-17T23:55:41.131 INFO:teuthology.orchestra.run.smithi204.stdout:[osd.4] 2024-03-17T23:55:41.131 INFO:teuthology.orchestra.run.smithi204.stdout: key = AQDvgvdlJJS/NRAA+xJD3FEqd8m2eLiiWsnjew== 2024-03-17T23:55:41.131 INFO:teuthology.orchestra.run.smithi204.stdout:[osd.5] 2024-03-17T23:55:41.131 INFO:teuthology.orchestra.run.smithi204.stdout: key = AQDygvdlo/45OhAAlNv7HOvbKTZxrrBXsGN4LA== 2024-03-17T23:55:41.131 INFO:teuthology.orchestra.run.smithi204.stdout:[osd.6] 2024-03-17T23:55:41.131 INFO:teuthology.orchestra.run.smithi204.stdout: key = AQD2gvdljUg4CBAAuOsvDXDUeCt/6YdS66zbIA== 2024-03-17T23:55:41.132 INFO:teuthology.orchestra.run.smithi204.stdout:[osd.7] 2024-03-17T23:55:41.132 INFO:teuthology.orchestra.run.smithi204.stdout: key = AQD5gvdlTEdmDhAAMRpCU3X/6AzaVsJ1J3u6wg== 2024-03-17T23:55:41.132 INFO:teuthology.orchestra.run.smithi204.stdout:[client.0] 2024-03-17T23:55:41.132 INFO:teuthology.orchestra.run.smithi204.stdout: key = AQDdgvdlX0qoHRAAlULmKMm1yd1F/+TqDA5JfA== 2024-03-17T23:55:41.132 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-03-17T23:55:41.173 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-03-17T23:55:41.220 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-03-17T23:55:41.222 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-03-17T23:55:41.267 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-03-17T23:55:41.309 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-03-17T23:55:41.351 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.e --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-03-17T23:55:41.392 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.e --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-03-17T23:55:41.437 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-17T23:55:41.481 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-17T23:55:41.521 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-17T23:55:41.561 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-17T23:55:41.609 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-17T23:55:41.649 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-17T23:55:41.691 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-17T23:55:41.736 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-17T23:55:41.779 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-03-17T23:55:41.825 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-03-17T23:55:41.867 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-03-17T23:55:41.913 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-03-17T23:55:41.960 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-03-17T23:55:42.000 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-03-17T23:55:42.049 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.f --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-03-17T23:55:42.085 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.f --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-03-17T23:55:42.132 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-17T23:55:42.134 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-17T23:55:42.213 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-17T23:55:42.216 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-17T23:55:42.294 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-17T23:55:42.297 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-17T23:55:42.385 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-17T23:55:42.387 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-17T23:55:42.466 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-03-17T23:55:42.473 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-03-17T23:55:42.558 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-03-17T23:55:42.558 DEBUG:teuthology.orchestra.run.smithi196:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-03-17T23:55:42.570 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-03-17T23:55:42.660 DEBUG:teuthology.orchestra.run.smithi196:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-03-17T23:55:42.670 DEBUG:teuthology.orchestra.run.smithi204:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-03-17T23:55:42.684 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-03-17T23:55:42.776 DEBUG:teuthology.orchestra.run.smithi204:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-03-17T23:55:42.785 DEBUG:teuthology.orchestra.run.smithi204:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-03-17T23:55:42.835 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-03-17T23:55:42.927 DEBUG:teuthology.orchestra.run.smithi204:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-03-17T23:55:42.937 DEBUG:teuthology.orchestra.run.smithi196:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-03-17T23:55:42.939 DEBUG:teuthology.orchestra.run.smithi204:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-03-17T23:55:42.982 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-03-17T23:55:42.983 INFO:tasks.ceph.mon.a:Restarting daemon 2024-03-17T23:55:42.983 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-mon -f --cluster ceph -i a 2024-03-17T23:55:42.988 INFO:tasks.ceph.mon.a:Started 2024-03-17T23:55:42.989 INFO:tasks.ceph.mon.b:Restarting daemon 2024-03-17T23:55:42.989 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-mon -f --cluster ceph -i b 2024-03-17T23:55:43.027 INFO:tasks.ceph.mon.b:Started 2024-03-17T23:55:43.027 INFO:tasks.ceph.mon.c:Restarting daemon 2024-03-17T23:55:43.028 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-mon -f --cluster ceph -i c 2024-03-17T23:55:43.029 INFO:tasks.ceph.mon.c:Started 2024-03-17T23:55:43.030 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-03-17T23:55:43.030 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-03-17T23:55:43.030 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-mgr -f --cluster ceph -i y 2024-03-17T23:55:43.032 INFO:tasks.ceph.mgr.y:Started 2024-03-17T23:55:43.033 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-03-17T23:55:43.033 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-mgr -f --cluster ceph -i x 2024-03-17T23:55:43.035 INFO:tasks.ceph.mgr.x:Started 2024-03-17T23:55:43.035 INFO:tasks.ceph:Setting crush tunables to default 2024-03-17T23:55:43.035 DEBUG:teuthology.orchestra.run.smithi196:> sudo ceph --cluster ceph osd crush tunables default 2024-03-17T23:55:43.151 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:43.149+0000 7fca5d9f1640 1 Processor -- start 2024-03-17T23:55:43.151 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:43.149+0000 7fca5d9f1640 1 -- start start 2024-03-17T23:55:43.153 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:43.153+0000 7fca5d9f1640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fca58151dd0 0x7fca580c2650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:55:43.153 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:43.153+0000 7fca5d9f1640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fca58158630 0x7fca580c9120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:55:43.153 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:43.153+0000 7fca5d9f1640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fca580c3060 0x7fca580c34d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:55:43.153 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:43.153+0000 7fca5d9f1640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7fca5806fac0 con 0x7fca58158630 2024-03-17T23:55:43.153 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:43.153+0000 7fca5d9f1640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 -- 0x7fca580c8410 con 0x7fca580c3060 2024-03-17T23:55:43.153 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:43.153+0000 7fca5d9f1640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7fca580c86f0 con 0x7fca58151dd0 2024-03-17T23:55:43.153 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:43.153+0000 7fca567fc640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fca58158630 0x7fca580c9120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:55:43.154 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:43.153+0000 7fca567fc640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fca58158630 0x7fca580c9120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.196:37016/0 (socket says 172.21.15.196:37016) 2024-03-17T23:55:43.154 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:43.153+0000 7fca567fc640 1 -- 172.21.15.196:0/1764161301 learned_addr learned my addr 172.21.15.196:0/1764161301 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-03-17T23:55:43.154 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:43.153+0000 7fca567fc640 1 -- 172.21.15.196:0/1764161301 >> v2:172.21.15.196:3300/0 conn(0x7fca58158630 msgr2=0x7fca580c9120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-03-17T23:55:43.154 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:43.153+0000 7fca567fc640 1 -- 172.21.15.196:0/1764161301 >> v2:172.21.15.196:3300/0 conn(0x7fca58158630 msgr2=0x7fca580c9120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-17T23:55:43.154 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:43.153+0000 7fca577fe640 1 --2- 172.21.15.196:0/1764161301 >> v2:172.21.15.204:3300/0 conn(0x7fca580c3060 0x7fca580c34d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:55:43.154 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:43.153+0000 7fca56ffd640 1 --2- 172.21.15.196:0/1764161301 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fca58151dd0 0x7fca580c2650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:55:43.154 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:43.153+0000 7fca567fc640 1 --2- 172.21.15.196:0/1764161301 >> v2:172.21.15.196:3300/0 conn(0x7fca58158630 0x7fca580c9120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-17T23:55:43.154 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:43.153+0000 7fca567fc640 1 --2- 172.21.15.196:0/1764161301 >> v2:172.21.15.196:3300/0 conn(0x7fca58158630 0x7fca580c9120 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-17T23:55:43.154 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:43.153+0000 7fca56ffd640 1 -- 172.21.15.196:0/1764161301 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fca58151dd0 msgr2=0x7fca580c2650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-03-17T23:55:43.154 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:43.153+0000 7fca56ffd640 1 -- 172.21.15.196:0/1764161301 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fca58151dd0 msgr2=0x7fca580c2650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-17T23:55:43.154 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:43.153+0000 7fca56ffd640 1 --2- 172.21.15.196:0/1764161301 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fca58151dd0 0x7fca580c2650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-17T23:55:43.154 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:43.153+0000 7fca577fe640 1 -- 172.21.15.196:0/1764161301 >> v2:172.21.15.204:3300/0 conn(0x7fca580c3060 msgr2=0x7fca580c34d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-03-17T23:55:43.155 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:43.153+0000 7fca577fe640 1 -- 172.21.15.196:0/1764161301 >> v2:172.21.15.204:3300/0 conn(0x7fca580c3060 msgr2=0x7fca580c34d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-17T23:55:43.155 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:43.153+0000 7fca577fe640 1 --2- 172.21.15.196:0/1764161301 >> v2:172.21.15.204:3300/0 conn(0x7fca580c3060 0x7fca580c34d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-17T23:55:43.155 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:43.153+0000 7fca56ffd640 1 --2- 172.21.15.196:0/1764161301 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fca58151dd0 0x7fca580c2650 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-17T23:55:43.155 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:43.153+0000 7fca577fe640 1 --2- 172.21.15.196:0/1764161301 >> v2:172.21.15.204:3300/0 conn(0x7fca580c3060 0x7fca580c34d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-17T23:55:43.356 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:43.357+0000 7fca567fc640 1 --2- 172.21.15.196:0/1764161301 >> v2:172.21.15.196:3300/0 conn(0x7fca58158630 0x7fca580c9120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:55:43.357 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:43.357+0000 7fca577fe640 1 --2- 172.21.15.196:0/1764161301 >> v2:172.21.15.204:3300/0 conn(0x7fca580c3060 0x7fca580c34d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:55:43.357 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:43.357+0000 7fca56ffd640 1 --2- 172.21.15.196:0/1764161301 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fca58151dd0 0x7fca580c2650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:55:43.357 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:43.357+0000 7fca567fc640 1 -- 172.21.15.196:0/1764161301 >> v2:172.21.15.196:3300/0 conn(0x7fca58158630 msgr2=0x7fca580c9120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-03-17T23:55:43.357 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:43.357+0000 7fca567fc640 1 -- 172.21.15.196:0/1764161301 >> v2:172.21.15.196:3300/0 conn(0x7fca58158630 msgr2=0x7fca580c9120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-17T23:55:43.357 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:43.357+0000 7fca567fc640 1 --2- 172.21.15.196:0/1764161301 >> v2:172.21.15.196:3300/0 conn(0x7fca58158630 0x7fca580c9120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-17T23:55:43.357 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:43.357+0000 7fca577fe640 1 -- 172.21.15.196:0/1764161301 >> v2:172.21.15.204:3300/0 conn(0x7fca580c3060 msgr2=0x7fca580c34d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-03-17T23:55:43.357 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:43.357+0000 7fca577fe640 1 -- 172.21.15.196:0/1764161301 >> v2:172.21.15.204:3300/0 conn(0x7fca580c3060 msgr2=0x7fca580c34d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-17T23:55:43.357 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:43.357+0000 7fca577fe640 1 --2- 172.21.15.196:0/1764161301 >> v2:172.21.15.204:3300/0 conn(0x7fca580c3060 0x7fca580c34d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-17T23:55:43.357 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:43.357+0000 7fca567fc640 1 --2- 172.21.15.196:0/1764161301 >> v2:172.21.15.196:3300/0 conn(0x7fca58158630 0x7fca580c9120 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-03-17T23:55:43.357 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:43.357+0000 7fca56ffd640 1 -- 172.21.15.196:0/1764161301 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fca58151dd0 msgr2=0x7fca580c2650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-03-17T23:55:43.357 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:43.357+0000 7fca56ffd640 1 -- 172.21.15.196:0/1764161301 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fca58151dd0 msgr2=0x7fca580c2650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-17T23:55:43.357 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:43.357+0000 7fca56ffd640 1 --2- 172.21.15.196:0/1764161301 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fca58151dd0 0x7fca580c2650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-17T23:55:43.357 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:43.357+0000 7fca577fe640 1 --2- 172.21.15.196:0/1764161301 >> v2:172.21.15.204:3300/0 conn(0x7fca580c3060 0x7fca580c34d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-03-17T23:55:43.357 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:43.357+0000 7fca56ffd640 1 --2- 172.21.15.196:0/1764161301 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fca58151dd0 0x7fca580c2650 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-03-17T23:55:43.620 INFO:tasks.ceph.mgr.x.smithi204.stderr:2024-03-17T23:55:43.615+0000 7f85f3708180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-03-17T23:55:43.760 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:43.761+0000 7fca567fc640 1 --2- 172.21.15.196:0/1764161301 >> v2:172.21.15.196:3300/0 conn(0x7fca58158630 0x7fca580c9120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:55:43.760 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:43.761+0000 7fca577fe640 1 --2- 172.21.15.196:0/1764161301 >> v2:172.21.15.204:3300/0 conn(0x7fca580c3060 0x7fca580c34d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:55:43.760 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:43.761+0000 7fca56ffd640 1 --2- 172.21.15.196:0/1764161301 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fca58151dd0 0x7fca580c2650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:55:43.761 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:43.761+0000 7fca567fc640 1 -- 172.21.15.196:0/1764161301 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fca58151dd0 msgr2=0x7fca580c2650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-17T23:55:43.761 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:43.761+0000 7fca567fc640 1 --2- 172.21.15.196:0/1764161301 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fca58151dd0 0x7fca580c2650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:55:43.761 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:43.761+0000 7fca567fc640 1 -- 172.21.15.196:0/1764161301 >> v2:172.21.15.204:3300/0 conn(0x7fca580c3060 msgr2=0x7fca580c34d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-17T23:55:43.761 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:43.761+0000 7fca567fc640 1 --2- 172.21.15.196:0/1764161301 >> v2:172.21.15.204:3300/0 conn(0x7fca580c3060 0x7fca580c34d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:55:43.761 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:43.761+0000 7fca567fc640 1 -- 172.21.15.196:0/1764161301 --> v2:172.21.15.196:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca5806f190 con 0x7fca58158630 2024-03-17T23:55:43.762 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:43.761+0000 7fca567fc640 1 --2- 172.21.15.196:0/1764161301 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fca58158630 0x7fca580c9120 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fca580c2dc0 tx=0x7fca4c01f2e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f869459b2d108265 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:55:43.762 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:43.761+0000 7fca55ffb640 1 -- 172.21.15.196:0/1764161301 <== mon.0 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca4c0b6070 con 0x7fca58158630 2024-03-17T23:55:43.762 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:43.761+0000 7fca55ffb640 1 -- 172.21.15.196:0/1764161301 <== mon.0 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca4c0b1410 con 0x7fca58158630 2024-03-17T23:55:43.763 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:43.761+0000 7fca55ffb640 1 -- 172.21.15.196:0/1764161301 <== mon.0 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca4c00f040 con 0x7fca58158630 2024-03-17T23:55:43.764 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:43.765+0000 7fca5d9f1640 1 -- 172.21.15.196:0/1764161301 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fca58158630 msgr2=0x7fca580c9120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:55:43.764 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:43.765+0000 7fca5d9f1640 1 --2- 172.21.15.196:0/1764161301 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fca58158630 0x7fca580c9120 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fca580c2dc0 tx=0x7fca4c01f2e0 comp rx=0 tx=0).stop 2024-03-17T23:55:43.764 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:43.765+0000 7fca5d9f1640 1 -- 172.21.15.196:0/1764161301 shutdown_connections 2024-03-17T23:55:43.764 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:43.765+0000 7fca5d9f1640 1 --2- 172.21.15.196:0/1764161301 >> v2:172.21.15.204:3300/0 conn(0x7fca580c3060 0x7fca580c34d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:55:43.764 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:43.765+0000 7fca5d9f1640 1 --2- 172.21.15.196:0/1764161301 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fca58158630 0x7fca580c9120 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:55:43.764 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:43.765+0000 7fca5d9f1640 1 --2- 172.21.15.196:0/1764161301 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fca58151dd0 0x7fca580c2650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:55:43.764 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:43.765+0000 7fca5d9f1640 1 -- 172.21.15.196:0/1764161301 >> 172.21.15.196:0/1764161301 conn(0x7fca580710c0 msgr2=0x7fca580714d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-17T23:55:43.764 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:43.765+0000 7fca5d9f1640 1 -- 172.21.15.196:0/1764161301 shutdown_connections 2024-03-17T23:55:43.764 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:43.765+0000 7fca5d9f1640 1 -- 172.21.15.196:0/1764161301 wait complete. 2024-03-17T23:55:43.770 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:43.765+0000 7fca5d9f1640 1 Processor -- start 2024-03-17T23:55:43.770 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:43.765+0000 7fca5d9f1640 1 -- start start 2024-03-17T23:55:43.770 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:43.765+0000 7fca5d9f1640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fca580c3060 0x7fca58154bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:55:43.770 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:43.765+0000 7fca5d9f1640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fca58151dd0 0x7fca58155a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:55:43.770 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:43.765+0000 7fca5d9f1640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fca58158630 0x7fca5814d820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:55:43.770 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:43.765+0000 7fca5d9f1640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fca581521b0 con 0x7fca58158630 2024-03-17T23:55:43.770 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:43.765+0000 7fca5d9f1640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7fca5806f750 con 0x7fca580c3060 2024-03-17T23:55:43.770 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:43.765+0000 7fca5d9f1640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7fca58158a50 con 0x7fca58151dd0 2024-03-17T23:55:43.771 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:43.765+0000 7fca577fe640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fca58158630 0x7fca5814d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:55:43.771 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:43.765+0000 7fca577fe640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fca58158630 0x7fca5814d820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.196:37084/0 (socket says 172.21.15.196:37084) 2024-03-17T23:55:43.771 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:43.765+0000 7fca577fe640 1 -- 172.21.15.196:0/136850216 learned_addr learned my addr 172.21.15.196:0/136850216 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-03-17T23:55:43.771 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:43.765+0000 7fca56ffd640 1 --2- 172.21.15.196:0/136850216 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fca580c3060 0x7fca58154bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:55:43.771 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:43.765+0000 7fca567fc640 1 --2- 172.21.15.196:0/136850216 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fca58151dd0 0x7fca58155a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:55:43.771 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:43.765+0000 7fca577fe640 1 -- 172.21.15.196:0/136850216 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fca58151dd0 msgr2=0x7fca58155a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:55:43.771 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:43.765+0000 7fca577fe640 1 --2- 172.21.15.196:0/136850216 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fca58151dd0 0x7fca58155a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:55:43.771 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:43.765+0000 7fca577fe640 1 -- 172.21.15.196:0/136850216 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fca580c3060 msgr2=0x7fca58154bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:55:43.771 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:43.765+0000 7fca577fe640 1 --2- 172.21.15.196:0/136850216 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fca580c3060 0x7fca58154bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:55:43.771 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:43.765+0000 7fca577fe640 1 -- 172.21.15.196:0/136850216 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca5806e0b0 con 0x7fca58158630 2024-03-17T23:55:43.771 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:43.765+0000 7fca577fe640 1 --2- 172.21.15.196:0/136850216 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fca58158630 0x7fca5814d820 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fca500046e0 tx=0x7fca50007700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:55:43.771 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:43.765+0000 7fca3ffff640 1 -- 172.21.15.196:0/136850216 <== mon.0 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca50019020 con 0x7fca58158630 2024-03-17T23:55:43.771 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:43.765+0000 7fca3ffff640 1 -- 172.21.15.196:0/136850216 <== mon.0 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca50007db0 con 0x7fca58158630 2024-03-17T23:55:43.771 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:43.765+0000 7fca3ffff640 1 -- 172.21.15.196:0/136850216 <== mon.0 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca50015610 con 0x7fca58158630 2024-03-17T23:55:43.772 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:43.765+0000 7fca5d9f1640 1 -- 172.21.15.196:0/136850216 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca581f0210 con 0x7fca58158630 2024-03-17T23:55:43.772 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:43.765+0000 7fca5d9f1640 1 -- 172.21.15.196:0/136850216 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca58155f60 con 0x7fca58158630 2024-03-17T23:55:43.772 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:43.765+0000 7fca3ffff640 1 -- 172.21.15.196:0/136850216 <== mon.0 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fca5001c020 con 0x7fca58158630 2024-03-17T23:55:43.772 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:43.769+0000 7fca3ffff640 1 -- 172.21.15.196:0/136850216 <== mon.0 v2:172.21.15.196:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fca5001ec60 con 0x7fca58158630 2024-03-17T23:55:43.772 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:43.769+0000 7fca5d9f1640 1 -- 172.21.15.196:0/136850216 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fca380052a0 con 0x7fca58158630 2024-03-17T23:55:43.772 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:43.769+0000 7fca3ffff640 1 -- 172.21.15.196:0/136850216 <== mon.0 v2:172.21.15.196:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7fca50023030 con 0x7fca58158630 2024-03-17T23:55:43.835 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:43.833+0000 7fca5d9f1640 1 -- 172.21.15.196:0/136850216 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7fca38005860 con 0x7fca58158630 2024-03-17T23:55:43.837 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:43.837+0000 7fca3ffff640 1 -- 172.21.15.196:0/136850216 <== mon.0 v2:172.21.15.196:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (secure 0 0 0) 0x7fca50015d70 con 0x7fca58158630 2024-03-17T23:55:43.838 INFO:teuthology.orchestra.run.smithi196.stderr:adjusted tunables profile to default 2024-03-17T23:55:43.839 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:43.837+0000 7fca5d9f1640 1 -- 172.21.15.196:0/136850216 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fca58158630 msgr2=0x7fca5814d820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:55:43.839 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:43.837+0000 7fca5d9f1640 1 --2- 172.21.15.196:0/136850216 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fca58158630 0x7fca5814d820 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fca500046e0 tx=0x7fca50007700 comp rx=0 tx=0).stop 2024-03-17T23:55:43.839 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:43.837+0000 7fca5d9f1640 1 -- 172.21.15.196:0/136850216 shutdown_connections 2024-03-17T23:55:43.839 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:43.837+0000 7fca5d9f1640 1 --2- 172.21.15.196:0/136850216 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fca58151dd0 0x7fca58155a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:55:43.839 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:43.837+0000 7fca5d9f1640 1 --2- 172.21.15.196:0/136850216 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fca58158630 0x7fca5814d820 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:55:43.839 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:43.837+0000 7fca5d9f1640 1 --2- 172.21.15.196:0/136850216 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fca580c3060 0x7fca58154bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:55:43.839 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:43.837+0000 7fca5d9f1640 1 -- 172.21.15.196:0/136850216 >> 172.21.15.196:0/136850216 conn(0x7fca580710c0 msgr2=0x7fca5814f820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-17T23:55:43.839 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:43.837+0000 7fca5d9f1640 1 -- 172.21.15.196:0/136850216 shutdown_connections 2024-03-17T23:55:43.839 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:43.837+0000 7fca5d9f1640 1 -- 172.21.15.196:0/136850216 wait complete. 2024-03-17T23:55:43.857 INFO:tasks.ceph:check_enable_crimson: False 2024-03-17T23:55:43.857 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-03-17T23:55:43.858 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2024-03-17T23:55:43.858 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-03-17T23:55:43.869 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2024-03-17T23:55:43.869 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-03-17T23:55:43.922 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2024-03-17T23:55:43.922 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-03-17T23:55:43.942 INFO:tasks.ceph.mgr.y.smithi196.stderr:2024-03-17T23:55:43.941+0000 7f2273686180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-03-17T23:55:43.953 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2024-03-17T23:55:43.953 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-03-17T23:55:44.007 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2024-03-17T23:55:44.007 DEBUG:teuthology.orchestra.run.smithi204:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-03-17T23:55:44.020 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2024-03-17T23:55:44.021 DEBUG:teuthology.orchestra.run.smithi204:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-03-17T23:55:44.074 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2024-03-17T23:55:44.075 DEBUG:teuthology.orchestra.run.smithi204:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-03-17T23:55:44.096 INFO:tasks.ceph.mgr.x.smithi204.stderr:2024-03-17T23:55:44.091+0000 7f85f3708180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-03-17T23:55:44.107 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2024-03-17T23:55:44.107 DEBUG:teuthology.orchestra.run.smithi204:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-03-17T23:55:44.162 DEBUG:teuthology.orchestra.run.smithi204:> sudo ceph --cluster ceph osd new 224d699f-bc10-4661-a8b5-6ca73290ffa0 0 2024-03-17T23:55:44.298 INFO:tasks.ceph.mgr.x.smithi204.stderr:2024-03-17T23:55:44.291+0000 7f85f3708180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-03-17T23:55:44.329 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:44.323+0000 7f98aa761640 1 Processor -- start 2024-03-17T23:55:44.329 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:44.323+0000 7f98aa761640 1 -- start start 2024-03-17T23:55:44.331 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:44.327+0000 7f98aa761640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f98a406c260 0x7f98a40c2200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:55:44.331 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:44.327+0000 7f98aa761640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f98a40c2740 0x7f98a40c2bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:55:44.331 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:44.327+0000 7f98aa761640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f98a4072400 con 0x7f98a4150f60 2024-03-17T23:55:44.331 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:44.327+0000 7f98aa761640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 -- 0x7f98a4157b30 con 0x7f98a40c2740 2024-03-17T23:55:44.331 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:44.327+0000 7f98aa761640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f98a4071e40 con 0x7f98a406c260 2024-03-17T23:55:44.331 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:44.327+0000 7f98a8cfe640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f98a40c2740 0x7f98a40c2bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:55:44.332 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:44.327+0000 7f98a37fe640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f98a406c260 0x7f98a40c2200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:55:44.332 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:44.327+0000 7f98a3fff640 1 --1- >> v1:172.21.15.204:6789/0 conn(0x7f98a4150f60 0x7f98a406bb50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.204:6789/0 says I am v1:172.21.15.204:38774/0 (socket says 172.21.15.204:38774) 2024-03-17T23:55:44.332 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:44.327+0000 7f98a3fff640 1 -- 172.21.15.204:0/3568871584 learned_addr learned my addr 172.21.15.204:0/3568871584 (peer_addr_for_me v1:172.21.15.204:0/0) 2024-03-17T23:55:44.332 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:44.327+0000 7f98a8cfe640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f98a40c2740 0x7f98a40c2bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3300/0 says I am v2:172.21.15.204:54792/0 (socket says 172.21.15.204:54792) 2024-03-17T23:55:44.332 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:44.327+0000 7f98a8cfe640 1 -- 172.21.15.204:0/3568871584 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f98a406c260 msgr2=0x7f98a40c2200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-17T23:55:44.332 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:44.327+0000 7f98a8cfe640 1 --2- 172.21.15.204:0/3568871584 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f98a406c260 0x7f98a40c2200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:55:44.332 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:44.327+0000 7f98a8cfe640 1 -- 172.21.15.204:0/3568871584 >> v1:172.21.15.204:6789/0 conn(0x7f98a4150f60 legacy=0x7f98a406bb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:55:44.332 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:44.327+0000 7f98a8cfe640 1 -- 172.21.15.204:0/3568871584 --> v2:172.21.15.204:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98a4072120 con 0x7f98a40c2740 2024-03-17T23:55:44.332 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:44.327+0000 7f98a37fe640 1 --2- 172.21.15.204:0/3568871584 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f98a406c260 0x7f98a40c2200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-17T23:55:44.333 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:44.327+0000 7f98a8cfe640 1 --2- 172.21.15.204:0/3568871584 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f98a40c2740 0x7f98a40c2bb0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f98940097c0 tx=0x7f989401ec90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=78aef1a5e83b9005 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:55:44.333 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:44.327+0000 7f98a2ffd640 1 -- 172.21.15.204:0/3568871584 <== mon.1 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98940b5070 con 0x7f98a40c2740 2024-03-17T23:55:44.334 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:44.327+0000 7f98a2ffd640 1 -- 172.21.15.204:0/3568871584 <== mon.1 v2:172.21.15.204:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f98940a8990 con 0x7f98a40c2740 2024-03-17T23:55:44.334 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:44.327+0000 7f98a2ffd640 1 -- 172.21.15.204:0/3568871584 <== mon.1 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98940a8d60 con 0x7f98a40c2740 2024-03-17T23:55:44.335 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:44.331+0000 7f98aa761640 1 -- 172.21.15.204:0/3568871584 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f98a40c2740 msgr2=0x7f98a40c2bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:55:44.335 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:44.331+0000 7f98aa761640 1 --2- 172.21.15.204:0/3568871584 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f98a40c2740 0x7f98a40c2bb0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f98940097c0 tx=0x7f989401ec90 comp rx=0 tx=0).stop 2024-03-17T23:55:44.335 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:44.331+0000 7f98aa761640 1 -- 172.21.15.204:0/3568871584 shutdown_connections 2024-03-17T23:55:44.335 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:44.331+0000 7f98aa761640 1 --2- 172.21.15.204:0/3568871584 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f98a40c2740 0x7f98a40c2bb0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:55:44.335 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:44.331+0000 7f98aa761640 1 --2- 172.21.15.204:0/3568871584 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f98a406c260 0x7f98a40c2200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:55:44.335 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:44.331+0000 7f98aa761640 1 -- 172.21.15.204:0/3568871584 >> 172.21.15.204:0/3568871584 conn(0x7f98a40c8b70 msgr2=0x7f98a40c8f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-17T23:55:44.335 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:44.331+0000 7f98aa761640 1 -- 172.21.15.204:0/3568871584 shutdown_connections 2024-03-17T23:55:44.335 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:44.331+0000 7f98aa761640 1 -- 172.21.15.204:0/3568871584 wait complete. 2024-03-17T23:55:44.336 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:44.331+0000 7f98aa761640 1 Processor -- start 2024-03-17T23:55:44.336 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:44.331+0000 7f98aa761640 1 -- start start 2024-03-17T23:55:44.338 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:44.331+0000 7f98aa761640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f98a406c260 0x7f98a4154be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:55:44.338 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:44.331+0000 7f98aa761640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f98a40c2740 0x7f98a41e1200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:55:44.338 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:44.331+0000 7f98aa761640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f98a4150f60 0x7f98a41e2470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:55:44.338 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:44.331+0000 7f98aa761640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f98a4151340 con 0x7f98a4150f60 2024-03-17T23:55:44.339 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:44.331+0000 7f98aa761640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f98a406b630 con 0x7f98a40c2740 2024-03-17T23:55:44.339 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:44.331+0000 7f98aa761640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f98a40735f0 con 0x7f98a406c260 2024-03-17T23:55:44.339 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:44.331+0000 7f98a3fff640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f98a406c260 0x7f98a4154be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:55:44.339 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:44.331+0000 7f98a37fe640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f98a40c2740 0x7f98a41e1200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:55:44.339 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:44.331+0000 7f98a3fff640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f98a406c260 0x7f98a4154be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3301/0 says I am v2:172.21.15.204:39844/0 (socket says 172.21.15.204:39844) 2024-03-17T23:55:44.339 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:44.331+0000 7f98a3fff640 1 -- 172.21.15.204:0/168786433 learned_addr learned my addr 172.21.15.204:0/168786433 (peer_addr_for_me v2:172.21.15.204:0/0) 2024-03-17T23:55:44.339 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:44.331+0000 7f98a37fe640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f98a40c2740 0x7f98a41e1200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3300/0 says I am v2:172.21.15.204:54802/0 (socket says 172.21.15.204:54802) 2024-03-17T23:55:44.339 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:44.331+0000 7f98a8cfe640 1 --2- 172.21.15.204:0/168786433 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f98a4150f60 0x7f98a41e2470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:55:44.339 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:44.331+0000 7f98a3fff640 1 -- 172.21.15.204:0/168786433 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f98a40c2740 msgr2=0x7f98a41e1200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:55:44.339 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:44.331+0000 7f98a3fff640 1 --2- 172.21.15.204:0/168786433 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f98a40c2740 0x7f98a41e1200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:55:44.339 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:44.331+0000 7f98a3fff640 1 -- 172.21.15.204:0/168786433 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f98a4150f60 msgr2=0x7f98a41e2470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:55:44.339 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:44.331+0000 7f98a3fff640 1 --2- 172.21.15.204:0/168786433 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f98a4150f60 0x7f98a41e2470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:55:44.339 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:44.331+0000 7f98a3fff640 1 -- 172.21.15.204:0/168786433 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98a41e35b0 con 0x7f98a406c260 2024-03-17T23:55:44.340 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:44.331+0000 7f98a3fff640 1 --2- 172.21.15.204:0/168786433 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f98a406c260 0x7f98a4154be0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f989c00cb40 tx=0x7f989c00a060 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:55:44.340 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:44.331+0000 7f98a0ff9640 1 -- 172.21.15.204:0/168786433 <== mon.2 v2:172.21.15.204:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f989c017070 con 0x7f98a406c260 2024-03-17T23:55:44.340 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:44.331+0000 7f98a0ff9640 1 -- 172.21.15.204:0/168786433 <== mon.2 v2:172.21.15.204:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f989c00acc0 con 0x7f98a406c260 2024-03-17T23:55:44.340 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:44.331+0000 7f98aa761640 1 -- 172.21.15.204:0/168786433 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f98a4155cc0 con 0x7f98a406c260 2024-03-17T23:55:44.340 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:44.331+0000 7f98a0ff9640 1 -- 172.21.15.204:0/168786433 <== mon.2 v2:172.21.15.204:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f989c012640 con 0x7f98a406c260 2024-03-17T23:55:44.340 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:44.331+0000 7f98aa761640 1 -- 172.21.15.204:0/168786433 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f98a40c7af0 con 0x7f98a406c260 2024-03-17T23:55:44.340 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:44.331+0000 7f98a0ff9640 1 -- 172.21.15.204:0/168786433 <== mon.2 v2:172.21.15.204:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f989c01a070 con 0x7f98a406c260 2024-03-17T23:55:44.340 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:44.331+0000 7f98a0ff9640 1 -- 172.21.15.204:0/168786433 <== mon.2 v2:172.21.15.204:3301/0 5 ==== osd_map(2..2 src has 1..2) ==== 725+0+0 (secure 0 0 0) 0x7f989c01cc50 con 0x7f98a406c260 2024-03-17T23:55:44.340 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:44.335+0000 7f98aa761640 1 -- 172.21.15.204:0/168786433 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f98a40689a0 con 0x7f98a406c260 2024-03-17T23:55:44.351 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:44.347+0000 7f98a0ff9640 1 -- 172.21.15.204:0/168786433 <== mon.2 v2:172.21.15.204:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f989c021020 con 0x7f98a406c260 2024-03-17T23:55:44.398 INFO:tasks.ceph.mgr.y.smithi196.stderr:2024-03-17T23:55:44.397+0000 7f2273686180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-03-17T23:55:44.420 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:44.415+0000 7f98aa761640 1 -- 172.21.15.204:0/168786433 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_command({"prefix": "osd new", "uuid": "224d699f-bc10-4661-a8b5-6ca73290ffa0", "id": 0} v 0) -- 0x7f98a40c0ec0 con 0x7f98a406c260 2024-03-17T23:55:44.428 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:44.423+0000 7f98a0ff9640 1 -- 172.21.15.204:0/168786433 <== mon.2 v2:172.21.15.204:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "224d699f-bc10-4661-a8b5-6ca73290ffa0", "id": 0}]=0 v3) ==== 112+0+2 (secure 0 0 0) 0x7f989c0127e0 con 0x7f98a406c260 2024-03-17T23:55:44.428 INFO:teuthology.orchestra.run.smithi204.stdout:0 2024-03-17T23:55:44.429 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:44.423+0000 7f98aa761640 1 -- 172.21.15.204:0/168786433 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f98a406c260 msgr2=0x7f98a4154be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:55:44.430 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:44.423+0000 7f98aa761640 1 --2- 172.21.15.204:0/168786433 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f98a406c260 0x7f98a4154be0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f989c00cb40 tx=0x7f989c00a060 comp rx=0 tx=0).stop 2024-03-17T23:55:44.430 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:44.423+0000 7f98aa761640 1 -- 172.21.15.204:0/168786433 shutdown_connections 2024-03-17T23:55:44.430 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:44.423+0000 7f98aa761640 1 --2- 172.21.15.204:0/168786433 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f98a4150f60 0x7f98a41e2470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:55:44.430 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:44.423+0000 7f98aa761640 1 --2- 172.21.15.204:0/168786433 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f98a40c2740 0x7f98a41e1200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:55:44.430 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:44.423+0000 7f98aa761640 1 --2- 172.21.15.204:0/168786433 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f98a406c260 0x7f98a4154be0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:55:44.430 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:44.423+0000 7f98aa761640 1 -- 172.21.15.204:0/168786433 >> 172.21.15.204:0/168786433 conn(0x7f98a40c8b70 msgr2=0x7f98a4156df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-17T23:55:44.430 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:44.423+0000 7f98aa761640 1 -- 172.21.15.204:0/168786433 shutdown_connections 2024-03-17T23:55:44.430 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:44.423+0000 7f98aa761640 1 -- 172.21.15.204:0/168786433 wait complete. 2024-03-17T23:55:44.446 DEBUG:teuthology.orchestra.run.smithi204:> sudo ceph --cluster ceph osd new d8d6a0b0-450b-4ab5-b143-d4f36286e81e 1 2024-03-17T23:55:44.566 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:44.559+0000 7f9a209ac640 1 Processor -- start 2024-03-17T23:55:44.566 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:44.559+0000 7f9a209ac640 1 -- start start 2024-03-17T23:55:44.567 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:44.563+0000 7f9a209ac640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f9a1c0b1e10 0x7f9a1c15bca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:55:44.567 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:44.563+0000 7f9a209ac640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f9a1c0c72b0 0x7f9a1c0c76f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:55:44.567 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:44.563+0000 7f9a209ac640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9a1c15c1e0 con 0x7f9a1c067310 2024-03-17T23:55:44.567 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:44.563+0000 7f9a209ac640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7f9a1c0c7c30 con 0x7f9a1c0c72b0 2024-03-17T23:55:44.568 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:44.563+0000 7f9a209ac640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 -- 0x7f9a1c0c6ab0 con 0x7f9a1c0b1e10 2024-03-17T23:55:44.568 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:44.563+0000 7f9a1a59c640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f9a1c0b1e10 0x7f9a1c15bca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:55:44.568 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:44.563+0000 7f9a1a59c640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f9a1c0b1e10 0x7f9a1c15bca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3300/0 says I am v2:172.21.15.204:54806/0 (socket says 172.21.15.204:54806) 2024-03-17T23:55:44.568 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:44.563+0000 7f9a1a59c640 1 -- 172.21.15.204:0/4117887679 learned_addr learned my addr 172.21.15.204:0/4117887679 (peer_addr_for_me v2:172.21.15.204:0/0) 2024-03-17T23:55:44.568 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:44.563+0000 7f9a1ad9d640 1 --2- 172.21.15.204:0/4117887679 >> v2:172.21.15.196:3300/0 conn(0x7f9a1c0c72b0 0x7f9a1c0c76f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:55:44.568 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:44.563+0000 7f9a1a59c640 1 -- 172.21.15.204:0/4117887679 >> v2:172.21.15.196:3300/0 conn(0x7f9a1c0c72b0 msgr2=0x7f9a1c0c76f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-17T23:55:44.568 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:44.563+0000 7f9a1a59c640 1 --2- 172.21.15.204:0/4117887679 >> v2:172.21.15.196:3300/0 conn(0x7f9a1c0c72b0 0x7f9a1c0c76f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:55:44.568 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:44.563+0000 7f9a1a59c640 1 -- 172.21.15.204:0/4117887679 >> v1:172.21.15.196:6789/0 conn(0x7f9a1c067310 legacy=0x7f9a1c073050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-17T23:55:44.568 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:44.563+0000 7f9a1a59c640 1 -- 172.21.15.204:0/4117887679 --> v2:172.21.15.204:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a1c073760 con 0x7f9a1c0b1e10 2024-03-17T23:55:44.569 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:44.563+0000 7f9a1a59c640 1 --2- 172.21.15.204:0/4117887679 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9a1c0b1e10 0x7f9a1c15bca0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f9a1c071810 tx=0x7f9a0c01ecd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e5e54e5c4b65788b server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:55:44.569 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:44.563+0000 7f9a1959a640 1 -- 172.21.15.204:0/4117887679 <== mon.1 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a0c0b5070 con 0x7f9a1c0b1e10 2024-03-17T23:55:44.570 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:44.563+0000 7f9a1959a640 1 -- 172.21.15.204:0/4117887679 <== mon.1 v2:172.21.15.204:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a0c0a89d0 con 0x7f9a1c0b1e10 2024-03-17T23:55:44.570 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:44.563+0000 7f9a1959a640 1 -- 172.21.15.204:0/4117887679 <== mon.1 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a0c0a8da0 con 0x7f9a1c0b1e10 2024-03-17T23:55:44.570 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:44.563+0000 7f9a209ac640 1 -- 172.21.15.204:0/4117887679 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9a1c0b1e10 msgr2=0x7f9a1c15bca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:55:44.570 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:44.563+0000 7f9a209ac640 1 --2- 172.21.15.204:0/4117887679 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9a1c0b1e10 0x7f9a1c15bca0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f9a1c071810 tx=0x7f9a0c01ecd0 comp rx=0 tx=0).stop 2024-03-17T23:55:44.571 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:44.567+0000 7f9a209ac640 1 -- 172.21.15.204:0/4117887679 shutdown_connections 2024-03-17T23:55:44.571 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:44.567+0000 7f9a209ac640 1 --2- 172.21.15.204:0/4117887679 >> v2:172.21.15.196:3300/0 conn(0x7f9a1c0c72b0 0x7f9a1c0c76f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:55:44.571 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:44.567+0000 7f9a209ac640 1 --2- 172.21.15.204:0/4117887679 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9a1c0b1e10 0x7f9a1c15bca0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:55:44.571 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:44.567+0000 7f9a209ac640 1 -- 172.21.15.204:0/4117887679 >> 172.21.15.204:0/4117887679 conn(0x7f9a1c06f670 msgr2=0x7f9a1c06fa80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-17T23:55:44.571 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:44.567+0000 7f9a209ac640 1 -- 172.21.15.204:0/4117887679 shutdown_connections 2024-03-17T23:55:44.571 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:44.567+0000 7f9a209ac640 1 -- 172.21.15.204:0/4117887679 wait complete. 2024-03-17T23:55:44.574 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:44.567+0000 7f9a209ac640 1 Processor -- start 2024-03-17T23:55:44.574 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:44.567+0000 7f9a209ac640 1 -- start start 2024-03-17T23:55:44.574 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:44.567+0000 7f9a209ac640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9a1c067310 0x7f9a1c1ee100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:55:44.574 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:44.567+0000 7f9a209ac640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9a1c0b1e10 0x7f9a1c0c4a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:55:44.574 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:44.567+0000 7f9a209ac640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9a1c0c72b0 0x7f9a1c1508e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:55:44.574 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:44.567+0000 7f9a209ac640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f9a1c072850 con 0x7f9a1c0b1e10 2024-03-17T23:55:44.574 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:44.567+0000 7f9a209ac640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f9a1c072570 con 0x7f9a1c067310 2024-03-17T23:55:44.574 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:44.567+0000 7f9a209ac640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f9a1c072b30 con 0x7f9a1c0c72b0 2024-03-17T23:55:44.574 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:44.567+0000 7f9a1a59c640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9a1c067310 0x7f9a1c1ee100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:55:44.575 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:44.567+0000 7f9a1ad9d640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9a1c0c72b0 0x7f9a1c1508e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:55:44.575 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:44.567+0000 7f9a1a59c640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9a1c067310 0x7f9a1c1ee100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3300/0 says I am v2:172.21.15.204:54808/0 (socket says 172.21.15.204:54808) 2024-03-17T23:55:44.575 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:44.567+0000 7f9a1a59c640 1 -- 172.21.15.204:0/2548926938 learned_addr learned my addr 172.21.15.204:0/2548926938 (peer_addr_for_me v2:172.21.15.204:0/0) 2024-03-17T23:55:44.575 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:44.567+0000 7f9a19d9b640 1 --2- 172.21.15.204:0/2548926938 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9a1c0b1e10 0x7f9a1c0c4a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:55:44.575 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:44.567+0000 7f9a1ad9d640 1 -- 172.21.15.204:0/2548926938 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9a1c067310 msgr2=0x7f9a1c1ee100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:55:44.575 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:44.567+0000 7f9a1ad9d640 1 --2- 172.21.15.204:0/2548926938 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9a1c067310 0x7f9a1c1ee100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:55:44.575 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:44.567+0000 7f9a1ad9d640 1 -- 172.21.15.204:0/2548926938 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9a1c0b1e10 msgr2=0x7f9a1c0c4a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:55:44.575 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:44.567+0000 7f9a1ad9d640 1 --2- 172.21.15.204:0/2548926938 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9a1c0b1e10 0x7f9a1c0c4a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:55:44.575 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:44.567+0000 7f9a1ad9d640 1 -- 172.21.15.204:0/2548926938 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a1c15bde0 con 0x7f9a1c0c72b0 2024-03-17T23:55:44.575 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:44.567+0000 7f9a1a59c640 1 --2- 172.21.15.204:0/2548926938 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9a1c067310 0x7f9a1c1ee100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-17T23:55:44.575 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:44.567+0000 7f9a19d9b640 1 --2- 172.21.15.204:0/2548926938 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9a1c0b1e10 0x7f9a1c0c4a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-17T23:55:44.575 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:44.567+0000 7f9a1ad9d640 1 --2- 172.21.15.204:0/2548926938 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9a1c0c72b0 0x7f9a1c1508e0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f9a14007cf0 tx=0x7f9a1400e4b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:55:44.575 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:44.567+0000 7f9a0affd640 1 -- 172.21.15.204:0/2548926938 <== mon.2 v2:172.21.15.204:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a1400edd0 con 0x7f9a1c0c72b0 2024-03-17T23:55:44.576 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:44.567+0000 7f9a0affd640 1 -- 172.21.15.204:0/2548926938 <== mon.2 v2:172.21.15.204:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a140039a0 con 0x7f9a1c0c72b0 2024-03-17T23:55:44.576 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:44.567+0000 7f9a209ac640 1 -- 172.21.15.204:0/2548926938 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9a1c1f1930 con 0x7f9a1c0c72b0 2024-03-17T23:55:44.576 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:44.567+0000 7f9a0affd640 1 -- 172.21.15.204:0/2548926938 <== mon.2 v2:172.21.15.204:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a14003d90 con 0x7f9a1c0c72b0 2024-03-17T23:55:44.576 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:44.567+0000 7f9a209ac640 1 -- 172.21.15.204:0/2548926938 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a1c1e1250 con 0x7f9a1c0c72b0 2024-03-17T23:55:44.576 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:44.567+0000 7f9a0affd640 1 -- 172.21.15.204:0/2548926938 <== mon.2 v2:172.21.15.204:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f9a1401b020 con 0x7f9a1c0c72b0 2024-03-17T23:55:44.576 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:44.567+0000 7f9a0affd640 1 -- 172.21.15.204:0/2548926938 <== mon.2 v2:172.21.15.204:3301/0 5 ==== osd_map(3..3 src has 1..3) ==== 840+0+0 (secure 0 0 0) 0x7f9a14014a90 con 0x7f9a1c0c72b0 2024-03-17T23:55:44.576 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:44.567+0000 7f9a209ac640 1 -- 172.21.15.204:0/2548926938 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9a1c0689a0 con 0x7f9a1c0c72b0 2024-03-17T23:55:44.576 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:44.571+0000 7f9a0affd640 1 -- 172.21.15.204:0/2548926938 <== mon.2 v2:172.21.15.204:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f9a14014ce0 con 0x7f9a1c0c72b0 2024-03-17T23:55:44.587 INFO:tasks.ceph.mgr.y.smithi196.stderr:2024-03-17T23:55:44.585+0000 7f2273686180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-03-17T23:55:44.643 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:44.639+0000 7f9a209ac640 1 -- 172.21.15.204:0/2548926938 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_command({"prefix": "osd new", "uuid": "d8d6a0b0-450b-4ab5-b143-d4f36286e81e", "id": 1} v 0) -- 0x7f9a1c0cabb0 con 0x7f9a1c0c72b0 2024-03-17T23:55:44.651 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:44.647+0000 7f9a0affd640 1 -- 172.21.15.204:0/2548926938 <== mon.2 v2:172.21.15.204:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "d8d6a0b0-450b-4ab5-b143-d4f36286e81e", "id": 1}]=0 v4) ==== 112+0+2 (secure 0 0 0) 0x7f9a14014420 con 0x7f9a1c0c72b0 2024-03-17T23:55:44.651 INFO:teuthology.orchestra.run.smithi204.stdout:1 2024-03-17T23:55:44.653 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:44.647+0000 7f9a209ac640 1 -- 172.21.15.204:0/2548926938 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9a1c0c72b0 msgr2=0x7f9a1c1508e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:55:44.653 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:44.647+0000 7f9a209ac640 1 --2- 172.21.15.204:0/2548926938 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9a1c0c72b0 0x7f9a1c1508e0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f9a14007cf0 tx=0x7f9a1400e4b0 comp rx=0 tx=0).stop 2024-03-17T23:55:44.653 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:44.647+0000 7f9a209ac640 1 -- 172.21.15.204:0/2548926938 shutdown_connections 2024-03-17T23:55:44.653 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:44.647+0000 7f9a209ac640 1 --2- 172.21.15.204:0/2548926938 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9a1c0c72b0 0x7f9a1c1508e0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:55:44.653 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:44.647+0000 7f9a209ac640 1 --2- 172.21.15.204:0/2548926938 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9a1c0b1e10 0x7f9a1c0c4a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:55:44.653 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:44.647+0000 7f9a209ac640 1 --2- 172.21.15.204:0/2548926938 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9a1c067310 0x7f9a1c1ee100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:55:44.653 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:44.647+0000 7f9a209ac640 1 -- 172.21.15.204:0/2548926938 >> 172.21.15.204:0/2548926938 conn(0x7f9a1c06f670 msgr2=0x7f9a1c0c3f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-17T23:55:44.653 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:44.647+0000 7f9a209ac640 1 -- 172.21.15.204:0/2548926938 shutdown_connections 2024-03-17T23:55:44.653 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:44.647+0000 7f9a209ac640 1 -- 172.21.15.204:0/2548926938 wait complete. 2024-03-17T23:55:44.668 DEBUG:teuthology.orchestra.run.smithi204:> sudo ceph --cluster ceph osd new d732ba94-1db0-41ed-930a-5abb6188980a 2 2024-03-17T23:55:44.781 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:44.775+0000 7f63c1910640 1 Processor -- start 2024-03-17T23:55:44.781 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:44.775+0000 7f63c1910640 1 -- start start 2024-03-17T23:55:44.782 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:44.775+0000 7f63c1910640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f63bc06fe90 0x7f63bc0702c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:55:44.783 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:44.775+0000 7f63c1910640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f63bc0c87a0 0x7f63bc0c8be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:55:44.783 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:44.775+0000 7f63c1910640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f63bc06c540 con 0x7f63bc157510 2024-03-17T23:55:44.783 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:44.775+0000 7f63c1910640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7f63bc0c9120 con 0x7f63bc06fe90 2024-03-17T23:55:44.783 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:44.775+0000 7f63c1910640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 -- 0x7f63bc06c820 con 0x7f63bc0c87a0 2024-03-17T23:55:44.783 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:44.779+0000 7f63bb7fe640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f63bc0c87a0 0x7f63bc0c8be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:55:44.783 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:44.779+0000 7f63bb7fe640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f63bc0c87a0 0x7f63bc0c8be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3300/0 says I am v2:172.21.15.204:54812/0 (socket says 172.21.15.204:54812) 2024-03-17T23:55:44.783 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:44.779+0000 7f63bb7fe640 1 -- 172.21.15.204:0/447156927 learned_addr learned my addr 172.21.15.204:0/447156927 (peer_addr_for_me v2:172.21.15.204:0/0) 2024-03-17T23:55:44.783 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:44.779+0000 7f63b3fff640 1 --2- 172.21.15.204:0/447156927 >> v2:172.21.15.196:3300/0 conn(0x7f63bc06fe90 0x7f63bc0702c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:55:44.783 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:44.779+0000 7f63bb7fe640 1 -- 172.21.15.204:0/447156927 >> v2:172.21.15.196:3300/0 conn(0x7f63bc06fe90 msgr2=0x7f63bc0702c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-17T23:55:44.783 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:44.779+0000 7f63bb7fe640 1 --2- 172.21.15.204:0/447156927 >> v2:172.21.15.196:3300/0 conn(0x7f63bc06fe90 0x7f63bc0702c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:55:44.783 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:44.779+0000 7f63bb7fe640 1 -- 172.21.15.204:0/447156927 >> v1:172.21.15.196:6789/0 conn(0x7f63bc157510 legacy=0x7f63bc15a880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:55:44.783 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:44.779+0000 7f63bb7fe640 1 -- 172.21.15.204:0/447156927 --> v2:172.21.15.204:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63bc06cb00 con 0x7f63bc0c87a0 2024-03-17T23:55:44.785 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:44.779+0000 7f63bb7fe640 1 --2- 172.21.15.204:0/447156927 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f63bc0c87a0 0x7f63bc0c8be0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f63bc0cb1f0 tx=0x7f63b401c9f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d1dc31a85712fbf6 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:55:44.785 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:44.779+0000 7f63ba7fc640 1 -- 172.21.15.204:0/447156927 <== mon.1 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63b40a57d0 con 0x7f63bc0c87a0 2024-03-17T23:55:44.785 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:44.779+0000 7f63ba7fc640 1 -- 172.21.15.204:0/447156927 <== mon.1 v2:172.21.15.204:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f63b40a5970 con 0x7f63bc0c87a0 2024-03-17T23:55:44.785 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:44.779+0000 7f63ba7fc640 1 -- 172.21.15.204:0/447156927 <== mon.1 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63b40a5d40 con 0x7f63bc0c87a0 2024-03-17T23:55:44.786 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:44.779+0000 7f63c1910640 1 -- 172.21.15.204:0/447156927 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f63bc0c87a0 msgr2=0x7f63bc0c8be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:55:44.786 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:44.779+0000 7f63c1910640 1 --2- 172.21.15.204:0/447156927 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f63bc0c87a0 0x7f63bc0c8be0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f63bc0cb1f0 tx=0x7f63b401c9f0 comp rx=0 tx=0).stop 2024-03-17T23:55:44.786 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:44.779+0000 7f63c1910640 1 -- 172.21.15.204:0/447156927 shutdown_connections 2024-03-17T23:55:44.786 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:44.779+0000 7f63c1910640 1 --2- 172.21.15.204:0/447156927 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f63bc0c87a0 0x7f63bc0c8be0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:55:44.786 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:44.779+0000 7f63c1910640 1 --2- 172.21.15.204:0/447156927 >> v2:172.21.15.196:3300/0 conn(0x7f63bc06fe90 0x7f63bc0702c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:55:44.786 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:44.779+0000 7f63c1910640 1 -- 172.21.15.204:0/447156927 >> 172.21.15.204:0/447156927 conn(0x7f63bc06b2b0 msgr2=0x7f63bc06b6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-17T23:55:44.787 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:44.779+0000 7f63c1910640 1 -- 172.21.15.204:0/447156927 shutdown_connections 2024-03-17T23:55:44.787 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:44.779+0000 7f63c1910640 1 -- 172.21.15.204:0/447156927 wait complete. 2024-03-17T23:55:44.789 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:44.783+0000 7f63c1910640 1 Processor -- start 2024-03-17T23:55:44.789 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:44.783+0000 7f63c1910640 1 -- start start 2024-03-17T23:55:44.789 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:44.783+0000 7f63c1910640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f63bc06fe90 0x7f63bc1f6500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:55:44.789 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:44.783+0000 7f63c1910640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f63bc0c87a0 0x7f63bc0c7370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:55:44.789 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:44.783+0000 7f63c1910640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f63bc157510 0x7f63bc1ebdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:55:44.790 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:44.783+0000 7f63c1910640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f63bc1578f0 con 0x7f63bc0c87a0 2024-03-17T23:55:44.790 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:44.783+0000 7f63c1910640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f63bc06cde0 con 0x7f63bc157510 2024-03-17T23:55:44.790 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:44.783+0000 7f63c1910640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f63bc0c98f0 con 0x7f63bc06fe90 2024-03-17T23:55:44.790 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:44.783+0000 7f63bb7fe640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f63bc157510 0x7f63bc1ebdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:55:44.790 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:44.783+0000 7f63baffd640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f63bc06fe90 0x7f63bc1f6500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:55:44.790 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:44.783+0000 7f63baffd640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f63bc06fe90 0x7f63bc1f6500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3301/0 says I am v2:172.21.15.204:39862/0 (socket says 172.21.15.204:39862) 2024-03-17T23:55:44.790 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:44.783+0000 7f63baffd640 1 -- 172.21.15.204:0/256730261 learned_addr learned my addr 172.21.15.204:0/256730261 (peer_addr_for_me v2:172.21.15.204:0/0) 2024-03-17T23:55:44.790 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:44.783+0000 7f63b3fff640 1 --2- 172.21.15.204:0/256730261 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f63bc0c87a0 0x7f63bc0c7370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:55:44.790 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:44.783+0000 7f63baffd640 1 -- 172.21.15.204:0/256730261 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f63bc157510 msgr2=0x7f63bc1ebdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:55:44.791 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:44.783+0000 7f63baffd640 1 --2- 172.21.15.204:0/256730261 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f63bc157510 0x7f63bc1ebdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:55:44.791 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:44.783+0000 7f63baffd640 1 -- 172.21.15.204:0/256730261 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f63bc0c87a0 msgr2=0x7f63bc0c7370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:55:44.791 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:44.783+0000 7f63baffd640 1 --2- 172.21.15.204:0/256730261 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f63bc0c87a0 0x7f63bc0c7370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:55:44.791 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:44.783+0000 7f63baffd640 1 -- 172.21.15.204:0/256730261 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63bc0b2290 con 0x7f63bc06fe90 2024-03-17T23:55:44.791 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:44.783+0000 7f63b3fff640 1 --2- 172.21.15.204:0/256730261 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f63bc0c87a0 0x7f63bc0c7370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-17T23:55:44.791 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:44.783+0000 7f63bb7fe640 1 --2- 172.21.15.204:0/256730261 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f63bc157510 0x7f63bc1ebdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-17T23:55:44.791 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:44.783+0000 7f63baffd640 1 --2- 172.21.15.204:0/256730261 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f63bc06fe90 0x7f63bc1f6500 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f63ac00c3a0 tx=0x7f63ac00c860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:55:44.791 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:44.783+0000 7f63b8ff9640 1 -- 172.21.15.204:0/256730261 <== mon.2 v2:172.21.15.204:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63ac0052d0 con 0x7f63bc06fe90 2024-03-17T23:55:44.791 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:44.783+0000 7f63b8ff9640 1 -- 172.21.15.204:0/256730261 <== mon.2 v2:172.21.15.204:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f63ac005470 con 0x7f63bc06fe90 2024-03-17T23:55:44.791 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:44.783+0000 7f63c1910640 1 -- 172.21.15.204:0/256730261 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f63bc1f6a40 con 0x7f63bc06fe90 2024-03-17T23:55:44.791 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:44.783+0000 7f63b8ff9640 1 -- 172.21.15.204:0/256730261 <== mon.2 v2:172.21.15.204:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63ac007260 con 0x7f63bc06fe90 2024-03-17T23:55:44.791 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:44.783+0000 7f63c1910640 1 -- 172.21.15.204:0/256730261 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f63bc0b2500 con 0x7f63bc06fe90 2024-03-17T23:55:44.792 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:44.783+0000 7f63b8ff9640 1 -- 172.21.15.204:0/256730261 <== mon.2 v2:172.21.15.204:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f63ac007400 con 0x7f63bc06fe90 2024-03-17T23:55:44.792 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:44.783+0000 7f63b8ff9640 1 -- 172.21.15.204:0/256730261 <== mon.2 v2:172.21.15.204:3301/0 5 ==== osd_map(4..4 src has 1..4) ==== 955+0+0 (secure 0 0 0) 0x7f63ac003de0 con 0x7f63bc06fe90 2024-03-17T23:55:44.792 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:44.783+0000 7f63c1910640 1 -- 172.21.15.204:0/256730261 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f63bc0689a0 con 0x7f63bc06fe90 2024-03-17T23:55:44.792 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:44.787+0000 7f63b8ff9640 1 -- 172.21.15.204:0/256730261 <== mon.2 v2:172.21.15.204:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f63bc1f6a40 con 0x7f63bc06fe90 2024-03-17T23:55:44.859 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:44.855+0000 7f63c1910640 1 -- 172.21.15.204:0/256730261 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_command({"prefix": "osd new", "uuid": "d732ba94-1db0-41ed-930a-5abb6188980a", "id": 2} v 0) -- 0x7f63bc0cb950 con 0x7f63bc06fe90 2024-03-17T23:55:44.867 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:44.863+0000 7f63b8ff9640 1 -- 172.21.15.204:0/256730261 <== mon.2 v2:172.21.15.204:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "d732ba94-1db0-41ed-930a-5abb6188980a", "id": 2}]=0 v5) ==== 112+0+2 (secure 0 0 0) 0x7f63ac0039c0 con 0x7f63bc06fe90 2024-03-17T23:55:44.867 INFO:teuthology.orchestra.run.smithi204.stdout:2 2024-03-17T23:55:44.868 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:44.863+0000 7f63c1910640 1 -- 172.21.15.204:0/256730261 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f63bc06fe90 msgr2=0x7f63bc1f6500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:55:44.868 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:44.863+0000 7f63c1910640 1 --2- 172.21.15.204:0/256730261 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f63bc06fe90 0x7f63bc1f6500 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f63ac00c3a0 tx=0x7f63ac00c860 comp rx=0 tx=0).stop 2024-03-17T23:55:44.868 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:44.863+0000 7f63c1910640 1 -- 172.21.15.204:0/256730261 shutdown_connections 2024-03-17T23:55:44.869 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:44.863+0000 7f63c1910640 1 --2- 172.21.15.204:0/256730261 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f63bc157510 0x7f63bc1ebdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:55:44.869 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:44.863+0000 7f63c1910640 1 --2- 172.21.15.204:0/256730261 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f63bc0c87a0 0x7f63bc0c7370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:55:44.869 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:44.863+0000 7f63c1910640 1 --2- 172.21.15.204:0/256730261 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f63bc06fe90 0x7f63bc1f6500 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:55:44.869 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:44.863+0000 7f63c1910640 1 -- 172.21.15.204:0/256730261 >> 172.21.15.204:0/256730261 conn(0x7f63bc06b2b0 msgr2=0x7f63bc0c9c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-17T23:55:44.869 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:44.863+0000 7f63c1910640 1 -- 172.21.15.204:0/256730261 shutdown_connections 2024-03-17T23:55:44.869 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:44.863+0000 7f63c1910640 1 -- 172.21.15.204:0/256730261 wait complete. 2024-03-17T23:55:44.880 INFO:tasks.ceph.mgr.x.smithi204.stderr:2024-03-17T23:55:44.875+0000 7f85f3708180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-03-17T23:55:44.884 DEBUG:teuthology.orchestra.run.smithi204:> sudo ceph --cluster ceph osd new b79cab98-a49f-4544-b6b0-546dcfbd47a1 3 2024-03-17T23:55:44.937 INFO:tasks.ceph.mgr.x.smithi204.stderr:2024-03-17T23:55:44.931+0000 7f85f3708180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-03-17T23:55:44.994 INFO:tasks.ceph.mgr.x.smithi204.stderr:2024-03-17T23:55:44.987+0000 7f85f3708180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-03-17T23:55:45.001 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:44.995+0000 7f1c7fd48640 1 Processor -- start 2024-03-17T23:55:45.001 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:44.995+0000 7f1c7fd48640 1 -- start start 2024-03-17T23:55:45.002 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:44.995+0000 7f1c7fd48640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f1c780c4730 0x7f1c7806fde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:55:45.003 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:44.995+0000 7f1c7fd48640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1c780c82e0 con 0x7f1c78152000 2024-03-17T23:55:45.003 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:44.995+0000 7f1c7fd48640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1c780c85c0 con 0x7f1c780ca1d0 2024-03-17T23:55:45.003 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:44.995+0000 7f1c7fd48640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 -- 0x7f1c78070420 con 0x7f1c780c4730 2024-03-17T23:55:45.003 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:44.995+0000 7f1c7d2e3640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f1c780c4730 0x7f1c7806fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:55:45.003 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:44.995+0000 7f1c7e2e5640 1 --1- >> v1:172.21.15.204:6789/0 conn(0x7f1c780ca1d0 0x7f1c780cd6b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.204:6789/0 says I am v1:172.21.15.204:38782/0 (socket says 172.21.15.204:38782) 2024-03-17T23:55:45.003 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:44.995+0000 7f1c7e2e5640 1 -- 172.21.15.204:0/1058752499 learned_addr learned my addr 172.21.15.204:0/1058752499 (peer_addr_for_me v1:172.21.15.204:0/0) 2024-03-17T23:55:45.003 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:44.999+0000 7f1c7d2e3640 1 -- 172.21.15.204:0/1058752499 >> v1:172.21.15.204:6789/0 conn(0x7f1c780ca1d0 legacy=0x7f1c780cd6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:55:45.003 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:44.999+0000 7f1c7d2e3640 1 -- 172.21.15.204:0/1058752499 >> v1:172.21.15.196:6789/0 conn(0x7f1c78152000 legacy=0x7f1c7815ba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:55:45.003 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:44.999+0000 7f1c7d2e3640 1 -- 172.21.15.204:0/1058752499 --> v2:172.21.15.204:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c780c88a0 con 0x7f1c780c4730 2024-03-17T23:55:45.005 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:44.999+0000 7f1c7d2e3640 1 --2- 172.21.15.204:0/1058752499 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1c780c4730 0x7f1c7806fde0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f1c6c0097c0 tx=0x7f1c6c01ec90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1c56a6ea08765c5c server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:55:45.005 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:44.999+0000 7f1c7cae2640 1 -- 172.21.15.204:0/1058752499 <== mon.1 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c6c0b5070 con 0x7f1c780c4730 2024-03-17T23:55:45.005 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:44.999+0000 7f1c7cae2640 1 -- 172.21.15.204:0/1058752499 <== mon.1 v2:172.21.15.204:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c6c0a8990 con 0x7f1c780c4730 2024-03-17T23:55:45.005 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:44.999+0000 7f1c7cae2640 1 -- 172.21.15.204:0/1058752499 <== mon.1 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c6c0a8d60 con 0x7f1c780c4730 2024-03-17T23:55:45.006 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:44.999+0000 7f1c7fd48640 1 -- 172.21.15.204:0/1058752499 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1c780c4730 msgr2=0x7f1c7806fde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:55:45.006 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:44.999+0000 7f1c7fd48640 1 --2- 172.21.15.204:0/1058752499 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1c780c4730 0x7f1c7806fde0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f1c6c0097c0 tx=0x7f1c6c01ec90 comp rx=0 tx=0).stop 2024-03-17T23:55:45.006 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.003+0000 7f1c7fd48640 1 -- 172.21.15.204:0/1058752499 shutdown_connections 2024-03-17T23:55:45.006 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.003+0000 7f1c7fd48640 1 --2- 172.21.15.204:0/1058752499 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1c780c4730 0x7f1c7806fde0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:55:45.006 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.003+0000 7f1c7fd48640 1 -- 172.21.15.204:0/1058752499 >> 172.21.15.204:0/1058752499 conn(0x7f1c7806b2b0 msgr2=0x7f1c7806b6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-17T23:55:45.007 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.003+0000 7f1c7fd48640 1 -- 172.21.15.204:0/1058752499 shutdown_connections 2024-03-17T23:55:45.007 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.003+0000 7f1c7fd48640 1 -- 172.21.15.204:0/1058752499 wait complete. 2024-03-17T23:55:45.007 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.003+0000 7f1c7fd48640 1 Processor -- start 2024-03-17T23:55:45.007 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.003+0000 7f1c7fd48640 1 -- start start 2024-03-17T23:55:45.009 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.003+0000 7f1c7fd48640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1c780c4730 0x7f1c7806dd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:55:45.009 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.003+0000 7f1c7fd48640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1c780ca1d0 0x7f1c7815a790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:55:45.009 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.003+0000 7f1c7fd48640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1c78152000 0x7f1c78141500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:55:45.010 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.003+0000 7f1c7fd48640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f1c7815b560 con 0x7f1c78152000 2024-03-17T23:55:45.010 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.003+0000 7f1c7fd48640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f1c78070790 con 0x7f1c780ca1d0 2024-03-17T23:55:45.010 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.003+0000 7f1c7fd48640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f1c780cddc0 con 0x7f1c780c4730 2024-03-17T23:55:45.010 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.003+0000 7f1c7d2e3640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1c780ca1d0 0x7f1c7815a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:55:45.010 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.003+0000 7f1c7dae4640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1c780c4730 0x7f1c7806dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:55:45.010 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.003+0000 7f1c7d2e3640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1c780ca1d0 0x7f1c7815a790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3300/0 says I am v2:172.21.15.204:54846/0 (socket says 172.21.15.204:54846) 2024-03-17T23:55:45.010 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.003+0000 7f1c7d2e3640 1 -- 172.21.15.204:0/807639126 learned_addr learned my addr 172.21.15.204:0/807639126 (peer_addr_for_me v2:172.21.15.204:0/0) 2024-03-17T23:55:45.010 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.003+0000 7f1c7e2e5640 1 --2- 172.21.15.204:0/807639126 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1c78152000 0x7f1c78141500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:55:45.010 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.003+0000 7f1c7dae4640 1 -- 172.21.15.204:0/807639126 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1c780ca1d0 msgr2=0x7f1c7815a790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:55:45.010 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.003+0000 7f1c7dae4640 1 --2- 172.21.15.204:0/807639126 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1c780ca1d0 0x7f1c7815a790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:55:45.010 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.003+0000 7f1c7dae4640 1 -- 172.21.15.204:0/807639126 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1c78152000 msgr2=0x7f1c78141500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:55:45.011 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.003+0000 7f1c7dae4640 1 --2- 172.21.15.204:0/807639126 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1c78152000 0x7f1c78141500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:55:45.011 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.003+0000 7f1c7dae4640 1 -- 172.21.15.204:0/807639126 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c78150800 con 0x7f1c780c4730 2024-03-17T23:55:45.011 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.003+0000 7f1c7e2e5640 1 --2- 172.21.15.204:0/807639126 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1c78152000 0x7f1c78141500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-17T23:55:45.011 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.003+0000 7f1c7d2e3640 1 --2- 172.21.15.204:0/807639126 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1c780ca1d0 0x7f1c7815a790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-17T23:55:45.011 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.003+0000 7f1c7dae4640 1 --2- 172.21.15.204:0/807639126 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1c780c4730 0x7f1c7806dd70 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f1c7000c680 tx=0x7f1c7000cb40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:55:45.011 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.003+0000 7f1c6a7fc640 1 -- 172.21.15.204:0/807639126 <== mon.2 v2:172.21.15.204:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c70003b80 con 0x7f1c780c4730 2024-03-17T23:55:45.011 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.003+0000 7f1c6a7fc640 1 -- 172.21.15.204:0/807639126 <== mon.2 v2:172.21.15.204:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c70003d20 con 0x7f1c780c4730 2024-03-17T23:55:45.011 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.003+0000 7f1c6a7fc640 1 -- 172.21.15.204:0/807639126 <== mon.2 v2:172.21.15.204:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c70005310 con 0x7f1c780c4730 2024-03-17T23:55:45.011 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.003+0000 7f1c7fd48640 1 -- 172.21.15.204:0/807639126 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1c78150ae0 con 0x7f1c780c4730 2024-03-17T23:55:45.011 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.003+0000 7f1c7fd48640 1 -- 172.21.15.204:0/807639126 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f1c7815a270 con 0x7f1c780c4730 2024-03-17T23:55:45.012 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.003+0000 7f1c7fd48640 1 -- 172.21.15.204:0/807639126 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1c780689a0 con 0x7f1c780c4730 2024-03-17T23:55:45.012 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.003+0000 7f1c6a7fc640 1 -- 172.21.15.204:0/807639126 <== mon.2 v2:172.21.15.204:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f1c700054b0 con 0x7f1c780c4730 2024-03-17T23:55:45.012 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.003+0000 7f1c6a7fc640 1 -- 172.21.15.204:0/807639126 <== mon.2 v2:172.21.15.204:3301/0 5 ==== osd_map(5..5 src has 1..5) ==== 1070+0+0 (secure 0 0 0) 0x7f1c700129a0 con 0x7f1c780c4730 2024-03-17T23:55:45.012 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.007+0000 7f1c6a7fc640 1 -- 172.21.15.204:0/807639126 <== mon.2 v2:172.21.15.204:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f1c700057a0 con 0x7f1c780c4730 2024-03-17T23:55:45.071 INFO:tasks.ceph.mgr.x.smithi204.stderr:2024-03-17T23:55:45.067+0000 7f85f3708180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-03-17T23:55:45.080 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.075+0000 7f1c7fd48640 1 -- 172.21.15.204:0/807639126 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_command({"prefix": "osd new", "uuid": "b79cab98-a49f-4544-b6b0-546dcfbd47a1", "id": 3} v 0) -- 0x7f1c78151000 con 0x7f1c780c4730 2024-03-17T23:55:45.086 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.083+0000 7f1c6a7fc640 1 -- 172.21.15.204:0/807639126 <== mon.2 v2:172.21.15.204:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "b79cab98-a49f-4544-b6b0-546dcfbd47a1", "id": 3}]=0 v6) ==== 112+0+2 (secure 0 0 0) 0x7f1c70012cd0 con 0x7f1c780c4730 2024-03-17T23:55:45.087 INFO:teuthology.orchestra.run.smithi204.stdout:3 2024-03-17T23:55:45.088 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.083+0000 7f1c7fd48640 1 -- 172.21.15.204:0/807639126 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1c780c4730 msgr2=0x7f1c7806dd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:55:45.088 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.083+0000 7f1c7fd48640 1 --2- 172.21.15.204:0/807639126 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1c780c4730 0x7f1c7806dd70 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f1c7000c680 tx=0x7f1c7000cb40 comp rx=0 tx=0).stop 2024-03-17T23:55:45.088 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.083+0000 7f1c7fd48640 1 -- 172.21.15.204:0/807639126 shutdown_connections 2024-03-17T23:55:45.088 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.083+0000 7f1c7fd48640 1 --2- 172.21.15.204:0/807639126 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1c78152000 0x7f1c78141500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:55:45.088 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.083+0000 7f1c7fd48640 1 --2- 172.21.15.204:0/807639126 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1c780ca1d0 0x7f1c7815a790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:55:45.089 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.083+0000 7f1c7fd48640 1 --2- 172.21.15.204:0/807639126 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1c780c4730 0x7f1c7806dd70 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:55:45.089 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.083+0000 7f1c7fd48640 1 -- 172.21.15.204:0/807639126 >> 172.21.15.204:0/807639126 conn(0x7f1c7806b2b0 msgr2=0x7f1c7806b690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-17T23:55:45.089 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.083+0000 7f1c7fd48640 1 -- 172.21.15.204:0/807639126 shutdown_connections 2024-03-17T23:55:45.089 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.083+0000 7f1c7fd48640 1 -- 172.21.15.204:0/807639126 wait complete. 2024-03-17T23:55:45.103 DEBUG:teuthology.orchestra.run.smithi204:> sudo ceph --cluster ceph osd new d5892856-6eb4-4188-beb0-368f64169af1 4 2024-03-17T23:55:45.127 INFO:tasks.ceph.mgr.x.smithi204.stderr:2024-03-17T23:55:45.123+0000 7f85f3708180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-03-17T23:55:45.141 INFO:tasks.ceph.mgr.y.smithi196.stderr:2024-03-17T23:55:45.141+0000 7f2273686180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-03-17T23:55:45.194 INFO:tasks.ceph.mgr.y.smithi196.stderr:2024-03-17T23:55:45.193+0000 7f2273686180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-03-17T23:55:45.206 INFO:tasks.ceph.mgr.x.smithi204.stderr:2024-03-17T23:55:45.203+0000 7f85f3708180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-03-17T23:55:45.221 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.215+0000 7fa23fdbf640 1 Processor -- start 2024-03-17T23:55:45.221 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.215+0000 7fa23fdbf640 1 -- start start 2024-03-17T23:55:45.222 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.215+0000 7fa23fdbf640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fa238150f60 0x7fa23806bb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:55:45.222 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.215+0000 7fa23fdbf640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa2380c2910 0x7fa2381615f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:55:45.222 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.215+0000 7fa23fdbf640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa23806c500 con 0x7fa23806c090 2024-03-17T23:55:45.222 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.215+0000 7fa23fdbf640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 -- 0x7fa238072400 con 0x7fa238150f60 2024-03-17T23:55:45.222 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.215+0000 7fa23fdbf640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7fa238157b30 con 0x7fa2380c2910 2024-03-17T23:55:45.222 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.215+0000 7fa23db5b640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fa238150f60 0x7fa23806bb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:55:45.223 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.215+0000 7fa23e35c640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa2380c2910 0x7fa2381615f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:55:45.223 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.215+0000 7fa23db5b640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fa238150f60 0x7fa23806bb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3300/0 says I am v2:172.21.15.204:54850/0 (socket says 172.21.15.204:54850) 2024-03-17T23:55:45.223 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.215+0000 7fa23db5b640 1 -- 172.21.15.204:0/4059958380 learned_addr learned my addr 172.21.15.204:0/4059958380 (peer_addr_for_me v2:172.21.15.204:0/0) 2024-03-17T23:55:45.223 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.219+0000 7fa23db5b640 1 -- 172.21.15.204:0/4059958380 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa2380c2910 msgr2=0x7fa2381615f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-17T23:55:45.223 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.219+0000 7fa23db5b640 1 --2- 172.21.15.204:0/4059958380 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa2380c2910 0x7fa2381615f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:55:45.223 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.219+0000 7fa23db5b640 1 -- 172.21.15.204:0/4059958380 >> v1:172.21.15.204:6789/0 conn(0x7fa23806c090 legacy=0x7fa2380c2200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:55:45.223 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.219+0000 7fa23db5b640 1 -- 172.21.15.204:0/4059958380 --> v2:172.21.15.204:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa238071e40 con 0x7fa238150f60 2024-03-17T23:55:45.223 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.219+0000 7fa23e35c640 1 --2- 172.21.15.204:0/4059958380 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa2380c2910 0x7fa2381615f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-17T23:55:45.224 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.219+0000 7fa23db5b640 1 --2- 172.21.15.204:0/4059958380 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa238150f60 0x7fa23806bb50 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fa230009e50 tx=0x7fa23001f230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1e6b006c0c2605b8 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:55:45.224 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.219+0000 7fa23cb59640 1 -- 172.21.15.204:0/4059958380 <== mon.1 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2300b4070 con 0x7fa238150f60 2024-03-17T23:55:45.224 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.219+0000 7fa23cb59640 1 -- 172.21.15.204:0/4059958380 <== mon.1 v2:172.21.15.204:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa2300af400 con 0x7fa238150f60 2024-03-17T23:55:45.225 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.219+0000 7fa23cb59640 1 -- 172.21.15.204:0/4059958380 <== mon.1 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2300af810 con 0x7fa238150f60 2024-03-17T23:55:45.225 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.219+0000 7fa23fdbf640 1 -- 172.21.15.204:0/4059958380 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa238150f60 msgr2=0x7fa23806bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:55:45.225 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.219+0000 7fa23fdbf640 1 --2- 172.21.15.204:0/4059958380 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa238150f60 0x7fa23806bb50 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fa230009e50 tx=0x7fa23001f230 comp rx=0 tx=0).stop 2024-03-17T23:55:45.225 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.219+0000 7fa23fdbf640 1 -- 172.21.15.204:0/4059958380 shutdown_connections 2024-03-17T23:55:45.226 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.219+0000 7fa23fdbf640 1 --2- 172.21.15.204:0/4059958380 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa2380c2910 0x7fa2381615f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:55:45.226 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.219+0000 7fa23fdbf640 1 --2- 172.21.15.204:0/4059958380 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa238150f60 0x7fa23806bb50 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:55:45.226 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.219+0000 7fa23fdbf640 1 -- 172.21.15.204:0/4059958380 >> 172.21.15.204:0/4059958380 conn(0x7fa2380c8b70 msgr2=0x7fa2380c8f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-17T23:55:45.226 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.219+0000 7fa23fdbf640 1 -- 172.21.15.204:0/4059958380 shutdown_connections 2024-03-17T23:55:45.226 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.219+0000 7fa23fdbf640 1 -- 172.21.15.204:0/4059958380 wait complete. 2024-03-17T23:55:45.226 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.223+0000 7fa23fdbf640 1 Processor -- start 2024-03-17T23:55:45.226 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.223+0000 7fa23fdbf640 1 -- start start 2024-03-17T23:55:45.228 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.223+0000 7fa23fdbf640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa23806c090 0x7fa2381df1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:55:45.228 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.223+0000 7fa23fdbf640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa2380c2910 0x7fa2380c3870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:55:45.228 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.223+0000 7fa23fdbf640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa238150f60 0x7fa2380c3db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:55:45.228 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.223+0000 7fa23fdbf640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fa23806b630 con 0x7fa238150f60 2024-03-17T23:55:45.228 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.223+0000 7fa23fdbf640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7fa23806b350 con 0x7fa2380c2910 2024-03-17T23:55:45.228 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.223+0000 7fa23fdbf640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7fa238151340 con 0x7fa23806c090 2024-03-17T23:55:45.229 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.223+0000 7fa23d35a640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa2380c2910 0x7fa2380c3870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:55:45.229 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.223+0000 7fa23db5b640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa23806c090 0x7fa2381df1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:55:45.229 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.223+0000 7fa23d35a640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa2380c2910 0x7fa2380c3870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3300/0 says I am v2:172.21.15.204:54866/0 (socket says 172.21.15.204:54866) 2024-03-17T23:55:45.229 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.223+0000 7fa23d35a640 1 -- 172.21.15.204:0/3428908923 learned_addr learned my addr 172.21.15.204:0/3428908923 (peer_addr_for_me v2:172.21.15.204:0/0) 2024-03-17T23:55:45.229 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.223+0000 7fa23e35c640 1 --2- 172.21.15.204:0/3428908923 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa238150f60 0x7fa2380c3db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:55:45.229 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.223+0000 7fa23db5b640 1 -- 172.21.15.204:0/3428908923 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa2380c2910 msgr2=0x7fa2380c3870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:55:45.229 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.223+0000 7fa23db5b640 1 --2- 172.21.15.204:0/3428908923 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa2380c2910 0x7fa2380c3870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:55:45.229 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.223+0000 7fa23db5b640 1 -- 172.21.15.204:0/3428908923 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa238150f60 msgr2=0x7fa2380c3db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:55:45.229 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.223+0000 7fa23db5b640 1 --2- 172.21.15.204:0/3428908923 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa238150f60 0x7fa2380c3db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:55:45.229 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.223+0000 7fa23db5b640 1 -- 172.21.15.204:0/3428908923 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2381f1a30 con 0x7fa23806c090 2024-03-17T23:55:45.229 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.223+0000 7fa23e35c640 1 --2- 172.21.15.204:0/3428908923 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa238150f60 0x7fa2380c3db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-17T23:55:45.229 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.223+0000 7fa23db5b640 1 --2- 172.21.15.204:0/3428908923 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa23806c090 0x7fa2381df1c0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fa2300ae000 tx=0x7fa23001bfd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:55:45.229 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.223+0000 7fa22e7fc640 1 -- 172.21.15.204:0/3428908923 <== mon.2 v2:172.21.15.204:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2300bf020 con 0x7fa23806c090 2024-03-17T23:55:45.229 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.223+0000 7fa22e7fc640 1 -- 172.21.15.204:0/3428908923 <== mon.2 v2:172.21.15.204:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa2300090d0 con 0x7fa23806c090 2024-03-17T23:55:45.229 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.223+0000 7fa22e7fc640 1 -- 172.21.15.204:0/3428908923 <== mon.2 v2:172.21.15.204:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2300b4040 con 0x7fa23806c090 2024-03-17T23:55:45.230 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.223+0000 7fa23fdbf640 1 -- 172.21.15.204:0/3428908923 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa2381f1d10 con 0x7fa23806c090 2024-03-17T23:55:45.230 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.223+0000 7fa23fdbf640 1 -- 172.21.15.204:0/3428908923 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fa238147df0 con 0x7fa23806c090 2024-03-17T23:55:45.230 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.223+0000 7fa22e7fc640 1 -- 172.21.15.204:0/3428908923 <== mon.2 v2:172.21.15.204:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fa2300c2070 con 0x7fa23806c090 2024-03-17T23:55:45.230 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.223+0000 7fa23fdbf640 1 -- 172.21.15.204:0/3428908923 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa2380689a0 con 0x7fa23806c090 2024-03-17T23:55:45.230 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.223+0000 7fa22e7fc640 1 -- 172.21.15.204:0/3428908923 <== mon.2 v2:172.21.15.204:3301/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7fa2300baca0 con 0x7fa23806c090 2024-03-17T23:55:45.231 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.227+0000 7fa22e7fc640 1 -- 172.21.15.204:0/3428908923 <== mon.2 v2:172.21.15.204:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7fa230018d90 con 0x7fa23806c090 2024-03-17T23:55:45.247 INFO:tasks.ceph.mgr.y.smithi196.stderr:2024-03-17T23:55:45.245+0000 7f2273686180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-03-17T23:55:45.262 INFO:tasks.ceph.mgr.x.smithi204.stderr:2024-03-17T23:55:45.259+0000 7f85f3708180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-03-17T23:55:45.300 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.295+0000 7fa23fdbf640 1 -- 172.21.15.204:0/3428908923 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_command({"prefix": "osd new", "uuid": "d5892856-6eb4-4188-beb0-368f64169af1", "id": 4} v 0) -- 0x7fa2380c0ec0 con 0x7fa23806c090 2024-03-17T23:55:45.307 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.303+0000 7fa22e7fc640 1 -- 172.21.15.204:0/3428908923 <== mon.2 v2:172.21.15.204:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "d5892856-6eb4-4188-beb0-368f64169af1", "id": 4}]=0 v7) ==== 112+0+2 (secure 0 0 0) 0x7fa230009a30 con 0x7fa23806c090 2024-03-17T23:55:45.307 INFO:teuthology.orchestra.run.smithi204.stdout:4 2024-03-17T23:55:45.309 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.303+0000 7fa23fdbf640 1 -- 172.21.15.204:0/3428908923 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa23806c090 msgr2=0x7fa2381df1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:55:45.309 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.303+0000 7fa23fdbf640 1 --2- 172.21.15.204:0/3428908923 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa23806c090 0x7fa2381df1c0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fa2300ae000 tx=0x7fa23001bfd0 comp rx=0 tx=0).stop 2024-03-17T23:55:45.309 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.303+0000 7fa23fdbf640 1 -- 172.21.15.204:0/3428908923 shutdown_connections 2024-03-17T23:55:45.309 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.303+0000 7fa23fdbf640 1 --2- 172.21.15.204:0/3428908923 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa238150f60 0x7fa2380c3db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:55:45.309 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.303+0000 7fa23fdbf640 1 --2- 172.21.15.204:0/3428908923 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa2380c2910 0x7fa2380c3870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:55:45.309 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.303+0000 7fa23fdbf640 1 --2- 172.21.15.204:0/3428908923 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa23806c090 0x7fa2381df1c0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:55:45.309 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.303+0000 7fa23fdbf640 1 -- 172.21.15.204:0/3428908923 >> 172.21.15.204:0/3428908923 conn(0x7fa2380c8b70 msgr2=0x7fa23814b280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-17T23:55:45.309 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.303+0000 7fa23fdbf640 1 -- 172.21.15.204:0/3428908923 shutdown_connections 2024-03-17T23:55:45.309 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.303+0000 7fa23fdbf640 1 -- 172.21.15.204:0/3428908923 wait complete. 2024-03-17T23:55:45.324 DEBUG:teuthology.orchestra.run.smithi204:> sudo ceph --cluster ceph osd new 89d6b48d-aa8a-4cb8-aa2e-e0aae04928b9 5 2024-03-17T23:55:45.324 INFO:tasks.ceph.mgr.y.smithi196.stderr:2024-03-17T23:55:45.325+0000 7f2273686180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-03-17T23:55:45.376 INFO:tasks.ceph.mgr.y.smithi196.stderr:2024-03-17T23:55:45.377+0000 7f2273686180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-03-17T23:55:45.417 INFO:tasks.ceph.mgr.x.smithi204.stderr:2024-03-17T23:55:45.411+0000 7f85f3708180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-03-17T23:55:45.454 INFO:tasks.ceph.mgr.y.smithi196.stderr:2024-03-17T23:55:45.453+0000 7f2273686180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-03-17T23:55:45.480 INFO:tasks.ceph.mgr.x.smithi204.stderr:2024-03-17T23:55:45.475+0000 7f85f3708180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-03-17T23:55:45.481 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.475+0000 7f8515689640 1 Processor -- start 2024-03-17T23:55:45.481 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.475+0000 7f8515689640 1 -- start start 2024-03-17T23:55:45.484 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.479+0000 7f8515689640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f85100735f0 0x7f85100c78f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:55:45.485 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.479+0000 7f8515689640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f85101577e0 con 0x7f85100c7f70 2024-03-17T23:55:45.485 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.479+0000 7f8515689640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8510157ac0 con 0x7f85101511a0 2024-03-17T23:55:45.485 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.479+0000 7f8515689640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7f85100c8970 con 0x7f85100735f0 2024-03-17T23:55:45.485 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.479+0000 7f850effd640 1 --1- >> v1:172.21.15.204:6789/0 conn(0x7f85101511a0 0x7f8510072450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.204:6789/0 says I am v1:172.21.15.204:38792/0 (socket says 172.21.15.204:38792) 2024-03-17T23:55:45.485 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.479+0000 7f850effd640 1 -- 172.21.15.204:0/1828006064 learned_addr learned my addr 172.21.15.204:0/1828006064 (peer_addr_for_me v1:172.21.15.204:0/0) 2024-03-17T23:55:45.485 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.479+0000 7f8507fff640 1 --2- 172.21.15.204:0/1828006064 >> v2:172.21.15.196:3300/0 conn(0x7f85100735f0 0x7f85100c78f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:55:45.485 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.479+0000 7f850e7fc640 1 -- 172.21.15.204:0/1828006064 <== mon.1 v1:172.21.15.204:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 745373175 0 0) 0x7f8510157ac0 con 0x7f85101511a0 2024-03-17T23:55:45.485 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.479+0000 7f850e7fc640 1 -- 172.21.15.204:0/1828006064 --> v1:172.21.15.204:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f84fc003530 con 0x7f85101511a0 2024-03-17T23:55:45.485 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.479+0000 7f850e7fc640 1 -- 172.21.15.204:0/1828006064 <== mon.1 v1:172.21.15.204:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3132704185 0 0) 0x7f84fc003530 con 0x7f85101511a0 2024-03-17T23:55:45.485 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.479+0000 7f850e7fc640 1 -- 172.21.15.204:0/1828006064 >> v2:172.21.15.196:3300/0 conn(0x7f85100735f0 msgr2=0x7f85100c78f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-17T23:55:45.485 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.479+0000 7f850e7fc640 1 --2- 172.21.15.204:0/1828006064 >> v2:172.21.15.196:3300/0 conn(0x7f85100735f0 0x7f85100c78f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:55:45.486 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.479+0000 7f850e7fc640 1 -- 172.21.15.204:0/1828006064 >> v1:172.21.15.196:6789/0 conn(0x7f85100c7f70 legacy=0x7f85100c3ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:55:45.486 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.479+0000 7f850e7fc640 1 -- 172.21.15.204:0/1828006064 --> v1:172.21.15.204:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85100c8bc0 con 0x7f85101511a0 2024-03-17T23:55:45.486 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.479+0000 7f850e7fc640 1 -- 172.21.15.204:0/1828006064 <== mon.1 v1:172.21.15.204:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 981458915 0 0) 0x7f8500001680 con 0x7f85101511a0 2024-03-17T23:55:45.486 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.479+0000 7f850e7fc640 1 -- 172.21.15.204:0/1828006064 >> v1:172.21.15.204:6789/0 conn(0x7f85101511a0 legacy=0x7f8510072450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:55:45.486 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.479+0000 7f850e7fc640 1 --2- 172.21.15.204:0/1828006064 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f84fc0039c0 0x7f84fc003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:55:45.486 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.479+0000 7f850e7fc640 1 --2- 172.21.15.204:0/1828006064 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f84fc004810 0x7f84fc004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:55:45.486 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.479+0000 7f850e7fc640 1 --2- 172.21.15.204:0/1828006064 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f84fc0051d0 0x7f84fc00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:55:45.486 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.479+0000 7f850e7fc640 1 -- 172.21.15.204:0/1828006064 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f85100c8970 con 0x7f84fc004810 2024-03-17T23:55:45.486 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.479+0000 7f850e7fc640 1 -- 172.21.15.204:0/1828006064 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f84fc00c080 con 0x7f84fc0051d0 2024-03-17T23:55:45.486 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.479+0000 7f850e7fc640 1 -- 172.21.15.204:0/1828006064 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f84fc00c280 con 0x7f84fc0039c0 2024-03-17T23:55:45.486 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.479+0000 7f850f7fe640 1 --2- 172.21.15.204:0/1828006064 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f84fc0051d0 0x7f84fc00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:55:45.486 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.479+0000 7f8507fff640 1 --2- 172.21.15.204:0/1828006064 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f84fc004810 0x7f84fc004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:55:45.487 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.479+0000 7f850effd640 1 --2- 172.21.15.204:0/1828006064 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f84fc0039c0 0x7f84fc003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:55:45.487 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.479+0000 7f850f7fe640 1 -- 172.21.15.204:0/1828006064 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f84fc0039c0 msgr2=0x7f84fc003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-17T23:55:45.487 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.479+0000 7f850f7fe640 1 --2- 172.21.15.204:0/1828006064 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f84fc0039c0 0x7f84fc003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:55:45.487 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.479+0000 7f850f7fe640 1 -- 172.21.15.204:0/1828006064 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f84fc004810 msgr2=0x7f84fc004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-17T23:55:45.487 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.479+0000 7f850f7fe640 1 --2- 172.21.15.204:0/1828006064 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f84fc004810 0x7f84fc004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:55:45.487 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.479+0000 7f850f7fe640 1 -- 172.21.15.204:0/1828006064 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84fc003530 con 0x7f84fc0051d0 2024-03-17T23:55:45.487 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.479+0000 7f850effd640 1 --2- 172.21.15.204:0/1828006064 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f84fc0039c0 0x7f84fc003de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-17T23:55:45.490 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.479+0000 7f850f7fe640 1 -- 172.21.15.204:0/1828006064 reap_dead start 2024-03-17T23:55:45.491 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.479+0000 7f850f7fe640 1 --2- 172.21.15.204:0/1828006064 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f84fc0051d0 0x7f84fc00b9d0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f8508001e70 tx=0x7f850801c780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fc2c17f17503551c server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:55:45.491 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.479+0000 7f850e7fc640 1 -- 172.21.15.204:0/1828006064 <== mon.1 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8508001a90 con 0x7f84fc0051d0 2024-03-17T23:55:45.491 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.479+0000 7f850e7fc640 1 -- 172.21.15.204:0/1828006064 <== mon.1 v2:172.21.15.204:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8508003bc0 con 0x7f84fc0051d0 2024-03-17T23:55:45.491 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.479+0000 7f850e7fc640 1 -- 172.21.15.204:0/1828006064 <== mon.1 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8508005020 con 0x7f84fc0051d0 2024-03-17T23:55:45.491 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.483+0000 7f8515689640 1 -- 172.21.15.204:0/1828006064 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f84fc0051d0 msgr2=0x7f84fc00b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:55:45.491 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.483+0000 7f8515689640 1 --2- 172.21.15.204:0/1828006064 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f84fc0051d0 0x7f84fc00b9d0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f8508001e70 tx=0x7f850801c780 comp rx=0 tx=0).stop 2024-03-17T23:55:45.491 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.483+0000 7f8515689640 1 -- 172.21.15.204:0/1828006064 shutdown_connections 2024-03-17T23:55:45.491 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.483+0000 7f8515689640 1 --2- 172.21.15.204:0/1828006064 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f84fc0051d0 0x7f84fc00b9d0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:55:45.491 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.483+0000 7f8515689640 1 -- 172.21.15.204:0/1828006064 >> 172.21.15.204:0/1828006064 conn(0x7f85100cc5e0 msgr2=0x7f85100cc9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-17T23:55:45.491 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.483+0000 7f8515689640 1 -- 172.21.15.204:0/1828006064 shutdown_connections 2024-03-17T23:55:45.491 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.483+0000 7f8515689640 1 -- 172.21.15.204:0/1828006064 wait complete. 2024-03-17T23:55:45.491 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.483+0000 7f8515689640 1 Processor -- start 2024-03-17T23:55:45.492 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.483+0000 7f8515689640 1 -- start start 2024-03-17T23:55:45.492 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.483+0000 7f8515689640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f84fc0051d0 0x7f851014c410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:55:45.492 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.483+0000 7f8515689640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f85101efed0 0x7f851014b880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:55:45.492 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.483+0000 7f8515689640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8510148b60 0x7f85101440c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:55:45.492 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.483+0000 7f8515689640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f85100c75a0 con 0x7f85101efed0 2024-03-17T23:55:45.492 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.483+0000 7f8515689640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f85100c7080 con 0x7f84fc0051d0 2024-03-17T23:55:45.492 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.483+0000 7f8515689640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f85100c78f0 con 0x7f8510148b60 2024-03-17T23:55:45.492 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.483+0000 7f850effd640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f84fc0051d0 0x7f851014c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:55:45.492 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.483+0000 7f850f7fe640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8510148b60 0x7f85101440c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:55:45.492 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.483+0000 7f850effd640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f84fc0051d0 0x7f851014c410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3300/0 says I am v2:172.21.15.204:54882/0 (socket says 172.21.15.204:54882) 2024-03-17T23:55:45.492 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.483+0000 7f850effd640 1 -- 172.21.15.204:0/1447312241 learned_addr learned my addr 172.21.15.204:0/1447312241 (peer_addr_for_me v2:172.21.15.204:0/0) 2024-03-17T23:55:45.492 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.483+0000 7f8507fff640 1 --2- 172.21.15.204:0/1447312241 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f85101efed0 0x7f851014b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:55:45.492 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.483+0000 7f850effd640 1 -- 172.21.15.204:0/1447312241 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8510148b60 msgr2=0x7f85101440c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:55:45.493 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.483+0000 7f850effd640 1 --2- 172.21.15.204:0/1447312241 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8510148b60 0x7f85101440c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:55:45.493 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.483+0000 7f850effd640 1 -- 172.21.15.204:0/1447312241 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f85101efed0 msgr2=0x7f851014b880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:55:45.493 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.483+0000 7f850effd640 1 --2- 172.21.15.204:0/1447312241 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f85101efed0 0x7f851014b880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:55:45.493 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.483+0000 7f850effd640 1 -- 172.21.15.204:0/1447312241 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f851014ec00 con 0x7f84fc0051d0 2024-03-17T23:55:45.493 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.483+0000 7f850effd640 1 --2- 172.21.15.204:0/1447312241 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f84fc0051d0 0x7f851014c410 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f850000e820 tx=0x7f850000ece0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:55:45.493 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.483+0000 7f85077fe640 1 -- 172.21.15.204:0/1447312241 <== mon.1 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8500019070 con 0x7f84fc0051d0 2024-03-17T23:55:45.493 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.483+0000 7f85077fe640 1 -- 172.21.15.204:0/1447312241 <== mon.1 v2:172.21.15.204:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f850000c8d0 con 0x7f84fc0051d0 2024-03-17T23:55:45.493 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.483+0000 7f8515689640 1 -- 172.21.15.204:0/1447312241 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f851006bfa0 con 0x7f84fc0051d0 2024-03-17T23:55:45.493 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.483+0000 7f85077fe640 1 -- 172.21.15.204:0/1447312241 <== mon.1 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f850000cc80 con 0x7f84fc0051d0 2024-03-17T23:55:45.493 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.483+0000 7f8515689640 1 -- 172.21.15.204:0/1447312241 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85101ef6d0 con 0x7f84fc0051d0 2024-03-17T23:55:45.493 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.483+0000 7f85077fe640 1 -- 172.21.15.204:0/1447312241 <== mon.1 v2:172.21.15.204:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f850001c070 con 0x7f84fc0051d0 2024-03-17T23:55:45.493 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.483+0000 7f85077fe640 1 -- 172.21.15.204:0/1447312241 <== mon.1 v2:172.21.15.204:3300/0 5 ==== osd_map(7..7 src has 1..7) ==== 1300+0+0 (secure 0 0 0) 0x7f850001e9c0 con 0x7f84fc0051d0 2024-03-17T23:55:45.493 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.487+0000 7f8515689640 1 -- 172.21.15.204:0/1447312241 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f85100689a0 con 0x7f84fc0051d0 2024-03-17T23:55:45.494 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.487+0000 7f85077fe640 1 -- 172.21.15.204:0/1447312241 <== mon.1 v2:172.21.15.204:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f850001e440 con 0x7f84fc0051d0 2024-03-17T23:55:45.508 INFO:tasks.ceph.mgr.y.smithi196.stderr:2024-03-17T23:55:45.509+0000 7f2273686180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-03-17T23:55:45.560 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.555+0000 7f8515689640 1 -- 172.21.15.204:0/1447312241 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_command({"prefix": "osd new", "uuid": "89d6b48d-aa8a-4cb8-aa2e-e0aae04928b9", "id": 5} v 0) -- 0x7f851014e580 con 0x7f84fc0051d0 2024-03-17T23:55:45.567 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.563+0000 7f85077fe640 1 -- 172.21.15.204:0/1447312241 <== mon.1 v2:172.21.15.204:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "89d6b48d-aa8a-4cb8-aa2e-e0aae04928b9", "id": 5}]=0 v8) ==== 112+0+2 (secure 0 0 0) 0x7f850001e620 con 0x7f84fc0051d0 2024-03-17T23:55:45.568 INFO:teuthology.orchestra.run.smithi204.stdout:5 2024-03-17T23:55:45.569 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.563+0000 7f8515689640 1 -- 172.21.15.204:0/1447312241 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f84fc0051d0 msgr2=0x7f851014c410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:55:45.569 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.563+0000 7f8515689640 1 --2- 172.21.15.204:0/1447312241 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f84fc0051d0 0x7f851014c410 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f850000e820 tx=0x7f850000ece0 comp rx=0 tx=0).stop 2024-03-17T23:55:45.569 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.563+0000 7f8515689640 1 -- 172.21.15.204:0/1447312241 shutdown_connections 2024-03-17T23:55:45.569 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.563+0000 7f8515689640 1 --2- 172.21.15.204:0/1447312241 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8510148b60 0x7f85101440c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:55:45.569 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.563+0000 7f8515689640 1 --2- 172.21.15.204:0/1447312241 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f85101efed0 0x7f851014b880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:55:45.569 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.563+0000 7f8515689640 1 --2- 172.21.15.204:0/1447312241 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f84fc0051d0 0x7f851014c410 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:55:45.569 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.563+0000 7f8515689640 1 -- 172.21.15.204:0/1447312241 >> 172.21.15.204:0/1447312241 conn(0x7f85100cc5e0 msgr2=0x7f851014f6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-17T23:55:45.569 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.563+0000 7f8515689640 1 -- 172.21.15.204:0/1447312241 shutdown_connections 2024-03-17T23:55:45.569 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.563+0000 7f8515689640 1 -- 172.21.15.204:0/1447312241 wait complete. 2024-03-17T23:55:45.584 DEBUG:teuthology.orchestra.run.smithi204:> sudo ceph --cluster ceph osd new ff7d0949-2836-42a6-a63d-bc5a4269e080 6 2024-03-17T23:55:45.658 INFO:tasks.ceph.mgr.y.smithi196.stderr:2024-03-17T23:55:45.657+0000 7f2273686180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-03-17T23:55:45.695 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.691+0000 7ffbb64bd640 1 Processor -- start 2024-03-17T23:55:45.695 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.691+0000 7ffbb64bd640 1 -- start start 2024-03-17T23:55:45.697 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.691+0000 7ffbb64bd640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ffbb0151dd0 0x7ffbb00c2650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:55:45.697 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.691+0000 7ffbb64bd640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7ffbb0158630 0x7ffbb00c9120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:55:45.697 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.691+0000 7ffbb64bd640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffbb00c8410 con 0x7ffbb00c3060 2024-03-17T23:55:45.697 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.691+0000 7ffbb64bd640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 -- 0x7ffbb006fac0 con 0x7ffbb0158630 2024-03-17T23:55:45.697 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.691+0000 7ffbb64bd640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7ffbb00c86f0 con 0x7ffbb0151dd0 2024-03-17T23:55:45.698 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.691+0000 7ffbaffff640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ffbb0151dd0 0x7ffbb00c2650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:55:45.698 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.691+0000 7ffbaf7fe640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7ffbb0158630 0x7ffbb00c9120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:55:45.698 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.691+0000 7ffbaffff640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ffbb0151dd0 0x7ffbb00c2650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3301/0 says I am v2:172.21.15.204:39904/0 (socket says 172.21.15.204:39904) 2024-03-17T23:55:45.698 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.691+0000 7ffbaffff640 1 -- 172.21.15.204:0/1291991374 learned_addr learned my addr 172.21.15.204:0/1291991374 (peer_addr_for_me v2:172.21.15.204:0/0) 2024-03-17T23:55:45.698 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.691+0000 7ffbaffff640 1 -- 172.21.15.204:0/1291991374 >> v2:172.21.15.204:3300/0 conn(0x7ffbb0158630 msgr2=0x7ffbb00c9120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-17T23:55:45.698 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.691+0000 7ffbaffff640 1 --2- 172.21.15.204:0/1291991374 >> v2:172.21.15.204:3300/0 conn(0x7ffbb0158630 0x7ffbb00c9120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:55:45.698 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.691+0000 7ffbaffff640 1 -- 172.21.15.204:0/1291991374 >> v1:172.21.15.196:6789/0 conn(0x7ffbb00c3060 legacy=0x7ffbb015b1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:55:45.698 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.691+0000 7ffbaffff640 1 -- 172.21.15.204:0/1291991374 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffbb006f190 con 0x7ffbb0151dd0 2024-03-17T23:55:45.698 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.691+0000 7ffbaf7fe640 1 --2- 172.21.15.204:0/1291991374 >> v2:172.21.15.204:3300/0 conn(0x7ffbb0158630 0x7ffbb00c9120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-17T23:55:45.699 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.695+0000 7ffbaffff640 1 --2- 172.21.15.204:0/1291991374 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ffbb0151dd0 0x7ffbb00c2650 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7ffba0009e50 tx=0x7ffba001f210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f9910b155c9d06d8 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:55:45.699 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.695+0000 7ffbaeffd640 1 -- 172.21.15.204:0/1291991374 <== mon.2 v2:172.21.15.204:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffba00b4070 con 0x7ffbb0151dd0 2024-03-17T23:55:45.700 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.695+0000 7ffbaeffd640 1 -- 172.21.15.204:0/1291991374 <== mon.2 v2:172.21.15.204:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffba00af400 con 0x7ffbb0151dd0 2024-03-17T23:55:45.700 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.695+0000 7ffbaeffd640 1 -- 172.21.15.204:0/1291991374 <== mon.2 v2:172.21.15.204:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffba00af7d0 con 0x7ffbb0151dd0 2024-03-17T23:55:45.700 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.695+0000 7ffbb64bd640 1 -- 172.21.15.204:0/1291991374 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ffbb0151dd0 msgr2=0x7ffbb00c2650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:55:45.701 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.695+0000 7ffbb64bd640 1 --2- 172.21.15.204:0/1291991374 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ffbb0151dd0 0x7ffbb00c2650 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7ffba0009e50 tx=0x7ffba001f210 comp rx=0 tx=0).stop 2024-03-17T23:55:45.701 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.695+0000 7ffbb64bd640 1 -- 172.21.15.204:0/1291991374 shutdown_connections 2024-03-17T23:55:45.701 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.695+0000 7ffbb64bd640 1 --2- 172.21.15.204:0/1291991374 >> v2:172.21.15.204:3300/0 conn(0x7ffbb0158630 0x7ffbb00c9120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:55:45.701 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.695+0000 7ffbb64bd640 1 --2- 172.21.15.204:0/1291991374 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ffbb0151dd0 0x7ffbb00c2650 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:55:45.701 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.695+0000 7ffbb64bd640 1 -- 172.21.15.204:0/1291991374 >> 172.21.15.204:0/1291991374 conn(0x7ffbb00710c0 msgr2=0x7ffbb00714d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-17T23:55:45.701 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.695+0000 7ffbb64bd640 1 -- 172.21.15.204:0/1291991374 shutdown_connections 2024-03-17T23:55:45.701 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.695+0000 7ffbb64bd640 1 -- 172.21.15.204:0/1291991374 wait complete. 2024-03-17T23:55:45.701 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.695+0000 7ffbb64bd640 1 Processor -- start 2024-03-17T23:55:45.702 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.695+0000 7ffbb64bd640 1 -- start start 2024-03-17T23:55:45.704 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.695+0000 7ffbb64bd640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ffbb00c3060 0x7ffbb01e3180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:55:45.704 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.695+0000 7ffbb64bd640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ffbb0151dd0 0x7ffbb01562a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:55:45.704 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.695+0000 7ffbb64bd640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ffbb0158630 0x7ffbb0157250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:55:45.704 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.695+0000 7ffbb64bd640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7ffbb01521b0 con 0x7ffbb0158630 2024-03-17T23:55:45.704 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.699+0000 7ffbb64bd640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7ffbb006f750 con 0x7ffbb0151dd0 2024-03-17T23:55:45.704 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.699+0000 7ffbb64bd640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7ffbb0158a50 con 0x7ffbb00c3060 2024-03-17T23:55:45.704 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.699+0000 7ffbaf7fe640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ffbb0151dd0 0x7ffbb01562a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:55:45.705 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.699+0000 7ffbaf7fe640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ffbb0151dd0 0x7ffbb01562a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3300/0 says I am v2:172.21.15.204:54888/0 (socket says 172.21.15.204:54888) 2024-03-17T23:55:45.705 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.699+0000 7ffbaf7fe640 1 -- 172.21.15.204:0/1913068087 learned_addr learned my addr 172.21.15.204:0/1913068087 (peer_addr_for_me v2:172.21.15.204:0/0) 2024-03-17T23:55:45.705 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.699+0000 7ffbaffff640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ffbb00c3060 0x7ffbb01e3180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:55:45.705 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.699+0000 7ffbb4a5a640 1 --2- 172.21.15.204:0/1913068087 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ffbb0158630 0x7ffbb0157250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:55:45.705 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.699+0000 7ffbaf7fe640 1 -- 172.21.15.204:0/1913068087 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ffbb00c3060 msgr2=0x7ffbb01e3180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:55:45.705 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.699+0000 7ffbaf7fe640 1 --2- 172.21.15.204:0/1913068087 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ffbb00c3060 0x7ffbb01e3180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:55:45.705 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.699+0000 7ffbaf7fe640 1 -- 172.21.15.204:0/1913068087 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ffbb0158630 msgr2=0x7ffbb0157250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:55:45.705 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.699+0000 7ffbaf7fe640 1 --2- 172.21.15.204:0/1913068087 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ffbb0158630 0x7ffbb0157250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:55:45.705 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.699+0000 7ffbaf7fe640 1 -- 172.21.15.204:0/1913068087 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffbb00c5830 con 0x7ffbb0151dd0 2024-03-17T23:55:45.705 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.699+0000 7ffbb4a5a640 1 --2- 172.21.15.204:0/1913068087 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ffbb0158630 0x7ffbb0157250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-17T23:55:45.705 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.699+0000 7ffbaf7fe640 1 --2- 172.21.15.204:0/1913068087 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ffbb0151dd0 0x7ffbb01562a0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7ffba400e980 tx=0x7ffba400ee40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:55:45.705 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.699+0000 7ffbacff9640 1 -- 172.21.15.204:0/1913068087 <== mon.1 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffba4017070 con 0x7ffbb0151dd0 2024-03-17T23:55:45.705 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.699+0000 7ffbacff9640 1 -- 172.21.15.204:0/1913068087 <== mon.1 v2:172.21.15.204:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffba400ca00 con 0x7ffbb0151dd0 2024-03-17T23:55:45.705 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.699+0000 7ffbb64bd640 1 -- 172.21.15.204:0/1913068087 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffbb01ddf20 con 0x7ffbb0151dd0 2024-03-17T23:55:45.705 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.699+0000 7ffbacff9640 1 -- 172.21.15.204:0/1913068087 <== mon.1 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffba400cdd0 con 0x7ffbb0151dd0 2024-03-17T23:55:45.706 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.699+0000 7ffbb64bd640 1 -- 172.21.15.204:0/1913068087 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffbb01e3ad0 con 0x7ffbb0151dd0 2024-03-17T23:55:45.706 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.699+0000 7ffbacff9640 1 -- 172.21.15.204:0/1913068087 <== mon.1 v2:172.21.15.204:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7ffba401a070 con 0x7ffbb0151dd0 2024-03-17T23:55:45.706 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.699+0000 7ffbacff9640 1 -- 172.21.15.204:0/1913068087 <== mon.1 v2:172.21.15.204:3300/0 5 ==== osd_map(8..8 src has 1..8) ==== 1415+0+0 (secure 0 0 0) 0x7ffba40064d0 con 0x7ffbb0151dd0 2024-03-17T23:55:45.706 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.699+0000 7ffbb64bd640 1 -- 172.21.15.204:0/1913068087 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffbb00689a0 con 0x7ffbb0151dd0 2024-03-17T23:55:45.706 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.699+0000 7ffbacff9640 1 -- 172.21.15.204:0/1913068087 <== mon.1 v2:172.21.15.204:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7ffba4009400 con 0x7ffbb0151dd0 2024-03-17T23:55:45.719 INFO:tasks.ceph.mgr.y.smithi196.stderr:2024-03-17T23:55:45.717+0000 7f2273686180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-03-17T23:55:45.798 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.795+0000 7ffbb64bd640 1 -- 172.21.15.204:0/1913068087 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_command({"prefix": "osd new", "uuid": "ff7d0949-2836-42a6-a63d-bc5a4269e080", "id": 6} v 0) -- 0x7ffbb00c8cf0 con 0x7ffbb0151dd0 2024-03-17T23:55:45.803 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.799+0000 7ffbacff9640 1 -- 172.21.15.204:0/1913068087 <== mon.1 v2:172.21.15.204:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "ff7d0949-2836-42a6-a63d-bc5a4269e080", "id": 6}]=0 v9) ==== 112+0+2 (secure 0 0 0) 0x7ffba4004020 con 0x7ffbb0151dd0 2024-03-17T23:55:45.804 INFO:teuthology.orchestra.run.smithi204.stdout:6 2024-03-17T23:55:45.810 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.803+0000 7ffb967fc640 1 -- 172.21.15.204:0/1913068087 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ffbb0151dd0 msgr2=0x7ffbb01562a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:55:45.810 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.803+0000 7ffb967fc640 1 --2- 172.21.15.204:0/1913068087 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ffbb0151dd0 0x7ffbb01562a0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7ffba400e980 tx=0x7ffba400ee40 comp rx=0 tx=0).stop 2024-03-17T23:55:45.810 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.803+0000 7ffb967fc640 1 -- 172.21.15.204:0/1913068087 shutdown_connections 2024-03-17T23:55:45.810 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.803+0000 7ffb967fc640 1 --2- 172.21.15.204:0/1913068087 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ffbb0158630 0x7ffbb0157250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:55:45.810 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.803+0000 7ffb967fc640 1 --2- 172.21.15.204:0/1913068087 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ffbb0151dd0 0x7ffbb01562a0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:55:45.810 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.803+0000 7ffb967fc640 1 --2- 172.21.15.204:0/1913068087 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ffbb00c3060 0x7ffbb01e3180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:55:45.810 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.803+0000 7ffb967fc640 1 -- 172.21.15.204:0/1913068087 >> 172.21.15.204:0/1913068087 conn(0x7ffbb00710c0 msgr2=0x7ffbb00c8f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-17T23:55:45.811 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.803+0000 7ffb967fc640 1 -- 172.21.15.204:0/1913068087 shutdown_connections 2024-03-17T23:55:45.811 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.803+0000 7ffb967fc640 1 -- 172.21.15.204:0/1913068087 wait complete. 2024-03-17T23:55:45.833 DEBUG:teuthology.orchestra.run.smithi204:> sudo ceph --cluster ceph osd new 42bcc14b-70b3-4c59-bf81-41436e4eb272 7 2024-03-17T23:55:45.937 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.931+0000 7f4da1a89640 1 Processor -- start 2024-03-17T23:55:45.937 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.931+0000 7f4da1a89640 1 -- start start 2024-03-17T23:55:45.939 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.931+0000 7f4da1a89640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4d9c0ca1d0 0x7f4d9c06fde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:55:45.939 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.931+0000 7f4da1a89640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4d9c0c82e0 con 0x7f4d9c0c4730 2024-03-17T23:55:45.939 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.931+0000 7f4da1a89640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4d9c0c85c0 con 0x7f4d9c152000 2024-03-17T23:55:45.939 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.931+0000 7f4da1a89640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f4d9c070420 con 0x7f4d9c0ca1d0 2024-03-17T23:55:45.939 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.935+0000 7f4d9b7fe640 1 --1- >> v1:172.21.15.204:6789/0 conn(0x7f4d9c152000 0x7f4d9c15ba80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.204:6789/0 says I am v1:172.21.15.204:38804/0 (socket says 172.21.15.204:38804) 2024-03-17T23:55:45.939 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.935+0000 7f4d9b7fe640 1 -- 172.21.15.204:0/3652290671 learned_addr learned my addr 172.21.15.204:0/3652290671 (peer_addr_for_me v1:172.21.15.204:0/0) 2024-03-17T23:55:45.939 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.935+0000 7f4d9bfff640 1 --2- 172.21.15.204:0/3652290671 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4d9c0ca1d0 0x7f4d9c06fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:55:45.939 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.935+0000 7f4d9affd640 1 -- 172.21.15.204:0/3652290671 <== mon.1 v1:172.21.15.204:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3252444118 0 0) 0x7f4d9c0c85c0 con 0x7f4d9c152000 2024-03-17T23:55:45.939 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.935+0000 7f4d9affd640 1 -- 172.21.15.204:0/3652290671 --> v1:172.21.15.204:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4d88003530 con 0x7f4d9c152000 2024-03-17T23:55:45.939 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.935+0000 7f4d9bfff640 1 -- 172.21.15.204:0/3652290671 >> v1:172.21.15.204:6789/0 conn(0x7f4d9c152000 legacy=0x7f4d9c15ba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:55:45.939 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.935+0000 7f4d9bfff640 1 -- 172.21.15.204:0/3652290671 >> v1:172.21.15.196:6789/0 conn(0x7f4d9c0c4730 legacy=0x7f4d9c0cd6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:55:45.939 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.935+0000 7f4d9bfff640 1 -- 172.21.15.204:0/3652290671 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d9c0c88a0 con 0x7f4d9c0ca1d0 2024-03-17T23:55:45.941 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.935+0000 7f4d9bfff640 1 --2- 172.21.15.204:0/3652290671 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4d9c0ca1d0 0x7f4d9c06fde0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f4d94009dc0 tx=0x7f4d9401f170 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7c801b740b16137b server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:55:45.941 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.935+0000 7f4d9affd640 1 -- 172.21.15.204:0/3652290671 <== mon.2 v2:172.21.15.204:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d940b4070 con 0x7f4d9c0ca1d0 2024-03-17T23:55:45.941 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.935+0000 7f4d9affd640 1 -- 172.21.15.204:0/3652290671 <== mon.2 v2:172.21.15.204:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d940af600 con 0x7f4d9c0ca1d0 2024-03-17T23:55:45.941 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.935+0000 7f4d9affd640 1 -- 172.21.15.204:0/3652290671 <== mon.2 v2:172.21.15.204:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d940af9d0 con 0x7f4d9c0ca1d0 2024-03-17T23:55:45.942 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.935+0000 7f4da1a89640 1 -- 172.21.15.204:0/3652290671 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4d9c0ca1d0 msgr2=0x7f4d9c06fde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:55:45.942 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.935+0000 7f4da1a89640 1 --2- 172.21.15.204:0/3652290671 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4d9c0ca1d0 0x7f4d9c06fde0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f4d94009dc0 tx=0x7f4d9401f170 comp rx=0 tx=0).stop 2024-03-17T23:55:45.942 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.935+0000 7f4da1a89640 1 -- 172.21.15.204:0/3652290671 shutdown_connections 2024-03-17T23:55:45.942 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.935+0000 7f4da1a89640 1 --2- 172.21.15.204:0/3652290671 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4d9c0ca1d0 0x7f4d9c06fde0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:55:45.942 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.935+0000 7f4da1a89640 1 -- 172.21.15.204:0/3652290671 >> 172.21.15.204:0/3652290671 conn(0x7f4d9c06b2b0 msgr2=0x7f4d9c06b6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-17T23:55:45.942 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.935+0000 7f4da1a89640 1 -- 172.21.15.204:0/3652290671 shutdown_connections 2024-03-17T23:55:45.942 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.935+0000 7f4da1a89640 1 -- 172.21.15.204:0/3652290671 wait complete. 2024-03-17T23:55:45.945 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.939+0000 7f4da1a89640 1 Processor -- start 2024-03-17T23:55:45.945 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.939+0000 7f4da1a89640 1 -- start start 2024-03-17T23:55:45.945 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.939+0000 7f4da1a89640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4d9c0c4730 0x7f4d9c1f07a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:55:45.945 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.939+0000 7f4da1a89640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4d9c0ca1d0 0x7f4d9c0c8dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:55:45.945 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.939+0000 7f4da1a89640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4d9c152000 0x7f4d9c1f30d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:55:45.945 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.939+0000 7f4da1a89640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f4d9c15b560 con 0x7f4d9c152000 2024-03-17T23:55:45.945 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.939+0000 7f4da1a89640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f4d9c070790 con 0x7f4d9c0ca1d0 2024-03-17T23:55:45.945 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.939+0000 7f4da1a89640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f4d9c0cddc0 con 0x7f4d9c0c4730 2024-03-17T23:55:45.945 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.939+0000 7f4d9b7fe640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4d9c0c4730 0x7f4d9c1f07a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:55:45.946 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.939+0000 7f4d9b7fe640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4d9c0c4730 0x7f4d9c1f07a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3301/0 says I am v2:172.21.15.204:39924/0 (socket says 172.21.15.204:39924) 2024-03-17T23:55:45.946 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.939+0000 7f4d9b7fe640 1 -- 172.21.15.204:0/2455873536 learned_addr learned my addr 172.21.15.204:0/2455873536 (peer_addr_for_me v2:172.21.15.204:0/0) 2024-03-17T23:55:45.946 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.939+0000 7f4d93fff640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4d9c0ca1d0 0x7f4d9c0c8dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:55:45.946 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.939+0000 7f4d9bfff640 1 --2- 172.21.15.204:0/2455873536 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4d9c152000 0x7f4d9c1f30d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:55:45.946 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.939+0000 7f4d9b7fe640 1 -- 172.21.15.204:0/2455873536 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4d9c0ca1d0 msgr2=0x7f4d9c0c8dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:55:45.946 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.939+0000 7f4d9b7fe640 1 --2- 172.21.15.204:0/2455873536 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4d9c0ca1d0 0x7f4d9c0c8dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:55:45.946 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.939+0000 7f4d9b7fe640 1 -- 172.21.15.204:0/2455873536 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4d9c152000 msgr2=0x7f4d9c1f30d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:55:45.946 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.939+0000 7f4d9b7fe640 1 --2- 172.21.15.204:0/2455873536 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4d9c152000 0x7f4d9c1f30d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:55:45.946 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.939+0000 7f4d9b7fe640 1 -- 172.21.15.204:0/2455873536 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d9c14fb40 con 0x7f4d9c0c4730 2024-03-17T23:55:45.946 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.939+0000 7f4d9bfff640 1 --2- 172.21.15.204:0/2455873536 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4d9c152000 0x7f4d9c1f30d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-17T23:55:45.946 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.939+0000 7f4d9b7fe640 1 --2- 172.21.15.204:0/2455873536 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4d9c0c4730 0x7f4d9c1f07a0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f4d8c00c450 tx=0x7f4d8c00c910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:55:45.946 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.939+0000 7f4d98ff9640 1 -- 172.21.15.204:0/2455873536 <== mon.2 v2:172.21.15.204:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d8c017070 con 0x7f4d9c0c4730 2024-03-17T23:55:45.946 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.939+0000 7f4d98ff9640 1 -- 172.21.15.204:0/2455873536 <== mon.2 v2:172.21.15.204:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d8c005cf0 con 0x7f4d9c0c4730 2024-03-17T23:55:45.946 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.939+0000 7f4da1a89640 1 -- 172.21.15.204:0/2455873536 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d9c14fe20 con 0x7f4d9c0c4730 2024-03-17T23:55:45.947 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.939+0000 7f4d98ff9640 1 -- 172.21.15.204:0/2455873536 <== mon.2 v2:172.21.15.204:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d8c007270 con 0x7f4d9c0c4730 2024-03-17T23:55:45.947 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.939+0000 7f4da1a89640 1 -- 172.21.15.204:0/2455873536 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d9c1effa0 con 0x7f4d9c0c4730 2024-03-17T23:55:45.947 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.939+0000 7f4d98ff9640 1 -- 172.21.15.204:0/2455873536 <== mon.2 v2:172.21.15.204:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f4d8c01a070 con 0x7f4d9c0c4730 2024-03-17T23:55:45.947 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.939+0000 7f4d98ff9640 1 -- 172.21.15.204:0/2455873536 <== mon.2 v2:172.21.15.204:3301/0 5 ==== osd_map(9..9 src has 1..9) ==== 1530+0+0 (secure 0 0 0) 0x7f4d8c01cbc0 con 0x7f4d9c0c4730 2024-03-17T23:55:45.947 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.939+0000 7f4da1a89640 1 -- 172.21.15.204:0/2455873536 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4d9c0689a0 con 0x7f4d9c0c4730 2024-03-17T23:55:45.948 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:45.943+0000 7f4d98ff9640 1 -- 172.21.15.204:0/2455873536 <== mon.2 v2:172.21.15.204:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f4d8c007470 con 0x7f4d9c0c4730 2024-03-17T23:55:46.014 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:46.007+0000 7f4da1a89640 1 -- 172.21.15.204:0/2455873536 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_command({"prefix": "osd new", "uuid": "42bcc14b-70b3-4c59-bf81-41436e4eb272", "id": 7} v 0) -- 0x7f4d9c0cb540 con 0x7f4d9c0c4730 2024-03-17T23:55:46.021 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:46.015+0000 7f4d98ff9640 1 -- 172.21.15.204:0/2455873536 <== mon.2 v2:172.21.15.204:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "42bcc14b-70b3-4c59-bf81-41436e4eb272", "id": 7}]=0 v10) ==== 112+0+2 (secure 0 0 0) 0x7f4d8c01c440 con 0x7f4d9c0c4730 2024-03-17T23:55:46.021 INFO:teuthology.orchestra.run.smithi204.stdout:7 2024-03-17T23:55:46.022 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:46.015+0000 7f4da1a89640 1 -- 172.21.15.204:0/2455873536 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4d9c0c4730 msgr2=0x7f4d9c1f07a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:55:46.022 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:46.015+0000 7f4da1a89640 1 --2- 172.21.15.204:0/2455873536 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4d9c0c4730 0x7f4d9c1f07a0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f4d8c00c450 tx=0x7f4d8c00c910 comp rx=0 tx=0).stop 2024-03-17T23:55:46.022 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:46.015+0000 7f4da1a89640 1 -- 172.21.15.204:0/2455873536 shutdown_connections 2024-03-17T23:55:46.023 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:46.015+0000 7f4da1a89640 1 --2- 172.21.15.204:0/2455873536 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4d9c152000 0x7f4d9c1f30d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:55:46.023 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:46.015+0000 7f4da1a89640 1 --2- 172.21.15.204:0/2455873536 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4d9c0ca1d0 0x7f4d9c0c8dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:55:46.023 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:46.015+0000 7f4da1a89640 1 --2- 172.21.15.204:0/2455873536 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4d9c0c4730 0x7f4d9c1f07a0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:55:46.023 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:46.015+0000 7f4da1a89640 1 -- 172.21.15.204:0/2455873536 >> 172.21.15.204:0/2455873536 conn(0x7f4d9c06b2b0 msgr2=0x7f4d9c0cce50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-17T23:55:46.023 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:46.015+0000 7f4da1a89640 1 -- 172.21.15.204:0/2455873536 shutdown_connections 2024-03-17T23:55:46.023 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-17T23:55:46.015+0000 7f4da1a89640 1 -- 172.21.15.204:0/2455873536 wait complete. 2024-03-17T23:55:46.037 INFO:tasks.ceph.osd.0:Restarting daemon 2024-03-17T23:55:46.037 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-osd -f --cluster ceph -i 0 2024-03-17T23:55:46.039 INFO:tasks.ceph.osd.0:Started 2024-03-17T23:55:46.040 INFO:tasks.ceph.osd.1:Restarting daemon 2024-03-17T23:55:46.040 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-osd -f --cluster ceph -i 1 2024-03-17T23:55:46.042 INFO:tasks.ceph.osd.1:Started 2024-03-17T23:55:46.042 INFO:tasks.ceph.osd.2:Restarting daemon 2024-03-17T23:55:46.042 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-osd -f --cluster ceph -i 2 2024-03-17T23:55:46.044 INFO:tasks.ceph.osd.2:Started 2024-03-17T23:55:46.044 INFO:tasks.ceph.osd.3:Restarting daemon 2024-03-17T23:55:46.045 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-osd -f --cluster ceph -i 3 2024-03-17T23:55:46.046 INFO:tasks.ceph.osd.3:Started 2024-03-17T23:55:46.047 INFO:tasks.ceph.osd.4:Restarting daemon 2024-03-17T23:55:46.047 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-osd -f --cluster ceph -i 4 2024-03-17T23:55:46.049 INFO:tasks.ceph.osd.4:Started 2024-03-17T23:55:46.049 INFO:tasks.ceph.osd.5:Restarting daemon 2024-03-17T23:55:46.049 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-osd -f --cluster ceph -i 5 2024-03-17T23:55:46.051 INFO:tasks.ceph.osd.5:Started 2024-03-17T23:55:46.051 INFO:tasks.ceph.osd.6:Restarting daemon 2024-03-17T23:55:46.051 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-osd -f --cluster ceph -i 6 2024-03-17T23:55:46.053 INFO:tasks.ceph.osd.6:Started 2024-03-17T23:55:46.053 INFO:tasks.ceph.osd.7:Restarting daemon 2024-03-17T23:55:46.053 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-osd -f --cluster ceph -i 7 2024-03-17T23:55:46.055 INFO:tasks.ceph.osd.7:Started 2024-03-17T23:55:46.056 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-17T23:55:46.064 INFO:tasks.ceph.mgr.x.smithi204.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-03-17T23:55:46.064 INFO:tasks.ceph.mgr.x.smithi204.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-03-17T23:55:46.064 INFO:tasks.ceph.mgr.x.smithi204.stderr: from numpy import show_config as show_numpy_config 2024-03-17T23:55:46.128 INFO:tasks.ceph.mgr.x.smithi204.stderr:2024-03-17T23:55:46.123+0000 7f85f3708180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-03-17T23:55:46.207 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:46.205+0000 7f1e7e273640 1 Processor -- start 2024-03-17T23:55:46.207 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:46.205+0000 7f1e7e273640 1 -- start start 2024-03-17T23:55:46.209 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:46.209+0000 7f1e7e273640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f1e7806c3c0 0x7f1e7815ac40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:55:46.210 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:46.209+0000 7f1e7e273640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1e780c80d0 con 0x7f1e781574a0 2024-03-17T23:55:46.210 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:46.209+0000 7f1e7e273640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1e780c83b0 con 0x7f1e780c3120 2024-03-17T23:55:46.210 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:46.209+0000 7f1e7e273640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 -- 0x7f1e7806d9f0 con 0x7f1e7806c3c0 2024-03-17T23:55:46.210 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:46.209+0000 7f1e77fff640 1 --1- >> v1:172.21.15.196:6789/0 conn(0x7f1e781574a0 0x7f1e7806cbd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.196:6789/0 says I am v1:172.21.15.196:57256/0 (socket says 172.21.15.196:57256) 2024-03-17T23:55:46.210 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:46.209+0000 7f1e77fff640 1 -- 172.21.15.196:0/3232831725 learned_addr learned my addr 172.21.15.196:0/3232831725 (peer_addr_for_me v1:172.21.15.196:0/0) 2024-03-17T23:55:46.210 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:46.209+0000 7f1e777fe640 1 --2- 172.21.15.196:0/3232831725 >> v2:172.21.15.204:3300/0 conn(0x7f1e7806c3c0 0x7f1e7815ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:55:46.210 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:46.209+0000 7f1e76ffd640 1 -- 172.21.15.196:0/3232831725 <== mon.0 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2683852411 0 0) 0x7f1e780c80d0 con 0x7f1e781574a0 2024-03-17T23:55:46.210 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:46.209+0000 7f1e76ffd640 1 -- 172.21.15.196:0/3232831725 --> v1:172.21.15.196:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1e60003530 con 0x7f1e781574a0 2024-03-17T23:55:46.210 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:46.209+0000 7f1e76ffd640 1 -- 172.21.15.196:0/3232831725 <== mon.1 v1:172.21.15.204:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2373445683 0 0) 0x7f1e780c83b0 con 0x7f1e780c3120 2024-03-17T23:55:46.210 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:46.209+0000 7f1e76ffd640 1 -- 172.21.15.196:0/3232831725 --> v1:172.21.15.204:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1e780c80d0 con 0x7f1e780c3120 2024-03-17T23:55:46.211 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:46.209+0000 7f1e76ffd640 1 -- 172.21.15.196:0/3232831725 <== mon.0 v1:172.21.15.196:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 117958009 0 0) 0x7f1e60003530 con 0x7f1e781574a0 2024-03-17T23:55:46.211 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:46.209+0000 7f1e76ffd640 1 -- 172.21.15.196:0/3232831725 >> v2:172.21.15.204:3300/0 conn(0x7f1e7806c3c0 msgr2=0x7f1e7815ac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-17T23:55:46.211 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:46.209+0000 7f1e76ffd640 1 --2- 172.21.15.196:0/3232831725 >> v2:172.21.15.204:3300/0 conn(0x7f1e7806c3c0 0x7f1e7815ac40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:55:46.211 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:46.209+0000 7f1e76ffd640 1 -- 172.21.15.196:0/3232831725 >> v1:172.21.15.204:6789/0 conn(0x7f1e780c3120 legacy=0x7f1e7806d2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:55:46.211 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:46.209+0000 7f1e76ffd640 1 -- 172.21.15.196:0/3232831725 --> v1:172.21.15.196:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e7815a160 con 0x7f1e781574a0 2024-03-17T23:55:46.211 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:46.209+0000 7f1e76ffd640 1 -- 172.21.15.196:0/3232831725 <== mon.0 v1:172.21.15.196:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 981458915 0 0) 0x7f1e68001680 con 0x7f1e781574a0 2024-03-17T23:55:46.211 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:46.209+0000 7f1e76ffd640 1 -- 172.21.15.196:0/3232831725 >> v1:172.21.15.196:6789/0 conn(0x7f1e781574a0 legacy=0x7f1e7806cbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:55:46.211 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:46.209+0000 7f1e76ffd640 1 --2- 172.21.15.196:0/3232831725 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1e60003b50 0x7f1e60003f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:55:46.211 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:46.209+0000 7f1e76ffd640 1 --2- 172.21.15.196:0/3232831725 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1e60004810 0x7f1e60004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:55:46.211 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:46.209+0000 7f1e76ffd640 1 --2- 172.21.15.196:0/3232831725 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1e600051d0 0x7f1e6000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:55:46.211 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:46.209+0000 7f1e76ffd640 1 -- 172.21.15.196:0/3232831725 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f1e7806d9f0 con 0x7f1e60003b50 2024-03-17T23:55:46.211 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:46.209+0000 7f1e76ffd640 1 -- 172.21.15.196:0/3232831725 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f1e6000c050 con 0x7f1e60004810 2024-03-17T23:55:46.211 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:46.209+0000 7f1e76ffd640 1 -- 172.21.15.196:0/3232831725 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f1e6000c250 con 0x7f1e600051d0 2024-03-17T23:55:46.211 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:46.209+0000 7f1e77fff640 1 --2- 172.21.15.196:0/3232831725 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1e60003b50 0x7f1e60003f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:55:46.212 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:46.209+0000 7f1e777fe640 1 --2- 172.21.15.196:0/3232831725 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1e60004810 0x7f1e60004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:55:46.212 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:46.209+0000 7f1e7c810640 1 --2- 172.21.15.196:0/3232831725 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1e600051d0 0x7f1e6000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:55:46.212 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:46.209+0000 7f1e77fff640 1 -- 172.21.15.196:0/3232831725 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1e600051d0 msgr2=0x7f1e6000b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-17T23:55:46.212 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:46.209+0000 7f1e77fff640 1 --2- 172.21.15.196:0/3232831725 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1e600051d0 0x7f1e6000b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:55:46.212 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:46.209+0000 7f1e77fff640 1 -- 172.21.15.196:0/3232831725 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1e60004810 msgr2=0x7f1e60004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-17T23:55:46.212 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:46.209+0000 7f1e77fff640 1 --2- 172.21.15.196:0/3232831725 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1e60004810 0x7f1e60004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:55:46.212 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:46.209+0000 7f1e77fff640 1 -- 172.21.15.196:0/3232831725 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e60003530 con 0x7f1e60003b50 2024-03-17T23:55:46.212 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:46.209+0000 7f1e7c810640 1 --2- 172.21.15.196:0/3232831725 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1e600051d0 0x7f1e6000b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-17T23:55:46.212 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:46.209+0000 7f1e777fe640 1 --2- 172.21.15.196:0/3232831725 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1e60004810 0x7f1e60004c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-17T23:55:46.212 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:46.209+0000 7f1e7c810640 1 -- 172.21.15.196:0/3232831725 reap_dead start 2024-03-17T23:55:46.215 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:46.209+0000 7f1e77fff640 1 --2- 172.21.15.196:0/3232831725 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1e60003b50 0x7f1e60003f50 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f1e6800c210 tx=0x7f1e6801cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea43d7db6f157a62 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:55:46.215 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:46.209+0000 7f1e76ffd640 1 -- 172.21.15.196:0/3232831725 <== mon.0 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e68007cf0 con 0x7f1e60003b50 2024-03-17T23:55:46.216 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:46.209+0000 7f1e76ffd640 1 -- 172.21.15.196:0/3232831725 <== mon.0 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e680a9020 con 0x7f1e60003b50 2024-03-17T23:55:46.216 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:46.209+0000 7f1e76ffd640 1 -- 172.21.15.196:0/3232831725 <== mon.0 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e68005b00 con 0x7f1e60003b50 2024-03-17T23:55:46.216 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:46.213+0000 7f1e7e273640 1 -- 172.21.15.196:0/3232831725 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1e60003b50 msgr2=0x7f1e60003f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:55:46.216 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:46.213+0000 7f1e7e273640 1 --2- 172.21.15.196:0/3232831725 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1e60003b50 0x7f1e60003f50 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f1e6800c210 tx=0x7f1e6801cc20 comp rx=0 tx=0).stop 2024-03-17T23:55:46.216 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:46.213+0000 7f1e7e273640 1 -- 172.21.15.196:0/3232831725 shutdown_connections 2024-03-17T23:55:46.216 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:46.213+0000 7f1e7e273640 1 --2- 172.21.15.196:0/3232831725 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1e60003b50 0x7f1e60003f50 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:55:46.216 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:46.213+0000 7f1e7e273640 1 -- 172.21.15.196:0/3232831725 >> 172.21.15.196:0/3232831725 conn(0x7f1e78071020 msgr2=0x7f1e78071430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-17T23:55:46.216 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:46.213+0000 7f1e7e273640 1 -- 172.21.15.196:0/3232831725 shutdown_connections 2024-03-17T23:55:46.216 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:46.213+0000 7f1e7e273640 1 -- 172.21.15.196:0/3232831725 wait complete. 2024-03-17T23:55:46.216 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:46.213+0000 7f1e7e273640 1 Processor -- start 2024-03-17T23:55:46.216 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:46.213+0000 7f1e7e273640 1 -- start start 2024-03-17T23:55:46.216 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:46.213+0000 7f1e7e273640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1e60003b50 0x7f1e781e9460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:55:46.216 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:46.213+0000 7f1e7e273640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1e78154070 0x7f1e7815cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:55:46.216 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:46.213+0000 7f1e7e273640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1e781f68e0 0x7f1e7815b1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:55:46.217 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:46.213+0000 7f1e7e273640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f1e780c8690 con 0x7f1e781f68e0 2024-03-17T23:55:46.217 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:46.213+0000 7f1e7e273640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f1e7815a7b0 con 0x7f1e78154070 2024-03-17T23:55:46.217 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:46.213+0000 7f1e7e273640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f1e78157880 con 0x7f1e60003b50 2024-03-17T23:55:46.217 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:46.213+0000 7f1e7c810640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1e781f68e0 0x7f1e7815b1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:55:46.217 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:46.213+0000 7f1e7c810640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1e781f68e0 0x7f1e7815b1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.196:37134/0 (socket says 172.21.15.196:37134) 2024-03-17T23:55:46.217 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:46.213+0000 7f1e7c810640 1 -- 172.21.15.196:0/1272331554 learned_addr learned my addr 172.21.15.196:0/1272331554 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-03-17T23:55:46.217 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:46.213+0000 7f1e77fff640 1 --2- 172.21.15.196:0/1272331554 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1e60003b50 0x7f1e781e9460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:55:46.217 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:46.213+0000 7f1e777fe640 1 --2- 172.21.15.196:0/1272331554 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1e78154070 0x7f1e7815cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:55:46.217 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:46.213+0000 7f1e7c810640 1 -- 172.21.15.196:0/1272331554 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1e60003b50 msgr2=0x7f1e781e9460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:55:46.217 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:46.213+0000 7f1e7c810640 1 --2- 172.21.15.196:0/1272331554 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1e60003b50 0x7f1e781e9460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:55:46.217 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:46.213+0000 7f1e7c810640 1 -- 172.21.15.196:0/1272331554 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1e78154070 msgr2=0x7f1e7815cff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:55:46.217 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:46.213+0000 7f1e7c810640 1 --2- 172.21.15.196:0/1272331554 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1e78154070 0x7f1e7815cff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:55:46.217 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:46.213+0000 7f1e7c810640 1 -- 172.21.15.196:0/1272331554 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e781f7590 con 0x7f1e781f68e0 2024-03-17T23:55:46.217 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:46.213+0000 7f1e777fe640 1 --2- 172.21.15.196:0/1272331554 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1e78154070 0x7f1e7815cff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-17T23:55:46.217 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:46.213+0000 7f1e7c810640 1 --2- 172.21.15.196:0/1272331554 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1e781f68e0 0x7f1e7815b1b0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f1e7000d7e0 tx=0x7f1e7000dca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:55:46.218 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:46.213+0000 7f1e74ff9640 1 -- 172.21.15.196:0/1272331554 <== mon.0 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e70018070 con 0x7f1e781f68e0 2024-03-17T23:55:46.218 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:46.213+0000 7f1e74ff9640 1 -- 172.21.15.196:0/1272331554 <== mon.0 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e70003dd0 con 0x7f1e781f68e0 2024-03-17T23:55:46.218 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:46.213+0000 7f1e7e273640 1 -- 172.21.15.196:0/1272331554 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1e781f72b0 con 0x7f1e781f68e0 2024-03-17T23:55:46.218 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:46.213+0000 7f1e74ff9640 1 -- 172.21.15.196:0/1272331554 <== mon.0 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e70006da0 con 0x7f1e781f68e0 2024-03-17T23:55:46.218 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:46.213+0000 7f1e7e273640 1 -- 172.21.15.196:0/1272331554 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1e780cd1e0 con 0x7f1e781f68e0 2024-03-17T23:55:46.218 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:46.213+0000 7f1e74ff9640 1 -- 172.21.15.196:0/1272331554 <== mon.0 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f1e70005070 con 0x7f1e781f68e0 2024-03-17T23:55:46.218 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:46.213+0000 7f1e74ff9640 1 -- 172.21.15.196:0/1272331554 <== mon.0 v2:172.21.15.196:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7f1e70007700 con 0x7f1e781f68e0 2024-03-17T23:55:46.218 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:46.213+0000 7f1e7e273640 1 -- 172.21.15.196:0/1272331554 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1e780cb4d0 con 0x7f1e781f68e0 2024-03-17T23:55:46.229 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:46.229+0000 7f1e74ff9640 1 -- 172.21.15.196:0/1272331554 <== mon.0 v2:172.21.15.196:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f1e70033dd0 con 0x7f1e781f68e0 2024-03-17T23:55:46.262 INFO:tasks.ceph.mgr.x.smithi204.stderr:2024-03-17T23:55:46.259+0000 7f85f3708180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-03-17T23:55:46.282 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:46.281+0000 7f1e7e273640 1 -- 172.21.15.196:0/1272331554 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1e780689a0 con 0x7f1e781f68e0 2024-03-17T23:55:46.283 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:46.281+0000 7f1e74ff9640 1 -- 172.21.15.196:0/1272331554 <== mon.0 v2:172.21.15.196:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7f1e70022070 con 0x7f1e781f68e0 2024-03-17T23:55:46.283 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-03-17T23:55:46.284 INFO:teuthology.orchestra.run.smithi196.stdout:{"epoch":10,"fsid":"b80f9c80-17ad-4126-8957-4c0c46f5b803","created":"2024-03-17T23:55:43.368838+0000","modified":"2024-03-17T23:55:46.016435+0000","last_up_change":"0.000000","last_in_change":"2024-03-17T23:55:46.016435+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"224d699f-bc10-4661-a8b5-6ca73290ffa0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"d8d6a0b0-450b-4ab5-b143-d4f36286e81e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"d732ba94-1db0-41ed-930a-5abb6188980a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"b79cab98-a49f-4544-b6b0-546dcfbd47a1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"d5892856-6eb4-4188-beb0-368f64169af1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"89d6b48d-aa8a-4cb8-aa2e-e0aae04928b9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"ff7d0949-2836-42a6-a63d-bc5a4269e080","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"42bcc14b-70b3-4c59-bf81-41436e4eb272","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-17T23:55:46.284 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:46.285+0000 7f1e7e273640 1 -- 172.21.15.196:0/1272331554 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1e781f68e0 msgr2=0x7f1e7815b1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:55:46.285 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:46.285+0000 7f1e7e273640 1 --2- 172.21.15.196:0/1272331554 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1e781f68e0 0x7f1e7815b1b0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f1e7000d7e0 tx=0x7f1e7000dca0 comp rx=0 tx=0).stop 2024-03-17T23:55:46.285 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:46.285+0000 7f1e7e273640 1 -- 172.21.15.196:0/1272331554 shutdown_connections 2024-03-17T23:55:46.285 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:46.285+0000 7f1e7e273640 1 --2- 172.21.15.196:0/1272331554 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1e781f68e0 0x7f1e7815b1b0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:55:46.285 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:46.285+0000 7f1e7e273640 1 --2- 172.21.15.196:0/1272331554 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1e78154070 0x7f1e7815cff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:55:46.285 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:46.285+0000 7f1e7e273640 1 --2- 172.21.15.196:0/1272331554 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1e60003b50 0x7f1e781e9460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:55:46.285 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:46.285+0000 7f1e7e273640 1 -- 172.21.15.196:0/1272331554 >> 172.21.15.196:0/1272331554 conn(0x7f1e78071020 msgr2=0x7f1e780c9080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-17T23:55:46.285 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:46.285+0000 7f1e7e273640 1 -- 172.21.15.196:0/1272331554 shutdown_connections 2024-03-17T23:55:46.285 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:46.285+0000 7f1e7e273640 1 -- 172.21.15.196:0/1272331554 wait complete. 2024-03-17T23:55:46.299 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-03-17T23:55:46.300 INFO:tasks.ceph:Waiting for OSDs to come up 2024-03-17T23:55:46.316 INFO:tasks.ceph.mgr.y.smithi196.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-03-17T23:55:46.316 INFO:tasks.ceph.mgr.y.smithi196.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-03-17T23:55:46.316 INFO:tasks.ceph.mgr.y.smithi196.stderr: from numpy import show_config as show_numpy_config 2024-03-17T23:55:46.369 INFO:tasks.ceph.mgr.y.smithi196.stderr:2024-03-17T23:55:46.369+0000 7f2273686180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-03-17T23:55:46.426 INFO:tasks.ceph.mgr.x.smithi204.stderr:2024-03-17T23:55:46.423+0000 7f85f3708180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-03-17T23:55:46.489 INFO:tasks.ceph.mgr.x.smithi204.stderr:2024-03-17T23:55:46.483+0000 7f85f3708180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-03-17T23:55:46.539 INFO:tasks.ceph.mgr.y.smithi196.stderr:2024-03-17T23:55:46.537+0000 7f2273686180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-03-17T23:55:46.626 INFO:tasks.ceph.mgr.x.smithi204.stderr:2024-03-17T23:55:46.623+0000 7f85f3708180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-03-17T23:55:46.675 INFO:tasks.ceph.osd.7.smithi204.stderr:2024-03-17T23:55:46.671+0000 7fa1536607c0 -1 Falling back to public interface 2024-03-17T23:55:46.676 INFO:tasks.ceph.osd.6.smithi204.stderr:2024-03-17T23:55:46.671+0000 7f32652327c0 -1 Falling back to public interface 2024-03-17T23:55:46.679 INFO:tasks.ceph.osd.4.smithi204.stderr:2024-03-17T23:55:46.675+0000 7efc535b37c0 -1 Falling back to public interface 2024-03-17T23:55:46.679 INFO:tasks.ceph.osd.5.smithi204.stderr:2024-03-17T23:55:46.675+0000 7f0373fbe7c0 -1 Falling back to public interface 2024-03-17T23:55:46.709 INFO:tasks.ceph.mgr.y.smithi196.stderr:2024-03-17T23:55:46.709+0000 7f2273686180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-03-17T23:55:46.725 INFO:tasks.ceph.osd.1.smithi196.stderr:2024-03-17T23:55:46.725+0000 7fae1e9d47c0 -1 Falling back to public interface 2024-03-17T23:55:46.725 INFO:tasks.ceph.osd.0.smithi196.stderr:2024-03-17T23:55:46.725+0000 7f3c153a77c0 -1 Falling back to public interface 2024-03-17T23:55:46.736 INFO:tasks.ceph.osd.3.smithi196.stderr:2024-03-17T23:55:46.737+0000 7fee611347c0 -1 Falling back to public interface 2024-03-17T23:55:46.744 INFO:tasks.ceph.osd.2.smithi196.stderr:2024-03-17T23:55:46.745+0000 7f36ac6e07c0 -1 Falling back to public interface 2024-03-17T23:55:46.789 INFO:tasks.ceph.mgr.y.smithi196.stderr:2024-03-17T23:55:46.789+0000 7f2273686180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-03-17T23:55:46.935 INFO:tasks.ceph.mgr.y.smithi196.stderr:2024-03-17T23:55:46.933+0000 7f2273686180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-03-17T23:55:47.106 DEBUG:teuthology.orchestra.run.smithi196:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-03-17T23:55:47.215 INFO:teuthology.misc.health.smithi196.stderr:2024-03-17T23:55:47.213+0000 7f2e98dd0640 1 Processor -- start 2024-03-17T23:55:47.216 INFO:teuthology.misc.health.smithi196.stderr:2024-03-17T23:55:47.213+0000 7f2e98dd0640 1 -- start start 2024-03-17T23:55:47.218 INFO:teuthology.misc.health.smithi196.stderr:2024-03-17T23:55:47.217+0000 7f2e98dd0640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2e941520d0 0x7f2e940cd6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:55:47.218 INFO:teuthology.misc.health.smithi196.stderr:2024-03-17T23:55:47.217+0000 7f2e98dd0640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f2e940c9b00 0x7f2e940c8140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:55:47.218 INFO:teuthology.misc.health.smithi196.stderr:2024-03-17T23:55:47.217+0000 7f2e98dd0640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f2e940c8680 0x7f2e940c8dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:55:47.218 INFO:teuthology.misc.health.smithi196.stderr:2024-03-17T23:55:47.217+0000 7f2e98dd0640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7f2e940ce040 con 0x7f2e940c9b00 2024-03-17T23:55:47.218 INFO:teuthology.misc.health.smithi196.stderr:2024-03-17T23:55:47.217+0000 7f2e98dd0640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 -- 0x7f2e9406f730 con 0x7f2e940c8680 2024-03-17T23:55:47.218 INFO:teuthology.misc.health.smithi196.stderr:2024-03-17T23:55:47.217+0000 7f2e98dd0640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f2e940cdd60 con 0x7f2e941520d0 2024-03-17T23:55:47.218 INFO:teuthology.misc.health.smithi196.stderr:2024-03-17T23:55:47.217+0000 7f2e8bfff640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f2e940c9b00 0x7f2e940c8140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:55:47.218 INFO:teuthology.misc.health.smithi196.stderr:2024-03-17T23:55:47.217+0000 7f2e8bfff640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f2e940c9b00 0x7f2e940c8140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.196:37146/0 (socket says 172.21.15.196:37146) 2024-03-17T23:55:47.218 INFO:teuthology.misc.health.smithi196.stderr:2024-03-17T23:55:47.217+0000 7f2e8bfff640 1 -- 172.21.15.196:0/980806802 learned_addr learned my addr 172.21.15.196:0/980806802 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-03-17T23:55:47.218 INFO:teuthology.misc.health.smithi196.stderr:2024-03-17T23:55:47.217+0000 7f2e92d9d640 1 --2- 172.21.15.196:0/980806802 >> v2:172.21.15.204:3300/0 conn(0x7f2e940c8680 0x7f2e940c8dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:55:47.218 INFO:teuthology.misc.health.smithi196.stderr:2024-03-17T23:55:47.217+0000 7f2e9259c640 1 --2- 172.21.15.196:0/980806802 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2e941520d0 0x7f2e940cd6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:55:47.218 INFO:teuthology.misc.health.smithi196.stderr:2024-03-17T23:55:47.217+0000 7f2e8bfff640 1 -- 172.21.15.196:0/980806802 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2e941520d0 msgr2=0x7f2e940cd6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-17T23:55:47.218 INFO:teuthology.misc.health.smithi196.stderr:2024-03-17T23:55:47.217+0000 7f2e8bfff640 1 --2- 172.21.15.196:0/980806802 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2e941520d0 0x7f2e940cd6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:55:47.219 INFO:teuthology.misc.health.smithi196.stderr:2024-03-17T23:55:47.217+0000 7f2e8bfff640 1 -- 172.21.15.196:0/980806802 >> v2:172.21.15.204:3300/0 conn(0x7f2e940c8680 msgr2=0x7f2e940c8dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-17T23:55:47.219 INFO:teuthology.misc.health.smithi196.stderr:2024-03-17T23:55:47.217+0000 7f2e8bfff640 1 --2- 172.21.15.196:0/980806802 >> v2:172.21.15.204:3300/0 conn(0x7f2e940c8680 0x7f2e940c8dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:55:47.219 INFO:teuthology.misc.health.smithi196.stderr:2024-03-17T23:55:47.217+0000 7f2e8bfff640 1 -- 172.21.15.196:0/980806802 --> v2:172.21.15.196:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e940c2800 con 0x7f2e940c9b00 2024-03-17T23:55:47.219 INFO:teuthology.misc.health.smithi196.stderr:2024-03-17T23:55:47.217+0000 7f2e9259c640 1 --2- 172.21.15.196:0/980806802 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2e941520d0 0x7f2e940cd6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-17T23:55:47.220 INFO:teuthology.misc.health.smithi196.stderr:2024-03-17T23:55:47.221+0000 7f2e8bfff640 1 --2- 172.21.15.196:0/980806802 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2e940c9b00 0x7f2e940c8140 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f2e940c4730 tx=0x7f2e7c01ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8307474b99989045 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:55:47.221 INFO:teuthology.misc.health.smithi196.stderr:2024-03-17T23:55:47.221+0000 7f2e91d9b640 1 -- 172.21.15.196:0/980806802 <== mon.0 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e7c0b5070 con 0x7f2e940c9b00 2024-03-17T23:55:47.221 INFO:teuthology.misc.health.smithi196.stderr:2024-03-17T23:55:47.221+0000 7f2e91d9b640 1 -- 172.21.15.196:0/980806802 <== mon.0 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e7c0a89d0 con 0x7f2e940c9b00 2024-03-17T23:55:47.221 INFO:teuthology.misc.health.smithi196.stderr:2024-03-17T23:55:47.221+0000 7f2e91d9b640 1 -- 172.21.15.196:0/980806802 <== mon.0 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e7c0a8da0 con 0x7f2e940c9b00 2024-03-17T23:55:47.221 INFO:teuthology.misc.health.smithi196.stderr:2024-03-17T23:55:47.221+0000 7f2e98dd0640 1 -- 172.21.15.196:0/980806802 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2e940c9b00 msgr2=0x7f2e940c8140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:55:47.222 INFO:teuthology.misc.health.smithi196.stderr:2024-03-17T23:55:47.221+0000 7f2e98dd0640 1 --2- 172.21.15.196:0/980806802 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2e940c9b00 0x7f2e940c8140 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f2e940c4730 tx=0x7f2e7c01ed10 comp rx=0 tx=0).stop 2024-03-17T23:55:47.222 INFO:teuthology.misc.health.smithi196.stderr:2024-03-17T23:55:47.221+0000 7f2e98dd0640 1 -- 172.21.15.196:0/980806802 shutdown_connections 2024-03-17T23:55:47.222 INFO:teuthology.misc.health.smithi196.stderr:2024-03-17T23:55:47.221+0000 7f2e98dd0640 1 --2- 172.21.15.196:0/980806802 >> v2:172.21.15.204:3300/0 conn(0x7f2e940c8680 0x7f2e940c8dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:55:47.222 INFO:teuthology.misc.health.smithi196.stderr:2024-03-17T23:55:47.221+0000 7f2e98dd0640 1 --2- 172.21.15.196:0/980806802 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2e940c9b00 0x7f2e940c8140 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:55:47.222 INFO:teuthology.misc.health.smithi196.stderr:2024-03-17T23:55:47.221+0000 7f2e98dd0640 1 --2- 172.21.15.196:0/980806802 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2e941520d0 0x7f2e940cd6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:55:47.222 INFO:teuthology.misc.health.smithi196.stderr:2024-03-17T23:55:47.221+0000 7f2e98dd0640 1 -- 172.21.15.196:0/980806802 >> 172.21.15.196:0/980806802 conn(0x7f2e9406b2b0 msgr2=0x7f2e9406b6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-17T23:55:47.222 INFO:teuthology.misc.health.smithi196.stderr:2024-03-17T23:55:47.221+0000 7f2e98dd0640 1 -- 172.21.15.196:0/980806802 shutdown_connections 2024-03-17T23:55:47.222 INFO:teuthology.misc.health.smithi196.stderr:2024-03-17T23:55:47.221+0000 7f2e98dd0640 1 -- 172.21.15.196:0/980806802 wait complete. 2024-03-17T23:55:47.223 INFO:teuthology.misc.health.smithi196.stderr:2024-03-17T23:55:47.221+0000 7f2e98dd0640 1 Processor -- start 2024-03-17T23:55:47.223 INFO:teuthology.misc.health.smithi196.stderr:2024-03-17T23:55:47.221+0000 7f2e98dd0640 1 -- start start 2024-03-17T23:55:47.225 INFO:teuthology.misc.health.smithi196.stderr:2024-03-17T23:55:47.221+0000 7f2e98dd0640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2e940c8680 0x7f2e941f1c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:55:47.225 INFO:teuthology.misc.health.smithi196.stderr:2024-03-17T23:55:47.221+0000 7f2e98dd0640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2e940c9b00 0x7f2e94145f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:55:47.225 INFO:teuthology.misc.health.smithi196.stderr:2024-03-17T23:55:47.221+0000 7f2e98dd0640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2e941520d0 0x7f2e941464c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:55:47.225 INFO:teuthology.misc.health.smithi196.stderr:2024-03-17T23:55:47.221+0000 7f2e98dd0640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f2e940c30a0 con 0x7f2e941520d0 2024-03-17T23:55:47.225 INFO:teuthology.misc.health.smithi196.stderr:2024-03-17T23:55:47.221+0000 7f2e98dd0640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f2e940c2dc0 con 0x7f2e940c8680 2024-03-17T23:55:47.225 INFO:teuthology.misc.health.smithi196.stderr:2024-03-17T23:55:47.221+0000 7f2e98dd0640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f2e941524b0 con 0x7f2e940c9b00 2024-03-17T23:55:47.226 INFO:teuthology.misc.health.smithi196.stderr:2024-03-17T23:55:47.221+0000 7f2e92d9d640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2e941520d0 0x7f2e941464c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:55:47.226 INFO:teuthology.misc.health.smithi196.stderr:2024-03-17T23:55:47.221+0000 7f2e92d9d640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2e941520d0 0x7f2e941464c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.196:37160/0 (socket says 172.21.15.196:37160) 2024-03-17T23:55:47.226 INFO:teuthology.misc.health.smithi196.stderr:2024-03-17T23:55:47.221+0000 7f2e92d9d640 1 -- 172.21.15.196:0/220456872 learned_addr learned my addr 172.21.15.196:0/220456872 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-03-17T23:55:47.226 INFO:teuthology.misc.health.smithi196.stderr:2024-03-17T23:55:47.225+0000 7f2e9259c640 1 --2- 172.21.15.196:0/220456872 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2e940c8680 0x7f2e941f1c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:55:47.226 INFO:teuthology.misc.health.smithi196.stderr:2024-03-17T23:55:47.225+0000 7f2e8bfff640 1 --2- 172.21.15.196:0/220456872 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2e940c9b00 0x7f2e94145f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:55:47.226 INFO:teuthology.misc.health.smithi196.stderr:2024-03-17T23:55:47.225+0000 7f2e92d9d640 1 -- 172.21.15.196:0/220456872 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2e940c9b00 msgr2=0x7f2e94145f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:55:47.226 INFO:teuthology.misc.health.smithi196.stderr:2024-03-17T23:55:47.225+0000 7f2e92d9d640 1 --2- 172.21.15.196:0/220456872 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2e940c9b00 0x7f2e94145f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:55:47.226 INFO:teuthology.misc.health.smithi196.stderr:2024-03-17T23:55:47.225+0000 7f2e92d9d640 1 -- 172.21.15.196:0/220456872 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2e940c8680 msgr2=0x7f2e941f1c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:55:47.226 INFO:teuthology.misc.health.smithi196.stderr:2024-03-17T23:55:47.225+0000 7f2e92d9d640 1 --2- 172.21.15.196:0/220456872 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2e940c8680 0x7f2e941f1c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:55:47.226 INFO:teuthology.misc.health.smithi196.stderr:2024-03-17T23:55:47.225+0000 7f2e92d9d640 1 -- 172.21.15.196:0/220456872 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e94147a00 con 0x7f2e941520d0 2024-03-17T23:55:47.226 INFO:teuthology.misc.health.smithi196.stderr:2024-03-17T23:55:47.225+0000 7f2e8bfff640 1 --2- 172.21.15.196:0/220456872 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2e940c9b00 0x7f2e94145f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-17T23:55:47.226 INFO:teuthology.misc.health.smithi196.stderr:2024-03-17T23:55:47.225+0000 7f2e92d9d640 1 --2- 172.21.15.196:0/220456872 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2e941520d0 0x7f2e941464c0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f2e8c007d10 tx=0x7f2e8c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:55:47.226 INFO:teuthology.misc.health.smithi196.stderr:2024-03-17T23:55:47.225+0000 7f2e8affd640 1 -- 172.21.15.196:0/220456872 <== mon.0 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e8c014420 con 0x7f2e941520d0 2024-03-17T23:55:47.226 INFO:teuthology.misc.health.smithi196.stderr:2024-03-17T23:55:47.225+0000 7f2e8affd640 1 -- 172.21.15.196:0/220456872 <== mon.0 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e8c019070 con 0x7f2e941520d0 2024-03-17T23:55:47.227 INFO:teuthology.misc.health.smithi196.stderr:2024-03-17T23:55:47.225+0000 7f2e98dd0640 1 -- 172.21.15.196:0/220456872 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e94147cc0 con 0x7f2e941520d0 2024-03-17T23:55:47.227 INFO:teuthology.misc.health.smithi196.stderr:2024-03-17T23:55:47.225+0000 7f2e8affd640 1 -- 172.21.15.196:0/220456872 <== mon.0 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e8c014820 con 0x7f2e941520d0 2024-03-17T23:55:47.227 INFO:teuthology.misc.health.smithi196.stderr:2024-03-17T23:55:47.225+0000 7f2e98dd0640 1 -- 172.21.15.196:0/220456872 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e940b18c0 con 0x7f2e941520d0 2024-03-17T23:55:47.227 INFO:teuthology.misc.health.smithi196.stderr:2024-03-17T23:55:47.225+0000 7f2e8affd640 1 -- 172.21.15.196:0/220456872 <== mon.0 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f2e8c0149c0 con 0x7f2e941520d0 2024-03-17T23:55:47.227 INFO:teuthology.misc.health.smithi196.stderr:2024-03-17T23:55:47.225+0000 7f2e8affd640 1 -- 172.21.15.196:0/220456872 <== mon.0 v2:172.21.15.196:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7f2e8c01da90 con 0x7f2e941520d0 2024-03-17T23:55:47.227 INFO:teuthology.misc.health.smithi196.stderr:2024-03-17T23:55:47.225+0000 7f2e98dd0640 1 -- 172.21.15.196:0/220456872 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2e94145a90 con 0x7f2e941520d0 2024-03-17T23:55:47.227 INFO:teuthology.misc.health.smithi196.stderr:2024-03-17T23:55:47.225+0000 7f2e8affd640 1 -- 172.21.15.196:0/220456872 <== mon.0 v2:172.21.15.196:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f2e8c01dce0 con 0x7f2e941520d0 2024-03-17T23:55:47.237 INFO:tasks.ceph.mgr.x.smithi204.stderr:2024-03-17T23:55:47.231+0000 7f85f3708180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-03-17T23:55:47.280 INFO:teuthology.misc.health.smithi196.stderr:2024-03-17T23:55:47.281+0000 7f2e98dd0640 1 -- 172.21.15.196:0/220456872 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2e94068bc0 con 0x7f2e941520d0 2024-03-17T23:55:47.281 INFO:teuthology.misc.health.smithi196.stderr:2024-03-17T23:55:47.281+0000 7f2e8affd640 1 -- 172.21.15.196:0/220456872 <== mon.0 v2:172.21.15.196:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7f2e8c01d3c0 con 0x7f2e941520d0 2024-03-17T23:55:47.281 INFO:teuthology.misc.health.smithi196.stdout: 2024-03-17T23:55:47.281 INFO:teuthology.misc.health.smithi196.stdout:{"epoch":10,"fsid":"b80f9c80-17ad-4126-8957-4c0c46f5b803","created":"2024-03-17T23:55:43.368838+0000","modified":"2024-03-17T23:55:46.016435+0000","last_up_change":"0.000000","last_in_change":"2024-03-17T23:55:46.016435+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"224d699f-bc10-4661-a8b5-6ca73290ffa0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"d8d6a0b0-450b-4ab5-b143-d4f36286e81e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"d732ba94-1db0-41ed-930a-5abb6188980a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"b79cab98-a49f-4544-b6b0-546dcfbd47a1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"d5892856-6eb4-4188-beb0-368f64169af1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"89d6b48d-aa8a-4cb8-aa2e-e0aae04928b9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"ff7d0949-2836-42a6-a63d-bc5a4269e080","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"42bcc14b-70b3-4c59-bf81-41436e4eb272","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-17T23:55:47.282 INFO:teuthology.misc.health.smithi196.stderr:2024-03-17T23:55:47.281+0000 7f2e98dd0640 1 -- 172.21.15.196:0/220456872 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2e941520d0 msgr2=0x7f2e941464c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:55:47.282 INFO:teuthology.misc.health.smithi196.stderr:2024-03-17T23:55:47.281+0000 7f2e98dd0640 1 --2- 172.21.15.196:0/220456872 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2e941520d0 0x7f2e941464c0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f2e8c007d10 tx=0x7f2e8c00e4b0 comp rx=0 tx=0).stop 2024-03-17T23:55:47.282 INFO:teuthology.misc.health.smithi196.stderr:2024-03-17T23:55:47.281+0000 7f2e98dd0640 1 -- 172.21.15.196:0/220456872 shutdown_connections 2024-03-17T23:55:47.283 INFO:teuthology.misc.health.smithi196.stderr:2024-03-17T23:55:47.281+0000 7f2e98dd0640 1 --2- 172.21.15.196:0/220456872 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2e940c9b00 0x7f2e94145f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:55:47.283 INFO:teuthology.misc.health.smithi196.stderr:2024-03-17T23:55:47.281+0000 7f2e98dd0640 1 --2- 172.21.15.196:0/220456872 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2e941520d0 0x7f2e941464c0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:55:47.283 INFO:teuthology.misc.health.smithi196.stderr:2024-03-17T23:55:47.281+0000 7f2e98dd0640 1 --2- 172.21.15.196:0/220456872 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2e940c8680 0x7f2e941f1c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:55:47.283 INFO:teuthology.misc.health.smithi196.stderr:2024-03-17T23:55:47.281+0000 7f2e98dd0640 1 -- 172.21.15.196:0/220456872 >> 172.21.15.196:0/220456872 conn(0x7f2e9406b2b0 msgr2=0x7f2e94150f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-17T23:55:47.283 INFO:teuthology.misc.health.smithi196.stderr:2024-03-17T23:55:47.281+0000 7f2e98dd0640 1 -- 172.21.15.196:0/220456872 shutdown_connections 2024-03-17T23:55:47.283 INFO:teuthology.misc.health.smithi196.stderr:2024-03-17T23:55:47.281+0000 7f2e98dd0640 1 -- 172.21.15.196:0/220456872 wait complete. 2024-03-17T23:55:47.296 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-03-17T23:55:47.312 INFO:tasks.ceph.mgr.x.smithi204.stderr:2024-03-17T23:55:47.307+0000 7f85f3708180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-03-17T23:55:47.494 INFO:tasks.ceph.mgr.x.smithi204.stderr:2024-03-17T23:55:47.487+0000 7f85f3708180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-03-17T23:55:47.567 INFO:tasks.ceph.mgr.x.smithi204.stderr:2024-03-17T23:55:47.563+0000 7f85f3708180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-03-17T23:55:47.597 INFO:tasks.ceph.mgr.y.smithi196.stderr:2024-03-17T23:55:47.597+0000 7f2273686180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-03-17T23:55:47.673 INFO:tasks.ceph.mgr.y.smithi196.stderr:2024-03-17T23:55:47.673+0000 7f2273686180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-03-17T23:55:47.854 INFO:tasks.ceph.mgr.y.smithi196.stderr:2024-03-17T23:55:47.853+0000 7f2273686180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-03-17T23:55:47.857 INFO:tasks.ceph.mgr.x.smithi204.stderr:2024-03-17T23:55:47.851+0000 7f85f3708180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-03-17T23:55:47.919 INFO:tasks.ceph.mgr.x.smithi204.stderr:2024-03-17T23:55:47.915+0000 7f85f3708180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-03-17T23:55:47.927 INFO:tasks.ceph.mgr.y.smithi196.stderr:2024-03-17T23:55:47.925+0000 7f2273686180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-03-17T23:55:48.223 INFO:tasks.ceph.mgr.y.smithi196.stderr:2024-03-17T23:55:48.221+0000 7f2273686180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-03-17T23:55:48.285 INFO:tasks.ceph.mgr.y.smithi196.stderr:2024-03-17T23:55:48.285+0000 7f2273686180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-03-17T23:55:48.966 INFO:tasks.ceph.mgr.x.smithi204.stderr:2024-03-17T23:55:48.959+0000 7f859ab51640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-03-17T23:55:48.967 INFO:tasks.ceph.mgr.x.smithi204.stderr:2024-03-17T23:55:48.963+0000 7f859ab51640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-03-17T23:55:50.398 INFO:tasks.ceph.osd.0.smithi196.stderr:2024-03-17T23:55:50.397+0000 7f3c153a77c0 -1 osd.0 0 log_to_monitors true 2024-03-17T23:55:50.405 INFO:tasks.ceph.osd.7.smithi204.stderr:2024-03-17T23:55:50.399+0000 7fa1536607c0 -1 osd.7 0 log_to_monitors true 2024-03-17T23:55:50.448 INFO:tasks.ceph.osd.1.smithi196.stderr:2024-03-17T23:55:50.449+0000 7fae1e9d47c0 -1 osd.1 0 log_to_monitors true 2024-03-17T23:55:50.493 INFO:tasks.ceph.osd.4.smithi204.stderr:2024-03-17T23:55:50.487+0000 7efc535b37c0 -1 osd.4 0 log_to_monitors true 2024-03-17T23:55:50.539 INFO:tasks.ceph.osd.6.smithi204.stderr:2024-03-17T23:55:50.535+0000 7f32652327c0 -1 osd.6 0 log_to_monitors true 2024-03-17T23:55:50.541 INFO:tasks.ceph.osd.5.smithi204.stderr:2024-03-17T23:55:50.535+0000 7f0373fbe7c0 -1 osd.5 0 log_to_monitors true 2024-03-17T23:55:50.647 INFO:tasks.ceph.osd.2.smithi196.stderr:2024-03-17T23:55:50.645+0000 7f36ac6e07c0 -1 osd.2 0 log_to_monitors true 2024-03-17T23:55:50.665 INFO:tasks.ceph.osd.3.smithi196.stderr:2024-03-17T23:55:50.665+0000 7fee611347c0 -1 osd.3 0 log_to_monitors true 2024-03-17T23:55:53.096 INFO:tasks.ceph.osd.1.smithi196.stderr:2024-03-17T23:55:53.092+0000 7fae1a97d640 -1 osd.1 0 waiting for initial osdmap 2024-03-17T23:55:53.111 INFO:tasks.ceph.osd.4.smithi204.stderr:2024-03-17T23:55:53.107+0000 7efc4f55c640 -1 osd.4 0 waiting for initial osdmap 2024-03-17T23:55:53.120 INFO:tasks.ceph.osd.1.smithi196.stderr:2024-03-17T23:55:53.120+0000 7fae127b2640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-17T23:55:53.122 INFO:tasks.ceph.osd.2.smithi196.stderr:2024-03-17T23:55:53.120+0000 7f36a8689640 -1 osd.2 0 waiting for initial osdmap 2024-03-17T23:55:53.128 INFO:tasks.ceph.osd.3.smithi196.stderr:2024-03-17T23:55:53.128+0000 7fee5d0dd640 -1 osd.3 0 waiting for initial osdmap 2024-03-17T23:55:53.147 INFO:tasks.ceph.osd.4.smithi204.stderr:2024-03-17T23:55:53.143+0000 7efc47391640 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-17T23:55:53.152 INFO:tasks.ceph.osd.5.smithi204.stderr:2024-03-17T23:55:53.147+0000 7f0370779640 -1 osd.5 0 waiting for initial osdmap 2024-03-17T23:55:53.160 INFO:tasks.ceph.osd.2.smithi196.stderr:2024-03-17T23:55:53.160+0000 7f36a04be640 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-17T23:55:53.162 INFO:tasks.ceph.osd.0.smithi196.stderr:2024-03-17T23:55:53.160+0000 7f3c11350640 -1 osd.0 0 waiting for initial osdmap 2024-03-17T23:55:53.165 INFO:tasks.ceph.osd.7.smithi204.stderr:2024-03-17T23:55:53.159+0000 7fa14f609640 -1 osd.7 0 waiting for initial osdmap 2024-03-17T23:55:53.168 INFO:tasks.ceph.osd.3.smithi196.stderr:2024-03-17T23:55:53.168+0000 7fee54f12640 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-17T23:55:53.173 INFO:tasks.ceph.osd.6.smithi204.stderr:2024-03-17T23:55:53.167+0000 7f32611db640 -1 osd.6 0 waiting for initial osdmap 2024-03-17T23:55:53.183 INFO:tasks.ceph.osd.5.smithi204.stderr:2024-03-17T23:55:53.179+0000 7f0367d9c640 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-17T23:55:53.195 INFO:tasks.ceph.osd.7.smithi204.stderr:2024-03-17T23:55:53.191+0000 7fa14743e640 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-17T23:55:53.201 INFO:tasks.ceph.osd.0.smithi196.stderr:2024-03-17T23:55:53.200+0000 7f3c09185640 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-17T23:55:53.203 INFO:tasks.ceph.osd.6.smithi204.stderr:2024-03-17T23:55:53.199+0000 7f3259010640 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-17T23:55:54.102 DEBUG:teuthology.orchestra.run.smithi196:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-03-17T23:55:54.231 INFO:teuthology.misc.health.smithi196.stderr:2024-03-17T23:55:54.228+0000 7fe594e69640 1 Processor -- start 2024-03-17T23:55:54.231 INFO:teuthology.misc.health.smithi196.stderr:2024-03-17T23:55:54.228+0000 7fe594e69640 1 -- start start 2024-03-17T23:55:54.233 INFO:teuthology.misc.health.smithi196.stderr:2024-03-17T23:55:54.232+0000 7fe594e69640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe590151ff0 0x7fe5900c78d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:55:54.233 INFO:teuthology.misc.health.smithi196.stderr:2024-03-17T23:55:54.232+0000 7fe594e69640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fe5900c1f90 0x7fe5900c7f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:55:54.233 INFO:teuthology.misc.health.smithi196.stderr:2024-03-17T23:55:54.232+0000 7fe594e69640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe5901523d0 con 0x7fe5900c8450 2024-03-17T23:55:54.233 INFO:teuthology.misc.health.smithi196.stderr:2024-03-17T23:55:54.232+0000 7fe594e69640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7fe5900c26c0 con 0x7fe5900c1f90 2024-03-17T23:55:54.233 INFO:teuthology.misc.health.smithi196.stderr:2024-03-17T23:55:54.232+0000 7fe594e69640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7fe59015c210 con 0x7fe590151ff0 2024-03-17T23:55:54.233 INFO:teuthology.misc.health.smithi196.stderr:2024-03-17T23:55:54.232+0000 7fe58dd9b640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fe5900c1f90 0x7fe5900c7f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:55:54.233 INFO:teuthology.misc.health.smithi196.stderr:2024-03-17T23:55:54.232+0000 7fe58dd9b640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fe5900c1f90 0x7fe5900c7f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.196:56104/0 (socket says 172.21.15.196:56104) 2024-03-17T23:55:54.233 INFO:teuthology.misc.health.smithi196.stderr:2024-03-17T23:55:54.232+0000 7fe58dd9b640 1 -- 172.21.15.196:0/2319770182 learned_addr learned my addr 172.21.15.196:0/2319770182 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-03-17T23:55:54.234 INFO:teuthology.misc.health.smithi196.stderr:2024-03-17T23:55:54.232+0000 7fe58e59c640 1 --2- 172.21.15.196:0/2319770182 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe590151ff0 0x7fe5900c78d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:55:54.234 INFO:teuthology.misc.health.smithi196.stderr:2024-03-17T23:55:54.232+0000 7fe58dd9b640 1 -- 172.21.15.196:0/2319770182 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe590151ff0 msgr2=0x7fe5900c78d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-17T23:55:54.234 INFO:teuthology.misc.health.smithi196.stderr:2024-03-17T23:55:54.232+0000 7fe58dd9b640 1 --2- 172.21.15.196:0/2319770182 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe590151ff0 0x7fe5900c78d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:55:54.234 INFO:teuthology.misc.health.smithi196.stderr:2024-03-17T23:55:54.232+0000 7fe58dd9b640 1 -- 172.21.15.196:0/2319770182 >> v1:172.21.15.204:6789/0 conn(0x7fe5900c8450 legacy=0x7fe590158340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-17T23:55:54.234 INFO:teuthology.misc.health.smithi196.stderr:2024-03-17T23:55:54.232+0000 7fe58dd9b640 1 -- 172.21.15.196:0/2319770182 --> v2:172.21.15.196:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe59015b690 con 0x7fe5900c1f90 2024-03-17T23:55:54.235 INFO:teuthology.misc.health.smithi196.stderr:2024-03-17T23:55:54.232+0000 7fe58dd9b640 1 --2- 172.21.15.196:0/2319770182 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe5900c1f90 0x7fe5900c7f10 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fe5900c2440 tx=0x7fe57801c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1d1fc63badd9908 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:55:54.235 INFO:teuthology.misc.health.smithi196.stderr:2024-03-17T23:55:54.232+0000 7fe58d59a640 1 -- 172.21.15.196:0/2319770182 <== mon.0 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5780b1070 con 0x7fe5900c1f90 2024-03-17T23:55:54.235 INFO:teuthology.misc.health.smithi196.stderr:2024-03-17T23:55:54.232+0000 7fe58d59a640 1 -- 172.21.15.196:0/2319770182 <== mon.0 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe5780ac410 con 0x7fe5900c1f90 2024-03-17T23:55:54.236 INFO:teuthology.misc.health.smithi196.stderr:2024-03-17T23:55:54.232+0000 7fe58d59a640 1 -- 172.21.15.196:0/2319770182 <== mon.0 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5780ac7e0 con 0x7fe5900c1f90 2024-03-17T23:55:54.236 INFO:teuthology.misc.health.smithi196.stderr:2024-03-17T23:55:54.236+0000 7fe594e69640 1 -- 172.21.15.196:0/2319770182 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe5900c1f90 msgr2=0x7fe5900c7f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:55:54.236 INFO:teuthology.misc.health.smithi196.stderr:2024-03-17T23:55:54.236+0000 7fe594e69640 1 --2- 172.21.15.196:0/2319770182 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe5900c1f90 0x7fe5900c7f10 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fe5900c2440 tx=0x7fe57801c500 comp rx=0 tx=0).stop 2024-03-17T23:55:54.236 INFO:teuthology.misc.health.smithi196.stderr:2024-03-17T23:55:54.236+0000 7fe594e69640 1 -- 172.21.15.196:0/2319770182 shutdown_connections 2024-03-17T23:55:54.237 INFO:teuthology.misc.health.smithi196.stderr:2024-03-17T23:55:54.236+0000 7fe594e69640 1 --2- 172.21.15.196:0/2319770182 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe5900c1f90 0x7fe5900c7f10 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:55:54.237 INFO:teuthology.misc.health.smithi196.stderr:2024-03-17T23:55:54.236+0000 7fe594e69640 1 --2- 172.21.15.196:0/2319770182 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe590151ff0 0x7fe5900c78d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:55:54.237 INFO:teuthology.misc.health.smithi196.stderr:2024-03-17T23:55:54.236+0000 7fe594e69640 1 -- 172.21.15.196:0/2319770182 >> 172.21.15.196:0/2319770182 conn(0x7fe5900cb650 msgr2=0x7fe5900cba60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-17T23:55:54.237 INFO:teuthology.misc.health.smithi196.stderr:2024-03-17T23:55:54.236+0000 7fe594e69640 1 -- 172.21.15.196:0/2319770182 shutdown_connections 2024-03-17T23:55:54.237 INFO:teuthology.misc.health.smithi196.stderr:2024-03-17T23:55:54.236+0000 7fe594e69640 1 -- 172.21.15.196:0/2319770182 wait complete. 2024-03-17T23:55:54.237 INFO:teuthology.misc.health.smithi196.stderr:2024-03-17T23:55:54.236+0000 7fe594e69640 1 Processor -- start 2024-03-17T23:55:54.237 INFO:teuthology.misc.health.smithi196.stderr:2024-03-17T23:55:54.236+0000 7fe594e69640 1 -- start start 2024-03-17T23:55:54.239 INFO:teuthology.misc.health.smithi196.stderr:2024-03-17T23:55:54.236+0000 7fe594e69640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe5900c1f90 0x7fe590149630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:55:54.239 INFO:teuthology.misc.health.smithi196.stderr:2024-03-17T23:55:54.236+0000 7fe594e69640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe5900c8450 0x7fe59015a300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:55:54.239 INFO:teuthology.misc.health.smithi196.stderr:2024-03-17T23:55:54.236+0000 7fe594e69640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe590151ff0 0x7fe5901415b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:55:54.239 INFO:teuthology.misc.health.smithi196.stderr:2024-03-17T23:55:54.236+0000 7fe594e69640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fe59015b270 con 0x7fe5900c1f90 2024-03-17T23:55:54.240 INFO:teuthology.misc.health.smithi196.stderr:2024-03-17T23:55:54.236+0000 7fe594e69640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7fe590157e20 con 0x7fe5900c8450 2024-03-17T23:55:54.240 INFO:teuthology.misc.health.smithi196.stderr:2024-03-17T23:55:54.236+0000 7fe594e69640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7fe59015b3f0 con 0x7fe590151ff0 2024-03-17T23:55:54.240 INFO:teuthology.misc.health.smithi196.stderr:2024-03-17T23:55:54.236+0000 7fe58e59c640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe5900c1f90 0x7fe590149630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:55:54.240 INFO:teuthology.misc.health.smithi196.stderr:2024-03-17T23:55:54.236+0000 7fe58e59c640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe5900c1f90 0x7fe590149630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.196:56106/0 (socket says 172.21.15.196:56106) 2024-03-17T23:55:54.240 INFO:teuthology.misc.health.smithi196.stderr:2024-03-17T23:55:54.236+0000 7fe58e59c640 1 -- 172.21.15.196:0/547412780 learned_addr learned my addr 172.21.15.196:0/547412780 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-03-17T23:55:54.240 INFO:teuthology.misc.health.smithi196.stderr:2024-03-17T23:55:54.236+0000 7fe58dd9b640 1 --2- 172.21.15.196:0/547412780 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe5900c8450 0x7fe59015a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:55:54.240 INFO:teuthology.misc.health.smithi196.stderr:2024-03-17T23:55:54.236+0000 7fe58ed9d640 1 --2- 172.21.15.196:0/547412780 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe590151ff0 0x7fe5901415b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:55:54.240 INFO:teuthology.misc.health.smithi196.stderr:2024-03-17T23:55:54.236+0000 7fe58e59c640 1 -- 172.21.15.196:0/547412780 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe590151ff0 msgr2=0x7fe5901415b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:55:54.240 INFO:teuthology.misc.health.smithi196.stderr:2024-03-17T23:55:54.236+0000 7fe58e59c640 1 --2- 172.21.15.196:0/547412780 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe590151ff0 0x7fe5901415b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:55:54.240 INFO:teuthology.misc.health.smithi196.stderr:2024-03-17T23:55:54.236+0000 7fe58e59c640 1 -- 172.21.15.196:0/547412780 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe5900c8450 msgr2=0x7fe59015a300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:55:54.240 INFO:teuthology.misc.health.smithi196.stderr:2024-03-17T23:55:54.236+0000 7fe58e59c640 1 --2- 172.21.15.196:0/547412780 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe5900c8450 0x7fe59015a300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:55:54.240 INFO:teuthology.misc.health.smithi196.stderr:2024-03-17T23:55:54.236+0000 7fe58e59c640 1 -- 172.21.15.196:0/547412780 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe590149c50 con 0x7fe5900c1f90 2024-03-17T23:55:54.240 INFO:teuthology.misc.health.smithi196.stderr:2024-03-17T23:55:54.236+0000 7fe58e59c640 1 --2- 172.21.15.196:0/547412780 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe5900c1f90 0x7fe590149630 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fe58800c7f0 tx=0x7fe58800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:55:54.240 INFO:teuthology.misc.health.smithi196.stderr:2024-03-17T23:55:54.236+0000 7fe586ffd640 1 -- 172.21.15.196:0/547412780 <== mon.0 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe588015070 con 0x7fe5900c1f90 2024-03-17T23:55:54.240 INFO:teuthology.misc.health.smithi196.stderr:2024-03-17T23:55:54.236+0000 7fe586ffd640 1 -- 172.21.15.196:0/547412780 <== mon.0 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe588004240 con 0x7fe5900c1f90 2024-03-17T23:55:54.240 INFO:teuthology.misc.health.smithi196.stderr:2024-03-17T23:55:54.236+0000 7fe586ffd640 1 -- 172.21.15.196:0/547412780 <== mon.0 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe588003620 con 0x7fe5900c1f90 2024-03-17T23:55:54.241 INFO:teuthology.misc.health.smithi196.stderr:2024-03-17T23:55:54.236+0000 7fe594e69640 1 -- 172.21.15.196:0/547412780 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe59014b310 con 0x7fe5900c1f90 2024-03-17T23:55:54.241 INFO:teuthology.misc.health.smithi196.stderr:2024-03-17T23:55:54.236+0000 7fe594e69640 1 -- 172.21.15.196:0/547412780 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe59014b890 con 0x7fe5900c1f90 2024-03-17T23:55:54.241 INFO:teuthology.misc.health.smithi196.stderr:2024-03-17T23:55:54.240+0000 7fe594e69640 1 -- 172.21.15.196:0/547412780 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe590068bc0 con 0x7fe5900c1f90 2024-03-17T23:55:54.241 INFO:teuthology.misc.health.smithi196.stderr:2024-03-17T23:55:54.240+0000 7fe586ffd640 1 -- 172.21.15.196:0/547412780 <== mon.0 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 4) ==== 87027+0+0 (secure 0 0 0) 0x7fe5880039d0 con 0x7fe5900c1f90 2024-03-17T23:55:54.241 INFO:teuthology.misc.health.smithi196.stderr:2024-03-17T23:55:54.240+0000 7fe586ffd640 1 --2- 172.21.15.196:0/547412780 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7fe5700675d0 0x7fe570069a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:55:54.242 INFO:teuthology.misc.health.smithi196.stderr:2024-03-17T23:55:54.240+0000 7fe586ffd640 1 -- 172.21.15.196:0/547412780 <== mon.0 v2:172.21.15.196:3300/0 5 ==== osd_map(13..13 src has 1..13) ==== 4471+0+0 (secure 0 0 0) 0x7fe5880852d0 con 0x7fe5900c1f90 2024-03-17T23:55:54.242 INFO:teuthology.misc.health.smithi196.stderr:2024-03-17T23:55:54.240+0000 7fe58dd9b640 1 --2- 172.21.15.196:0/547412780 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7fe5700675d0 0x7fe570069a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:55:54.242 INFO:teuthology.misc.health.smithi196.stderr:2024-03-17T23:55:54.240+0000 7fe58dd9b640 1 --2- 172.21.15.196:0/547412780 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7fe5700675d0 0x7fe570069a90 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fe5780ae000 tx=0x7fe578008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:55:54.245 INFO:teuthology.misc.health.smithi196.stderr:2024-03-17T23:55:54.244+0000 7fe586ffd640 1 -- 172.21.15.196:0/547412780 <== mon.0 v2:172.21.15.196:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177849 (secure 0 0 0) 0x7fe588056590 con 0x7fe5900c1f90 2024-03-17T23:55:54.392 INFO:teuthology.misc.health.smithi196.stderr:2024-03-17T23:55:54.392+0000 7fe594e69640 1 -- 172.21.15.196:0/547412780 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe59014e8e0 con 0x7fe5900c1f90 2024-03-17T23:55:54.394 INFO:teuthology.misc.health.smithi196.stderr:2024-03-17T23:55:54.392+0000 7fe586ffd640 1 -- 172.21.15.196:0/547412780 <== mon.0 v2:172.21.15.196:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v13) ==== 74+0+10945 (secure 0 0 0) 0x7fe588055e90 con 0x7fe5900c1f90 2024-03-17T23:55:54.394 INFO:teuthology.misc.health.smithi196.stdout: 2024-03-17T23:55:54.394 INFO:teuthology.misc.health.smithi196.stdout:{"epoch":13,"fsid":"b80f9c80-17ad-4126-8957-4c0c46f5b803","created":"2024-03-17T23:55:43.368838+0000","modified":"2024-03-17T23:55:54.132187+0000","last_up_change":"2024-03-17T23:55:54.132187+0000","last_in_change":"2024-03-17T23:55:46.016435+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"224d699f-bc10-4661-a8b5-6ca73290ffa0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6806","nonce":1194547591},{"type":"v1","addr":"172.21.15.196:6807","nonce":1194547591}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6809","nonce":1194547591},{"type":"v1","addr":"172.21.15.196:6811","nonce":1194547591}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6814","nonce":1194547591},{"type":"v1","addr":"172.21.15.196:6815","nonce":1194547591}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6812","nonce":1194547591},{"type":"v1","addr":"172.21.15.196:6813","nonce":1194547591}]},"public_addr":"172.21.15.196:6807/1194547591","cluster_addr":"172.21.15.196:6811/1194547591","heartbeat_back_addr":"172.21.15.196:6815/1194547591","heartbeat_front_addr":"172.21.15.196:6813/1194547591","state":["exists","up"]},{"osd":1,"uuid":"d8d6a0b0-450b-4ab5-b143-d4f36286e81e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6800","nonce":1901246986},{"type":"v1","addr":"172.21.15.196:6801","nonce":1901246986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6802","nonce":1901246986},{"type":"v1","addr":"172.21.15.196:6803","nonce":1901246986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6808","nonce":1901246986},{"type":"v1","addr":"172.21.15.196:6810","nonce":1901246986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6804","nonce":1901246986},{"type":"v1","addr":"172.21.15.196:6805","nonce":1901246986}]},"public_addr":"172.21.15.196:6801/1901246986","cluster_addr":"172.21.15.196:6803/1901246986","heartbeat_back_addr":"172.21.15.196:6810/1901246986","heartbeat_front_addr":"172.21.15.196:6805/1901246986","state":["exists","up"]},{"osd":2,"uuid":"d732ba94-1db0-41ed-930a-5abb6188980a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6824","nonce":673819559},{"type":"v1","addr":"172.21.15.196:6825","nonce":673819559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6826","nonce":673819559},{"type":"v1","addr":"172.21.15.196:6827","nonce":673819559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6830","nonce":673819559},{"type":"v1","addr":"172.21.15.196:6831","nonce":673819559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6828","nonce":673819559},{"type":"v1","addr":"172.21.15.196:6829","nonce":673819559}]},"public_addr":"172.21.15.196:6825/673819559","cluster_addr":"172.21.15.196:6827/673819559","heartbeat_back_addr":"172.21.15.196:6831/673819559","heartbeat_front_addr":"172.21.15.196:6829/673819559","state":["exists","up"]},{"osd":3,"uuid":"b79cab98-a49f-4544-b6b0-546dcfbd47a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6816","nonce":1104340623},{"type":"v1","addr":"172.21.15.196:6817","nonce":1104340623}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6818","nonce":1104340623},{"type":"v1","addr":"172.21.15.196:6819","nonce":1104340623}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6822","nonce":1104340623},{"type":"v1","addr":"172.21.15.196:6823","nonce":1104340623}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6820","nonce":1104340623},{"type":"v1","addr":"172.21.15.196:6821","nonce":1104340623}]},"public_addr":"172.21.15.196:6817/1104340623","cluster_addr":"172.21.15.196:6819/1104340623","heartbeat_back_addr":"172.21.15.196:6823/1104340623","heartbeat_front_addr":"172.21.15.196:6821/1104340623","state":["exists","up"]},{"osd":4,"uuid":"d5892856-6eb4-4188-beb0-368f64169af1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6816","nonce":658561863},{"type":"v1","addr":"172.21.15.204:6818","nonce":658561863}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6819","nonce":658561863},{"type":"v1","addr":"172.21.15.204:6821","nonce":658561863}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6826","nonce":658561863},{"type":"v1","addr":"172.21.15.204:6828","nonce":658561863}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6823","nonce":658561863},{"type":"v1","addr":"172.21.15.204:6825","nonce":658561863}]},"public_addr":"172.21.15.204:6818/658561863","cluster_addr":"172.21.15.204:6821/658561863","heartbeat_back_addr":"172.21.15.204:6828/658561863","heartbeat_front_addr":"172.21.15.204:6825/658561863","state":["exists","up"]},{"osd":5,"uuid":"89d6b48d-aa8a-4cb8-aa2e-e0aae04928b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6817","nonce":3367327749},{"type":"v1","addr":"172.21.15.204:6820","nonce":3367327749}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6822","nonce":3367327749},{"type":"v1","addr":"172.21.15.204:6824","nonce":3367327749}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6830","nonce":3367327749},{"type":"v1","addr":"172.21.15.204:6831","nonce":3367327749}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6827","nonce":3367327749},{"type":"v1","addr":"172.21.15.204:6829","nonce":3367327749}]},"public_addr":"172.21.15.204:6820/3367327749","cluster_addr":"172.21.15.204:6824/3367327749","heartbeat_back_addr":"172.21.15.204:6831/3367327749","heartbeat_front_addr":"172.21.15.204:6829/3367327749","state":["exists","up"]},{"osd":6,"uuid":"ff7d0949-2836-42a6-a63d-bc5a4269e080","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6805","nonce":2586742078},{"type":"v1","addr":"172.21.15.204:6807","nonce":2586742078}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6809","nonce":2586742078},{"type":"v1","addr":"172.21.15.204:6811","nonce":2586742078}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6814","nonce":2586742078},{"type":"v1","addr":"172.21.15.204:6815","nonce":2586742078}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6812","nonce":2586742078},{"type":"v1","addr":"172.21.15.204:6813","nonce":2586742078}]},"public_addr":"172.21.15.204:6807/2586742078","cluster_addr":"172.21.15.204:6811/2586742078","heartbeat_back_addr":"172.21.15.204:6815/2586742078","heartbeat_front_addr":"172.21.15.204:6813/2586742078","state":["exists","up"]},{"osd":7,"uuid":"42bcc14b-70b3-4c59-bf81-41436e4eb272","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6800","nonce":3361860686},{"type":"v1","addr":"172.21.15.204:6801","nonce":3361860686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6802","nonce":3361860686},{"type":"v1","addr":"172.21.15.204:6803","nonce":3361860686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6808","nonce":3361860686},{"type":"v1","addr":"172.21.15.204:6810","nonce":3361860686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6804","nonce":3361860686},{"type":"v1","addr":"172.21.15.204:6806","nonce":3361860686}]},"public_addr":"172.21.15.204:6801/3361860686","cluster_addr":"172.21.15.204:6803/3361860686","heartbeat_back_addr":"172.21.15.204:6810/3361860686","heartbeat_front_addr":"172.21.15.204:6806/3361860686","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-17T23:55:54.396 INFO:teuthology.misc.health.smithi196.stderr:2024-03-17T23:55:54.392+0000 7fe594e69640 1 -- 172.21.15.196:0/547412780 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7fe5700675d0 msgr2=0x7fe570069a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:55:54.396 INFO:teuthology.misc.health.smithi196.stderr:2024-03-17T23:55:54.392+0000 7fe594e69640 1 --2- 172.21.15.196:0/547412780 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7fe5700675d0 0x7fe570069a90 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fe5780ae000 tx=0x7fe578008040 comp rx=0 tx=0).stop 2024-03-17T23:55:54.396 INFO:teuthology.misc.health.smithi196.stderr:2024-03-17T23:55:54.392+0000 7fe594e69640 1 -- 172.21.15.196:0/547412780 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe5900c1f90 msgr2=0x7fe590149630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:55:54.396 INFO:teuthology.misc.health.smithi196.stderr:2024-03-17T23:55:54.392+0000 7fe594e69640 1 --2- 172.21.15.196:0/547412780 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe5900c1f90 0x7fe590149630 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fe58800c7f0 tx=0x7fe58800ccb0 comp rx=0 tx=0).stop 2024-03-17T23:55:54.397 INFO:teuthology.misc.health.smithi196.stderr:2024-03-17T23:55:54.396+0000 7fe594e69640 1 -- 172.21.15.196:0/547412780 shutdown_connections 2024-03-17T23:55:54.397 INFO:teuthology.misc.health.smithi196.stderr:2024-03-17T23:55:54.396+0000 7fe594e69640 1 --2- 172.21.15.196:0/547412780 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7fe5700675d0 0x7fe570069a90 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:55:54.397 INFO:teuthology.misc.health.smithi196.stderr:2024-03-17T23:55:54.396+0000 7fe594e69640 1 --2- 172.21.15.196:0/547412780 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe590151ff0 0x7fe5901415b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:55:54.397 INFO:teuthology.misc.health.smithi196.stderr:2024-03-17T23:55:54.396+0000 7fe594e69640 1 --2- 172.21.15.196:0/547412780 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe5900c8450 0x7fe59015a300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:55:54.397 INFO:teuthology.misc.health.smithi196.stderr:2024-03-17T23:55:54.396+0000 7fe594e69640 1 --2- 172.21.15.196:0/547412780 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe5900c1f90 0x7fe590149630 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:55:54.397 INFO:teuthology.misc.health.smithi196.stderr:2024-03-17T23:55:54.396+0000 7fe594e69640 1 -- 172.21.15.196:0/547412780 >> 172.21.15.196:0/547412780 conn(0x7fe5900cb650 msgr2=0x7fe590158190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-17T23:55:54.397 INFO:teuthology.misc.health.smithi196.stderr:2024-03-17T23:55:54.396+0000 7fe594e69640 1 -- 172.21.15.196:0/547412780 shutdown_connections 2024-03-17T23:55:54.397 INFO:teuthology.misc.health.smithi196.stderr:2024-03-17T23:55:54.396+0000 7fe594e69640 1 -- 172.21.15.196:0/547412780 wait complete. 2024-03-17T23:55:54.410 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-03-17T23:55:54.410 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-03-17T23:55:54.411 INFO:tasks.ceph.mds.a:Restarting daemon 2024-03-17T23:55:54.411 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-mds -f --cluster ceph -i a 2024-03-17T23:55:54.413 INFO:tasks.ceph.mds.a:Started 2024-03-17T23:55:54.413 INFO:tasks.ceph.mds.c:Restarting daemon 2024-03-17T23:55:54.413 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-mds -f --cluster ceph -i c 2024-03-17T23:55:54.416 INFO:tasks.ceph.mds.c:Started 2024-03-17T23:55:54.416 INFO:tasks.ceph.mds.e:Restarting daemon 2024-03-17T23:55:54.416 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-mds -f --cluster ceph -i e 2024-03-17T23:55:54.418 INFO:tasks.ceph.mds.e:Started 2024-03-17T23:55:54.418 INFO:tasks.ceph.mds.b:Restarting daemon 2024-03-17T23:55:54.418 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-mds -f --cluster ceph -i b 2024-03-17T23:55:54.422 INFO:tasks.ceph.mds.b:Started 2024-03-17T23:55:54.424 INFO:tasks.ceph.mds.d:Restarting daemon 2024-03-17T23:55:54.424 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-mds -f --cluster ceph -i d 2024-03-17T23:55:54.426 INFO:tasks.ceph.mds.d:Started 2024-03-17T23:55:54.427 INFO:tasks.ceph.mds.f:Restarting daemon 2024-03-17T23:55:54.427 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-mds -f --cluster ceph -i f 2024-03-17T23:55:54.429 INFO:tasks.ceph.mds.f:Started 2024-03-17T23:55:54.429 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-03-17T23:55:54.429 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-17T23:55:54.540 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:54.536+0000 7fc6c57e0640 1 Processor -- start 2024-03-17T23:55:54.540 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:54.536+0000 7fc6c57e0640 1 -- start start 2024-03-17T23:55:54.541 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:54.540+0000 7fc6c57e0640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fc6c0154340 0x7fc6c00c8d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:55:54.541 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:54.540+0000 7fc6c57e0640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc6c015d5d0 con 0x7fc6c0153f60 2024-03-17T23:55:54.541 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:54.540+0000 7fc6c57e0640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc6c015d8b0 con 0x7fc6c015aa70 2024-03-17T23:55:54.541 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:54.540+0000 7fc6c57e0640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7fc6c0072770 con 0x7fc6c0154340 2024-03-17T23:55:54.541 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:54.540+0000 7fc6b7fff640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fc6c0154340 0x7fc6c00c8d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:55:54.541 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:54.540+0000 7fc6beffd640 1 --1- >> v1:172.21.15.196:6789/0 conn(0x7fc6c0153f60 0x7fc6c00705f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.196:6789/0 says I am v1:172.21.15.196:60860/0 (socket says 172.21.15.196:60860) 2024-03-17T23:55:54.541 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:54.540+0000 7fc6beffd640 1 -- 172.21.15.196:0/3492438121 learned_addr learned my addr 172.21.15.196:0/3492438121 (peer_addr_for_me v1:172.21.15.196:0/0) 2024-03-17T23:55:54.541 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:54.540+0000 7fc6b7fff640 1 -- 172.21.15.196:0/3492438121 >> v1:172.21.15.204:6789/0 conn(0x7fc6c015aa70 legacy=0x7fc6c0072c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-17T23:55:54.542 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:54.540+0000 7fc6b7fff640 1 -- 172.21.15.196:0/3492438121 >> v1:172.21.15.196:6789/0 conn(0x7fc6c0153f60 legacy=0x7fc6c00705f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:55:54.542 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:54.540+0000 7fc6b7fff640 1 -- 172.21.15.196:0/3492438121 --> v2:172.21.15.196:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6c015db90 con 0x7fc6c0154340 2024-03-17T23:55:54.542 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:54.540+0000 7fc6be7fc640 1 -- 172.21.15.196:0/3492438121 <== mon.0 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2599401223 0 0) 0x7fc6c015d5d0 con 0x7fc6c0153f60 2024-03-17T23:55:54.544 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:54.540+0000 7fc6b7fff640 1 --2- 172.21.15.196:0/3492438121 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc6c0154340 0x7fc6c00c8d60 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fc6a80097c0 tx=0x7fc6a801ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ffa9a25fb526370 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:55:54.544 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:54.540+0000 7fc6be7fc640 1 -- 172.21.15.196:0/3492438121 <== mon.0 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6a80b5070 con 0x7fc6c0154340 2024-03-17T23:55:54.544 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:54.540+0000 7fc6be7fc640 1 -- 172.21.15.196:0/3492438121 <== mon.0 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc6a80a8950 con 0x7fc6c0154340 2024-03-17T23:55:54.544 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:54.540+0000 7fc6be7fc640 1 -- 172.21.15.196:0/3492438121 <== mon.0 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6a80a8d20 con 0x7fc6c0154340 2024-03-17T23:55:54.544 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:54.544+0000 7fc6c57e0640 1 -- 172.21.15.196:0/3492438121 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc6c0154340 msgr2=0x7fc6c00c8d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:55:54.544 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:54.544+0000 7fc6c57e0640 1 --2- 172.21.15.196:0/3492438121 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc6c0154340 0x7fc6c00c8d60 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fc6a80097c0 tx=0x7fc6a801ec50 comp rx=0 tx=0).stop 2024-03-17T23:55:54.544 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:54.544+0000 7fc6c57e0640 1 -- 172.21.15.196:0/3492438121 shutdown_connections 2024-03-17T23:55:54.544 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:54.544+0000 7fc6c57e0640 1 --2- 172.21.15.196:0/3492438121 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc6c0154340 0x7fc6c00c8d60 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:55:54.544 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:54.544+0000 7fc6c57e0640 1 -- 172.21.15.196:0/3492438121 >> 172.21.15.196:0/3492438121 conn(0x7fc6c006c3c0 msgr2=0x7fc6c006c7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-17T23:55:54.545 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:54.544+0000 7fc6c57e0640 1 -- 172.21.15.196:0/3492438121 shutdown_connections 2024-03-17T23:55:54.545 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:54.544+0000 7fc6c57e0640 1 -- 172.21.15.196:0/3492438121 wait complete. 2024-03-17T23:55:54.545 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:54.544+0000 7fc6c57e0640 1 Processor -- start 2024-03-17T23:55:54.545 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:54.544+0000 7fc6c57e0640 1 -- start start 2024-03-17T23:55:54.548 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:54.544+0000 7fc6c57e0640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc6c0153f60 0x7fc6c01e3710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:55:54.548 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:54.544+0000 7fc6c57e0640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc6c0154340 0x7fc6c015ca50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:55:54.548 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:54.544+0000 7fc6c57e0640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc6c015aa70 0x7fc6c01e4350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:55:54.548 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:54.544+0000 7fc6c57e0640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fc6c015e150 con 0x7fc6c015aa70 2024-03-17T23:55:54.548 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:54.544+0000 7fc6c57e0640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7fc6c015d380 con 0x7fc6c0153f60 2024-03-17T23:55:54.548 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:54.544+0000 7fc6c57e0640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7fc6c0070d00 con 0x7fc6c0154340 2024-03-17T23:55:54.548 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:54.544+0000 7fc6bf7fe640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc6c015aa70 0x7fc6c01e4350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:55:54.548 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:54.544+0000 7fc6bf7fe640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc6c015aa70 0x7fc6c01e4350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.196:56136/0 (socket says 172.21.15.196:56136) 2024-03-17T23:55:54.548 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:54.544+0000 7fc6bf7fe640 1 -- 172.21.15.196:0/1234236777 learned_addr learned my addr 172.21.15.196:0/1234236777 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-03-17T23:55:54.548 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:54.544+0000 7fc6beffd640 1 --2- 172.21.15.196:0/1234236777 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc6c0153f60 0x7fc6c01e3710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:55:54.548 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:54.544+0000 7fc6b7fff640 1 --2- 172.21.15.196:0/1234236777 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc6c0154340 0x7fc6c015ca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:55:54.548 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:54.544+0000 7fc6bf7fe640 1 -- 172.21.15.196:0/1234236777 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc6c0154340 msgr2=0x7fc6c015ca50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:55:54.549 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:54.544+0000 7fc6bf7fe640 1 --2- 172.21.15.196:0/1234236777 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc6c0154340 0x7fc6c015ca50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:55:54.549 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:54.544+0000 7fc6bf7fe640 1 -- 172.21.15.196:0/1234236777 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc6c0153f60 msgr2=0x7fc6c01e3710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:55:54.549 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:54.544+0000 7fc6bf7fe640 1 --2- 172.21.15.196:0/1234236777 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc6c0153f60 0x7fc6c01e3710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:55:54.549 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:54.544+0000 7fc6bf7fe640 1 -- 172.21.15.196:0/1234236777 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6c0158ba0 con 0x7fc6c015aa70 2024-03-17T23:55:54.549 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:54.544+0000 7fc6beffd640 1 --2- 172.21.15.196:0/1234236777 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc6c0153f60 0x7fc6c01e3710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-17T23:55:54.549 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:54.544+0000 7fc6bf7fe640 1 --2- 172.21.15.196:0/1234236777 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc6c015aa70 0x7fc6c01e4350 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fc6b800b990 tx=0x7fc6b800be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:55:54.549 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:54.544+0000 7fc6b77fe640 1 -- 172.21.15.196:0/1234236777 <== mon.0 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6b8019070 con 0x7fc6c015aa70 2024-03-17T23:55:54.549 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:54.544+0000 7fc6b77fe640 1 -- 172.21.15.196:0/1234236777 <== mon.0 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc6b800cb40 con 0x7fc6c015aa70 2024-03-17T23:55:54.549 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:54.544+0000 7fc6b77fe640 1 -- 172.21.15.196:0/1234236777 <== mon.0 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6b8014440 con 0x7fc6c015aa70 2024-03-17T23:55:54.549 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:54.544+0000 7fc6c57e0640 1 -- 172.21.15.196:0/1234236777 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6c01e3f30 con 0x7fc6c015aa70 2024-03-17T23:55:54.549 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:54.544+0000 7fc6c57e0640 1 -- 172.21.15.196:0/1234236777 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6c01580c0 con 0x7fc6c015aa70 2024-03-17T23:55:54.549 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:54.544+0000 7fc6c57e0640 1 -- 172.21.15.196:0/1234236777 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc6c00689a0 con 0x7fc6c015aa70 2024-03-17T23:55:54.549 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:54.548+0000 7fc6b77fe640 1 -- 172.21.15.196:0/1234236777 <== mon.0 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 4) ==== 87027+0+0 (secure 0 0 0) 0x7fc6b8007370 con 0x7fc6c015aa70 2024-03-17T23:55:54.550 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:54.548+0000 7fc6b77fe640 1 --2- 172.21.15.196:0/1234236777 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7fc6a0067600 0x7fc6a0069ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:55:54.550 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:54.548+0000 7fc6b77fe640 1 -- 172.21.15.196:0/1234236777 <== mon.0 v2:172.21.15.196:3300/0 5 ==== osd_map(13..13 src has 1..13) ==== 4471+0+0 (secure 0 0 0) 0x7fc6b8084ed0 con 0x7fc6c015aa70 2024-03-17T23:55:54.550 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:54.548+0000 7fc6beffd640 1 --2- 172.21.15.196:0/1234236777 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7fc6a0067600 0x7fc6a0069ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:55:54.550 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:54.548+0000 7fc6beffd640 1 --2- 172.21.15.196:0/1234236777 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7fc6a0067600 0x7fc6a0069ac0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fc6b0000f70 tx=0x7fc6b0009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:55:54.552 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:54.552+0000 7fc6b77fe640 1 -- 172.21.15.196:0/1234236777 <== mon.0 v2:172.21.15.196:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177849 (secure 0 0 0) 0x7fc6b8056100 con 0x7fc6c015aa70 2024-03-17T23:55:54.589 INFO:tasks.ceph.mds.b.smithi204.stdout:starting mds.b at 2024-03-17T23:55:54.598 INFO:tasks.ceph.mds.d.smithi204.stdout:starting mds.d at 2024-03-17T23:55:54.601 INFO:tasks.ceph.mds.f.smithi204.stdout:starting mds.f at 2024-03-17T23:55:54.670 INFO:tasks.ceph.mds.a.smithi196.stdout:starting mds.a at 2024-03-17T23:55:54.675 INFO:tasks.ceph.mds.e.smithi196.stdout:starting mds.e at 2024-03-17T23:55:54.678 INFO:tasks.ceph.mds.c.smithi196.stdout:starting mds.c at 2024-03-17T23:55:54.726 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:54.724+0000 7fc6c57e0640 1 -- 172.21.15.196:0/1234236777 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc6c00c8600 con 0x7fc6c015aa70 2024-03-17T23:55:54.726 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:54.724+0000 7fc6b77fe640 1 -- 172.21.15.196:0/1234236777 <== mon.0 v2:172.21.15.196:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v13) ==== 74+0+10945 (secure 0 0 0) 0x7fc6b8055a00 con 0x7fc6c015aa70 2024-03-17T23:55:54.727 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-03-17T23:55:54.727 INFO:teuthology.orchestra.run.smithi196.stdout:{"epoch":13,"fsid":"b80f9c80-17ad-4126-8957-4c0c46f5b803","created":"2024-03-17T23:55:43.368838+0000","modified":"2024-03-17T23:55:54.132187+0000","last_up_change":"2024-03-17T23:55:54.132187+0000","last_in_change":"2024-03-17T23:55:46.016435+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"224d699f-bc10-4661-a8b5-6ca73290ffa0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6806","nonce":1194547591},{"type":"v1","addr":"172.21.15.196:6807","nonce":1194547591}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6809","nonce":1194547591},{"type":"v1","addr":"172.21.15.196:6811","nonce":1194547591}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6814","nonce":1194547591},{"type":"v1","addr":"172.21.15.196:6815","nonce":1194547591}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6812","nonce":1194547591},{"type":"v1","addr":"172.21.15.196:6813","nonce":1194547591}]},"public_addr":"172.21.15.196:6807/1194547591","cluster_addr":"172.21.15.196:6811/1194547591","heartbeat_back_addr":"172.21.15.196:6815/1194547591","heartbeat_front_addr":"172.21.15.196:6813/1194547591","state":["exists","up"]},{"osd":1,"uuid":"d8d6a0b0-450b-4ab5-b143-d4f36286e81e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6800","nonce":1901246986},{"type":"v1","addr":"172.21.15.196:6801","nonce":1901246986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6802","nonce":1901246986},{"type":"v1","addr":"172.21.15.196:6803","nonce":1901246986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6808","nonce":1901246986},{"type":"v1","addr":"172.21.15.196:6810","nonce":1901246986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6804","nonce":1901246986},{"type":"v1","addr":"172.21.15.196:6805","nonce":1901246986}]},"public_addr":"172.21.15.196:6801/1901246986","cluster_addr":"172.21.15.196:6803/1901246986","heartbeat_back_addr":"172.21.15.196:6810/1901246986","heartbeat_front_addr":"172.21.15.196:6805/1901246986","state":["exists","up"]},{"osd":2,"uuid":"d732ba94-1db0-41ed-930a-5abb6188980a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6824","nonce":673819559},{"type":"v1","addr":"172.21.15.196:6825","nonce":673819559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6826","nonce":673819559},{"type":"v1","addr":"172.21.15.196:6827","nonce":673819559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6830","nonce":673819559},{"type":"v1","addr":"172.21.15.196:6831","nonce":673819559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6828","nonce":673819559},{"type":"v1","addr":"172.21.15.196:6829","nonce":673819559}]},"public_addr":"172.21.15.196:6825/673819559","cluster_addr":"172.21.15.196:6827/673819559","heartbeat_back_addr":"172.21.15.196:6831/673819559","heartbeat_front_addr":"172.21.15.196:6829/673819559","state":["exists","up"]},{"osd":3,"uuid":"b79cab98-a49f-4544-b6b0-546dcfbd47a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6816","nonce":1104340623},{"type":"v1","addr":"172.21.15.196:6817","nonce":1104340623}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6818","nonce":1104340623},{"type":"v1","addr":"172.21.15.196:6819","nonce":1104340623}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6822","nonce":1104340623},{"type":"v1","addr":"172.21.15.196:6823","nonce":1104340623}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6820","nonce":1104340623},{"type":"v1","addr":"172.21.15.196:6821","nonce":1104340623}]},"public_addr":"172.21.15.196:6817/1104340623","cluster_addr":"172.21.15.196:6819/1104340623","heartbeat_back_addr":"172.21.15.196:6823/1104340623","heartbeat_front_addr":"172.21.15.196:6821/1104340623","state":["exists","up"]},{"osd":4,"uuid":"d5892856-6eb4-4188-beb0-368f64169af1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6816","nonce":658561863},{"type":"v1","addr":"172.21.15.204:6818","nonce":658561863}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6819","nonce":658561863},{"type":"v1","addr":"172.21.15.204:6821","nonce":658561863}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6826","nonce":658561863},{"type":"v1","addr":"172.21.15.204:6828","nonce":658561863}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6823","nonce":658561863},{"type":"v1","addr":"172.21.15.204:6825","nonce":658561863}]},"public_addr":"172.21.15.204:6818/658561863","cluster_addr":"172.21.15.204:6821/658561863","heartbeat_back_addr":"172.21.15.204:6828/658561863","heartbeat_front_addr":"172.21.15.204:6825/658561863","state":["exists","up"]},{"osd":5,"uuid":"89d6b48d-aa8a-4cb8-aa2e-e0aae04928b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6817","nonce":3367327749},{"type":"v1","addr":"172.21.15.204:6820","nonce":3367327749}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6822","nonce":3367327749},{"type":"v1","addr":"172.21.15.204:6824","nonce":3367327749}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6830","nonce":3367327749},{"type":"v1","addr":"172.21.15.204:6831","nonce":3367327749}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6827","nonce":3367327749},{"type":"v1","addr":"172.21.15.204:6829","nonce":3367327749}]},"public_addr":"172.21.15.204:6820/3367327749","cluster_addr":"172.21.15.204:6824/3367327749","heartbeat_back_addr":"172.21.15.204:6831/3367327749","heartbeat_front_addr":"172.21.15.204:6829/3367327749","state":["exists","up"]},{"osd":6,"uuid":"ff7d0949-2836-42a6-a63d-bc5a4269e080","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6805","nonce":2586742078},{"type":"v1","addr":"172.21.15.204:6807","nonce":2586742078}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6809","nonce":2586742078},{"type":"v1","addr":"172.21.15.204:6811","nonce":2586742078}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6814","nonce":2586742078},{"type":"v1","addr":"172.21.15.204:6815","nonce":2586742078}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6812","nonce":2586742078},{"type":"v1","addr":"172.21.15.204:6813","nonce":2586742078}]},"public_addr":"172.21.15.204:6807/2586742078","cluster_addr":"172.21.15.204:6811/2586742078","heartbeat_back_addr":"172.21.15.204:6815/2586742078","heartbeat_front_addr":"172.21.15.204:6813/2586742078","state":["exists","up"]},{"osd":7,"uuid":"42bcc14b-70b3-4c59-bf81-41436e4eb272","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6800","nonce":3361860686},{"type":"v1","addr":"172.21.15.204:6801","nonce":3361860686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6802","nonce":3361860686},{"type":"v1","addr":"172.21.15.204:6803","nonce":3361860686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6808","nonce":3361860686},{"type":"v1","addr":"172.21.15.204:6810","nonce":3361860686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6804","nonce":3361860686},{"type":"v1","addr":"172.21.15.204:6806","nonce":3361860686}]},"public_addr":"172.21.15.204:6801/3361860686","cluster_addr":"172.21.15.204:6803/3361860686","heartbeat_back_addr":"172.21.15.204:6810/3361860686","heartbeat_front_addr":"172.21.15.204:6806/3361860686","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-17T23:55:54.729 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:54.728+0000 7fc6c57e0640 1 -- 172.21.15.196:0/1234236777 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7fc6a0067600 msgr2=0x7fc6a0069ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:55:54.729 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:54.728+0000 7fc6c57e0640 1 --2- 172.21.15.196:0/1234236777 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7fc6a0067600 0x7fc6a0069ac0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fc6b0000f70 tx=0x7fc6b0009040 comp rx=0 tx=0).stop 2024-03-17T23:55:54.729 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:54.728+0000 7fc6c57e0640 1 -- 172.21.15.196:0/1234236777 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc6c015aa70 msgr2=0x7fc6c01e4350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:55:54.729 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:54.728+0000 7fc6c57e0640 1 --2- 172.21.15.196:0/1234236777 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc6c015aa70 0x7fc6c01e4350 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fc6b800b990 tx=0x7fc6b800be50 comp rx=0 tx=0).stop 2024-03-17T23:55:54.729 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:54.728+0000 7fc6c57e0640 1 -- 172.21.15.196:0/1234236777 shutdown_connections 2024-03-17T23:55:54.729 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:54.728+0000 7fc6c57e0640 1 --2- 172.21.15.196:0/1234236777 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7fc6a0067600 0x7fc6a0069ac0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:55:54.729 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:54.728+0000 7fc6c57e0640 1 --2- 172.21.15.196:0/1234236777 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc6c0154340 0x7fc6c015ca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:55:54.729 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:54.728+0000 7fc6c57e0640 1 --2- 172.21.15.196:0/1234236777 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc6c015aa70 0x7fc6c01e4350 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:55:54.729 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:54.728+0000 7fc6c57e0640 1 --2- 172.21.15.196:0/1234236777 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc6c0153f60 0x7fc6c01e3710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:55:54.729 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:54.728+0000 7fc6c57e0640 1 -- 172.21.15.196:0/1234236777 >> 172.21.15.196:0/1234236777 conn(0x7fc6c006c3c0 msgr2=0x7fc6c00c4870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-17T23:55:54.729 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:54.728+0000 7fc6c57e0640 1 -- 172.21.15.196:0/1234236777 shutdown_connections 2024-03-17T23:55:54.729 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:54.728+0000 7fc6c57e0640 1 -- 172.21.15.196:0/1234236777 wait complete. 2024-03-17T23:55:54.743 INFO:tasks.cephfs.filesystem.ceph_manager:[] 2024-03-17T23:55:54.743 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-17T23:55:54.849 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:54.848+0000 7fc046de0640 1 Processor -- start 2024-03-17T23:55:54.849 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:54.848+0000 7fc046de0640 1 -- start start 2024-03-17T23:55:54.851 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:54.848+0000 7fc046de0640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fc0401575c0 0x7fc04015ac40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:55:54.851 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:54.848+0000 7fc046de0640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fc0400c3120 0x7fc04015df80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:55:54.851 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:54.848+0000 7fc046de0640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc0400c80d0 con 0x7fc04006c3c0 2024-03-17T23:55:54.851 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:54.848+0000 7fc046de0640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7fc0400c3570 con 0x7fc0400c3120 2024-03-17T23:55:54.851 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:54.848+0000 7fc046de0640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 -- 0x7fc04015a7b0 con 0x7fc0401575c0 2024-03-17T23:55:54.851 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:54.848+0000 7fc04537d640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fc0400c3120 0x7fc04015df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:55:54.851 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:54.848+0000 7fc03ffff640 1 --1- >> v1:172.21.15.196:6789/0 conn(0x7fc04006c3c0 0x7fc04006f0f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.196:6789/0 says I am v1:172.21.15.196:60888/0 (socket says 172.21.15.196:60888) 2024-03-17T23:55:54.851 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:54.848+0000 7fc03ffff640 1 -- 172.21.15.196:0/3825035946 learned_addr learned my addr 172.21.15.196:0/3825035946 (peer_addr_for_me v1:172.21.15.196:0/0) 2024-03-17T23:55:54.851 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:54.848+0000 7fc044b7c640 1 --2- 172.21.15.196:0/3825035946 >> v2:172.21.15.204:3300/0 conn(0x7fc0401575c0 0x7fc04015ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:55:54.851 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:54.848+0000 7fc04537d640 1 -- 172.21.15.196:0/3825035946 >> v2:172.21.15.204:3300/0 conn(0x7fc0401575c0 msgr2=0x7fc04015ac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-17T23:55:54.851 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:54.848+0000 7fc04537d640 1 --2- 172.21.15.196:0/3825035946 >> v2:172.21.15.204:3300/0 conn(0x7fc0401575c0 0x7fc04015ac40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:55:54.851 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:54.848+0000 7fc04537d640 1 -- 172.21.15.196:0/3825035946 >> v1:172.21.15.196:6789/0 conn(0x7fc04006c3c0 legacy=0x7fc04006f0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:55:54.851 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:54.848+0000 7fc04537d640 1 -- 172.21.15.196:0/3825035946 --> v2:172.21.15.196:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0400c83b0 con 0x7fc0400c3120 2024-03-17T23:55:54.852 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:54.848+0000 7fc03f7fe640 1 -- 172.21.15.196:0/3825035946 <== mon.0 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4285132079 0 0) 0x7fc0400c80d0 con 0x7fc04006c3c0 2024-03-17T23:55:54.853 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:54.852+0000 7fc04537d640 1 --2- 172.21.15.196:0/3825035946 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc0400c3120 0x7fc04015df80 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fc0400720b0 tx=0x7fc03801f110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29459f288e9268d7 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:55:54.853 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:54.852+0000 7fc03f7fe640 1 -- 172.21.15.196:0/3825035946 <== mon.0 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0380b4070 con 0x7fc0400c3120 2024-03-17T23:55:54.853 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:54.852+0000 7fc03f7fe640 1 -- 172.21.15.196:0/3825035946 <== mon.0 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc0380af600 con 0x7fc0400c3120 2024-03-17T23:55:54.853 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:54.852+0000 7fc03f7fe640 1 -- 172.21.15.196:0/3825035946 <== mon.0 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0380af9d0 con 0x7fc0400c3120 2024-03-17T23:55:54.854 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:54.852+0000 7fc046de0640 1 -- 172.21.15.196:0/3825035946 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc0400c3120 msgr2=0x7fc04015df80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:55:54.854 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:54.852+0000 7fc046de0640 1 --2- 172.21.15.196:0/3825035946 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc0400c3120 0x7fc04015df80 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fc0400720b0 tx=0x7fc03801f110 comp rx=0 tx=0).stop 2024-03-17T23:55:54.854 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:54.852+0000 7fc046de0640 1 -- 172.21.15.196:0/3825035946 shutdown_connections 2024-03-17T23:55:54.854 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:54.852+0000 7fc046de0640 1 --2- 172.21.15.196:0/3825035946 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc0400c3120 0x7fc04015df80 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:55:54.854 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:54.852+0000 7fc046de0640 1 --2- 172.21.15.196:0/3825035946 >> v2:172.21.15.204:3300/0 conn(0x7fc0401575c0 0x7fc04015ac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:55:54.854 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:54.852+0000 7fc046de0640 1 -- 172.21.15.196:0/3825035946 >> 172.21.15.196:0/3825035946 conn(0x7fc040071020 msgr2=0x7fc040071430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-17T23:55:54.854 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:54.852+0000 7fc046de0640 1 -- 172.21.15.196:0/3825035946 shutdown_connections 2024-03-17T23:55:54.854 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:54.852+0000 7fc046de0640 1 -- 172.21.15.196:0/3825035946 wait complete. 2024-03-17T23:55:54.856 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:54.852+0000 7fc046de0640 1 Processor -- start 2024-03-17T23:55:54.857 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:54.852+0000 7fc046de0640 1 -- start start 2024-03-17T23:55:54.857 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:54.852+0000 7fc046de0640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc04006c3c0 0x7fc0400b0f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:55:54.857 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:54.852+0000 7fc046de0640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc0400c3120 0x7fc0401535f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:55:54.857 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:54.852+0000 7fc046de0640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc0401575c0 0x7fc0400b2650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:55:54.857 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:54.852+0000 7fc046de0640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fc0401579a0 con 0x7fc0401575c0 2024-03-17T23:55:54.857 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:54.852+0000 7fc046de0640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7fc04015a440 con 0x7fc04006c3c0 2024-03-17T23:55:54.857 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:54.852+0000 7fc046de0640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7fc0400c8690 con 0x7fc0400c3120 2024-03-17T23:55:54.857 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:54.852+0000 7fc04537d640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc0401575c0 0x7fc0400b2650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:55:54.857 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:54.852+0000 7fc04537d640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc0401575c0 0x7fc0400b2650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.196:56240/0 (socket says 172.21.15.196:56240) 2024-03-17T23:55:54.857 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:54.852+0000 7fc04537d640 1 -- 172.21.15.196:0/2256648592 learned_addr learned my addr 172.21.15.196:0/2256648592 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-03-17T23:55:54.858 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:54.852+0000 7fc04537d640 1 -- 172.21.15.196:0/2256648592 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc0400c3120 msgr2=0x7fc0401535f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:55:54.858 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:54.852+0000 7fc04537d640 1 --2- 172.21.15.196:0/2256648592 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc0400c3120 0x7fc0401535f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:55:54.858 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:54.852+0000 7fc04537d640 1 -- 172.21.15.196:0/2256648592 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc04006c3c0 msgr2=0x7fc0400b0f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:55:54.858 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:54.852+0000 7fc04537d640 1 --2- 172.21.15.196:0/2256648592 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc04006c3c0 0x7fc0400b0f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:55:54.858 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:54.852+0000 7fc04537d640 1 -- 172.21.15.196:0/2256648592 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0400b1be0 con 0x7fc0401575c0 2024-03-17T23:55:54.858 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:54.856+0000 7fc04537d640 1 --2- 172.21.15.196:0/2256648592 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc0401575c0 0x7fc0400b2650 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fc03801cd40 tx=0x7fc03801beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:55:54.858 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:54.856+0000 7fc03d7fa640 1 -- 172.21.15.196:0/2256648592 <== mon.0 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0380b4040 con 0x7fc0401575c0 2024-03-17T23:55:54.858 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:54.856+0000 7fc03d7fa640 1 -- 172.21.15.196:0/2256648592 <== mon.0 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc0380039a0 con 0x7fc0401575c0 2024-03-17T23:55:54.858 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:54.856+0000 7fc046de0640 1 -- 172.21.15.196:0/2256648592 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc0400cb9d0 con 0x7fc0401575c0 2024-03-17T23:55:54.858 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:54.856+0000 7fc03d7fa640 1 -- 172.21.15.196:0/2256648592 <== mon.0 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc038009450 con 0x7fc0401575c0 2024-03-17T23:55:54.858 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:54.856+0000 7fc046de0640 1 -- 172.21.15.196:0/2256648592 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0401f3a90 con 0x7fc0401575c0 2024-03-17T23:55:54.859 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:54.856+0000 7fc046de0640 1 -- 172.21.15.196:0/2256648592 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc0400689a0 con 0x7fc0401575c0 2024-03-17T23:55:54.859 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:54.856+0000 7fc03d7fa640 1 -- 172.21.15.196:0/2256648592 <== mon.0 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 4) ==== 87027+0+0 (secure 0 0 0) 0x7fc0380c4060 con 0x7fc0401575c0 2024-03-17T23:55:54.859 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:54.856+0000 7fc03d7fa640 1 --2- 172.21.15.196:0/2256648592 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7fc02c0675d0 0x7fc02c069a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:55:54.859 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:54.856+0000 7fc03d7fa640 1 -- 172.21.15.196:0/2256648592 <== mon.0 v2:172.21.15.196:3300/0 5 ==== osd_map(13..13 src has 1..13) ==== 4471+0+0 (secure 0 0 0) 0x7fc038123100 con 0x7fc0401575c0 2024-03-17T23:55:54.860 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:54.856+0000 7fc044b7c640 1 --2- 172.21.15.196:0/2256648592 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7fc02c0675d0 0x7fc02c069a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:55:54.860 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:54.856+0000 7fc044b7c640 1 --2- 172.21.15.196:0/2256648592 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7fc02c0675d0 0x7fc02c069a90 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fc03000b850 tx=0x7fc030008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:55:54.862 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:54.860+0000 7fc03d7fa640 1 -- 172.21.15.196:0/2256648592 <== mon.0 v2:172.21.15.196:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177849 (secure 0 0 0) 0x7fc038018c70 con 0x7fc0401575c0 2024-03-17T23:55:55.040 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:55.040+0000 7fc046de0640 1 -- 172.21.15.196:0/2256648592 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc0400c7f10 con 0x7fc0401575c0 2024-03-17T23:55:55.041 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:55.040+0000 7fc03d7fa640 1 -- 172.21.15.196:0/2256648592 <== mon.0 v2:172.21.15.196:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1395 (secure 0 0 0) 0x7fc0380b8370 con 0x7fc0401575c0 2024-03-17T23:55:55.042 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-03-17T23:55:55.042 INFO:teuthology.orchestra.run.smithi196.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4261,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6837/3888512151","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6836","nonce":3888512151},{"type":"v1","addr":"172.21.15.204:6837","nonce":3888512151}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-03-17T23:55:55.042 INFO:teuthology.orchestra.run.smithi196.stderr:dumped fsmap epoch 2 2024-03-17T23:55:55.044 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:55.040+0000 7fc046de0640 1 -- 172.21.15.196:0/2256648592 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7fc02c0675d0 msgr2=0x7fc02c069a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:55:55.044 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:55.040+0000 7fc046de0640 1 --2- 172.21.15.196:0/2256648592 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7fc02c0675d0 0x7fc02c069a90 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fc03000b850 tx=0x7fc030008040 comp rx=0 tx=0).stop 2024-03-17T23:55:55.044 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:55.040+0000 7fc046de0640 1 -- 172.21.15.196:0/2256648592 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc0401575c0 msgr2=0x7fc0400b2650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:55:55.044 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:55.040+0000 7fc046de0640 1 --2- 172.21.15.196:0/2256648592 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc0401575c0 0x7fc0400b2650 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fc03801cd40 tx=0x7fc03801beb0 comp rx=0 tx=0).stop 2024-03-17T23:55:55.045 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:55.040+0000 7fc046de0640 1 -- 172.21.15.196:0/2256648592 shutdown_connections 2024-03-17T23:55:55.045 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:55.040+0000 7fc046de0640 1 --2- 172.21.15.196:0/2256648592 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7fc02c0675d0 0x7fc02c069a90 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:55:55.045 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:55.040+0000 7fc046de0640 1 --2- 172.21.15.196:0/2256648592 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc0400c3120 0x7fc0401535f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:55:55.045 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:55.040+0000 7fc046de0640 1 --2- 172.21.15.196:0/2256648592 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc0401575c0 0x7fc0400b2650 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:55:55.045 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:55.040+0000 7fc046de0640 1 --2- 172.21.15.196:0/2256648592 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc04006c3c0 0x7fc0400b0f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:55:55.045 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:55.040+0000 7fc046de0640 1 -- 172.21.15.196:0/2256648592 >> 172.21.15.196:0/2256648592 conn(0x7fc040071020 msgr2=0x7fc040155b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-17T23:55:55.045 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:55.044+0000 7fc046de0640 1 -- 172.21.15.196:0/2256648592 shutdown_connections 2024-03-17T23:55:55.045 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:55.044+0000 7fc046de0640 1 -- 172.21.15.196:0/2256648592 wait complete. 2024-03-17T23:55:57.060 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-17T23:55:57.192 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:57.192+0000 7f84ee36e640 1 Processor -- start 2024-03-17T23:55:57.193 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:57.192+0000 7f84ee36e640 1 -- start start 2024-03-17T23:55:57.194 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:57.192+0000 7f84ee36e640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f84e8151f10 0x7f84e80c25e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:55:57.194 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:57.192+0000 7f84ee36e640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f84e80c7fc0 0x7f84e81583f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:55:57.194 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:57.192+0000 7f84ee36e640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f84e80cd530 0x7f84e80cd9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:55:57.194 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:57.192+0000 7f84ee36e640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7f84e8157f60 con 0x7f84e80cd530 2024-03-17T23:55:57.195 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:57.192+0000 7f84ee36e640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 -- 0x7f84e81522f0 con 0x7f84e80c7fc0 2024-03-17T23:55:57.195 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:57.192+0000 7f84ee36e640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f84e80c3330 con 0x7f84e8151f10 2024-03-17T23:55:57.195 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:57.192+0000 7f84ec90b640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f84e80cd530 0x7f84e80cd9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:55:57.195 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:57.192+0000 7f84ec90b640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f84e80cd530 0x7f84e80cd9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.196:56256/0 (socket says 172.21.15.196:56256) 2024-03-17T23:55:57.195 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:57.192+0000 7f84ec90b640 1 -- 172.21.15.196:0/1250088867 learned_addr learned my addr 172.21.15.196:0/1250088867 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-03-17T23:55:57.195 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:57.192+0000 7f84df7fe640 1 --2- 172.21.15.196:0/1250088867 >> v2:172.21.15.204:3300/0 conn(0x7f84e80c7fc0 0x7f84e81583f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:55:57.195 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:57.192+0000 7f84e7fff640 1 --2- 172.21.15.196:0/1250088867 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f84e8151f10 0x7f84e80c25e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:55:57.195 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:57.192+0000 7f84ec90b640 1 -- 172.21.15.196:0/1250088867 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f84e8151f10 msgr2=0x7f84e80c25e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-17T23:55:57.195 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:57.192+0000 7f84ec90b640 1 --2- 172.21.15.196:0/1250088867 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f84e8151f10 0x7f84e80c25e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:55:57.195 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:57.192+0000 7f84ec90b640 1 -- 172.21.15.196:0/1250088867 >> v2:172.21.15.204:3300/0 conn(0x7f84e80c7fc0 msgr2=0x7f84e81583f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-17T23:55:57.195 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:57.192+0000 7f84ec90b640 1 --2- 172.21.15.196:0/1250088867 >> v2:172.21.15.204:3300/0 conn(0x7f84e80c7fc0 0x7f84e81583f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:55:57.195 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:57.192+0000 7f84ec90b640 1 -- 172.21.15.196:0/1250088867 --> v2:172.21.15.196:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84e80c3610 con 0x7f84e80cd530 2024-03-17T23:55:57.195 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:57.192+0000 7f84e7fff640 1 --2- 172.21.15.196:0/1250088867 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f84e8151f10 0x7f84e80c25e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-17T23:55:57.195 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:57.192+0000 7f84df7fe640 1 --2- 172.21.15.196:0/1250088867 >> v2:172.21.15.204:3300/0 conn(0x7f84e80c7fc0 0x7f84e81583f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-17T23:55:57.196 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:57.196+0000 7f84ec90b640 1 --2- 172.21.15.196:0/1250088867 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f84e80cd530 0x7f84e80cd9c0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f84e806ede0 tx=0x7f84e001c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3401ba2aeac48a13 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:55:57.196 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:57.196+0000 7f84e77fe640 1 -- 172.21.15.196:0/1250088867 <== mon.0 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84e00a5760 con 0x7f84e80cd530 2024-03-17T23:55:57.196 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:57.196+0000 7f84e77fe640 1 -- 172.21.15.196:0/1250088867 <== mon.0 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f84e00a5900 con 0x7f84e80cd530 2024-03-17T23:55:57.196 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:57.196+0000 7f84e77fe640 1 -- 172.21.15.196:0/1250088867 <== mon.0 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84e00a5cd0 con 0x7f84e80cd530 2024-03-17T23:55:57.197 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:57.196+0000 7f84ee36e640 1 -- 172.21.15.196:0/1250088867 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f84e80cd530 msgr2=0x7f84e80cd9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:55:57.197 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:57.196+0000 7f84ee36e640 1 --2- 172.21.15.196:0/1250088867 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f84e80cd530 0x7f84e80cd9c0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f84e806ede0 tx=0x7f84e001c9f0 comp rx=0 tx=0).stop 2024-03-17T23:55:57.197 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:57.196+0000 7f84ee36e640 1 -- 172.21.15.196:0/1250088867 shutdown_connections 2024-03-17T23:55:57.197 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:57.196+0000 7f84ee36e640 1 --2- 172.21.15.196:0/1250088867 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f84e80cd530 0x7f84e80cd9c0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:55:57.197 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:57.196+0000 7f84ee36e640 1 --2- 172.21.15.196:0/1250088867 >> v2:172.21.15.204:3300/0 conn(0x7f84e80c7fc0 0x7f84e81583f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:55:57.197 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:57.196+0000 7f84ee36e640 1 --2- 172.21.15.196:0/1250088867 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f84e8151f10 0x7f84e80c25e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:55:57.198 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:57.196+0000 7f84ee36e640 1 -- 172.21.15.196:0/1250088867 >> 172.21.15.196:0/1250088867 conn(0x7f84e806f360 msgr2=0x7f84e806f770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-17T23:55:57.198 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:57.196+0000 7f84ee36e640 1 -- 172.21.15.196:0/1250088867 shutdown_connections 2024-03-17T23:55:57.198 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:57.196+0000 7f84ee36e640 1 -- 172.21.15.196:0/1250088867 wait complete. 2024-03-17T23:55:57.198 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:57.196+0000 7f84ee36e640 1 Processor -- start 2024-03-17T23:55:57.198 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:57.196+0000 7f84ee36e640 1 -- start start 2024-03-17T23:55:57.200 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:57.196+0000 7f84ee36e640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f84e80c7fc0 0x7f84e80b26f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:55:57.200 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:57.196+0000 7f84ee36e640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f84e80cd530 0x7f84e8158d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:55:57.200 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:57.196+0000 7f84ee36e640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f84e8151f10 0x7f84e8144020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:55:57.200 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:57.196+0000 7f84ee36e640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f84e815b1b0 con 0x7f84e8151f10 2024-03-17T23:55:57.200 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:57.196+0000 7f84ee36e640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f84e80c2ff0 con 0x7f84e80c7fc0 2024-03-17T23:55:57.200 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:57.196+0000 7f84ee36e640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f84e8158930 con 0x7f84e80cd530 2024-03-17T23:55:57.201 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:57.196+0000 7f84ec90b640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f84e8151f10 0x7f84e8144020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:55:57.201 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:57.196+0000 7f84ec90b640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f84e8151f10 0x7f84e8144020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.196:56266/0 (socket says 172.21.15.196:56266) 2024-03-17T23:55:57.201 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:57.196+0000 7f84ec90b640 1 -- 172.21.15.196:0/1263422842 learned_addr learned my addr 172.21.15.196:0/1263422842 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-03-17T23:55:57.201 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:57.196+0000 7f84df7fe640 1 --2- 172.21.15.196:0/1263422842 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f84e80cd530 0x7f84e8158d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:55:57.201 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:57.196+0000 7f84ec90b640 1 -- 172.21.15.196:0/1263422842 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f84e80cd530 msgr2=0x7f84e8158d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:55:57.201 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:57.196+0000 7f84ec90b640 1 --2- 172.21.15.196:0/1263422842 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f84e80cd530 0x7f84e8158d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:55:57.201 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:57.196+0000 7f84e7fff640 1 --2- 172.21.15.196:0/1263422842 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f84e80c7fc0 0x7f84e80b26f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:55:57.201 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:57.196+0000 7f84ec90b640 1 -- 172.21.15.196:0/1263422842 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f84e80c7fc0 msgr2=0x7f84e80b26f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:55:57.201 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:57.196+0000 7f84ec90b640 1 --2- 172.21.15.196:0/1263422842 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f84e80c7fc0 0x7f84e80b26f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:55:57.201 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:57.196+0000 7f84ec90b640 1 -- 172.21.15.196:0/1263422842 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84e815a660 con 0x7f84e8151f10 2024-03-17T23:55:57.201 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:57.196+0000 7f84ec90b640 1 --2- 172.21.15.196:0/1263422842 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f84e8151f10 0x7f84e8144020 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f84e00af040 tx=0x7f84e0019790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:55:57.201 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:57.196+0000 7f84e57fa640 1 -- 172.21.15.196:0/1263422842 <== mon.0 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84e00bc020 con 0x7f84e8151f10 2024-03-17T23:55:57.201 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:57.200+0000 7f84e57fa640 1 -- 172.21.15.196:0/1263422842 <== mon.0 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f84e00b8670 con 0x7f84e8151f10 2024-03-17T23:55:57.201 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:57.200+0000 7f84ee36e640 1 -- 172.21.15.196:0/1263422842 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84e815ace0 con 0x7f84e8151f10 2024-03-17T23:55:57.201 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:57.200+0000 7f84e57fa640 1 -- 172.21.15.196:0/1263422842 <== mon.0 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84e00b8a60 con 0x7f84e8151f10 2024-03-17T23:55:57.202 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:57.200+0000 7f84ee36e640 1 -- 172.21.15.196:0/1263422842 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84e80b1390 con 0x7f84e8151f10 2024-03-17T23:55:57.202 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:57.200+0000 7f84ee36e640 1 -- 172.21.15.196:0/1263422842 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f84e8068290 con 0x7f84e8151f10 2024-03-17T23:55:57.202 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:57.200+0000 7f84e57fa640 1 -- 172.21.15.196:0/1263422842 <== mon.0 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 4) ==== 87027+0+0 (secure 0 0 0) 0x7f84e00bf020 con 0x7f84e8151f10 2024-03-17T23:55:57.203 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:57.200+0000 7f84e57fa640 1 --2- 172.21.15.196:0/1263422842 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f84c8067600 0x7f84c8069ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:55:57.203 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:57.200+0000 7f84e57fa640 1 -- 172.21.15.196:0/1263422842 <== mon.0 v2:172.21.15.196:3300/0 5 ==== osd_map(15..15 src has 1..15) ==== 4846+0+0 (secure 0 0 0) 0x7f84e0120660 con 0x7f84e8151f10 2024-03-17T23:55:57.203 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:57.200+0000 7f84e7fff640 1 --2- 172.21.15.196:0/1263422842 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f84c8067600 0x7f84c8069ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:55:57.203 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:57.200+0000 7f84e7fff640 1 --2- 172.21.15.196:0/1263422842 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f84c8067600 0x7f84c8069ac0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f84d8006fd0 tx=0x7f84d8008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:55:57.206 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:57.204+0000 7f84e57fa640 1 -- 172.21.15.196:0/1263422842 <== mon.0 v2:172.21.15.196:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177849 (secure 0 0 0) 0x7f84e00c6030 con 0x7f84e8151f10 2024-03-17T23:55:57.395 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:57.392+0000 7f84ee36e640 1 -- 172.21.15.196:0/1263422842 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f84e80c89b0 con 0x7f84e8151f10 2024-03-17T23:55:57.396 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:57.396+0000 7f84e57fa640 1 -- 172.21.15.196:0/1263422842 <== mon.0 v2:172.21.15.196:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+5530 (secure 0 0 0) 0x7f84e815a660 con 0x7f84e8151f10 2024-03-17T23:55:57.397 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-03-17T23:55:57.397 INFO:teuthology.orchestra.run.smithi196.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4211,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6835/1901351791","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6834","nonce":1901351791},{"type":"v1","addr":"172.21.15.204:6835","nonce":1901351791}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4261,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6837/3888512151","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6836","nonce":3888512151},{"type":"v1","addr":"172.21.15.204:6837","nonce":3888512151}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4264,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6839/2849161202","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6838","nonce":2849161202},{"type":"v1","addr":"172.21.15.204:6839","nonce":2849161202}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4275,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6833/2075619627","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6832","nonce":2075619627},{"type":"v1","addr":"172.21.15.196:6833","nonce":2075619627}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4281,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6835/1837184297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6834","nonce":1837184297},{"type":"v1","addr":"172.21.15.196:6835","nonce":1837184297}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4284,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6837/2436120950","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6836","nonce":2436120950},{"type":"v1","addr":"172.21.15.196:6837","nonce":2436120950}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-03-17T23:55:57.397 INFO:teuthology.orchestra.run.smithi196.stderr:dumped fsmap epoch 3 2024-03-17T23:55:57.399 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:57.396+0000 7f84ee36e640 1 -- 172.21.15.196:0/1263422842 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f84c8067600 msgr2=0x7f84c8069ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:55:57.399 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:57.396+0000 7f84ee36e640 1 --2- 172.21.15.196:0/1263422842 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f84c8067600 0x7f84c8069ac0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f84d8006fd0 tx=0x7f84d8008040 comp rx=0 tx=0).stop 2024-03-17T23:55:57.399 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:57.396+0000 7f84ee36e640 1 -- 172.21.15.196:0/1263422842 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f84e8151f10 msgr2=0x7f84e8144020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:55:57.399 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:57.396+0000 7f84ee36e640 1 --2- 172.21.15.196:0/1263422842 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f84e8151f10 0x7f84e8144020 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f84e00af040 tx=0x7f84e0019790 comp rx=0 tx=0).stop 2024-03-17T23:55:57.399 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:57.396+0000 7f84ee36e640 1 -- 172.21.15.196:0/1263422842 shutdown_connections 2024-03-17T23:55:57.399 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:57.396+0000 7f84ee36e640 1 --2- 172.21.15.196:0/1263422842 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f84c8067600 0x7f84c8069ac0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:55:57.399 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:57.396+0000 7f84ee36e640 1 --2- 172.21.15.196:0/1263422842 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f84e80cd530 0x7f84e8158d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:55:57.399 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:57.396+0000 7f84ee36e640 1 --2- 172.21.15.196:0/1263422842 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f84e8151f10 0x7f84e8144020 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:55:57.399 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:57.396+0000 7f84ee36e640 1 --2- 172.21.15.196:0/1263422842 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f84e80c7fc0 0x7f84e80b26f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:55:57.399 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:57.396+0000 7f84ee36e640 1 -- 172.21.15.196:0/1263422842 >> 172.21.15.196:0/1263422842 conn(0x7f84e806f360 msgr2=0x7f84e80ccd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-17T23:55:57.399 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:57.396+0000 7f84ee36e640 1 -- 172.21.15.196:0/1263422842 shutdown_connections 2024-03-17T23:55:57.399 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:57.396+0000 7f84ee36e640 1 -- 172.21.15.196:0/1263422842 wait complete. 2024-03-17T23:55:57.414 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-17T23:55:57.531 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:57.528+0000 7faa37c90640 1 Processor -- start 2024-03-17T23:55:57.531 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:57.528+0000 7faa37c90640 1 -- start start 2024-03-17T23:55:57.533 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:57.528+0000 7faa37c90640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7faa30153e30 0x7faa3015a930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:55:57.533 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:57.528+0000 7faa37c90640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faa30071f50 con 0x7faa30154210 2024-03-17T23:55:57.533 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:57.528+0000 7faa37c90640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faa30072230 con 0x7faa3006d270 2024-03-17T23:55:57.534 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:57.528+0000 7faa37c90640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 -- 0x7faa30072b60 con 0x7faa30153e30 2024-03-17T23:55:57.534 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:57.532+0000 7faa3522b640 1 --1- >> v1:172.21.15.196:6789/0 conn(0x7faa30154210 0x7faa3006c6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.196:6789/0 says I am v1:172.21.15.196:60892/0 (socket says 172.21.15.196:60892) 2024-03-17T23:55:57.534 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:57.532+0000 7faa3522b640 1 -- 172.21.15.196:0/2960105664 learned_addr learned my addr 172.21.15.196:0/2960105664 (peer_addr_for_me v1:172.21.15.196:0/0) 2024-03-17T23:55:57.534 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:57.532+0000 7faa34a2a640 1 -- 172.21.15.196:0/2960105664 <== mon.0 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1613570932 0 0) 0x7faa30071f50 con 0x7faa30154210 2024-03-17T23:55:57.534 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:57.532+0000 7faa34a2a640 1 -- 172.21.15.196:0/2960105664 --> v1:172.21.15.196:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faa1c003530 con 0x7faa30154210 2024-03-17T23:55:57.534 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:57.532+0000 7faa35a2c640 1 --2- 172.21.15.196:0/2960105664 >> v2:172.21.15.204:3300/0 conn(0x7faa30153e30 0x7faa3015a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:55:57.534 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:57.532+0000 7faa34a2a640 1 -- 172.21.15.196:0/2960105664 <== mon.0 v1:172.21.15.196:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 412941886 0 0) 0x7faa1c003530 con 0x7faa30154210 2024-03-17T23:55:57.534 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:57.532+0000 7faa34a2a640 1 -- 172.21.15.196:0/2960105664 >> v2:172.21.15.204:3300/0 conn(0x7faa30153e30 msgr2=0x7faa3015a930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-17T23:55:57.534 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:57.532+0000 7faa34a2a640 1 --2- 172.21.15.196:0/2960105664 >> v2:172.21.15.204:3300/0 conn(0x7faa30153e30 0x7faa3015a930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:55:57.534 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:57.532+0000 7faa34a2a640 1 -- 172.21.15.196:0/2960105664 >> v1:172.21.15.204:6789/0 conn(0x7faa3006d270 legacy=0x7faa3015b1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:55:57.534 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:57.532+0000 7faa34a2a640 1 -- 172.21.15.196:0/2960105664 --> v1:172.21.15.196:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa30072510 con 0x7faa30154210 2024-03-17T23:55:57.534 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:57.532+0000 7faa34a2a640 1 -- 172.21.15.196:0/2960105664 <== mon.0 v1:172.21.15.196:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 981458915 0 0) 0x7faa20001680 con 0x7faa30154210 2024-03-17T23:55:57.535 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:57.532+0000 7faa35a2c640 1 --2- 172.21.15.196:0/2960105664 >> v2:172.21.15.204:3300/0 conn(0x7faa30153e30 0x7faa3015a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-17T23:55:57.535 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:57.532+0000 7faa34a2a640 1 -- 172.21.15.196:0/2960105664 >> v1:172.21.15.196:6789/0 conn(0x7faa30154210 legacy=0x7faa3006c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:55:57.535 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:57.532+0000 7faa34a2a640 1 --2- 172.21.15.196:0/2960105664 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7faa1c0039c0 0x7faa1c003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:55:57.535 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:57.532+0000 7faa34a2a640 1 --2- 172.21.15.196:0/2960105664 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7faa1c004810 0x7faa1c004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:55:57.535 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:57.532+0000 7faa34a2a640 1 --2- 172.21.15.196:0/2960105664 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7faa1c0051d0 0x7faa1c00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:55:57.535 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:57.532+0000 7faa34a2a640 1 -- 172.21.15.196:0/2960105664 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7faa30072b60 con 0x7faa1c004810 2024-03-17T23:55:57.535 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:57.532+0000 7faa34a2a640 1 -- 172.21.15.196:0/2960105664 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7faa1c00c100 con 0x7faa1c0051d0 2024-03-17T23:55:57.535 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:57.532+0000 7faa34a2a640 1 -- 172.21.15.196:0/2960105664 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7faa1c00c300 con 0x7faa1c0039c0 2024-03-17T23:55:57.535 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:57.532+0000 7faa3522b640 1 --2- 172.21.15.196:0/2960105664 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7faa1c004810 0x7faa1c004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:55:57.535 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:57.532+0000 7faa35a2c640 1 --2- 172.21.15.196:0/2960105664 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7faa1c0039c0 0x7faa1c003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:55:57.535 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:57.532+0000 7faa3522b640 1 -- 172.21.15.196:0/2960105664 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7faa1c0039c0 msgr2=0x7faa1c003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-17T23:55:57.535 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:57.532+0000 7faa3522b640 1 --2- 172.21.15.196:0/2960105664 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7faa1c0039c0 0x7faa1c003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:55:57.535 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:57.532+0000 7faa3622d640 1 --2- 172.21.15.196:0/2960105664 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7faa1c0051d0 0x7faa1c00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:55:57.535 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:57.532+0000 7faa3522b640 1 -- 172.21.15.196:0/2960105664 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7faa1c0051d0 msgr2=0x7faa1c00b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-17T23:55:57.535 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:57.532+0000 7faa3522b640 1 --2- 172.21.15.196:0/2960105664 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7faa1c0051d0 0x7faa1c00b9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:55:57.536 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:57.532+0000 7faa3622d640 1 -- 172.21.15.196:0/2960105664 reap_dead start 2024-03-17T23:55:57.536 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:57.532+0000 7faa3522b640 1 -- 172.21.15.196:0/2960105664 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa1c003530 con 0x7faa1c004810 2024-03-17T23:55:57.537 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:57.532+0000 7faa3522b640 1 --2- 172.21.15.196:0/2960105664 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7faa1c004810 0x7faa1c004c90 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7faa2000c1c0 tx=0x7faa2001cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed6beaec5a6cb389 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:55:57.537 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:57.532+0000 7faa34a2a640 1 -- 172.21.15.196:0/2960105664 <== mon.0 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa20007d00 con 0x7faa1c004810 2024-03-17T23:55:57.537 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:57.532+0000 7faa34a2a640 1 -- 172.21.15.196:0/2960105664 <== mon.0 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa200a9020 con 0x7faa1c004810 2024-03-17T23:55:57.537 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:57.532+0000 7faa34a2a640 1 -- 172.21.15.196:0/2960105664 <== mon.0 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa200a5b60 con 0x7faa1c004810 2024-03-17T23:55:57.537 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:57.536+0000 7faa37c90640 1 -- 172.21.15.196:0/2960105664 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7faa1c004810 msgr2=0x7faa1c004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:55:57.537 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:57.536+0000 7faa37c90640 1 --2- 172.21.15.196:0/2960105664 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7faa1c004810 0x7faa1c004c90 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7faa2000c1c0 tx=0x7faa2001cc60 comp rx=0 tx=0).stop 2024-03-17T23:55:57.537 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:57.536+0000 7faa37c90640 1 -- 172.21.15.196:0/2960105664 shutdown_connections 2024-03-17T23:55:57.537 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:57.536+0000 7faa37c90640 1 --2- 172.21.15.196:0/2960105664 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7faa1c004810 0x7faa1c004c90 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:55:57.537 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:57.536+0000 7faa37c90640 1 -- 172.21.15.196:0/2960105664 >> 172.21.15.196:0/2960105664 conn(0x7faa300c7da0 msgr2=0x7faa300c81b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-17T23:55:57.537 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:57.536+0000 7faa37c90640 1 -- 172.21.15.196:0/2960105664 shutdown_connections 2024-03-17T23:55:57.537 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:57.536+0000 7faa37c90640 1 -- 172.21.15.196:0/2960105664 wait complete. 2024-03-17T23:55:57.538 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:57.536+0000 7faa37c90640 1 Processor -- start 2024-03-17T23:55:57.538 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:57.536+0000 7faa37c90640 1 -- start start 2024-03-17T23:55:57.540 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:57.536+0000 7faa37c90640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7faa1c004810 0x7faa30146e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:55:57.540 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:57.536+0000 7faa37c90640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7faa30156a70 0x7faa300c3560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:55:57.540 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:57.536+0000 7faa37c90640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7faa30157090 0x7faa300c72c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:55:57.540 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:57.536+0000 7faa37c90640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7faa3015aab0 con 0x7faa1c004810 2024-03-17T23:55:57.540 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:57.536+0000 7faa37c90640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7faa3015a930 con 0x7faa30157090 2024-03-17T23:55:57.540 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:57.536+0000 7faa37c90640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7faa3015ac30 con 0x7faa30156a70 2024-03-17T23:55:57.540 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:57.536+0000 7faa35a2c640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7faa1c004810 0x7faa30146e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:55:57.540 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:57.536+0000 7faa35a2c640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7faa1c004810 0x7faa30146e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.196:56286/0 (socket says 172.21.15.196:56286) 2024-03-17T23:55:57.540 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:57.536+0000 7faa35a2c640 1 -- 172.21.15.196:0/3530426484 learned_addr learned my addr 172.21.15.196:0/3530426484 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-03-17T23:55:57.540 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:57.536+0000 7faa3522b640 1 --2- 172.21.15.196:0/3530426484 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7faa30156a70 0x7faa300c3560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:55:57.540 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:57.536+0000 7faa3622d640 1 --2- 172.21.15.196:0/3530426484 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7faa30157090 0x7faa300c72c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:55:57.540 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:57.536+0000 7faa35a2c640 1 -- 172.21.15.196:0/3530426484 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7faa30156a70 msgr2=0x7faa300c3560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:55:57.540 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:57.536+0000 7faa35a2c640 1 --2- 172.21.15.196:0/3530426484 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7faa30156a70 0x7faa300c3560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:55:57.540 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:57.536+0000 7faa35a2c640 1 -- 172.21.15.196:0/3530426484 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7faa30157090 msgr2=0x7faa300c72c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:55:57.541 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:57.536+0000 7faa35a2c640 1 --2- 172.21.15.196:0/3530426484 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7faa30157090 0x7faa300c72c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:55:57.541 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:57.536+0000 7faa35a2c640 1 -- 172.21.15.196:0/3530426484 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa300c5510 con 0x7faa1c004810 2024-03-17T23:55:57.541 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:57.536+0000 7faa3522b640 1 --2- 172.21.15.196:0/3530426484 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7faa30156a70 0x7faa300c3560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-17T23:55:57.541 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:57.536+0000 7faa35a2c640 1 --2- 172.21.15.196:0/3530426484 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7faa1c004810 0x7faa30146e90 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7faa2c010840 tx=0x7faa2c010d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:55:57.541 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:57.536+0000 7faa267fc640 1 -- 172.21.15.196:0/3530426484 <== mon.0 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa2c01a020 con 0x7faa1c004810 2024-03-17T23:55:57.541 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:57.536+0000 7faa267fc640 1 -- 172.21.15.196:0/3530426484 <== mon.0 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa2c00eb60 con 0x7faa1c004810 2024-03-17T23:55:57.541 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:57.536+0000 7faa37c90640 1 -- 172.21.15.196:0/3530426484 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa301575f0 con 0x7faa1c004810 2024-03-17T23:55:57.541 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:57.536+0000 7faa267fc640 1 -- 172.21.15.196:0/3530426484 <== mon.0 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa2c00f040 con 0x7faa1c004810 2024-03-17T23:55:57.541 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:57.536+0000 7faa37c90640 1 -- 172.21.15.196:0/3530426484 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa300c6280 con 0x7faa1c004810 2024-03-17T23:55:57.542 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:57.540+0000 7faa37c90640 1 -- 172.21.15.196:0/3530426484 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faa30068290 con 0x7faa1c004810 2024-03-17T23:55:57.542 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:57.540+0000 7faa267fc640 1 -- 172.21.15.196:0/3530426484 <== mon.0 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 4) ==== 87027+0+0 (secure 0 0 0) 0x7faa2c01d020 con 0x7faa1c004810 2024-03-17T23:55:57.542 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:57.540+0000 7faa267fc640 1 --2- 172.21.15.196:0/3530426484 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7faa140675d0 0x7faa14069a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:55:57.542 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:57.540+0000 7faa267fc640 1 -- 172.21.15.196:0/3530426484 <== mon.0 v2:172.21.15.196:3300/0 5 ==== osd_map(15..15 src has 1..15) ==== 4846+0+0 (secure 0 0 0) 0x7faa2c085db0 con 0x7faa1c004810 2024-03-17T23:55:57.542 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:57.540+0000 7faa3522b640 1 --2- 172.21.15.196:0/3530426484 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7faa140675d0 0x7faa14069a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:55:57.543 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:57.540+0000 7faa3522b640 1 --2- 172.21.15.196:0/3530426484 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7faa140675d0 0x7faa14069a90 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7faa200aa000 tx=0x7faa300c58b0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:55:57.546 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:57.544+0000 7faa267fc640 1 -- 172.21.15.196:0/3530426484 <== mon.0 v2:172.21.15.196:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177849 (secure 0 0 0) 0x7faa2c024020 con 0x7faa1c004810 2024-03-17T23:55:57.706 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:57.704+0000 7faa37c90640 1 -- 172.21.15.196:0/3530426484 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7faa300c70a0 con 0x7faa1c004810 2024-03-17T23:55:57.709 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:57.708+0000 7faa267fc640 1 -- 172.21.15.196:0/3530426484 <== mon.0 v2:172.21.15.196:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) ==== 74+0+12933 (secure 0 0 0) 0x7faa2c056e70 con 0x7faa1c004810 2024-03-17T23:55:57.709 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-03-17T23:55:57.709 INFO:teuthology.orchestra.run.smithi196.stdout:{"epoch":16,"fsid":"b80f9c80-17ad-4126-8957-4c0c46f5b803","created":"2024-03-17T23:55:43.368838+0000","modified":"2024-03-17T23:55:57.617577+0000","last_up_change":"2024-03-17T23:55:54.132187+0000","last_in_change":"2024-03-17T23:55:46.016435+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-17T23:55:56.030640+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"224d699f-bc10-4661-a8b5-6ca73290ffa0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6806","nonce":1194547591},{"type":"v1","addr":"172.21.15.196:6807","nonce":1194547591}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6809","nonce":1194547591},{"type":"v1","addr":"172.21.15.196:6811","nonce":1194547591}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6814","nonce":1194547591},{"type":"v1","addr":"172.21.15.196:6815","nonce":1194547591}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6812","nonce":1194547591},{"type":"v1","addr":"172.21.15.196:6813","nonce":1194547591}]},"public_addr":"172.21.15.196:6807/1194547591","cluster_addr":"172.21.15.196:6811/1194547591","heartbeat_back_addr":"172.21.15.196:6815/1194547591","heartbeat_front_addr":"172.21.15.196:6813/1194547591","state":["exists","up"]},{"osd":1,"uuid":"d8d6a0b0-450b-4ab5-b143-d4f36286e81e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6800","nonce":1901246986},{"type":"v1","addr":"172.21.15.196:6801","nonce":1901246986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6802","nonce":1901246986},{"type":"v1","addr":"172.21.15.196:6803","nonce":1901246986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6808","nonce":1901246986},{"type":"v1","addr":"172.21.15.196:6810","nonce":1901246986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6804","nonce":1901246986},{"type":"v1","addr":"172.21.15.196:6805","nonce":1901246986}]},"public_addr":"172.21.15.196:6801/1901246986","cluster_addr":"172.21.15.196:6803/1901246986","heartbeat_back_addr":"172.21.15.196:6810/1901246986","heartbeat_front_addr":"172.21.15.196:6805/1901246986","state":["exists","up"]},{"osd":2,"uuid":"d732ba94-1db0-41ed-930a-5abb6188980a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6824","nonce":673819559},{"type":"v1","addr":"172.21.15.196:6825","nonce":673819559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6826","nonce":673819559},{"type":"v1","addr":"172.21.15.196:6827","nonce":673819559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6830","nonce":673819559},{"type":"v1","addr":"172.21.15.196:6831","nonce":673819559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6828","nonce":673819559},{"type":"v1","addr":"172.21.15.196:6829","nonce":673819559}]},"public_addr":"172.21.15.196:6825/673819559","cluster_addr":"172.21.15.196:6827/673819559","heartbeat_back_addr":"172.21.15.196:6831/673819559","heartbeat_front_addr":"172.21.15.196:6829/673819559","state":["exists","up"]},{"osd":3,"uuid":"b79cab98-a49f-4544-b6b0-546dcfbd47a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6816","nonce":1104340623},{"type":"v1","addr":"172.21.15.196:6817","nonce":1104340623}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6818","nonce":1104340623},{"type":"v1","addr":"172.21.15.196:6819","nonce":1104340623}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6822","nonce":1104340623},{"type":"v1","addr":"172.21.15.196:6823","nonce":1104340623}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6820","nonce":1104340623},{"type":"v1","addr":"172.21.15.196:6821","nonce":1104340623}]},"public_addr":"172.21.15.196:6817/1104340623","cluster_addr":"172.21.15.196:6819/1104340623","heartbeat_back_addr":"172.21.15.196:6823/1104340623","heartbeat_front_addr":"172.21.15.196:6821/1104340623","state":["exists","up"]},{"osd":4,"uuid":"d5892856-6eb4-4188-beb0-368f64169af1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6816","nonce":658561863},{"type":"v1","addr":"172.21.15.204:6818","nonce":658561863}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6819","nonce":658561863},{"type":"v1","addr":"172.21.15.204:6821","nonce":658561863}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6826","nonce":658561863},{"type":"v1","addr":"172.21.15.204:6828","nonce":658561863}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6823","nonce":658561863},{"type":"v1","addr":"172.21.15.204:6825","nonce":658561863}]},"public_addr":"172.21.15.204:6818/658561863","cluster_addr":"172.21.15.204:6821/658561863","heartbeat_back_addr":"172.21.15.204:6828/658561863","heartbeat_front_addr":"172.21.15.204:6825/658561863","state":["exists","up"]},{"osd":5,"uuid":"89d6b48d-aa8a-4cb8-aa2e-e0aae04928b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6817","nonce":3367327749},{"type":"v1","addr":"172.21.15.204:6820","nonce":3367327749}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6822","nonce":3367327749},{"type":"v1","addr":"172.21.15.204:6824","nonce":3367327749}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6830","nonce":3367327749},{"type":"v1","addr":"172.21.15.204:6831","nonce":3367327749}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6827","nonce":3367327749},{"type":"v1","addr":"172.21.15.204:6829","nonce":3367327749}]},"public_addr":"172.21.15.204:6820/3367327749","cluster_addr":"172.21.15.204:6824/3367327749","heartbeat_back_addr":"172.21.15.204:6831/3367327749","heartbeat_front_addr":"172.21.15.204:6829/3367327749","state":["exists","up"]},{"osd":6,"uuid":"ff7d0949-2836-42a6-a63d-bc5a4269e080","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6805","nonce":2586742078},{"type":"v1","addr":"172.21.15.204:6807","nonce":2586742078}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6809","nonce":2586742078},{"type":"v1","addr":"172.21.15.204:6811","nonce":2586742078}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6814","nonce":2586742078},{"type":"v1","addr":"172.21.15.204:6815","nonce":2586742078}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6812","nonce":2586742078},{"type":"v1","addr":"172.21.15.204:6813","nonce":2586742078}]},"public_addr":"172.21.15.204:6807/2586742078","cluster_addr":"172.21.15.204:6811/2586742078","heartbeat_back_addr":"172.21.15.204:6815/2586742078","heartbeat_front_addr":"172.21.15.204:6813/2586742078","state":["exists","up"]},{"osd":7,"uuid":"42bcc14b-70b3-4c59-bf81-41436e4eb272","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6800","nonce":3361860686},{"type":"v1","addr":"172.21.15.204:6801","nonce":3361860686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6802","nonce":3361860686},{"type":"v1","addr":"172.21.15.204:6803","nonce":3361860686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6808","nonce":3361860686},{"type":"v1","addr":"172.21.15.204:6810","nonce":3361860686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6804","nonce":3361860686},{"type":"v1","addr":"172.21.15.204:6806","nonce":3361860686}]},"public_addr":"172.21.15.204:6801/3361860686","cluster_addr":"172.21.15.204:6803/3361860686","heartbeat_back_addr":"172.21.15.204:6810/3361860686","heartbeat_front_addr":"172.21.15.204:6806/3361860686","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-17T23:55:51.372683+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-17T23:55:51.466291+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-17T23:55:51.608084+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-17T23:55:51.680819+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-17T23:55:51.528198+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-17T23:55:51.537065+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-17T23:55:51.558146+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-17T23:55:51.382540+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-17T23:55:57.711 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:57.708+0000 7faa37c90640 1 -- 172.21.15.196:0/3530426484 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7faa140675d0 msgr2=0x7faa14069a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:55:57.711 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:57.708+0000 7faa37c90640 1 --2- 172.21.15.196:0/3530426484 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7faa140675d0 0x7faa14069a90 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7faa200aa000 tx=0x7faa300c58b0 comp rx=0 tx=0).stop 2024-03-17T23:55:57.711 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:57.708+0000 7faa37c90640 1 -- 172.21.15.196:0/3530426484 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7faa1c004810 msgr2=0x7faa30146e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:55:57.711 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:57.708+0000 7faa37c90640 1 --2- 172.21.15.196:0/3530426484 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7faa1c004810 0x7faa30146e90 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7faa2c010840 tx=0x7faa2c010d00 comp rx=0 tx=0).stop 2024-03-17T23:55:57.711 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:57.708+0000 7faa37c90640 1 -- 172.21.15.196:0/3530426484 shutdown_connections 2024-03-17T23:55:57.712 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:57.708+0000 7faa37c90640 1 --2- 172.21.15.196:0/3530426484 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7faa140675d0 0x7faa14069a90 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:55:57.712 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:57.708+0000 7faa37c90640 1 --2- 172.21.15.196:0/3530426484 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7faa30156a70 0x7faa300c3560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:55:57.712 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:57.708+0000 7faa37c90640 1 --2- 172.21.15.196:0/3530426484 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7faa30157090 0x7faa300c72c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:55:57.712 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:57.708+0000 7faa37c90640 1 --2- 172.21.15.196:0/3530426484 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7faa1c004810 0x7faa30146e90 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:55:57.712 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:57.708+0000 7faa37c90640 1 -- 172.21.15.196:0/3530426484 >> 172.21.15.196:0/3530426484 conn(0x7faa300c7da0 msgr2=0x7faa30152280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-17T23:55:57.712 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:57.708+0000 7faa37c90640 1 -- 172.21.15.196:0/3530426484 shutdown_connections 2024-03-17T23:55:57.712 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:57.708+0000 7faa37c90640 1 -- 172.21.15.196:0/3530426484 wait complete. 2024-03-17T23:55:57.728 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-17T23:55:56.030640+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-17T23:55:57.728 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-17T23:55:57.845 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:57.844+0000 7fe5f0965640 1 Processor -- start 2024-03-17T23:55:57.845 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:57.844+0000 7fe5f0965640 1 -- start start 2024-03-17T23:55:57.846 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:57.844+0000 7fe5f0965640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fe5ec150f40 0x7fe5ec071bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:55:57.846 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:57.844+0000 7fe5f0965640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fe5ec15f5d0 0x7fe5ec1619c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:55:57.846 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:57.844+0000 7fe5f0965640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe5ec0c0ec0 con 0x7fe5ec0c2b60 2024-03-17T23:55:57.846 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:57.844+0000 7fe5f0965640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7fe5ec0732c0 con 0x7fe5ec15f5d0 2024-03-17T23:55:57.847 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:57.844+0000 7fe5f0965640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 -- 0x7fe5ec1576a0 con 0x7fe5ec150f40 2024-03-17T23:55:57.847 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:57.844+0000 7fe5ead9d640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fe5ec15f5d0 0x7fe5ec1619c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:55:57.847 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:57.844+0000 7fe5ead9d640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fe5ec15f5d0 0x7fe5ec1619c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.196:56288/0 (socket says 172.21.15.196:56288) 2024-03-17T23:55:57.847 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:57.844+0000 7fe5ead9d640 1 -- 172.21.15.196:0/2352473636 learned_addr learned my addr 172.21.15.196:0/2352473636 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-03-17T23:55:57.847 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:57.844+0000 7fe5ea59c640 1 --2- 172.21.15.196:0/2352473636 >> v2:172.21.15.204:3300/0 conn(0x7fe5ec150f40 0x7fe5ec071bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:55:57.847 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:57.844+0000 7fe5ead9d640 1 -- 172.21.15.196:0/2352473636 >> v2:172.21.15.204:3300/0 conn(0x7fe5ec150f40 msgr2=0x7fe5ec071bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-17T23:55:57.847 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:57.844+0000 7fe5ead9d640 1 --2- 172.21.15.196:0/2352473636 >> v2:172.21.15.204:3300/0 conn(0x7fe5ec150f40 0x7fe5ec071bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:55:57.847 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:57.844+0000 7fe5ead9d640 1 -- 172.21.15.196:0/2352473636 >> v1:172.21.15.204:6789/0 conn(0x7fe5ec0c2b60 legacy=0x7fe5ec06c3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-17T23:55:57.847 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:57.844+0000 7fe5ead9d640 1 -- 172.21.15.196:0/2352473636 --> v2:172.21.15.196:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5ec0c1180 con 0x7fe5ec15f5d0 2024-03-17T23:55:57.849 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:57.848+0000 7fe5ead9d640 1 --2- 172.21.15.196:0/2352473636 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe5ec15f5d0 0x7fe5ec1619c0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fe5ec0715c0 tx=0x7fe5e401f1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7437a94013b46bf4 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:55:57.849 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:57.848+0000 7fe5e959a640 1 -- 172.21.15.196:0/2352473636 <== mon.0 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5e40b4070 con 0x7fe5ec15f5d0 2024-03-17T23:55:57.849 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:57.848+0000 7fe5e959a640 1 -- 172.21.15.196:0/2352473636 <== mon.0 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe5e40af400 con 0x7fe5ec15f5d0 2024-03-17T23:55:57.849 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:57.848+0000 7fe5e959a640 1 -- 172.21.15.196:0/2352473636 <== mon.0 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5e40af7d0 con 0x7fe5ec15f5d0 2024-03-17T23:55:57.850 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:57.848+0000 7fe5f0965640 1 -- 172.21.15.196:0/2352473636 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe5ec15f5d0 msgr2=0x7fe5ec1619c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:55:57.850 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:57.848+0000 7fe5f0965640 1 --2- 172.21.15.196:0/2352473636 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe5ec15f5d0 0x7fe5ec1619c0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fe5ec0715c0 tx=0x7fe5e401f1a0 comp rx=0 tx=0).stop 2024-03-17T23:55:57.850 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:57.848+0000 7fe5f0965640 1 -- 172.21.15.196:0/2352473636 shutdown_connections 2024-03-17T23:55:57.850 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:57.848+0000 7fe5f0965640 1 --2- 172.21.15.196:0/2352473636 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe5ec15f5d0 0x7fe5ec1619c0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:55:57.850 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:57.848+0000 7fe5f0965640 1 --2- 172.21.15.196:0/2352473636 >> v2:172.21.15.204:3300/0 conn(0x7fe5ec150f40 0x7fe5ec071bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:55:57.850 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:57.848+0000 7fe5f0965640 1 -- 172.21.15.196:0/2352473636 >> 172.21.15.196:0/2352473636 conn(0x7fe5ec06f5e0 msgr2=0x7fe5ec06f9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-17T23:55:57.850 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:57.848+0000 7fe5f0965640 1 -- 172.21.15.196:0/2352473636 shutdown_connections 2024-03-17T23:55:57.850 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:57.848+0000 7fe5f0965640 1 -- 172.21.15.196:0/2352473636 wait complete. 2024-03-17T23:55:57.850 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:57.848+0000 7fe5f0965640 1 Processor -- start 2024-03-17T23:55:57.851 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:57.848+0000 7fe5f0965640 1 -- start start 2024-03-17T23:55:57.852 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:57.848+0000 7fe5f0965640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe5ec0c2b60 0x7fe5ec0cab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:55:57.852 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:57.848+0000 7fe5f0965640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe5ec150f40 0x7fe5ec1f1290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:55:57.852 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:57.848+0000 7fe5f0965640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe5ec15f5d0 0x7fe5ec1f17d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:55:57.852 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:57.848+0000 7fe5f0965640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fe5ec157330 con 0x7fe5ec0c2b60 2024-03-17T23:55:57.853 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:57.848+0000 7fe5f0965640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7fe5ec157050 con 0x7fe5ec150f40 2024-03-17T23:55:57.853 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:57.848+0000 7fe5f0965640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7fe5ec156d40 con 0x7fe5ec15f5d0 2024-03-17T23:55:57.853 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:57.848+0000 7fe5ea59c640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe5ec0c2b60 0x7fe5ec0cab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:55:57.853 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:57.848+0000 7fe5ea59c640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe5ec0c2b60 0x7fe5ec0cab00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.196:56292/0 (socket says 172.21.15.196:56292) 2024-03-17T23:55:57.853 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:57.848+0000 7fe5ea59c640 1 -- 172.21.15.196:0/3426130125 learned_addr learned my addr 172.21.15.196:0/3426130125 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-03-17T23:55:57.853 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:57.848+0000 7fe5e9d9b640 1 --2- 172.21.15.196:0/3426130125 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe5ec150f40 0x7fe5ec1f1290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:55:57.853 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:57.848+0000 7fe5ead9d640 1 --2- 172.21.15.196:0/3426130125 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe5ec15f5d0 0x7fe5ec1f17d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:55:57.853 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:57.848+0000 7fe5ea59c640 1 -- 172.21.15.196:0/3426130125 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe5ec15f5d0 msgr2=0x7fe5ec1f17d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:55:57.853 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:57.848+0000 7fe5ea59c640 1 --2- 172.21.15.196:0/3426130125 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe5ec15f5d0 0x7fe5ec1f17d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:55:57.853 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:57.848+0000 7fe5ea59c640 1 -- 172.21.15.196:0/3426130125 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe5ec150f40 msgr2=0x7fe5ec1f1290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:55:57.853 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:57.848+0000 7fe5ea59c640 1 --2- 172.21.15.196:0/3426130125 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe5ec150f40 0x7fe5ec1f1290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:55:57.853 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:57.848+0000 7fe5ea59c640 1 -- 172.21.15.196:0/3426130125 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5ec14bd60 con 0x7fe5ec0c2b60 2024-03-17T23:55:57.853 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:57.848+0000 7fe5ead9d640 1 --2- 172.21.15.196:0/3426130125 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe5ec15f5d0 0x7fe5ec1f17d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-17T23:55:57.853 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:57.848+0000 7fe5e9d9b640 1 --2- 172.21.15.196:0/3426130125 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe5ec150f40 0x7fe5ec1f1290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-17T23:55:57.853 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:57.848+0000 7fe5ea59c640 1 --2- 172.21.15.196:0/3426130125 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe5ec0c2b60 0x7fe5ec0cab00 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fe5dc00c7f0 tx=0x7fe5dc00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:55:57.854 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:57.852+0000 7fe5daffd640 1 -- 172.21.15.196:0/3426130125 <== mon.0 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5dc015070 con 0x7fe5ec0c2b60 2024-03-17T23:55:57.854 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:57.852+0000 7fe5daffd640 1 -- 172.21.15.196:0/3426130125 <== mon.0 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe5dc004240 con 0x7fe5ec0c2b60 2024-03-17T23:55:57.854 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:57.852+0000 7fe5daffd640 1 -- 172.21.15.196:0/3426130125 <== mon.0 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5dc003620 con 0x7fe5ec0c2b60 2024-03-17T23:55:57.854 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:57.852+0000 7fe5f0965640 1 -- 172.21.15.196:0/3426130125 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe5ec0cb040 con 0x7fe5ec0c2b60 2024-03-17T23:55:57.854 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:57.852+0000 7fe5f0965640 1 -- 172.21.15.196:0/3426130125 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5ec0c6910 con 0x7fe5ec0c2b60 2024-03-17T23:55:57.855 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:57.852+0000 7fe5f0965640 1 -- 172.21.15.196:0/3426130125 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe5ec0689a0 con 0x7fe5ec0c2b60 2024-03-17T23:55:57.855 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:57.852+0000 7fe5daffd640 1 -- 172.21.15.196:0/3426130125 <== mon.0 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 4) ==== 87027+0+0 (secure 0 0 0) 0x7fe5dc0039d0 con 0x7fe5ec0c2b60 2024-03-17T23:55:57.855 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:57.852+0000 7fe5daffd640 1 --2- 172.21.15.196:0/3426130125 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7fe5cc0675d0 0x7fe5cc069a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:55:57.855 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:57.852+0000 7fe5daffd640 1 -- 172.21.15.196:0/3426130125 <== mon.0 v2:172.21.15.196:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7fe5dc085420 con 0x7fe5ec0c2b60 2024-03-17T23:55:57.855 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:57.852+0000 7fe5e9d9b640 1 --2- 172.21.15.196:0/3426130125 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7fe5cc0675d0 0x7fe5cc069a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:55:57.855 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:57.852+0000 7fe5e9d9b640 1 --2- 172.21.15.196:0/3426130125 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7fe5cc0675d0 0x7fe5cc069a90 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fe5ec14bab0 tx=0x7fe5e0008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:55:57.858 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:57.856+0000 7fe5daffd640 1 -- 172.21.15.196:0/3426130125 <== mon.0 v2:172.21.15.196:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177849 (secure 0 0 0) 0x7fe5dc0564d0 con 0x7fe5ec0c2b60 2024-03-17T23:55:58.003 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:58.000+0000 7fe5f0965640 1 -- 172.21.15.196:0/3426130125 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fe5ec073450 con 0x7fe5ec0c2b60 2024-03-17T23:55:58.004 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:58.000+0000 7fe5daffd640 1 -- 172.21.15.196:0/3426130125 <== mon.0 v2:172.21.15.196:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) ==== 93+0+10 (secure 0 0 0) 0x7fe5dc055dd0 con 0x7fe5ec0c2b60 2024-03-17T23:55:58.004 INFO:teuthology.orchestra.run.smithi196.stdout:pg_num: 1 2024-03-17T23:55:58.006 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:58.004+0000 7fe5f0965640 1 -- 172.21.15.196:0/3426130125 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7fe5cc0675d0 msgr2=0x7fe5cc069a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:55:58.006 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:58.004+0000 7fe5f0965640 1 --2- 172.21.15.196:0/3426130125 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7fe5cc0675d0 0x7fe5cc069a90 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fe5ec14bab0 tx=0x7fe5e0008040 comp rx=0 tx=0).stop 2024-03-17T23:55:58.006 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:58.004+0000 7fe5f0965640 1 -- 172.21.15.196:0/3426130125 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe5ec0c2b60 msgr2=0x7fe5ec0cab00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:55:58.006 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:58.004+0000 7fe5f0965640 1 --2- 172.21.15.196:0/3426130125 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe5ec0c2b60 0x7fe5ec0cab00 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fe5dc00c7f0 tx=0x7fe5dc00ccb0 comp rx=0 tx=0).stop 2024-03-17T23:55:58.006 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:58.004+0000 7fe5f0965640 1 -- 172.21.15.196:0/3426130125 shutdown_connections 2024-03-17T23:55:58.007 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:58.004+0000 7fe5f0965640 1 --2- 172.21.15.196:0/3426130125 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7fe5cc0675d0 0x7fe5cc069a90 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:55:58.007 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:58.004+0000 7fe5f0965640 1 --2- 172.21.15.196:0/3426130125 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe5ec15f5d0 0x7fe5ec1f17d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:55:58.007 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:58.004+0000 7fe5f0965640 1 --2- 172.21.15.196:0/3426130125 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe5ec150f40 0x7fe5ec1f1290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:55:58.007 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:58.004+0000 7fe5f0965640 1 --2- 172.21.15.196:0/3426130125 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe5ec0c2b60 0x7fe5ec0cab00 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:55:58.007 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:58.004+0000 7fe5f0965640 1 -- 172.21.15.196:0/3426130125 >> 172.21.15.196:0/3426130125 conn(0x7fe5ec06f5e0 msgr2=0x7fe5ec0b16d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-17T23:55:58.007 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:58.004+0000 7fe5f0965640 1 -- 172.21.15.196:0/3426130125 shutdown_connections 2024-03-17T23:55:58.007 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:58.004+0000 7fe5f0965640 1 -- 172.21.15.196:0/3426130125 wait complete. 2024-03-17T23:55:58.022 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-03-17T23:55:58.132 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:58.132+0000 7f7122ede640 1 Processor -- start 2024-03-17T23:55:58.132 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:58.132+0000 7f7122ede640 1 -- start start 2024-03-17T23:55:58.134 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:58.132+0000 7f7122ede640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f711c0c8240 0x7f711c0c9b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:55:58.134 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:58.132+0000 7f7122ede640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f711c0c4660 0x7f711c0ca060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:55:58.134 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:58.132+0000 7f7122ede640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f711c06fea0 con 0x7f711c0b0150 2024-03-17T23:55:58.134 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:58.132+0000 7f7122ede640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7f711c0b0530 con 0x7f711c0c8240 2024-03-17T23:55:58.134 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:58.132+0000 7f7122ede640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f711c070180 con 0x7f711c0c4660 2024-03-17T23:55:58.134 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:58.132+0000 7f711bfff640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f711c0c8240 0x7f711c0c9b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:55:58.134 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:58.132+0000 7f7120c7a640 1 --1- >> v1:172.21.15.196:6789/0 conn(0x7f711c0b0150 0x7f711c06c3c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.196:6789/0 says I am v1:172.21.15.196:60894/0 (socket says 172.21.15.196:60894) 2024-03-17T23:55:58.134 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:58.132+0000 7f7120c7a640 1 -- 172.21.15.196:0/3703021813 learned_addr learned my addr 172.21.15.196:0/3703021813 (peer_addr_for_me v1:172.21.15.196:0/0) 2024-03-17T23:55:58.134 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:58.132+0000 7f712147b640 1 --2- 172.21.15.196:0/3703021813 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f711c0c4660 0x7f711c0ca060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:55:58.134 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:58.132+0000 7f711bfff640 1 -- 172.21.15.196:0/3703021813 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f711c0c4660 msgr2=0x7f711c0ca060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-17T23:55:58.134 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:58.132+0000 7f711bfff640 1 --2- 172.21.15.196:0/3703021813 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f711c0c4660 0x7f711c0ca060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:55:58.135 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:58.132+0000 7f711bfff640 1 -- 172.21.15.196:0/3703021813 >> v1:172.21.15.196:6789/0 conn(0x7f711c0b0150 legacy=0x7f711c06c3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:55:58.135 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:58.132+0000 7f711b7fe640 1 -- 172.21.15.196:0/3703021813 <== mon.0 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1729976574 0 0) 0x7f711c06fea0 con 0x7f711c0b0150 2024-03-17T23:55:58.135 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:58.132+0000 7f711bfff640 1 -- 172.21.15.196:0/3703021813 --> v2:172.21.15.196:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f711c0c8cb0 con 0x7f711c0c8240 2024-03-17T23:55:58.135 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:58.132+0000 7f712147b640 1 --2- 172.21.15.196:0/3703021813 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f711c0c4660 0x7f711c0ca060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-17T23:55:58.137 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:58.132+0000 7f711bfff640 1 --2- 172.21.15.196:0/3703021813 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f711c0c8240 0x7f711c0c9b20 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f71080097c0 tx=0x7f710801c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f56d4007d96f209 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:55:58.137 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:58.132+0000 7f711b7fe640 1 -- 172.21.15.196:0/3703021813 <== mon.0 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71080b1070 con 0x7f711c0c8240 2024-03-17T23:55:58.137 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:58.136+0000 7f711b7fe640 1 -- 172.21.15.196:0/3703021813 <== mon.0 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f71080ac410 con 0x7f711c0c8240 2024-03-17T23:55:58.137 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:58.136+0000 7f711b7fe640 1 -- 172.21.15.196:0/3703021813 <== mon.0 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71080ac7e0 con 0x7f711c0c8240 2024-03-17T23:55:58.137 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:58.136+0000 7f7122ede640 1 -- 172.21.15.196:0/3703021813 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f711c0c8240 msgr2=0x7f711c0c9b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:55:58.137 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:58.136+0000 7f7122ede640 1 --2- 172.21.15.196:0/3703021813 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f711c0c8240 0x7f711c0c9b20 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f71080097c0 tx=0x7f710801c4a0 comp rx=0 tx=0).stop 2024-03-17T23:55:58.137 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:58.136+0000 7f7122ede640 1 -- 172.21.15.196:0/3703021813 shutdown_connections 2024-03-17T23:55:58.137 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:58.136+0000 7f7122ede640 1 --2- 172.21.15.196:0/3703021813 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f711c0c4660 0x7f711c0ca060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:55:58.137 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:58.136+0000 7f7122ede640 1 --2- 172.21.15.196:0/3703021813 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f711c0c8240 0x7f711c0c9b20 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:55:58.137 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:58.136+0000 7f7122ede640 1 -- 172.21.15.196:0/3703021813 >> 172.21.15.196:0/3703021813 conn(0x7f711c06b2b0 msgr2=0x7f711c06b6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-17T23:55:58.137 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:58.136+0000 7f7122ede640 1 -- 172.21.15.196:0/3703021813 shutdown_connections 2024-03-17T23:55:58.137 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:58.136+0000 7f7122ede640 1 -- 172.21.15.196:0/3703021813 wait complete. 2024-03-17T23:55:58.138 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:58.136+0000 7f7122ede640 1 Processor -- start 2024-03-17T23:55:58.138 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:58.136+0000 7f7122ede640 1 -- start start 2024-03-17T23:55:58.140 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:58.136+0000 7f7122ede640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f711c0b0150 0x7f711c1576d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:55:58.140 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:58.136+0000 7f7122ede640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f711c0c4660 0x7f711c159d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:55:58.140 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:58.136+0000 7f7122ede640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f711c0c8240 0x7f711c0b0cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:55:58.140 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:58.136+0000 7f7122ede640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f711c06cc50 con 0x7f711c0c8240 2024-03-17T23:55:58.140 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:58.136+0000 7f7122ede640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f711c06cad0 con 0x7f711c0b0150 2024-03-17T23:55:58.140 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:58.136+0000 7f7122ede640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f711c167030 con 0x7f711c0c4660 2024-03-17T23:55:58.140 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:58.136+0000 7f712147b640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f711c0c8240 0x7f711c0b0cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:55:58.140 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:58.136+0000 7f712147b640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f711c0c8240 0x7f711c0b0cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.196:56302/0 (socket says 172.21.15.196:56302) 2024-03-17T23:55:58.140 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:58.136+0000 7f712147b640 1 -- 172.21.15.196:0/2184884068 learned_addr learned my addr 172.21.15.196:0/2184884068 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-03-17T23:55:58.140 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:58.136+0000 7f711bfff640 1 --2- 172.21.15.196:0/2184884068 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f711c0c4660 0x7f711c159d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:55:58.141 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:58.136+0000 7f7120c7a640 1 --2- 172.21.15.196:0/2184884068 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f711c0b0150 0x7f711c1576d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:55:58.141 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:58.136+0000 7f712147b640 1 -- 172.21.15.196:0/2184884068 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f711c0c4660 msgr2=0x7f711c159d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:55:58.141 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:58.136+0000 7f712147b640 1 --2- 172.21.15.196:0/2184884068 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f711c0c4660 0x7f711c159d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:55:58.141 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:58.136+0000 7f712147b640 1 -- 172.21.15.196:0/2184884068 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f711c0b0150 msgr2=0x7f711c1576d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:55:58.141 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:58.136+0000 7f712147b640 1 --2- 172.21.15.196:0/2184884068 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f711c0b0150 0x7f711c1576d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:55:58.141 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:58.136+0000 7f712147b640 1 -- 172.21.15.196:0/2184884068 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f711c1f6490 con 0x7f711c0c8240 2024-03-17T23:55:58.141 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:58.136+0000 7f712147b640 1 --2- 172.21.15.196:0/2184884068 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f711c0c8240 0x7f711c0b0cf0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f7114007ef0 tx=0x7f711400d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:55:58.141 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:58.136+0000 7f71197fa640 1 -- 172.21.15.196:0/2184884068 <== mon.0 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f711401a070 con 0x7f711c0c8240 2024-03-17T23:55:58.141 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:58.136+0000 7f71197fa640 1 -- 172.21.15.196:0/2184884068 <== mon.0 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7114003ba0 con 0x7f711c0c8240 2024-03-17T23:55:58.141 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:58.136+0000 7f7122ede640 1 -- 172.21.15.196:0/2184884068 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f711c1f21c0 con 0x7f711c0c8240 2024-03-17T23:55:58.141 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:58.136+0000 7f71197fa640 1 -- 172.21.15.196:0/2184884068 <== mon.0 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7114004030 con 0x7f711c0c8240 2024-03-17T23:55:58.141 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:58.136+0000 7f7122ede640 1 -- 172.21.15.196:0/2184884068 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f711c1f2460 con 0x7f711c0c8240 2024-03-17T23:55:58.141 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:58.140+0000 7f7122ede640 1 -- 172.21.15.196:0/2184884068 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f711c0689a0 con 0x7f711c0c8240 2024-03-17T23:55:58.142 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:58.140+0000 7f71197fa640 1 -- 172.21.15.196:0/2184884068 <== mon.0 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 4) ==== 87027+0+0 (secure 0 0 0) 0x7f711401d070 con 0x7f711c0c8240 2024-03-17T23:55:58.142 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:58.140+0000 7f71197fa640 1 --2- 172.21.15.196:0/2184884068 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f71000675d0 0x7f7100069a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:55:58.142 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:58.140+0000 7f71197fa640 1 -- 172.21.15.196:0/2184884068 <== mon.0 v2:172.21.15.196:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7f71140855c0 con 0x7f711c0c8240 2024-03-17T23:55:58.142 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:58.140+0000 7f7120c7a640 1 --2- 172.21.15.196:0/2184884068 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f71000675d0 0x7f7100069a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:55:58.142 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:58.140+0000 7f7120c7a640 1 --2- 172.21.15.196:0/2184884068 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f71000675d0 0x7f7100069a90 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f7110000f70 tx=0x7f7110009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:55:58.146 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:58.144+0000 7f71197fa640 1 -- 172.21.15.196:0/2184884068 <== mon.0 v2:172.21.15.196:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177849 (secure 0 0 0) 0x7f7114010070 con 0x7f711c0c8240 2024-03-17T23:55:58.306 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:58.304+0000 7f7122ede640 1 -- 172.21.15.196:0/2184884068 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f711c071b50 con 0x7f711c0c8240 2024-03-17T23:55:58.306 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:58.304+0000 7f71197fa640 1 -- 172.21.15.196:0/2184884068 <== mon.0 v2:172.21.15.196:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v16) ==== 84+0+65 (secure 0 0 0) 0x7f7114056020 con 0x7f711c0c8240 2024-03-17T23:55:58.307 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-03-17T23:55:58.307 INFO:teuthology.orchestra.run.smithi196.stdout:[ 2024-03-17T23:55:58.307 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-03-17T23:55:58.307 INFO:teuthology.orchestra.run.smithi196.stdout: "poolnum": 1, 2024-03-17T23:55:58.307 INFO:teuthology.orchestra.run.smithi196.stdout: "poolname": ".mgr" 2024-03-17T23:55:58.307 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-03-17T23:55:58.307 INFO:teuthology.orchestra.run.smithi196.stdout:] 2024-03-17T23:55:58.309 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:58.308+0000 7f7122ede640 1 -- 172.21.15.196:0/2184884068 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f71000675d0 msgr2=0x7f7100069a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:55:58.309 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:58.308+0000 7f7122ede640 1 --2- 172.21.15.196:0/2184884068 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f71000675d0 0x7f7100069a90 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f7110000f70 tx=0x7f7110009040 comp rx=0 tx=0).stop 2024-03-17T23:55:58.309 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:58.308+0000 7f7122ede640 1 -- 172.21.15.196:0/2184884068 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f711c0c8240 msgr2=0x7f711c0b0cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:55:58.309 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:58.308+0000 7f7122ede640 1 --2- 172.21.15.196:0/2184884068 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f711c0c8240 0x7f711c0b0cf0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f7114007ef0 tx=0x7f711400d4a0 comp rx=0 tx=0).stop 2024-03-17T23:55:58.309 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:58.308+0000 7f7122ede640 1 -- 172.21.15.196:0/2184884068 shutdown_connections 2024-03-17T23:55:58.309 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:58.308+0000 7f7122ede640 1 --2- 172.21.15.196:0/2184884068 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f71000675d0 0x7f7100069a90 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:55:58.309 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:58.308+0000 7f7122ede640 1 --2- 172.21.15.196:0/2184884068 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f711c0c4660 0x7f711c159d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:55:58.309 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:58.308+0000 7f7122ede640 1 --2- 172.21.15.196:0/2184884068 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f711c0c8240 0x7f711c0b0cf0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:55:58.309 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:58.308+0000 7f7122ede640 1 --2- 172.21.15.196:0/2184884068 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f711c0b0150 0x7f711c1576d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:55:58.309 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:58.308+0000 7f7122ede640 1 -- 172.21.15.196:0/2184884068 >> 172.21.15.196:0/2184884068 conn(0x7f711c06b2b0 msgr2=0x7f711c06c3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-17T23:55:58.309 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:58.308+0000 7f7122ede640 1 -- 172.21.15.196:0/2184884068 shutdown_connections 2024-03-17T23:55:58.309 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:58.308+0000 7f7122ede640 1 -- 172.21.15.196:0/2184884068 wait complete. 2024-03-17T23:55:58.323 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-03-17T23:55:58.324 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-03-17T23:55:58.444 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:58.440+0000 7fa8e29ad640 1 Processor -- start 2024-03-17T23:55:58.444 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:58.444+0000 7fa8e29ad640 1 -- start start 2024-03-17T23:55:58.447 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:58.444+0000 7fa8e29ad640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fa8dc0c7f70 0x7fa8dc0c78f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:55:58.447 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:58.444+0000 7fa8e29ad640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa8dc1577e0 con 0x7fa8dc0735f0 2024-03-17T23:55:58.447 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:58.444+0000 7fa8e29ad640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa8dc157ac0 con 0x7fa8dc1511a0 2024-03-17T23:55:58.448 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:58.444+0000 7fa8e29ad640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 -- 0x7fa8dc0c8970 con 0x7fa8dc0c7f70 2024-03-17T23:55:58.448 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:58.444+0000 7fa8d3fff640 1 --1- >> v1:172.21.15.196:6789/0 conn(0x7fa8dc0735f0 0x7fa8dc0c3ae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.196:6789/0 says I am v1:172.21.15.196:60896/0 (socket says 172.21.15.196:60896) 2024-03-17T23:55:58.448 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:58.444+0000 7fa8d3fff640 1 -- 172.21.15.196:0/717110589 learned_addr learned my addr 172.21.15.196:0/717110589 (peer_addr_for_me v1:172.21.15.196:0/0) 2024-03-17T23:55:58.448 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:58.444+0000 7fa8e0f4a640 1 --2- 172.21.15.196:0/717110589 >> v2:172.21.15.204:3300/0 conn(0x7fa8dc0c7f70 0x7fa8dc0c78f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:55:58.448 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:58.444+0000 7fa8db7fe640 1 -- 172.21.15.196:0/717110589 <== mon.0 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2972882970 0 0) 0x7fa8dc1577e0 con 0x7fa8dc0735f0 2024-03-17T23:55:58.448 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:58.444+0000 7fa8db7fe640 1 -- 172.21.15.196:0/717110589 --> v1:172.21.15.196:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa8c8003530 con 0x7fa8dc0735f0 2024-03-17T23:55:58.448 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:58.444+0000 7fa8db7fe640 1 -- 172.21.15.196:0/717110589 <== mon.0 v1:172.21.15.196:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2209905185 0 0) 0x7fa8c8003530 con 0x7fa8dc0735f0 2024-03-17T23:55:58.448 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:58.444+0000 7fa8db7fe640 1 -- 172.21.15.196:0/717110589 >> v2:172.21.15.204:3300/0 conn(0x7fa8dc0c7f70 msgr2=0x7fa8dc0c78f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-17T23:55:58.448 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:58.444+0000 7fa8db7fe640 1 --2- 172.21.15.196:0/717110589 >> v2:172.21.15.204:3300/0 conn(0x7fa8dc0c7f70 0x7fa8dc0c78f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:55:58.448 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:58.444+0000 7fa8db7fe640 1 -- 172.21.15.196:0/717110589 >> v1:172.21.15.204:6789/0 conn(0x7fa8dc1511a0 legacy=0x7fa8dc072450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:55:58.448 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:58.444+0000 7fa8db7fe640 1 -- 172.21.15.196:0/717110589 --> v1:172.21.15.196:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8dc0c8bc0 con 0x7fa8dc0735f0 2024-03-17T23:55:58.448 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:58.444+0000 7fa8db7fe640 1 -- 172.21.15.196:0/717110589 <== mon.0 v1:172.21.15.196:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 981458915 0 0) 0x7fa8c4001680 con 0x7fa8dc0735f0 2024-03-17T23:55:58.448 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:58.444+0000 7fa8db7fe640 1 -- 172.21.15.196:0/717110589 >> v1:172.21.15.196:6789/0 conn(0x7fa8dc0735f0 legacy=0x7fa8dc0c3ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:55:58.448 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:58.444+0000 7fa8db7fe640 1 --2- 172.21.15.196:0/717110589 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa8c80039c0 0x7fa8c8003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:55:58.449 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:58.444+0000 7fa8db7fe640 1 --2- 172.21.15.196:0/717110589 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa8c8004810 0x7fa8c8004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:55:58.449 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:58.444+0000 7fa8db7fe640 1 --2- 172.21.15.196:0/717110589 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa8c80051d0 0x7fa8c800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:55:58.449 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:58.444+0000 7fa8db7fe640 1 -- 172.21.15.196:0/717110589 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fa8dc0c8970 con 0x7fa8c80039c0 2024-03-17T23:55:58.449 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:58.444+0000 7fa8db7fe640 1 -- 172.21.15.196:0/717110589 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7fa8c800c080 con 0x7fa8c80051d0 2024-03-17T23:55:58.449 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:58.444+0000 7fa8db7fe640 1 -- 172.21.15.196:0/717110589 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7fa8c800c280 con 0x7fa8c8004810 2024-03-17T23:55:58.449 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:58.444+0000 7fa8dbfff640 1 --2- 172.21.15.196:0/717110589 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa8c80039c0 0x7fa8c8003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:55:58.449 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:58.444+0000 7fa8dbfff640 1 -- 172.21.15.196:0/717110589 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa8c8004810 msgr2=0x7fa8c8004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-17T23:55:58.449 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:58.444+0000 7fa8dbfff640 1 --2- 172.21.15.196:0/717110589 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa8c8004810 0x7fa8c8004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:55:58.449 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:58.444+0000 7fa8dbfff640 1 -- 172.21.15.196:0/717110589 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa8c80051d0 msgr2=0x7fa8c800b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-17T23:55:58.450 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:58.444+0000 7fa8dbfff640 1 --2- 172.21.15.196:0/717110589 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa8c80051d0 0x7fa8c800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:55:58.450 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:58.444+0000 7fa8e0f4a640 1 -- 172.21.15.196:0/717110589 reap_dead start 2024-03-17T23:55:58.450 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:58.444+0000 7fa8dbfff640 1 -- 172.21.15.196:0/717110589 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8c8003530 con 0x7fa8c80039c0 2024-03-17T23:55:58.451 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:58.448+0000 7fa8dbfff640 1 --2- 172.21.15.196:0/717110589 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa8c80039c0 0x7fa8c8003de0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fa8cc001780 tx=0x7fa8cc01c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3dbdfb391079cdc1 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:55:58.451 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:58.448+0000 7fa8db7fe640 1 -- 172.21.15.196:0/717110589 <== mon.0 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8cc0013a0 con 0x7fa8c80039c0 2024-03-17T23:55:58.451 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:58.448+0000 7fa8db7fe640 1 -- 172.21.15.196:0/717110589 <== mon.0 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa8cc0a9070 con 0x7fa8c80039c0 2024-03-17T23:55:58.451 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:58.448+0000 7fa8db7fe640 1 -- 172.21.15.196:0/717110589 <== mon.0 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8cc003600 con 0x7fa8c80039c0 2024-03-17T23:55:58.451 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:58.448+0000 7fa8e29ad640 1 -- 172.21.15.196:0/717110589 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa8c80039c0 msgr2=0x7fa8c8003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:55:58.451 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:58.448+0000 7fa8e29ad640 1 --2- 172.21.15.196:0/717110589 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa8c80039c0 0x7fa8c8003de0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fa8cc001780 tx=0x7fa8cc01c420 comp rx=0 tx=0).stop 2024-03-17T23:55:58.452 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:58.448+0000 7fa8e29ad640 1 -- 172.21.15.196:0/717110589 shutdown_connections 2024-03-17T23:55:58.452 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:58.448+0000 7fa8e29ad640 1 --2- 172.21.15.196:0/717110589 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa8c80039c0 0x7fa8c8003de0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:55:58.452 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:58.448+0000 7fa8e29ad640 1 -- 172.21.15.196:0/717110589 >> 172.21.15.196:0/717110589 conn(0x7fa8dc0cc5e0 msgr2=0x7fa8dc0cc9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-17T23:55:58.452 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:58.448+0000 7fa8e29ad640 1 -- 172.21.15.196:0/717110589 shutdown_connections 2024-03-17T23:55:58.452 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:58.448+0000 7fa8e29ad640 1 -- 172.21.15.196:0/717110589 wait complete. 2024-03-17T23:55:58.452 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:58.448+0000 7fa8e29ad640 1 Processor -- start 2024-03-17T23:55:58.452 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:58.448+0000 7fa8e29ad640 1 -- start start 2024-03-17T23:55:58.455 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:58.448+0000 7fa8e29ad640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa8c80039c0 0x7fa8dc153aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:55:58.455 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:58.448+0000 7fa8e29ad640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa8dc142cf0 0x7fa8dc153fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:55:58.455 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:58.448+0000 7fa8e29ad640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa8dc1f2df0 0x7fa8dc1f3270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:55:58.455 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:58.448+0000 7fa8e29ad640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fa8dc0c75a0 con 0x7fa8dc1f2df0 2024-03-17T23:55:58.455 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:58.448+0000 7fa8e29ad640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7fa8dc0c7080 con 0x7fa8dc142cf0 2024-03-17T23:55:58.455 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:58.448+0000 7fa8e29ad640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7fa8dc0c78f0 con 0x7fa8c80039c0 2024-03-17T23:55:58.455 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:58.448+0000 7fa8e0f4a640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa8dc1f2df0 0x7fa8dc1f3270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:55:58.455 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:58.448+0000 7fa8e0f4a640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa8dc1f2df0 0x7fa8dc1f3270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.196:56320/0 (socket says 172.21.15.196:56320) 2024-03-17T23:55:58.455 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:58.448+0000 7fa8e0f4a640 1 -- 172.21.15.196:0/2909859751 learned_addr learned my addr 172.21.15.196:0/2909859751 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-03-17T23:55:58.455 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:58.452+0000 7fa8d3fff640 1 --2- 172.21.15.196:0/2909859751 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa8dc142cf0 0x7fa8dc153fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:55:58.455 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:58.452+0000 7fa8dbfff640 1 --2- 172.21.15.196:0/2909859751 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa8c80039c0 0x7fa8dc153aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:55:58.455 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:58.452+0000 7fa8e0f4a640 1 -- 172.21.15.196:0/2909859751 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa8c80039c0 msgr2=0x7fa8dc153aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:55:58.456 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:58.452+0000 7fa8e0f4a640 1 --2- 172.21.15.196:0/2909859751 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa8c80039c0 0x7fa8dc153aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:55:58.456 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:58.452+0000 7fa8e0f4a640 1 -- 172.21.15.196:0/2909859751 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa8dc142cf0 msgr2=0x7fa8dc153fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:55:58.456 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:58.452+0000 7fa8e0f4a640 1 --2- 172.21.15.196:0/2909859751 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa8dc142cf0 0x7fa8dc153fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:55:58.456 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:58.452+0000 7fa8e0f4a640 1 -- 172.21.15.196:0/2909859751 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8dc156ec0 con 0x7fa8dc1f2df0 2024-03-17T23:55:58.456 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:58.452+0000 7fa8dbfff640 1 --2- 172.21.15.196:0/2909859751 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa8c80039c0 0x7fa8dc153aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-17T23:55:58.456 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:58.452+0000 7fa8d3fff640 1 --2- 172.21.15.196:0/2909859751 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa8dc142cf0 0x7fa8dc153fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-17T23:55:58.456 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:58.452+0000 7fa8e0f4a640 1 --2- 172.21.15.196:0/2909859751 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa8dc1f2df0 0x7fa8dc1f3270 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fa8dc071000 tx=0x7fa8d400eee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:55:58.456 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:58.452+0000 7fa8d97fa640 1 -- 172.21.15.196:0/2909859751 <== mon.0 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8d400bb10 con 0x7fa8dc1f2df0 2024-03-17T23:55:58.456 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:58.452+0000 7fa8d97fa640 1 -- 172.21.15.196:0/2909859751 <== mon.0 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa8d401a070 con 0x7fa8dc1f2df0 2024-03-17T23:55:58.456 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:58.452+0000 7fa8e29ad640 1 -- 172.21.15.196:0/2909859751 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8dc143bd0 con 0x7fa8dc1f2df0 2024-03-17T23:55:58.456 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:58.452+0000 7fa8d97fa640 1 -- 172.21.15.196:0/2909859751 <== mon.0 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8d4014400 con 0x7fa8dc1f2df0 2024-03-17T23:55:58.456 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:58.452+0000 7fa8e29ad640 1 -- 172.21.15.196:0/2909859751 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8dc156be0 con 0x7fa8dc1f2df0 2024-03-17T23:55:58.456 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:58.452+0000 7fa8e29ad640 1 -- 172.21.15.196:0/2909859751 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa8dc0689a0 con 0x7fa8dc1f2df0 2024-03-17T23:55:58.456 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:58.452+0000 7fa8d97fa640 1 -- 172.21.15.196:0/2909859751 <== mon.0 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 4) ==== 87027+0+0 (secure 0 0 0) 0x7fa8d4013070 con 0x7fa8dc1f2df0 2024-03-17T23:55:58.457 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:58.452+0000 7fa8d97fa640 1 --2- 172.21.15.196:0/2909859751 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7fa8bc0675d0 0x7fa8bc069a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:55:58.457 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:58.452+0000 7fa8d97fa640 1 -- 172.21.15.196:0/2909859751 <== mon.0 v2:172.21.15.196:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7fa8d4085480 con 0x7fa8dc1f2df0 2024-03-17T23:55:58.457 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:58.452+0000 7fa8dbfff640 1 --2- 172.21.15.196:0/2909859751 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7fa8bc0675d0 0x7fa8bc069a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:55:58.457 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:58.452+0000 7fa8dbfff640 1 --2- 172.21.15.196:0/2909859751 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7fa8bc0675d0 0x7fa8bc069a90 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fa8cc001750 tx=0x7fa8cc0011a0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:55:58.459 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:58.456+0000 7fa8d97fa640 1 -- 172.21.15.196:0/2909859751 <== mon.0 v2:172.21.15.196:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177849 (secure 0 0 0) 0x7fa8d40565c0 con 0x7fa8dc1f2df0 2024-03-17T23:55:58.621 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:58.620+0000 7fa8e29ad640 1 -- 172.21.15.196:0/2909859751 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7fa8dc070d40 con 0x7fa8dc1f2df0 2024-03-17T23:55:59.628 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:59.624+0000 7fa8d97fa640 1 -- 172.21.15.196:0/2909859751 <== mon.0 v2:172.21.15.196:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v18) ==== 138+0+0 (secure 0 0 0) 0x7fa8d4055ec0 con 0x7fa8dc1f2df0 2024-03-17T23:55:59.628 INFO:teuthology.orchestra.run.smithi196.stderr:pool 'cephfs_metadata' created 2024-03-17T23:55:59.631 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:59.628+0000 7fa8e29ad640 1 -- 172.21.15.196:0/2909859751 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7fa8bc0675d0 msgr2=0x7fa8bc069a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:55:59.631 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:59.628+0000 7fa8e29ad640 1 --2- 172.21.15.196:0/2909859751 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7fa8bc0675d0 0x7fa8bc069a90 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fa8cc001750 tx=0x7fa8cc0011a0 comp rx=0 tx=0).stop 2024-03-17T23:55:59.631 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:59.628+0000 7fa8e29ad640 1 -- 172.21.15.196:0/2909859751 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa8dc1f2df0 msgr2=0x7fa8dc1f3270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:55:59.631 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:59.628+0000 7fa8e29ad640 1 --2- 172.21.15.196:0/2909859751 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa8dc1f2df0 0x7fa8dc1f3270 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fa8dc071000 tx=0x7fa8d400eee0 comp rx=0 tx=0).stop 2024-03-17T23:55:59.632 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:59.628+0000 7fa8e29ad640 1 -- 172.21.15.196:0/2909859751 shutdown_connections 2024-03-17T23:55:59.632 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:59.628+0000 7fa8e29ad640 1 --2- 172.21.15.196:0/2909859751 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7fa8bc0675d0 0x7fa8bc069a90 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:55:59.632 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:59.628+0000 7fa8e29ad640 1 --2- 172.21.15.196:0/2909859751 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa8dc1f2df0 0x7fa8dc1f3270 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:55:59.632 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:59.628+0000 7fa8e29ad640 1 --2- 172.21.15.196:0/2909859751 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa8dc142cf0 0x7fa8dc153fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:55:59.632 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:59.628+0000 7fa8e29ad640 1 --2- 172.21.15.196:0/2909859751 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa8c80039c0 0x7fa8dc153aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:55:59.632 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:59.628+0000 7fa8e29ad640 1 -- 172.21.15.196:0/2909859751 >> 172.21.15.196:0/2909859751 conn(0x7fa8dc0cc5e0 msgr2=0x7fa8dc0c5ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-17T23:55:59.632 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:59.628+0000 7fa8e29ad640 1 -- 172.21.15.196:0/2909859751 shutdown_connections 2024-03-17T23:55:59.632 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:59.628+0000 7fa8e29ad640 1 -- 172.21.15.196:0/2909859751 wait complete. 2024-03-17T23:55:59.659 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-03-17T23:55:59.789 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:59.788+0000 7f2e1c4b5640 1 Processor -- start 2024-03-17T23:55:59.789 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:59.788+0000 7f2e1c4b5640 1 -- start start 2024-03-17T23:55:59.791 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:59.788+0000 7f2e1c4b5640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f2e141544b0 0x7f2e14070240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:55:59.791 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:59.788+0000 7f2e1c4b5640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2e14159f40 0x7f2e14070780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:55:59.791 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:59.788+0000 7f2e1c4b5640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2e1415a3d0 con 0x7f2e1406bcc0 2024-03-17T23:55:59.791 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:59.788+0000 7f2e1c4b5640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7f2e1415a6b0 con 0x7f2e141544b0 2024-03-17T23:55:59.791 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:59.788+0000 7f2e1c4b5640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f2e1415a990 con 0x7f2e14159f40 2024-03-17T23:55:59.791 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:59.788+0000 7f2e1a251640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f2e141544b0 0x7f2e14070240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:55:59.791 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:59.788+0000 7f2e1aa52640 1 --1- >> v1:172.21.15.196:6789/0 conn(0x7f2e1406bcc0 0x7f2e14072660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.196:6789/0 says I am v1:172.21.15.196:60902/0 (socket says 172.21.15.196:60902) 2024-03-17T23:55:59.791 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:59.788+0000 7f2e1a251640 1 --2- 172.21.15.196:0/2074666645 >> v2:172.21.15.196:3300/0 conn(0x7f2e141544b0 0x7f2e14070240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.196:56322/0 (socket says 172.21.15.196:56322) 2024-03-17T23:55:59.792 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:59.788+0000 7f2e1aa52640 1 -- 172.21.15.196:0/2074666645 learned_addr learned my addr 172.21.15.196:0/2074666645 (peer_addr_for_me v1:172.21.15.196:0/0) 2024-03-17T23:55:59.792 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:59.788+0000 7f2e19a50640 1 --2- 172.21.15.196:0/2074666645 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2e14159f40 0x7f2e14070780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:55:59.792 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:59.788+0000 7f2e1a251640 1 -- 172.21.15.196:0/2074666645 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2e14159f40 msgr2=0x7f2e14070780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-17T23:55:59.792 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:59.788+0000 7f2e1a251640 1 --2- 172.21.15.196:0/2074666645 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2e14159f40 0x7f2e14070780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:55:59.792 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:59.788+0000 7f2e1a251640 1 -- 172.21.15.196:0/2074666645 >> v1:172.21.15.196:6789/0 conn(0x7f2e1406bcc0 legacy=0x7f2e14072660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:55:59.792 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:59.788+0000 7f2e1a251640 1 -- 172.21.15.196:0/2074666645 --> v2:172.21.15.196:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e1415ac70 con 0x7f2e141544b0 2024-03-17T23:55:59.792 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:59.788+0000 7f2e19a50640 1 --2- 172.21.15.196:0/2074666645 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2e14159f40 0x7f2e14070780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-17T23:55:59.793 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:59.792+0000 7f2e1a251640 1 --2- 172.21.15.196:0/2074666645 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2e141544b0 0x7f2e14070240 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f2e100097c0 tx=0x7f2e1001c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f374a1610e5b226 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:55:59.793 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:59.792+0000 7f2e1924f640 1 -- 172.21.15.196:0/2074666645 <== mon.0 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e100b0070 con 0x7f2e141544b0 2024-03-17T23:55:59.793 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:59.792+0000 7f2e1924f640 1 -- 172.21.15.196:0/2074666645 <== mon.0 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e100ab600 con 0x7f2e141544b0 2024-03-17T23:55:59.793 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:59.792+0000 7f2e1924f640 1 -- 172.21.15.196:0/2074666645 <== mon.0 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e100ab9d0 con 0x7f2e141544b0 2024-03-17T23:55:59.794 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:59.792+0000 7f2e1c4b5640 1 -- 172.21.15.196:0/2074666645 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2e141544b0 msgr2=0x7f2e14070240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:55:59.794 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:59.792+0000 7f2e1c4b5640 1 --2- 172.21.15.196:0/2074666645 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2e141544b0 0x7f2e14070240 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f2e100097c0 tx=0x7f2e1001c3c0 comp rx=0 tx=0).stop 2024-03-17T23:55:59.794 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:59.792+0000 7f2e1c4b5640 1 -- 172.21.15.196:0/2074666645 shutdown_connections 2024-03-17T23:55:59.795 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:59.792+0000 7f2e1c4b5640 1 --2- 172.21.15.196:0/2074666645 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2e14159f40 0x7f2e14070780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:55:59.795 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:59.792+0000 7f2e1c4b5640 1 --2- 172.21.15.196:0/2074666645 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2e141544b0 0x7f2e14070240 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:55:59.795 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:59.792+0000 7f2e1c4b5640 1 -- 172.21.15.196:0/2074666645 >> 172.21.15.196:0/2074666645 conn(0x7f2e140cc5e0 msgr2=0x7f2e140cc9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-17T23:55:59.795 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:59.792+0000 7f2e1c4b5640 1 -- 172.21.15.196:0/2074666645 shutdown_connections 2024-03-17T23:55:59.795 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:59.792+0000 7f2e1c4b5640 1 -- 172.21.15.196:0/2074666645 wait complete. 2024-03-17T23:55:59.795 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:59.792+0000 7f2e1c4b5640 1 Processor -- start 2024-03-17T23:55:59.795 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:59.792+0000 7f2e1c4b5640 1 -- start start 2024-03-17T23:55:59.798 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:59.796+0000 7f2e1c4b5640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2e1406bcc0 0x7f2e140cadf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:55:59.798 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:59.796+0000 7f2e1c4b5640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2e141544b0 0x7f2e141533f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:55:59.798 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:59.796+0000 7f2e1c4b5640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2e140c99c0 0x7f2e1414f3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:55:59.798 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:59.796+0000 7f2e1c4b5640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f2e14072d70 con 0x7f2e140c99c0 2024-03-17T23:55:59.798 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:59.796+0000 7f2e1c4b5640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f2e140cd3f0 con 0x7f2e1406bcc0 2024-03-17T23:55:59.798 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:59.796+0000 7f2e1c4b5640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f2e14072ef0 con 0x7f2e141544b0 2024-03-17T23:55:59.798 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:59.796+0000 7f2e1aa52640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2e140c99c0 0x7f2e1414f3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:55:59.798 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:59.796+0000 7f2e1aa52640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2e140c99c0 0x7f2e1414f3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.196:56330/0 (socket says 172.21.15.196:56330) 2024-03-17T23:55:59.798 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:59.796+0000 7f2e1aa52640 1 -- 172.21.15.196:0/496719362 learned_addr learned my addr 172.21.15.196:0/496719362 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-03-17T23:55:59.798 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:59.796+0000 7f2e19a50640 1 --2- 172.21.15.196:0/496719362 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2e141544b0 0x7f2e141533f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:55:59.799 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:59.796+0000 7f2e1a251640 1 --2- 172.21.15.196:0/496719362 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2e1406bcc0 0x7f2e140cadf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:55:59.799 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:59.796+0000 7f2e1aa52640 1 -- 172.21.15.196:0/496719362 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2e141544b0 msgr2=0x7f2e141533f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:55:59.799 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:59.796+0000 7f2e1aa52640 1 --2- 172.21.15.196:0/496719362 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2e141544b0 0x7f2e141533f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:55:59.799 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:59.796+0000 7f2e1aa52640 1 -- 172.21.15.196:0/496719362 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2e1406bcc0 msgr2=0x7f2e140cadf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:55:59.799 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:59.796+0000 7f2e1aa52640 1 --2- 172.21.15.196:0/496719362 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2e1406bcc0 0x7f2e140cadf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:55:59.799 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:59.796+0000 7f2e1aa52640 1 -- 172.21.15.196:0/496719362 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e141f3890 con 0x7f2e140c99c0 2024-03-17T23:55:59.799 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:59.796+0000 7f2e1aa52640 1 --2- 172.21.15.196:0/496719362 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2e140c99c0 0x7f2e1414f3e0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f2e0c00e7b0 tx=0x7f2e0c00ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:55:59.799 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:59.796+0000 7f2e0affd640 1 -- 172.21.15.196:0/496719362 <== mon.0 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e0c00f930 con 0x7f2e140c99c0 2024-03-17T23:55:59.799 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:59.796+0000 7f2e0affd640 1 -- 172.21.15.196:0/496719362 <== mon.0 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e0c013070 con 0x7f2e140c99c0 2024-03-17T23:55:59.799 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:59.796+0000 7f2e0affd640 1 -- 172.21.15.196:0/496719362 <== mon.0 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e0c00fcd0 con 0x7f2e140c99c0 2024-03-17T23:55:59.799 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:59.796+0000 7f2e1c4b5640 1 -- 172.21.15.196:0/496719362 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e14148810 con 0x7f2e140c99c0 2024-03-17T23:55:59.800 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:59.796+0000 7f2e1c4b5640 1 -- 172.21.15.196:0/496719362 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e141f3e10 con 0x7f2e140c99c0 2024-03-17T23:55:59.800 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:59.796+0000 7f2e1c4b5640 1 -- 172.21.15.196:0/496719362 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2e140689a0 con 0x7f2e140c99c0 2024-03-17T23:55:59.801 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:59.796+0000 7f2e0affd640 1 -- 172.21.15.196:0/496719362 <== mon.0 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 4) ==== 87027+0+0 (secure 0 0 0) 0x7f2e0c0090d0 con 0x7f2e140c99c0 2024-03-17T23:55:59.801 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:59.796+0000 7f2e0affd640 1 --2- 172.21.15.196:0/496719362 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f2df8067600 0x7f2df8069ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:55:59.801 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:59.796+0000 7f2e0affd640 1 -- 172.21.15.196:0/496719362 <== mon.0 v2:172.21.15.196:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 5227+0+0 (secure 0 0 0) 0x7f2e0c088250 con 0x7f2e140c99c0 2024-03-17T23:55:59.801 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:59.796+0000 7f2e1a251640 1 --2- 172.21.15.196:0/496719362 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f2df8067600 0x7f2df8069ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:55:59.801 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:59.800+0000 7f2e1a251640 1 --2- 172.21.15.196:0/496719362 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f2df8067600 0x7f2df8069ac0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f2e100ad000 tx=0x7f2e10008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:55:59.804 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:59.804+0000 7f2e0affd640 1 -- 172.21.15.196:0/496719362 <== mon.0 v2:172.21.15.196:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177849 (secure 0 0 0) 0x7f2e0c059060 con 0x7f2e140c99c0 2024-03-17T23:55:59.962 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:55:59.960+0000 7f2e1c4b5640 1 -- 172.21.15.196:0/496719362 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f2e14157f50 con 0x7f2e140c99c0 2024-03-17T23:56:00.641 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:00.640+0000 7f2e0affd640 1 -- 172.21.15.196:0/496719362 <== mon.0 v2:172.21.15.196:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v19) ==== 170+0+0 (secure 0 0 0) 0x7f2e0c058960 con 0x7f2e140c99c0 2024-03-17T23:56:00.641 INFO:teuthology.orchestra.run.smithi196.stderr:pool 'cephfs_data' created 2024-03-17T23:56:00.645 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:00.644+0000 7f2e1c4b5640 1 -- 172.21.15.196:0/496719362 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f2df8067600 msgr2=0x7f2df8069ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:00.646 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:00.644+0000 7f2e1c4b5640 1 --2- 172.21.15.196:0/496719362 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f2df8067600 0x7f2df8069ac0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f2e100ad000 tx=0x7f2e10008040 comp rx=0 tx=0).stop 2024-03-17T23:56:00.646 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:00.644+0000 7f2e1c4b5640 1 -- 172.21.15.196:0/496719362 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2e140c99c0 msgr2=0x7f2e1414f3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:00.646 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:00.644+0000 7f2e1c4b5640 1 --2- 172.21.15.196:0/496719362 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2e140c99c0 0x7f2e1414f3e0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f2e0c00e7b0 tx=0x7f2e0c00ec70 comp rx=0 tx=0).stop 2024-03-17T23:56:00.646 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:00.644+0000 7f2e1c4b5640 1 -- 172.21.15.196:0/496719362 shutdown_connections 2024-03-17T23:56:00.646 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:00.644+0000 7f2e1c4b5640 1 --2- 172.21.15.196:0/496719362 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f2df8067600 0x7f2df8069ac0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:00.646 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:00.644+0000 7f2e1c4b5640 1 --2- 172.21.15.196:0/496719362 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2e141544b0 0x7f2e141533f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:00.646 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:00.644+0000 7f2e1c4b5640 1 --2- 172.21.15.196:0/496719362 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2e140c99c0 0x7f2e1414f3e0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:00.646 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:00.644+0000 7f2e1c4b5640 1 --2- 172.21.15.196:0/496719362 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2e1406bcc0 0x7f2e140cadf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:00.646 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:00.644+0000 7f2e1c4b5640 1 -- 172.21.15.196:0/496719362 >> 172.21.15.196:0/496719362 conn(0x7f2e140cc5e0 msgr2=0x7f2e14158680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-17T23:56:00.646 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:00.644+0000 7f2e1c4b5640 1 -- 172.21.15.196:0/496719362 shutdown_connections 2024-03-17T23:56:00.646 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:00.644+0000 7f2e1c4b5640 1 -- 172.21.15.196:0/496719362 wait complete. 2024-03-17T23:56:00.681 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-03-17T23:56:00.808 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:00.804+0000 7f5514d20640 1 Processor -- start 2024-03-17T23:56:00.808 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:00.804+0000 7f5514d20640 1 -- start start 2024-03-17T23:56:00.809 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:00.808+0000 7f5514d20640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f5510151dd0 0x7f551006f990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:00.809 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:00.808+0000 7f5514d20640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5510157bf0 0x7f551006f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:00.809 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:00.808+0000 7f5514d20640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5510072b00 con 0x7f55100c1f00 2024-03-17T23:56:00.809 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:00.808+0000 7f5514d20640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 -- 0x7f5510072de0 con 0x7f5510151dd0 2024-03-17T23:56:00.809 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:00.808+0000 7f5514d20640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f55100713a0 con 0x7f5510157bf0 2024-03-17T23:56:00.809 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:00.808+0000 7f550ed9d640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5510157bf0 0x7f551006f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:00.809 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:00.808+0000 7f550e59c640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f5510151dd0 0x7f551006f990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:00.809 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:00.808+0000 7f550ed9d640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5510157bf0 0x7f551006f1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3301/0 says I am v2:172.21.15.196:45414/0 (socket says 172.21.15.196:45414) 2024-03-17T23:56:00.809 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:00.808+0000 7f550ed9d640 1 -- 172.21.15.196:0/3963884691 learned_addr learned my addr 172.21.15.196:0/3963884691 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-03-17T23:56:00.809 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:00.808+0000 7f550e59c640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f5510151dd0 0x7f551006f990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3300/0 says I am v2:172.21.15.196:49256/0 (socket says 172.21.15.196:49256) 2024-03-17T23:56:00.810 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:00.808+0000 7f550e59c640 1 -- 172.21.15.196:0/3963884691 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5510157bf0 msgr2=0x7f551006f1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-17T23:56:00.810 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:00.808+0000 7f550e59c640 1 --2- 172.21.15.196:0/3963884691 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5510157bf0 0x7f551006f1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:00.810 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:00.808+0000 7f550e59c640 1 -- 172.21.15.196:0/3963884691 >> v1:172.21.15.204:6789/0 conn(0x7f55100c1f00 legacy=0x7f55100c4c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:00.810 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:00.808+0000 7f550e59c640 1 -- 172.21.15.196:0/3963884691 --> v2:172.21.15.204:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5510071680 con 0x7f5510151dd0 2024-03-17T23:56:00.810 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:00.808+0000 7f550ed9d640 1 --2- 172.21.15.196:0/3963884691 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5510157bf0 0x7f551006f1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-17T23:56:00.812 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:00.812+0000 7f550e59c640 1 --2- 172.21.15.196:0/3963884691 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5510151dd0 0x7f551006f990 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f55000097c0 tx=0x7f550001c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c78a064a4f210c8e server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:56:00.812 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:00.812+0000 7f550d59a640 1 -- 172.21.15.196:0/3963884691 <== mon.1 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55000b2070 con 0x7f5510151dd0 2024-03-17T23:56:00.813 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:00.812+0000 7f550d59a640 1 -- 172.21.15.196:0/3963884691 <== mon.1 v2:172.21.15.204:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f55000ad640 con 0x7f5510151dd0 2024-03-17T23:56:00.813 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:00.812+0000 7f550d59a640 1 -- 172.21.15.196:0/3963884691 <== mon.1 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55000ada10 con 0x7f5510151dd0 2024-03-17T23:56:00.813 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:00.812+0000 7f5514d20640 1 -- 172.21.15.196:0/3963884691 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5510151dd0 msgr2=0x7f551006f990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:00.813 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:00.812+0000 7f5514d20640 1 --2- 172.21.15.196:0/3963884691 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5510151dd0 0x7f551006f990 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f55000097c0 tx=0x7f550001c4a0 comp rx=0 tx=0).stop 2024-03-17T23:56:00.814 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:00.812+0000 7f5514d20640 1 -- 172.21.15.196:0/3963884691 shutdown_connections 2024-03-17T23:56:00.814 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:00.812+0000 7f5514d20640 1 --2- 172.21.15.196:0/3963884691 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5510157bf0 0x7f551006f1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:00.814 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:00.812+0000 7f5514d20640 1 --2- 172.21.15.196:0/3963884691 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5510151dd0 0x7f551006f990 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:00.814 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:00.812+0000 7f5514d20640 1 -- 172.21.15.196:0/3963884691 >> 172.21.15.196:0/3963884691 conn(0x7f551006b2b0 msgr2=0x7f551006b6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-17T23:56:00.814 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:00.812+0000 7f5514d20640 1 -- 172.21.15.196:0/3963884691 shutdown_connections 2024-03-17T23:56:00.814 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:00.812+0000 7f5514d20640 1 -- 172.21.15.196:0/3963884691 wait complete. 2024-03-17T23:56:00.814 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:00.812+0000 7f5514d20640 1 Processor -- start 2024-03-17T23:56:00.815 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:00.812+0000 7f5514d20640 1 -- start start 2024-03-17T23:56:00.816 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:00.812+0000 7f5514d20640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f55100c1f00 0x7f551013dcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:00.816 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:00.812+0000 7f5514d20640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5510151dd0 0x7f55101f02f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:00.817 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:00.812+0000 7f5514d20640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5510157bf0 0x7f55101f0830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:00.817 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:00.812+0000 7f5514d20640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f55100c26f0 con 0x7f5510157bf0 2024-03-17T23:56:00.817 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:00.812+0000 7f5514d20640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f55100c2570 con 0x7f55100c1f00 2024-03-17T23:56:00.817 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:00.812+0000 7f5514d20640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f55100c5310 con 0x7f5510151dd0 2024-03-17T23:56:00.817 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:00.812+0000 7f550ed9d640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5510157bf0 0x7f55101f0830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:00.817 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:00.812+0000 7f550ed9d640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5510157bf0 0x7f55101f0830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.196:56332/0 (socket says 172.21.15.196:56332) 2024-03-17T23:56:00.817 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:00.812+0000 7f550ed9d640 1 -- 172.21.15.196:0/3860697720 learned_addr learned my addr 172.21.15.196:0/3860697720 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-03-17T23:56:00.817 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:00.812+0000 7f550e59c640 1 --2- 172.21.15.196:0/3860697720 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f55100c1f00 0x7f551013dcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:00.817 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:00.812+0000 7f550dd9b640 1 --2- 172.21.15.196:0/3860697720 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5510151dd0 0x7f55101f02f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:00.817 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:00.812+0000 7f550ed9d640 1 -- 172.21.15.196:0/3860697720 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5510151dd0 msgr2=0x7f55101f02f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:00.817 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:00.812+0000 7f550ed9d640 1 --2- 172.21.15.196:0/3860697720 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5510151dd0 0x7f55101f02f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:00.817 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:00.812+0000 7f550ed9d640 1 -- 172.21.15.196:0/3860697720 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f55100c1f00 msgr2=0x7f551013dcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:00.817 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:00.812+0000 7f550ed9d640 1 --2- 172.21.15.196:0/3860697720 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f55100c1f00 0x7f551013dcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:00.818 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:00.812+0000 7f550ed9d640 1 -- 172.21.15.196:0/3860697720 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55100cae00 con 0x7f5510157bf0 2024-03-17T23:56:00.818 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:00.812+0000 7f550e59c640 1 --2- 172.21.15.196:0/3860697720 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f55100c1f00 0x7f551013dcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-17T23:56:00.818 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:00.812+0000 7f550ed9d640 1 --2- 172.21.15.196:0/3860697720 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5510157bf0 0x7f55101f0830 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f5508009f10 tx=0x7f550800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:56:00.818 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:00.816+0000 7f54feffd640 1 -- 172.21.15.196:0/3860697720 <== mon.0 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f550800cc40 con 0x7f5510157bf0 2024-03-17T23:56:00.818 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:00.816+0000 7f54feffd640 1 -- 172.21.15.196:0/3860697720 <== mon.0 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f550800cde0 con 0x7f5510157bf0 2024-03-17T23:56:00.818 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:00.816+0000 7f5514d20640 1 -- 172.21.15.196:0/3860697720 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f55101f37e0 con 0x7f5510157bf0 2024-03-17T23:56:00.818 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:00.816+0000 7f54feffd640 1 -- 172.21.15.196:0/3860697720 <== mon.0 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5508003bc0 con 0x7f5510157bf0 2024-03-17T23:56:00.818 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:00.816+0000 7f5514d20640 1 -- 172.21.15.196:0/3860697720 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55101f3da0 con 0x7f5510157bf0 2024-03-17T23:56:00.819 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:00.816+0000 7f5514d20640 1 -- 172.21.15.196:0/3860697720 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5510068290 con 0x7f5510157bf0 2024-03-17T23:56:00.819 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:00.816+0000 7f54feffd640 1 -- 172.21.15.196:0/3860697720 <== mon.0 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 5) ==== 87083+0+0 (secure 0 0 0) 0x7f550801b030 con 0x7f5510157bf0 2024-03-17T23:56:00.819 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:00.816+0000 7f54feffd640 1 --2- 172.21.15.196:0/3860697720 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f54f0067660 0x7f54f0069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:00.819 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:00.816+0000 7f54feffd640 1 -- 172.21.15.196:0/3860697720 <== mon.0 v2:172.21.15.196:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 5609+0+0 (secure 0 0 0) 0x7f5508085bd0 con 0x7f5510157bf0 2024-03-17T23:56:00.819 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:00.816+0000 7f550e59c640 1 --2- 172.21.15.196:0/3860697720 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f54f0067660 0x7f54f0069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:00.819 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:00.816+0000 7f550e59c640 1 --2- 172.21.15.196:0/3860697720 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f54f0067660 0x7f54f0069b20 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f55000af000 tx=0x7f5500008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:56:00.822 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:00.820+0000 7f54feffd640 1 -- 172.21.15.196:0/3860697720 <== mon.0 v2:172.21.15.196:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177849 (secure 0 0 0) 0x7f5508022020 con 0x7f5510157bf0 2024-03-17T23:56:01.016 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:01.016+0000 7f5514d20640 1 -- 172.21.15.196:0/3860697720 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f551006f770 con 0x7f5510157bf0 2024-03-17T23:56:01.645 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:01.644+0000 7f54feffd640 1 -- 172.21.15.196:0/3860697720 <== mon.0 v2:172.21.15.196:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) ==== 172+0+0 (secure 0 0 0) 0x7f55100cae00 con 0x7f5510157bf0 2024-03-17T23:56:01.645 INFO:teuthology.orchestra.run.smithi196.stderr:new fs with metadata pool 2 and data pool 3 2024-03-17T23:56:01.648 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:01.648+0000 7f5514d20640 1 -- 172.21.15.196:0/3860697720 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f54f0067660 msgr2=0x7f54f0069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:01.649 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:01.648+0000 7f5514d20640 1 --2- 172.21.15.196:0/3860697720 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f54f0067660 0x7f54f0069b20 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f55000af000 tx=0x7f5500008040 comp rx=0 tx=0).stop 2024-03-17T23:56:01.649 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:01.648+0000 7f5514d20640 1 -- 172.21.15.196:0/3860697720 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5510157bf0 msgr2=0x7f55101f0830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:01.649 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:01.648+0000 7f5514d20640 1 --2- 172.21.15.196:0/3860697720 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5510157bf0 0x7f55101f0830 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f5508009f10 tx=0x7f550800c490 comp rx=0 tx=0).stop 2024-03-17T23:56:01.649 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:01.648+0000 7f5514d20640 1 -- 172.21.15.196:0/3860697720 shutdown_connections 2024-03-17T23:56:01.649 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:01.648+0000 7f5514d20640 1 --2- 172.21.15.196:0/3860697720 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f54f0067660 0x7f54f0069b20 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:01.649 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:01.648+0000 7f5514d20640 1 --2- 172.21.15.196:0/3860697720 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5510151dd0 0x7f55101f02f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:01.649 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:01.648+0000 7f5514d20640 1 --2- 172.21.15.196:0/3860697720 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5510157bf0 0x7f55101f0830 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:01.649 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:01.648+0000 7f5514d20640 1 --2- 172.21.15.196:0/3860697720 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f55100c1f00 0x7f551013dcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:01.649 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:01.648+0000 7f5514d20640 1 -- 172.21.15.196:0/3860697720 >> 172.21.15.196:0/3860697720 conn(0x7f551006b2b0 msgr2=0x7f55100c5610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-17T23:56:01.649 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:01.648+0000 7f5514d20640 1 -- 172.21.15.196:0/3860697720 shutdown_connections 2024-03-17T23:56:01.649 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:01.648+0000 7f5514d20640 1 -- 172.21.15.196:0/3860697720 wait complete. 2024-03-17T23:56:01.676 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-17T23:56:01.792 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:01.788+0000 7f5e2ead4640 1 Processor -- start 2024-03-17T23:56:01.792 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:01.788+0000 7f5e2ead4640 1 -- start start 2024-03-17T23:56:01.793 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:01.792+0000 7f5e2ead4640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f5e281520b0 0x7f5e280c5ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:01.794 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:01.792+0000 7f5e2ead4640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f5e280c7630 0x7f5e2806d440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:01.794 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:01.792+0000 7f5e2ead4640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5e28157ba0 0x7f5e28158030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:01.794 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:01.792+0000 7f5e2ead4640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7f5e2806cfb0 con 0x7f5e281520b0 2024-03-17T23:56:01.794 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:01.792+0000 7f5e2ead4640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 -- 0x7f5e280c3a80 con 0x7f5e280c7630 2024-03-17T23:56:01.794 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:01.792+0000 7f5e2ead4640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f5e2806c6c0 con 0x7f5e28157ba0 2024-03-17T23:56:01.794 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:01.792+0000 7f5e2c870640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f5e281520b0 0x7f5e280c5ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:01.794 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:01.792+0000 7f5e2c870640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f5e281520b0 0x7f5e280c5ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.196:56346/0 (socket says 172.21.15.196:56346) 2024-03-17T23:56:01.794 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:01.792+0000 7f5e2c870640 1 -- 172.21.15.196:0/2536895927 learned_addr learned my addr 172.21.15.196:0/2536895927 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-03-17T23:56:01.794 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:01.792+0000 7f5e2c870640 1 -- 172.21.15.196:0/2536895927 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5e28157ba0 msgr2=0x7f5e28158030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-17T23:56:01.794 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:01.792+0000 7f5e2d071640 1 --2- 172.21.15.196:0/2536895927 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5e28157ba0 0x7f5e28158030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:01.794 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:01.792+0000 7f5e27fff640 1 --2- 172.21.15.196:0/2536895927 >> v2:172.21.15.204:3300/0 conn(0x7f5e280c7630 0x7f5e2806d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:01.794 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:01.792+0000 7f5e2c870640 1 --2- 172.21.15.196:0/2536895927 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5e28157ba0 0x7f5e28158030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:01.795 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:01.792+0000 7f5e2c870640 1 -- 172.21.15.196:0/2536895927 >> v2:172.21.15.204:3300/0 conn(0x7f5e280c7630 msgr2=0x7f5e2806d440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-17T23:56:01.795 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:01.792+0000 7f5e2c870640 1 --2- 172.21.15.196:0/2536895927 >> v2:172.21.15.204:3300/0 conn(0x7f5e280c7630 0x7f5e2806d440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:01.795 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:01.792+0000 7f5e2c870640 1 -- 172.21.15.196:0/2536895927 --> v2:172.21.15.196:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e280c3d20 con 0x7f5e281520b0 2024-03-17T23:56:01.796 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:01.792+0000 7f5e2c870640 1 --2- 172.21.15.196:0/2536895927 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5e281520b0 0x7f5e280c5ca0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f5e2806e370 tx=0x7f5e1801ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c8777f3518b0846 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:56:01.796 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:01.792+0000 7f5e277fe640 1 -- 172.21.15.196:0/2536895927 <== mon.0 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e180b5070 con 0x7f5e281520b0 2024-03-17T23:56:01.796 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:01.792+0000 7f5e277fe640 1 -- 172.21.15.196:0/2536895927 <== mon.0 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5e180a89d0 con 0x7f5e281520b0 2024-03-17T23:56:01.796 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:01.792+0000 7f5e277fe640 1 -- 172.21.15.196:0/2536895927 <== mon.0 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e180a8da0 con 0x7f5e281520b0 2024-03-17T23:56:01.797 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:01.796+0000 7f5e2ead4640 1 -- 172.21.15.196:0/2536895927 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5e281520b0 msgr2=0x7f5e280c5ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:01.797 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:01.796+0000 7f5e2ead4640 1 --2- 172.21.15.196:0/2536895927 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5e281520b0 0x7f5e280c5ca0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f5e2806e370 tx=0x7f5e1801ed10 comp rx=0 tx=0).stop 2024-03-17T23:56:01.797 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:01.796+0000 7f5e2ead4640 1 -- 172.21.15.196:0/2536895927 shutdown_connections 2024-03-17T23:56:01.797 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:01.796+0000 7f5e2ead4640 1 --2- 172.21.15.196:0/2536895927 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5e28157ba0 0x7f5e28158030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:01.797 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:01.796+0000 7f5e2ead4640 1 --2- 172.21.15.196:0/2536895927 >> v2:172.21.15.204:3300/0 conn(0x7f5e280c7630 0x7f5e2806d440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:01.797 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:01.796+0000 7f5e2ead4640 1 --2- 172.21.15.196:0/2536895927 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5e281520b0 0x7f5e280c5ca0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:01.798 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:01.796+0000 7f5e2ead4640 1 -- 172.21.15.196:0/2536895927 >> 172.21.15.196:0/2536895927 conn(0x7f5e280c7da0 msgr2=0x7f5e280c81b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-17T23:56:01.798 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:01.796+0000 7f5e2ead4640 1 -- 172.21.15.196:0/2536895927 shutdown_connections 2024-03-17T23:56:01.798 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:01.796+0000 7f5e2ead4640 1 -- 172.21.15.196:0/2536895927 wait complete. 2024-03-17T23:56:01.800 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:01.796+0000 7f5e2ead4640 1 Processor -- start 2024-03-17T23:56:01.800 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:01.796+0000 7f5e2ead4640 1 -- start start 2024-03-17T23:56:01.800 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:01.796+0000 7f5e2ead4640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5e280c7630 0x7f5e28156ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:01.800 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:01.796+0000 7f5e2ead4640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5e281520b0 0x7f5e2814e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:01.800 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:01.796+0000 7f5e2ead4640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5e28157ba0 0x7f5e2814eee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:01.801 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:01.796+0000 7f5e2ead4640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f5e2806cc40 con 0x7f5e280c7630 2024-03-17T23:56:01.801 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:01.796+0000 7f5e2ead4640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f5e2806c960 con 0x7f5e281520b0 2024-03-17T23:56:01.801 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:01.796+0000 7f5e2ead4640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f5e280cc140 con 0x7f5e28157ba0 2024-03-17T23:56:01.801 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:01.796+0000 7f5e2c870640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5e280c7630 0x7f5e28156ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:01.801 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:01.796+0000 7f5e2c870640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5e280c7630 0x7f5e28156ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.196:56354/0 (socket says 172.21.15.196:56354) 2024-03-17T23:56:01.801 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:01.796+0000 7f5e2c870640 1 -- 172.21.15.196:0/2114077293 learned_addr learned my addr 172.21.15.196:0/2114077293 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-03-17T23:56:01.801 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:01.796+0000 7f5e27fff640 1 --2- 172.21.15.196:0/2114077293 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5e281520b0 0x7f5e2814e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:01.801 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:01.796+0000 7f5e2d071640 1 --2- 172.21.15.196:0/2114077293 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5e28157ba0 0x7f5e2814eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:01.801 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:01.796+0000 7f5e2c870640 1 -- 172.21.15.196:0/2114077293 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5e28157ba0 msgr2=0x7f5e2814eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:01.801 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:01.796+0000 7f5e2c870640 1 --2- 172.21.15.196:0/2114077293 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5e28157ba0 0x7f5e2814eee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:01.801 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:01.796+0000 7f5e2c870640 1 -- 172.21.15.196:0/2114077293 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5e281520b0 msgr2=0x7f5e2814e9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:01.801 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:01.796+0000 7f5e2c870640 1 --2- 172.21.15.196:0/2114077293 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5e281520b0 0x7f5e2814e9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:01.801 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:01.796+0000 7f5e2c870640 1 -- 172.21.15.196:0/2114077293 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e280c9aa0 con 0x7f5e280c7630 2024-03-17T23:56:01.802 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:01.796+0000 7f5e27fff640 1 --2- 172.21.15.196:0/2114077293 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5e281520b0 0x7f5e2814e9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-17T23:56:01.802 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:01.796+0000 7f5e2c870640 1 --2- 172.21.15.196:0/2114077293 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5e280c7630 0x7f5e28156ed0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f5e180b3040 tx=0x7f5e1801bab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:56:01.802 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:01.796+0000 7f5e257fa640 1 -- 172.21.15.196:0/2114077293 <== mon.0 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e180bf070 con 0x7f5e280c7630 2024-03-17T23:56:01.802 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:01.796+0000 7f5e257fa640 1 -- 172.21.15.196:0/2114077293 <== mon.0 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5e180b0860 con 0x7f5e280c7630 2024-03-17T23:56:01.802 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:01.796+0000 7f5e2ead4640 1 -- 172.21.15.196:0/2114077293 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e2814c690 con 0x7f5e280c7630 2024-03-17T23:56:01.802 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:01.796+0000 7f5e257fa640 1 -- 172.21.15.196:0/2114077293 <== mon.0 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e180b5040 con 0x7f5e280c7630 2024-03-17T23:56:01.802 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:01.796+0000 7f5e2ead4640 1 -- 172.21.15.196:0/2114077293 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e2814cc50 con 0x7f5e280c7630 2024-03-17T23:56:01.802 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:01.800+0000 7f5e2ead4640 1 -- 172.21.15.196:0/2114077293 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5e28068290 con 0x7f5e280c7630 2024-03-17T23:56:01.803 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:01.800+0000 7f5e257fa640 1 -- 172.21.15.196:0/2114077293 <== mon.0 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 5) ==== 87083+0+0 (secure 0 0 0) 0x7f5e180c2070 con 0x7f5e280c7630 2024-03-17T23:56:01.803 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:01.800+0000 7f5e257fa640 1 --2- 172.21.15.196:0/2114077293 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f5e14067660 0x7f5e14069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:01.803 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:01.800+0000 7f5e257fa640 1 -- 172.21.15.196:0/2114077293 <== mon.0 v2:172.21.15.196:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f5e18122370 con 0x7f5e280c7630 2024-03-17T23:56:01.803 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:01.800+0000 7f5e27fff640 1 --2- 172.21.15.196:0/2114077293 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f5e14067660 0x7f5e14069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:01.803 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:01.800+0000 7f5e27fff640 1 --2- 172.21.15.196:0/2114077293 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f5e14067660 0x7f5e14069b20 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f5e28157810 tx=0x7f5e1c008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:56:01.806 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:01.804+0000 7f5e257fa640 1 -- 172.21.15.196:0/2114077293 <== mon.0 v2:172.21.15.196:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177849 (secure 0 0 0) 0x7f5e18018870 con 0x7f5e280c7630 2024-03-17T23:56:01.967 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:01.964+0000 7f5e2ead4640 1 -- 172.21.15.196:0/2114077293 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f5e280c2c40 con 0x7f5e280c7630 2024-03-17T23:56:01.970 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:01.968+0000 7f5e257fa640 1 -- 172.21.15.196:0/2114077293 <== mon.0 v2:172.21.15.196:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16654 (secure 0 0 0) 0x7f5e180f2f50 con 0x7f5e280c7630 2024-03-17T23:56:01.971 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-03-17T23:56:01.971 INFO:teuthology.orchestra.run.smithi196.stdout:{"epoch":20,"fsid":"b80f9c80-17ad-4126-8957-4c0c46f5b803","created":"2024-03-17T23:55:43.368838+0000","modified":"2024-03-17T23:56:01.018924+0000","last_up_change":"2024-03-17T23:55:54.132187+0000","last_in_change":"2024-03-17T23:55:46.016435+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-17T23:55:56.030640+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-17T23:55:58.658234+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-17T23:56:00.003208+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"224d699f-bc10-4661-a8b5-6ca73290ffa0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6806","nonce":1194547591},{"type":"v1","addr":"172.21.15.196:6807","nonce":1194547591}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6809","nonce":1194547591},{"type":"v1","addr":"172.21.15.196:6811","nonce":1194547591}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6814","nonce":1194547591},{"type":"v1","addr":"172.21.15.196:6815","nonce":1194547591}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6812","nonce":1194547591},{"type":"v1","addr":"172.21.15.196:6813","nonce":1194547591}]},"public_addr":"172.21.15.196:6807/1194547591","cluster_addr":"172.21.15.196:6811/1194547591","heartbeat_back_addr":"172.21.15.196:6815/1194547591","heartbeat_front_addr":"172.21.15.196:6813/1194547591","state":["exists","up"]},{"osd":1,"uuid":"d8d6a0b0-450b-4ab5-b143-d4f36286e81e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6800","nonce":1901246986},{"type":"v1","addr":"172.21.15.196:6801","nonce":1901246986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6802","nonce":1901246986},{"type":"v1","addr":"172.21.15.196:6803","nonce":1901246986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6808","nonce":1901246986},{"type":"v1","addr":"172.21.15.196:6810","nonce":1901246986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6804","nonce":1901246986},{"type":"v1","addr":"172.21.15.196:6805","nonce":1901246986}]},"public_addr":"172.21.15.196:6801/1901246986","cluster_addr":"172.21.15.196:6803/1901246986","heartbeat_back_addr":"172.21.15.196:6810/1901246986","heartbeat_front_addr":"172.21.15.196:6805/1901246986","state":["exists","up"]},{"osd":2,"uuid":"d732ba94-1db0-41ed-930a-5abb6188980a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6824","nonce":673819559},{"type":"v1","addr":"172.21.15.196:6825","nonce":673819559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6826","nonce":673819559},{"type":"v1","addr":"172.21.15.196:6827","nonce":673819559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6830","nonce":673819559},{"type":"v1","addr":"172.21.15.196:6831","nonce":673819559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6828","nonce":673819559},{"type":"v1","addr":"172.21.15.196:6829","nonce":673819559}]},"public_addr":"172.21.15.196:6825/673819559","cluster_addr":"172.21.15.196:6827/673819559","heartbeat_back_addr":"172.21.15.196:6831/673819559","heartbeat_front_addr":"172.21.15.196:6829/673819559","state":["exists","up"]},{"osd":3,"uuid":"b79cab98-a49f-4544-b6b0-546dcfbd47a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6816","nonce":1104340623},{"type":"v1","addr":"172.21.15.196:6817","nonce":1104340623}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6818","nonce":1104340623},{"type":"v1","addr":"172.21.15.196:6819","nonce":1104340623}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6822","nonce":1104340623},{"type":"v1","addr":"172.21.15.196:6823","nonce":1104340623}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6820","nonce":1104340623},{"type":"v1","addr":"172.21.15.196:6821","nonce":1104340623}]},"public_addr":"172.21.15.196:6817/1104340623","cluster_addr":"172.21.15.196:6819/1104340623","heartbeat_back_addr":"172.21.15.196:6823/1104340623","heartbeat_front_addr":"172.21.15.196:6821/1104340623","state":["exists","up"]},{"osd":4,"uuid":"d5892856-6eb4-4188-beb0-368f64169af1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6816","nonce":658561863},{"type":"v1","addr":"172.21.15.204:6818","nonce":658561863}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6819","nonce":658561863},{"type":"v1","addr":"172.21.15.204:6821","nonce":658561863}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6826","nonce":658561863},{"type":"v1","addr":"172.21.15.204:6828","nonce":658561863}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6823","nonce":658561863},{"type":"v1","addr":"172.21.15.204:6825","nonce":658561863}]},"public_addr":"172.21.15.204:6818/658561863","cluster_addr":"172.21.15.204:6821/658561863","heartbeat_back_addr":"172.21.15.204:6828/658561863","heartbeat_front_addr":"172.21.15.204:6825/658561863","state":["exists","up"]},{"osd":5,"uuid":"89d6b48d-aa8a-4cb8-aa2e-e0aae04928b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6817","nonce":3367327749},{"type":"v1","addr":"172.21.15.204:6820","nonce":3367327749}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6822","nonce":3367327749},{"type":"v1","addr":"172.21.15.204:6824","nonce":3367327749}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6830","nonce":3367327749},{"type":"v1","addr":"172.21.15.204:6831","nonce":3367327749}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6827","nonce":3367327749},{"type":"v1","addr":"172.21.15.204:6829","nonce":3367327749}]},"public_addr":"172.21.15.204:6820/3367327749","cluster_addr":"172.21.15.204:6824/3367327749","heartbeat_back_addr":"172.21.15.204:6831/3367327749","heartbeat_front_addr":"172.21.15.204:6829/3367327749","state":["exists","up"]},{"osd":6,"uuid":"ff7d0949-2836-42a6-a63d-bc5a4269e080","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6805","nonce":2586742078},{"type":"v1","addr":"172.21.15.204:6807","nonce":2586742078}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6809","nonce":2586742078},{"type":"v1","addr":"172.21.15.204:6811","nonce":2586742078}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6814","nonce":2586742078},{"type":"v1","addr":"172.21.15.204:6815","nonce":2586742078}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6812","nonce":2586742078},{"type":"v1","addr":"172.21.15.204:6813","nonce":2586742078}]},"public_addr":"172.21.15.204:6807/2586742078","cluster_addr":"172.21.15.204:6811/2586742078","heartbeat_back_addr":"172.21.15.204:6815/2586742078","heartbeat_front_addr":"172.21.15.204:6813/2586742078","state":["exists","up"]},{"osd":7,"uuid":"42bcc14b-70b3-4c59-bf81-41436e4eb272","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6800","nonce":3361860686},{"type":"v1","addr":"172.21.15.204:6801","nonce":3361860686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6802","nonce":3361860686},{"type":"v1","addr":"172.21.15.204:6803","nonce":3361860686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6808","nonce":3361860686},{"type":"v1","addr":"172.21.15.204:6810","nonce":3361860686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6804","nonce":3361860686},{"type":"v1","addr":"172.21.15.204:6806","nonce":3361860686}]},"public_addr":"172.21.15.204:6801/3361860686","cluster_addr":"172.21.15.204:6803/3361860686","heartbeat_back_addr":"172.21.15.204:6810/3361860686","heartbeat_front_addr":"172.21.15.204:6806/3361860686","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-17T23:55:51.372683+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-17T23:55:51.466291+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-17T23:55:51.608084+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-17T23:55:51.680819+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-17T23:55:51.528198+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-17T23:55:51.537065+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-17T23:55:51.558146+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-17T23:55:51.382540+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-17T23:56:01.973 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:01.972+0000 7f5e2ead4640 1 -- 172.21.15.196:0/2114077293 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f5e14067660 msgr2=0x7f5e14069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:01.973 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:01.972+0000 7f5e2ead4640 1 --2- 172.21.15.196:0/2114077293 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f5e14067660 0x7f5e14069b20 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f5e28157810 tx=0x7f5e1c008040 comp rx=0 tx=0).stop 2024-03-17T23:56:01.973 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:01.972+0000 7f5e2ead4640 1 -- 172.21.15.196:0/2114077293 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5e280c7630 msgr2=0x7f5e28156ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:01.973 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:01.972+0000 7f5e2ead4640 1 --2- 172.21.15.196:0/2114077293 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5e280c7630 0x7f5e28156ed0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f5e180b3040 tx=0x7f5e1801bab0 comp rx=0 tx=0).stop 2024-03-17T23:56:01.973 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:01.972+0000 7f5e2ead4640 1 -- 172.21.15.196:0/2114077293 shutdown_connections 2024-03-17T23:56:01.973 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:01.972+0000 7f5e2ead4640 1 --2- 172.21.15.196:0/2114077293 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f5e14067660 0x7f5e14069b20 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:01.973 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:01.972+0000 7f5e2ead4640 1 --2- 172.21.15.196:0/2114077293 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5e28157ba0 0x7f5e2814eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:01.973 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:01.972+0000 7f5e2ead4640 1 --2- 172.21.15.196:0/2114077293 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5e281520b0 0x7f5e2814e9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:01.973 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:01.972+0000 7f5e2ead4640 1 --2- 172.21.15.196:0/2114077293 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5e280c7630 0x7f5e28156ed0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:01.973 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:01.972+0000 7f5e2ead4640 1 -- 172.21.15.196:0/2114077293 >> 172.21.15.196:0/2114077293 conn(0x7f5e280c7da0 msgr2=0x7f5e28158030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-17T23:56:01.974 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:01.972+0000 7f5e2ead4640 1 -- 172.21.15.196:0/2114077293 shutdown_connections 2024-03-17T23:56:01.974 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:01.972+0000 7f5e2ead4640 1 -- 172.21.15.196:0/2114077293 wait complete. 2024-03-17T23:56:01.989 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-17T23:56:02.109 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:02.108+0000 7f3e0b87b640 1 Processor -- start 2024-03-17T23:56:02.109 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:02.108+0000 7f3e0b87b640 1 -- start start 2024-03-17T23:56:02.110 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:02.108+0000 7f3e0b87b640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f3e040c5ca0 0x7f3e0406d440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:02.110 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:02.108+0000 7f3e0b87b640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3e040c3a80 con 0x7f3e041520b0 2024-03-17T23:56:02.110 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:02.108+0000 7f3e0b87b640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3e0406c6c0 con 0x7f3e040c7630 2024-03-17T23:56:02.111 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:02.108+0000 7f3e0b87b640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7f3e0406cfb0 con 0x7f3e040c5ca0 2024-03-17T23:56:02.111 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:02.108+0000 7f3e09e18640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f3e040c5ca0 0x7f3e0406d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:02.111 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:02.108+0000 7f3e09617640 1 --1- >> v1:172.21.15.196:6789/0 conn(0x7f3e041520b0 0x7f3e04157ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.196:6789/0 says I am v1:172.21.15.196:60908/0 (socket says 172.21.15.196:60908) 2024-03-17T23:56:02.111 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:02.108+0000 7f3e09617640 1 -- 172.21.15.196:0/850792469 learned_addr learned my addr 172.21.15.196:0/850792469 (peer_addr_for_me v1:172.21.15.196:0/0) 2024-03-17T23:56:02.111 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:02.108+0000 7f3e09e18640 1 -- 172.21.15.196:0/850792469 >> v1:172.21.15.204:6789/0 conn(0x7f3e040c7630 legacy=0x7f3e041582b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-17T23:56:02.111 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:02.108+0000 7f3e09e18640 1 -- 172.21.15.196:0/850792469 >> v1:172.21.15.196:6789/0 conn(0x7f3e041520b0 legacy=0x7f3e04157ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:02.111 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:02.108+0000 7f3e09e18640 1 -- 172.21.15.196:0/850792469 --> v2:172.21.15.196:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e040c3d20 con 0x7f3e040c5ca0 2024-03-17T23:56:02.112 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:02.112+0000 7f3e09e18640 1 --2- 172.21.15.196:0/850792469 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3e040c5ca0 0x7f3e0406d440 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f3dfc009d90 tx=0x7f3dfc01f120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6cbf998f7af889c6 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:56:02.112 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:02.112+0000 7f3dfbfff640 1 -- 172.21.15.196:0/850792469 <== mon.0 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dfc0b4070 con 0x7f3e040c5ca0 2024-03-17T23:56:02.113 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:02.112+0000 7f3dfbfff640 1 -- 172.21.15.196:0/850792469 <== mon.0 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3dfc0af600 con 0x7f3e040c5ca0 2024-03-17T23:56:02.113 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:02.112+0000 7f3dfbfff640 1 -- 172.21.15.196:0/850792469 <== mon.0 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dfc0af9d0 con 0x7f3e040c5ca0 2024-03-17T23:56:02.113 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:02.112+0000 7f3e0b87b640 1 -- 172.21.15.196:0/850792469 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3e040c5ca0 msgr2=0x7f3e0406d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:02.114 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:02.112+0000 7f3e0b87b640 1 --2- 172.21.15.196:0/850792469 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3e040c5ca0 0x7f3e0406d440 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f3dfc009d90 tx=0x7f3dfc01f120 comp rx=0 tx=0).stop 2024-03-17T23:56:02.114 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:02.112+0000 7f3e0b87b640 1 -- 172.21.15.196:0/850792469 shutdown_connections 2024-03-17T23:56:02.114 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:02.112+0000 7f3e0b87b640 1 --2- 172.21.15.196:0/850792469 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3e040c5ca0 0x7f3e0406d440 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:02.114 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:02.112+0000 7f3e0b87b640 1 -- 172.21.15.196:0/850792469 >> 172.21.15.196:0/850792469 conn(0x7f3e040c7da0 msgr2=0x7f3e040c81b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-17T23:56:02.114 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:02.112+0000 7f3e0b87b640 1 -- 172.21.15.196:0/850792469 shutdown_connections 2024-03-17T23:56:02.114 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:02.112+0000 7f3e0b87b640 1 -- 172.21.15.196:0/850792469 wait complete. 2024-03-17T23:56:02.115 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:02.112+0000 7f3e0b87b640 1 Processor -- start 2024-03-17T23:56:02.115 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:02.112+0000 7f3e0b87b640 1 -- start start 2024-03-17T23:56:02.117 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:02.112+0000 7f3e0b87b640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3e040c5ca0 0x7f3e041f03a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:02.117 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:02.112+0000 7f3e0b87b640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3e040c7630 0x7f3e04147460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:02.117 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:02.112+0000 7f3e0b87b640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3e041520b0 0x7f3e0414aa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:02.117 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:02.112+0000 7f3e0b87b640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f3e0406cc40 con 0x7f3e040c7630 2024-03-17T23:56:02.117 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:02.112+0000 7f3e0b87b640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f3e0406c960 con 0x7f3e040c5ca0 2024-03-17T23:56:02.117 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:02.112+0000 7f3e0b87b640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f3e040cc140 con 0x7f3e041520b0 2024-03-17T23:56:02.117 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:02.112+0000 7f3e08e16640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3e040c7630 0x7f3e04147460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:02.117 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:02.112+0000 7f3e08e16640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3e040c7630 0x7f3e04147460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.196:56362/0 (socket says 172.21.15.196:56362) 2024-03-17T23:56:02.118 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:02.112+0000 7f3e08e16640 1 -- 172.21.15.196:0/1941856722 learned_addr learned my addr 172.21.15.196:0/1941856722 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-03-17T23:56:02.118 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:02.116+0000 7f3e09e18640 1 --2- 172.21.15.196:0/1941856722 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3e041520b0 0x7f3e0414aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:02.118 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:02.116+0000 7f3e09617640 1 --2- 172.21.15.196:0/1941856722 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3e040c5ca0 0x7f3e041f03a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:02.118 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:02.116+0000 7f3e08e16640 1 -- 172.21.15.196:0/1941856722 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3e041520b0 msgr2=0x7f3e0414aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:02.118 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:02.116+0000 7f3e08e16640 1 --2- 172.21.15.196:0/1941856722 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3e041520b0 0x7f3e0414aa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:02.118 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:02.116+0000 7f3e08e16640 1 -- 172.21.15.196:0/1941856722 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3e040c5ca0 msgr2=0x7f3e041f03a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:02.118 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:02.116+0000 7f3e08e16640 1 --2- 172.21.15.196:0/1941856722 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3e040c5ca0 0x7f3e041f03a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:02.118 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:02.116+0000 7f3e08e16640 1 -- 172.21.15.196:0/1941856722 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e0414a2b0 con 0x7f3e040c7630 2024-03-17T23:56:02.118 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:02.116+0000 7f3e09e18640 1 --2- 172.21.15.196:0/1941856722 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3e041520b0 0x7f3e0414aa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-17T23:56:02.118 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:02.116+0000 7f3e08e16640 1 --2- 172.21.15.196:0/1941856722 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3e040c7630 0x7f3e04147460 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f3df400c4c0 tx=0x7f3df4001e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:56:02.118 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:02.116+0000 7f3df9ffb640 1 -- 172.21.15.196:0/1941856722 <== mon.0 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3df4017070 con 0x7f3e040c7630 2024-03-17T23:56:02.118 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:02.116+0000 7f3df9ffb640 1 -- 172.21.15.196:0/1941856722 <== mon.0 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3df4003600 con 0x7f3e040c7630 2024-03-17T23:56:02.118 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:02.116+0000 7f3e0b87b640 1 -- 172.21.15.196:0/1941856722 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e041f09e0 con 0x7f3e040c7630 2024-03-17T23:56:02.119 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:02.116+0000 7f3df9ffb640 1 -- 172.21.15.196:0/1941856722 <== mon.0 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3df40039f0 con 0x7f3e040c7630 2024-03-17T23:56:02.119 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:02.116+0000 7f3e0b87b640 1 -- 172.21.15.196:0/1941856722 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e041f0fa0 con 0x7f3e040c7630 2024-03-17T23:56:02.120 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:02.116+0000 7f3e0b87b640 1 -- 172.21.15.196:0/1941856722 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3e04068290 con 0x7f3e040c7630 2024-03-17T23:56:02.120 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:02.116+0000 7f3df9ffb640 1 -- 172.21.15.196:0/1941856722 <== mon.0 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 5) ==== 87083+0+0 (secure 0 0 0) 0x7f3df401a070 con 0x7f3e040c7630 2024-03-17T23:56:02.120 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:02.116+0000 7f3df9ffb640 1 --2- 172.21.15.196:0/1941856722 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f3de8067660 0x7f3de8069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:02.120 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:02.116+0000 7f3df9ffb640 1 -- 172.21.15.196:0/1941856722 <== mon.0 v2:172.21.15.196:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f3df4084ce0 con 0x7f3e040c7630 2024-03-17T23:56:02.120 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:02.116+0000 7f3e09617640 1 --2- 172.21.15.196:0/1941856722 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f3de8067660 0x7f3de8069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:02.120 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:02.116+0000 7f3e09617640 1 --2- 172.21.15.196:0/1941856722 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f3de8067660 0x7f3de8069b20 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f3e00000f70 tx=0x7f3e00009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:56:02.123 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:02.120+0000 7f3df9ffb640 1 -- 172.21.15.196:0/1941856722 <== mon.0 v2:172.21.15.196:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177849 (secure 0 0 0) 0x7f3df40558c0 con 0x7f3e040c7630 2024-03-17T23:56:02.283 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:02.280+0000 7f3e0b87b640 1 -- 172.21.15.196:0/1941856722 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f3e0406db40 con 0x7f3e040c7630 2024-03-17T23:56:02.286 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:02.284+0000 7f3df9ffb640 1 -- 172.21.15.196:0/1941856722 <== mon.0 v2:172.21.15.196:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16641 (secure 0 0 0) 0x7f3df40551c0 con 0x7f3e040c7630 2024-03-17T23:56:02.286 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-03-17T23:56:02.287 INFO:teuthology.orchestra.run.smithi196.stdout:{"epoch":21,"fsid":"b80f9c80-17ad-4126-8957-4c0c46f5b803","created":"2024-03-17T23:55:43.368838+0000","modified":"2024-03-17T23:56:02.157128+0000","last_up_change":"2024-03-17T23:55:54.132187+0000","last_in_change":"2024-03-17T23:55:46.016435+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-17T23:55:56.030640+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-17T23:55:58.658234+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-17T23:56:00.003208+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"224d699f-bc10-4661-a8b5-6ca73290ffa0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6806","nonce":1194547591},{"type":"v1","addr":"172.21.15.196:6807","nonce":1194547591}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6809","nonce":1194547591},{"type":"v1","addr":"172.21.15.196:6811","nonce":1194547591}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6814","nonce":1194547591},{"type":"v1","addr":"172.21.15.196:6815","nonce":1194547591}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6812","nonce":1194547591},{"type":"v1","addr":"172.21.15.196:6813","nonce":1194547591}]},"public_addr":"172.21.15.196:6807/1194547591","cluster_addr":"172.21.15.196:6811/1194547591","heartbeat_back_addr":"172.21.15.196:6815/1194547591","heartbeat_front_addr":"172.21.15.196:6813/1194547591","state":["exists","up"]},{"osd":1,"uuid":"d8d6a0b0-450b-4ab5-b143-d4f36286e81e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6800","nonce":1901246986},{"type":"v1","addr":"172.21.15.196:6801","nonce":1901246986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6802","nonce":1901246986},{"type":"v1","addr":"172.21.15.196:6803","nonce":1901246986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6808","nonce":1901246986},{"type":"v1","addr":"172.21.15.196:6810","nonce":1901246986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6804","nonce":1901246986},{"type":"v1","addr":"172.21.15.196:6805","nonce":1901246986}]},"public_addr":"172.21.15.196:6801/1901246986","cluster_addr":"172.21.15.196:6803/1901246986","heartbeat_back_addr":"172.21.15.196:6810/1901246986","heartbeat_front_addr":"172.21.15.196:6805/1901246986","state":["exists","up"]},{"osd":2,"uuid":"d732ba94-1db0-41ed-930a-5abb6188980a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6824","nonce":673819559},{"type":"v1","addr":"172.21.15.196:6825","nonce":673819559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6826","nonce":673819559},{"type":"v1","addr":"172.21.15.196:6827","nonce":673819559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6830","nonce":673819559},{"type":"v1","addr":"172.21.15.196:6831","nonce":673819559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6828","nonce":673819559},{"type":"v1","addr":"172.21.15.196:6829","nonce":673819559}]},"public_addr":"172.21.15.196:6825/673819559","cluster_addr":"172.21.15.196:6827/673819559","heartbeat_back_addr":"172.21.15.196:6831/673819559","heartbeat_front_addr":"172.21.15.196:6829/673819559","state":["exists","up"]},{"osd":3,"uuid":"b79cab98-a49f-4544-b6b0-546dcfbd47a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6816","nonce":1104340623},{"type":"v1","addr":"172.21.15.196:6817","nonce":1104340623}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6818","nonce":1104340623},{"type":"v1","addr":"172.21.15.196:6819","nonce":1104340623}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6822","nonce":1104340623},{"type":"v1","addr":"172.21.15.196:6823","nonce":1104340623}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6820","nonce":1104340623},{"type":"v1","addr":"172.21.15.196:6821","nonce":1104340623}]},"public_addr":"172.21.15.196:6817/1104340623","cluster_addr":"172.21.15.196:6819/1104340623","heartbeat_back_addr":"172.21.15.196:6823/1104340623","heartbeat_front_addr":"172.21.15.196:6821/1104340623","state":["exists","up"]},{"osd":4,"uuid":"d5892856-6eb4-4188-beb0-368f64169af1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6816","nonce":658561863},{"type":"v1","addr":"172.21.15.204:6818","nonce":658561863}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6819","nonce":658561863},{"type":"v1","addr":"172.21.15.204:6821","nonce":658561863}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6826","nonce":658561863},{"type":"v1","addr":"172.21.15.204:6828","nonce":658561863}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6823","nonce":658561863},{"type":"v1","addr":"172.21.15.204:6825","nonce":658561863}]},"public_addr":"172.21.15.204:6818/658561863","cluster_addr":"172.21.15.204:6821/658561863","heartbeat_back_addr":"172.21.15.204:6828/658561863","heartbeat_front_addr":"172.21.15.204:6825/658561863","state":["exists","up"]},{"osd":5,"uuid":"89d6b48d-aa8a-4cb8-aa2e-e0aae04928b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6817","nonce":3367327749},{"type":"v1","addr":"172.21.15.204:6820","nonce":3367327749}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6822","nonce":3367327749},{"type":"v1","addr":"172.21.15.204:6824","nonce":3367327749}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6830","nonce":3367327749},{"type":"v1","addr":"172.21.15.204:6831","nonce":3367327749}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6827","nonce":3367327749},{"type":"v1","addr":"172.21.15.204:6829","nonce":3367327749}]},"public_addr":"172.21.15.204:6820/3367327749","cluster_addr":"172.21.15.204:6824/3367327749","heartbeat_back_addr":"172.21.15.204:6831/3367327749","heartbeat_front_addr":"172.21.15.204:6829/3367327749","state":["exists","up"]},{"osd":6,"uuid":"ff7d0949-2836-42a6-a63d-bc5a4269e080","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6805","nonce":2586742078},{"type":"v1","addr":"172.21.15.204:6807","nonce":2586742078}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6809","nonce":2586742078},{"type":"v1","addr":"172.21.15.204:6811","nonce":2586742078}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6814","nonce":2586742078},{"type":"v1","addr":"172.21.15.204:6815","nonce":2586742078}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6812","nonce":2586742078},{"type":"v1","addr":"172.21.15.204:6813","nonce":2586742078}]},"public_addr":"172.21.15.204:6807/2586742078","cluster_addr":"172.21.15.204:6811/2586742078","heartbeat_back_addr":"172.21.15.204:6815/2586742078","heartbeat_front_addr":"172.21.15.204:6813/2586742078","state":["exists","up"]},{"osd":7,"uuid":"42bcc14b-70b3-4c59-bf81-41436e4eb272","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6800","nonce":3361860686},{"type":"v1","addr":"172.21.15.204:6801","nonce":3361860686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6802","nonce":3361860686},{"type":"v1","addr":"172.21.15.204:6803","nonce":3361860686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6808","nonce":3361860686},{"type":"v1","addr":"172.21.15.204:6810","nonce":3361860686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6804","nonce":3361860686},{"type":"v1","addr":"172.21.15.204:6806","nonce":3361860686}]},"public_addr":"172.21.15.204:6801/3361860686","cluster_addr":"172.21.15.204:6803/3361860686","heartbeat_back_addr":"172.21.15.204:6810/3361860686","heartbeat_front_addr":"172.21.15.204:6806/3361860686","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-17T23:55:51.372683+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-17T23:55:51.466291+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-17T23:55:51.608084+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-17T23:55:51.680819+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-17T23:55:51.528198+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-17T23:55:51.537065+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-17T23:55:51.558146+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-17T23:55:51.382540+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-17T23:56:02.288 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:02.288+0000 7f3e0b87b640 1 -- 172.21.15.196:0/1941856722 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f3de8067660 msgr2=0x7f3de8069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:02.288 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:02.288+0000 7f3e0b87b640 1 --2- 172.21.15.196:0/1941856722 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f3de8067660 0x7f3de8069b20 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f3e00000f70 tx=0x7f3e00009040 comp rx=0 tx=0).stop 2024-03-17T23:56:02.289 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:02.288+0000 7f3e0b87b640 1 -- 172.21.15.196:0/1941856722 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3e040c7630 msgr2=0x7f3e04147460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:02.289 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:02.288+0000 7f3e0b87b640 1 --2- 172.21.15.196:0/1941856722 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3e040c7630 0x7f3e04147460 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f3df400c4c0 tx=0x7f3df4001e80 comp rx=0 tx=0).stop 2024-03-17T23:56:02.289 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:02.288+0000 7f3e0b87b640 1 -- 172.21.15.196:0/1941856722 shutdown_connections 2024-03-17T23:56:02.289 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:02.288+0000 7f3e0b87b640 1 --2- 172.21.15.196:0/1941856722 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f3de8067660 0x7f3de8069b20 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:02.289 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:02.288+0000 7f3e0b87b640 1 --2- 172.21.15.196:0/1941856722 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3e041520b0 0x7f3e0414aa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:02.289 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:02.288+0000 7f3e0b87b640 1 --2- 172.21.15.196:0/1941856722 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3e040c7630 0x7f3e04147460 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:02.289 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:02.288+0000 7f3e0b87b640 1 --2- 172.21.15.196:0/1941856722 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3e040c5ca0 0x7f3e041f03a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:02.289 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:02.288+0000 7f3e0b87b640 1 -- 172.21.15.196:0/1941856722 >> 172.21.15.196:0/1941856722 conn(0x7f3e040c7da0 msgr2=0x7f3e040c20e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-17T23:56:02.289 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:02.288+0000 7f3e0b87b640 1 -- 172.21.15.196:0/1941856722 shutdown_connections 2024-03-17T23:56:02.289 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:02.288+0000 7f3e0b87b640 1 -- 172.21.15.196:0/1941856722 wait complete. 2024-03-17T23:56:02.305 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-03-17T23:56:02.423 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:02.420+0000 7f404dfdd640 1 Processor -- start 2024-03-17T23:56:02.424 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:02.420+0000 7f404dfdd640 1 -- start start 2024-03-17T23:56:02.425 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:02.424+0000 7f404dfdd640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f40480c9650 0x7f40480c2e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:02.425 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:02.424+0000 7f404dfdd640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f4048157d10 0x7f40480c8030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:02.425 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:02.424+0000 7f404dfdd640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f40480c2650 con 0x7f4048151ef0 2024-03-17T23:56:02.425 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:02.424+0000 7f404dfdd640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7f40480b2bc0 con 0x7f4048157d10 2024-03-17T23:56:02.425 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:02.424+0000 7f404dfdd640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 -- 0x7f40480701d0 con 0x7f40480c9650 2024-03-17T23:56:02.425 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:02.424+0000 7f4047fff640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f4048157d10 0x7f40480c8030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:02.425 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:02.424+0000 7f40477fe640 1 --1- >> v1:172.21.15.196:6789/0 conn(0x7f4048151ef0 0x7f40480c8be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.196:6789/0 says I am v1:172.21.15.196:60910/0 (socket says 172.21.15.196:60910) 2024-03-17T23:56:02.425 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:02.424+0000 7f40477fe640 1 -- 172.21.15.196:0/3045408991 learned_addr learned my addr 172.21.15.196:0/3045408991 (peer_addr_for_me v1:172.21.15.196:0/0) 2024-03-17T23:56:02.426 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:02.424+0000 7f4047fff640 1 -- 172.21.15.196:0/3045408991 >> v2:172.21.15.204:3300/0 conn(0x7f40480c9650 msgr2=0x7f40480c2e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-17T23:56:02.426 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:02.424+0000 7f403ffff640 1 --2- 172.21.15.196:0/3045408991 >> v2:172.21.15.204:3300/0 conn(0x7f40480c9650 0x7f40480c2e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:02.426 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:02.424+0000 7f4047fff640 1 --2- 172.21.15.196:0/3045408991 >> v2:172.21.15.204:3300/0 conn(0x7f40480c9650 0x7f40480c2e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:02.426 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:02.424+0000 7f4047fff640 1 -- 172.21.15.196:0/3045408991 >> v1:172.21.15.196:6789/0 conn(0x7f4048151ef0 legacy=0x7f40480c8be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:02.426 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:02.424+0000 7f4047fff640 1 -- 172.21.15.196:0/3045408991 --> v2:172.21.15.196:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40480704b0 con 0x7f4048157d10 2024-03-17T23:56:02.426 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:02.424+0000 7f4046ffd640 1 -- 172.21.15.196:0/3045408991 <== mon.0 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2568380914 0 0) 0x7f40480c2650 con 0x7f4048151ef0 2024-03-17T23:56:02.427 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:02.424+0000 7f4047fff640 1 --2- 172.21.15.196:0/3045408991 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4048157d10 0x7f40480c8030 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f404806f940 tx=0x7f404001f110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58e77975a611dfe7 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:56:02.427 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:02.424+0000 7f4046ffd640 1 -- 172.21.15.196:0/3045408991 <== mon.0 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40400b4070 con 0x7f4048157d10 2024-03-17T23:56:02.427 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:02.424+0000 7f4046ffd640 1 -- 172.21.15.196:0/3045408991 <== mon.0 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f40400af600 con 0x7f4048157d10 2024-03-17T23:56:02.427 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:02.424+0000 7f4046ffd640 1 -- 172.21.15.196:0/3045408991 <== mon.0 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40400af9d0 con 0x7f4048157d10 2024-03-17T23:56:02.428 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:02.424+0000 7f404dfdd640 1 -- 172.21.15.196:0/3045408991 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4048157d10 msgr2=0x7f40480c8030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:02.428 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:02.424+0000 7f404dfdd640 1 --2- 172.21.15.196:0/3045408991 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4048157d10 0x7f40480c8030 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f404806f940 tx=0x7f404001f110 comp rx=0 tx=0).stop 2024-03-17T23:56:02.428 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:02.424+0000 7f404dfdd640 1 -- 172.21.15.196:0/3045408991 shutdown_connections 2024-03-17T23:56:02.428 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:02.424+0000 7f404dfdd640 1 --2- 172.21.15.196:0/3045408991 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4048157d10 0x7f40480c8030 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:02.428 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:02.424+0000 7f404dfdd640 1 --2- 172.21.15.196:0/3045408991 >> v2:172.21.15.204:3300/0 conn(0x7f40480c9650 0x7f40480c2e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:02.428 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:02.424+0000 7f404dfdd640 1 -- 172.21.15.196:0/3045408991 >> 172.21.15.196:0/3045408991 conn(0x7f404806b480 msgr2=0x7f404806b890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-17T23:56:02.428 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:02.424+0000 7f404dfdd640 1 -- 172.21.15.196:0/3045408991 shutdown_connections 2024-03-17T23:56:02.429 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:02.424+0000 7f404dfdd640 1 -- 172.21.15.196:0/3045408991 wait complete. 2024-03-17T23:56:02.429 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:02.428+0000 7f404dfdd640 1 Processor -- start 2024-03-17T23:56:02.429 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:02.428+0000 7f404dfdd640 1 -- start start 2024-03-17T23:56:02.431 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:02.428+0000 7f404dfdd640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f40480c9650 0x7f404814cc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:02.431 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:02.428+0000 7f404dfdd640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4048151ef0 0x7f40481dfcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:02.432 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:02.428+0000 7f404dfdd640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4048157d10 0x7f4048154830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:02.432 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:02.428+0000 7f404dfdd640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f40480c28f0 con 0x7f40480c9650 2024-03-17T23:56:02.432 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:02.428+0000 7f404dfdd640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f4048070a70 con 0x7f4048157d10 2024-03-17T23:56:02.432 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:02.428+0000 7f404dfdd640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f40481581a0 con 0x7f4048151ef0 2024-03-17T23:56:02.432 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:02.428+0000 7f40477fe640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f40480c9650 0x7f404814cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:02.432 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:02.428+0000 7f40477fe640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f40480c9650 0x7f404814cc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.196:56380/0 (socket says 172.21.15.196:56380) 2024-03-17T23:56:02.432 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:02.428+0000 7f40477fe640 1 -- 172.21.15.196:0/2848796220 learned_addr learned my addr 172.21.15.196:0/2848796220 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-03-17T23:56:02.432 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:02.428+0000 7f403ffff640 1 --2- 172.21.15.196:0/2848796220 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4048151ef0 0x7f40481dfcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:02.432 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:02.428+0000 7f40477fe640 1 -- 172.21.15.196:0/2848796220 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4048151ef0 msgr2=0x7f40481dfcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:02.432 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:02.428+0000 7f40477fe640 1 --2- 172.21.15.196:0/2848796220 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4048151ef0 0x7f40481dfcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:02.432 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:02.428+0000 7f40477fe640 1 -- 172.21.15.196:0/2848796220 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4048157d10 msgr2=0x7f4048154830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:02.432 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:02.428+0000 7f40477fe640 1 --2- 172.21.15.196:0/2848796220 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4048157d10 0x7f4048154830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:02.433 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:02.428+0000 7f40477fe640 1 -- 172.21.15.196:0/2848796220 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f404814d1b0 con 0x7f40480c9650 2024-03-17T23:56:02.433 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:02.428+0000 7f40477fe640 1 --2- 172.21.15.196:0/2848796220 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f40480c9650 0x7f404814cc70 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f403800c4d0 tx=0x7f403800c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:56:02.433 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:02.428+0000 7f4044ff9640 1 -- 172.21.15.196:0/2848796220 <== mon.0 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4038018070 con 0x7f40480c9650 2024-03-17T23:56:02.433 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:02.428+0000 7f4044ff9640 1 -- 172.21.15.196:0/2848796220 <== mon.0 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f40380074e0 con 0x7f40480c9650 2024-03-17T23:56:02.433 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:02.428+0000 7f404dfdd640 1 -- 172.21.15.196:0/2848796220 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4048070fb0 con 0x7f40480c9650 2024-03-17T23:56:02.433 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:02.428+0000 7f4044ff9640 1 -- 172.21.15.196:0/2848796220 <== mon.0 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4038004a30 con 0x7f40480c9650 2024-03-17T23:56:02.433 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:02.428+0000 7f404dfdd640 1 -- 172.21.15.196:0/2848796220 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40481ef120 con 0x7f40480c9650 2024-03-17T23:56:02.433 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:02.428+0000 7f404dfdd640 1 -- 172.21.15.196:0/2848796220 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f40480689a0 con 0x7f40480c9650 2024-03-17T23:56:02.434 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:02.432+0000 7f4044ff9640 1 -- 172.21.15.196:0/2848796220 <== mon.0 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 5) ==== 87083+0+0 (secure 0 0 0) 0x7f403801b070 con 0x7f40480c9650 2024-03-17T23:56:02.434 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:02.432+0000 7f4044ff9640 1 --2- 172.21.15.196:0/2848796220 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f4028067690 0x7f4028069b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:02.434 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:02.432+0000 7f4044ff9640 1 -- 172.21.15.196:0/2848796220 <== mon.0 v2:172.21.15.196:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f4038084a00 con 0x7f40480c9650 2024-03-17T23:56:02.434 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:02.432+0000 7f403ffff640 1 --2- 172.21.15.196:0/2848796220 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f4028067690 0x7f4028069b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:02.434 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:02.432+0000 7f403ffff640 1 --2- 172.21.15.196:0/2848796220 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f4028067690 0x7f4028069b50 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f40480cc940 tx=0x7f4030008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:56:02.437 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:02.436+0000 7f4044ff9640 1 -- 172.21.15.196:0/2848796220 <== mon.0 v2:172.21.15.196:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177849 (secure 0 0 0) 0x7f404814d1b0 con 0x7f40480c9650 2024-03-17T23:56:02.633 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:02.632+0000 7f404dfdd640 1 -- 172.21.15.196:0/2848796220 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f4048074bd0 con 0x7f40480c9650 2024-03-17T23:56:02.653 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:02.652+0000 7f4044ff9640 1 -- 172.21.15.196:0/2848796220 <== mon.0 v2:172.21.15.196:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v5) ==== 118+0+0 (secure 0 0 0) 0x7f4038055710 con 0x7f40480c9650 2024-03-17T23:56:02.655 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:02.652+0000 7f404dfdd640 1 -- 172.21.15.196:0/2848796220 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f4028067690 msgr2=0x7f4028069b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:02.655 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:02.652+0000 7f404dfdd640 1 --2- 172.21.15.196:0/2848796220 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f4028067690 0x7f4028069b50 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f40480cc940 tx=0x7f4030008040 comp rx=0 tx=0).stop 2024-03-17T23:56:02.655 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:02.652+0000 7f404dfdd640 1 -- 172.21.15.196:0/2848796220 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f40480c9650 msgr2=0x7f404814cc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:02.655 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:02.652+0000 7f404dfdd640 1 --2- 172.21.15.196:0/2848796220 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f40480c9650 0x7f404814cc70 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f403800c4d0 tx=0x7f403800c990 comp rx=0 tx=0).stop 2024-03-17T23:56:02.656 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:02.652+0000 7f404dfdd640 1 -- 172.21.15.196:0/2848796220 shutdown_connections 2024-03-17T23:56:02.656 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:02.652+0000 7f404dfdd640 1 --2- 172.21.15.196:0/2848796220 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f4028067690 0x7f4028069b50 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:02.656 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:02.652+0000 7f404dfdd640 1 --2- 172.21.15.196:0/2848796220 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4048151ef0 0x7f40481dfcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:02.656 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:02.652+0000 7f404dfdd640 1 --2- 172.21.15.196:0/2848796220 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4048157d10 0x7f4048154830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:02.656 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:02.652+0000 7f404dfdd640 1 --2- 172.21.15.196:0/2848796220 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f40480c9650 0x7f404814cc70 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:02.656 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:02.652+0000 7f404dfdd640 1 -- 172.21.15.196:0/2848796220 >> 172.21.15.196:0/2848796220 conn(0x7f404806b480 msgr2=0x7f4048157580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-17T23:56:02.656 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:02.652+0000 7f404dfdd640 1 -- 172.21.15.196:0/2848796220 shutdown_connections 2024-03-17T23:56:02.656 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:02.652+0000 7f404dfdd640 1 -- 172.21.15.196:0/2848796220 wait complete. 2024-03-17T23:56:02.672 DEBUG:tasks.cephfs.filesystem:fs_config: {'max_mds': 5, 'session_timeout': 300} 2024-03-17T23:56:02.672 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs max_mds 5 2024-03-17T23:56:02.795 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:02.792+0000 7f8a3308b640 1 Processor -- start 2024-03-17T23:56:02.796 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:02.792+0000 7f8a3308b640 1 -- start start 2024-03-17T23:56:02.797 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:02.796+0000 7f8a3308b640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f8a2c151dd0 0x7f8a2c06f990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:02.797 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:02.796+0000 7f8a3308b640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8a2c0c1f00 0x7f8a2c157bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:02.797 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:02.796+0000 7f8a3308b640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8a2c072b00 con 0x7f8a2c06f1a0 2024-03-17T23:56:02.797 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:02.796+0000 7f8a3308b640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 -- 0x7f8a2c072de0 con 0x7f8a2c151dd0 2024-03-17T23:56:02.797 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:02.796+0000 7f8a3308b640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f8a2c0713a0 con 0x7f8a2c0c1f00 2024-03-17T23:56:02.797 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:02.796+0000 7f8a2bfff640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8a2c0c1f00 0x7f8a2c157bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:02.797 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:02.796+0000 7f8a30e27640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f8a2c151dd0 0x7f8a2c06f990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:02.798 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:02.796+0000 7f8a31628640 1 --1- >> v1:172.21.15.204:6789/0 conn(0x7f8a2c06f1a0 0x7f8a2c0c4c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.204:6789/0 says I am v1:172.21.15.196:60064/0 (socket says 172.21.15.196:60064) 2024-03-17T23:56:02.798 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:02.796+0000 7f8a31628640 1 -- 172.21.15.196:0/2517444004 learned_addr learned my addr 172.21.15.196:0/2517444004 (peer_addr_for_me v1:172.21.15.196:0/0) 2024-03-17T23:56:02.798 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:02.796+0000 7f8a2bfff640 1 -- 172.21.15.196:0/2517444004 >> v2:172.21.15.204:3300/0 conn(0x7f8a2c151dd0 msgr2=0x7f8a2c06f990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-17T23:56:02.798 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:02.796+0000 7f8a2bfff640 1 --2- 172.21.15.196:0/2517444004 >> v2:172.21.15.204:3300/0 conn(0x7f8a2c151dd0 0x7f8a2c06f990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:02.798 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:02.796+0000 7f8a2bfff640 1 -- 172.21.15.196:0/2517444004 >> v1:172.21.15.204:6789/0 conn(0x7f8a2c06f1a0 legacy=0x7f8a2c0c4c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:02.798 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:02.796+0000 7f8a2bfff640 1 -- 172.21.15.196:0/2517444004 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a2c071680 con 0x7f8a2c0c1f00 2024-03-17T23:56:02.798 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:02.796+0000 7f8a30e27640 1 --2- 172.21.15.196:0/2517444004 >> v2:172.21.15.204:3300/0 conn(0x7f8a2c151dd0 0x7f8a2c06f990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-17T23:56:02.800 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:02.796+0000 7f8a2bfff640 1 --2- 172.21.15.196:0/2517444004 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8a2c0c1f00 0x7f8a2c157bf0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f8a200097c0 tx=0x7f8a2001c4a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3f26cb6a9b4f5202 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:56:02.800 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:02.800+0000 7f8a2b7fe640 1 -- 172.21.15.196:0/2517444004 <== mon.2 v2:172.21.15.204:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a200b2070 con 0x7f8a2c0c1f00 2024-03-17T23:56:02.800 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:02.800+0000 7f8a2b7fe640 1 -- 172.21.15.196:0/2517444004 <== mon.2 v2:172.21.15.204:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a200ad640 con 0x7f8a2c0c1f00 2024-03-17T23:56:02.800 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:02.800+0000 7f8a2b7fe640 1 -- 172.21.15.196:0/2517444004 <== mon.2 v2:172.21.15.204:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a200ada10 con 0x7f8a2c0c1f00 2024-03-17T23:56:02.801 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:02.800+0000 7f8a3308b640 1 -- 172.21.15.196:0/2517444004 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8a2c0c1f00 msgr2=0x7f8a2c157bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:02.801 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:02.800+0000 7f8a3308b640 1 --2- 172.21.15.196:0/2517444004 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8a2c0c1f00 0x7f8a2c157bf0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f8a200097c0 tx=0x7f8a2001c4a0 comp rx=0 tx=0).stop 2024-03-17T23:56:02.801 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:02.800+0000 7f8a3308b640 1 -- 172.21.15.196:0/2517444004 shutdown_connections 2024-03-17T23:56:02.801 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:02.800+0000 7f8a3308b640 1 --2- 172.21.15.196:0/2517444004 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8a2c0c1f00 0x7f8a2c157bf0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:02.801 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:02.800+0000 7f8a3308b640 1 --2- 172.21.15.196:0/2517444004 >> v2:172.21.15.204:3300/0 conn(0x7f8a2c151dd0 0x7f8a2c06f990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:02.802 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:02.800+0000 7f8a3308b640 1 -- 172.21.15.196:0/2517444004 >> 172.21.15.196:0/2517444004 conn(0x7f8a2c06b2b0 msgr2=0x7f8a2c06b6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-17T23:56:02.802 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:02.800+0000 7f8a3308b640 1 -- 172.21.15.196:0/2517444004 shutdown_connections 2024-03-17T23:56:02.802 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:02.800+0000 7f8a3308b640 1 -- 172.21.15.196:0/2517444004 wait complete. 2024-03-17T23:56:02.803 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:02.800+0000 7f8a3308b640 1 Processor -- start 2024-03-17T23:56:02.803 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:02.800+0000 7f8a3308b640 1 -- start start 2024-03-17T23:56:02.806 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:02.804+0000 7f8a3308b640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8a2c06f1a0 0x7f8a2c157a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:02.806 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:02.804+0000 7f8a3308b640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8a2c0c1f00 0x7f8a2c0c7ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:02.806 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:02.804+0000 7f8a3308b640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8a2c151dd0 0x7f8a2c148e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:02.806 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:02.804+0000 7f8a3308b640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f8a2c0c26f0 con 0x7f8a2c06f1a0 2024-03-17T23:56:02.806 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:02.804+0000 7f8a3308b640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f8a2c0c2570 con 0x7f8a2c151dd0 2024-03-17T23:56:02.806 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:02.804+0000 7f8a3308b640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f8a2c0c5310 con 0x7f8a2c0c1f00 2024-03-17T23:56:02.806 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:02.804+0000 7f8a30e27640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8a2c06f1a0 0x7f8a2c157a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:02.806 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:02.804+0000 7f8a30e27640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8a2c06f1a0 0x7f8a2c157a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.196:34302/0 (socket says 172.21.15.196:34302) 2024-03-17T23:56:02.806 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:02.804+0000 7f8a30e27640 1 -- 172.21.15.196:0/513600510 learned_addr learned my addr 172.21.15.196:0/513600510 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-03-17T23:56:02.806 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:02.804+0000 7f8a31628640 1 --2- 172.21.15.196:0/513600510 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8a2c151dd0 0x7f8a2c148e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:02.806 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:02.804+0000 7f8a2bfff640 1 --2- 172.21.15.196:0/513600510 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8a2c0c1f00 0x7f8a2c0c7ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:02.807 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:02.804+0000 7f8a30e27640 1 -- 172.21.15.196:0/513600510 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8a2c0c1f00 msgr2=0x7f8a2c0c7ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:02.807 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:02.804+0000 7f8a30e27640 1 --2- 172.21.15.196:0/513600510 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8a2c0c1f00 0x7f8a2c0c7ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:02.807 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:02.804+0000 7f8a30e27640 1 -- 172.21.15.196:0/513600510 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8a2c151dd0 msgr2=0x7f8a2c148e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:02.807 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:02.804+0000 7f8a30e27640 1 --2- 172.21.15.196:0/513600510 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8a2c151dd0 0x7f8a2c148e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:02.807 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:02.804+0000 7f8a30e27640 1 -- 172.21.15.196:0/513600510 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a2c1516a0 con 0x7f8a2c06f1a0 2024-03-17T23:56:02.807 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:02.804+0000 7f8a31628640 1 --2- 172.21.15.196:0/513600510 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8a2c151dd0 0x7f8a2c148e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-17T23:56:02.807 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:02.804+0000 7f8a30e27640 1 --2- 172.21.15.196:0/513600510 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8a2c06f1a0 0x7f8a2c157a00 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f8a1c00e980 tx=0x7f8a1c00ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:56:02.807 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:02.804+0000 7f8a297fa640 1 -- 172.21.15.196:0/513600510 <== mon.0 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a1c017070 con 0x7f8a2c06f1a0 2024-03-17T23:56:02.807 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:02.804+0000 7f8a297fa640 1 -- 172.21.15.196:0/513600510 <== mon.0 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a1c00ca00 con 0x7f8a2c06f1a0 2024-03-17T23:56:02.807 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:02.804+0000 7f8a3308b640 1 -- 172.21.15.196:0/513600510 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a2c1f6630 con 0x7f8a2c06f1a0 2024-03-17T23:56:02.807 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:02.804+0000 7f8a297fa640 1 -- 172.21.15.196:0/513600510 <== mon.0 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a1c00cdd0 con 0x7f8a2c06f1a0 2024-03-17T23:56:02.807 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:02.804+0000 7f8a3308b640 1 -- 172.21.15.196:0/513600510 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a2c1f2930 con 0x7f8a2c06f1a0 2024-03-17T23:56:02.807 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:02.804+0000 7f8a3308b640 1 -- 172.21.15.196:0/513600510 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8a2c068290 con 0x7f8a2c06f1a0 2024-03-17T23:56:02.808 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:02.804+0000 7f8a297fa640 1 -- 172.21.15.196:0/513600510 <== mon.0 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 5) ==== 87083+0+0 (secure 0 0 0) 0x7f8a1c01a070 con 0x7f8a2c06f1a0 2024-03-17T23:56:02.808 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:02.804+0000 7f8a297fa640 1 --2- 172.21.15.196:0/513600510 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f8a18067660 0x7f8a18069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:02.808 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:02.804+0000 7f8a297fa640 1 -- 172.21.15.196:0/513600510 <== mon.0 v2:172.21.15.196:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f8a1c085860 con 0x7f8a2c06f1a0 2024-03-17T23:56:02.808 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:02.804+0000 7f8a2bfff640 1 --2- 172.21.15.196:0/513600510 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f8a18067660 0x7f8a18069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:02.808 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:02.808+0000 7f8a2bfff640 1 --2- 172.21.15.196:0/513600510 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f8a18067660 0x7f8a18069b20 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f8a200af000 tx=0x7f8a200a7070 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:56:02.811 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:02.808+0000 7f8a297fa640 1 -- 172.21.15.196:0/513600510 <== mon.0 v2:172.21.15.196:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177849 (secure 0 0 0) 0x7f8a2c1516a0 con 0x7f8a2c06f1a0 2024-03-17T23:56:03.093 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:03.092+0000 7f8a3308b640 1 -- 172.21.15.196:0/513600510 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"} v 0) -- 0x7f8a2c161bc0 con 0x7f8a2c06f1a0 2024-03-17T23:56:03.655 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:03.652+0000 7f8a297fa640 1 -- 172.21.15.196:0/513600510 <== mon.0 v2:172.21.15.196:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]=0 v6) ==== 105+0+0 (secure 0 0 0) 0x7f8a1c0563c0 con 0x7f8a2c06f1a0 2024-03-17T23:56:03.659 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:03.656+0000 7f8a3308b640 1 -- 172.21.15.196:0/513600510 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f8a18067660 msgr2=0x7f8a18069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:03.659 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:03.656+0000 7f8a3308b640 1 --2- 172.21.15.196:0/513600510 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f8a18067660 0x7f8a18069b20 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f8a200af000 tx=0x7f8a200a7070 comp rx=0 tx=0).stop 2024-03-17T23:56:03.659 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:03.656+0000 7f8a3308b640 1 -- 172.21.15.196:0/513600510 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8a2c06f1a0 msgr2=0x7f8a2c157a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:03.659 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:03.656+0000 7f8a3308b640 1 --2- 172.21.15.196:0/513600510 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8a2c06f1a0 0x7f8a2c157a00 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f8a1c00e980 tx=0x7f8a1c00ee40 comp rx=0 tx=0).stop 2024-03-17T23:56:03.659 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:03.656+0000 7f8a3308b640 1 -- 172.21.15.196:0/513600510 shutdown_connections 2024-03-17T23:56:03.659 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:03.656+0000 7f8a3308b640 1 --2- 172.21.15.196:0/513600510 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f8a18067660 0x7f8a18069b20 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:03.659 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:03.656+0000 7f8a3308b640 1 --2- 172.21.15.196:0/513600510 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8a2c0c1f00 0x7f8a2c0c7ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:03.659 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:03.656+0000 7f8a3308b640 1 --2- 172.21.15.196:0/513600510 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8a2c151dd0 0x7f8a2c148e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:03.659 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:03.656+0000 7f8a3308b640 1 --2- 172.21.15.196:0/513600510 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8a2c06f1a0 0x7f8a2c157a00 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:03.659 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:03.656+0000 7f8a3308b640 1 -- 172.21.15.196:0/513600510 >> 172.21.15.196:0/513600510 conn(0x7f8a2c06b2b0 msgr2=0x7f8a2c06b690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-17T23:56:03.660 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:03.656+0000 7f8a3308b640 1 -- 172.21.15.196:0/513600510 shutdown_connections 2024-03-17T23:56:03.660 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:03.656+0000 7f8a3308b640 1 -- 172.21.15.196:0/513600510 wait complete. 2024-03-17T23:56:03.684 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-03-17T23:56:03.795 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:03.792+0000 7fb0dc299640 1 Processor -- start 2024-03-17T23:56:03.795 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:03.792+0000 7fb0dc299640 1 -- start start 2024-03-17T23:56:03.798 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:03.792+0000 7fb0dc299640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fb0d40736b0 0x7fb0d41635b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:03.798 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:03.792+0000 7fb0dc299640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb0d4071bb0 con 0x7fb0d40c7930 2024-03-17T23:56:03.798 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:03.796+0000 7fb0dc299640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb0d4071e50 con 0x7fb0d4151de0 2024-03-17T23:56:03.798 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:03.796+0000 7fb0dc299640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 -- 0x7fb0d40c6a20 con 0x7fb0d40736b0 2024-03-17T23:56:03.798 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:03.796+0000 7fb0d9834640 1 --1- >> v1:172.21.15.196:6789/0 conn(0x7fb0d40c7930 0x7fb0d4158090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.196:6789/0 says I am v1:172.21.15.196:50332/0 (socket says 172.21.15.196:50332) 2024-03-17T23:56:03.798 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:03.796+0000 7fb0d9834640 1 -- 172.21.15.196:0/2953227043 learned_addr learned my addr 172.21.15.196:0/2953227043 (peer_addr_for_me v1:172.21.15.196:0/0) 2024-03-17T23:56:03.798 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:03.796+0000 7fb0da836640 1 --2- 172.21.15.196:0/2953227043 >> v2:172.21.15.204:3300/0 conn(0x7fb0d40736b0 0x7fb0d41635b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:03.798 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:03.796+0000 7fb0d9033640 1 -- 172.21.15.196:0/2953227043 <== mon.0 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1433143952 0 0) 0x7fb0d4071bb0 con 0x7fb0d40c7930 2024-03-17T23:56:03.798 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:03.796+0000 7fb0d9033640 1 -- 172.21.15.196:0/2953227043 --> v1:172.21.15.196:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb0c0003530 con 0x7fb0d40c7930 2024-03-17T23:56:03.798 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:03.796+0000 7fb0d9033640 1 -- 172.21.15.196:0/2953227043 <== mon.0 v1:172.21.15.196:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1909154382 0 0) 0x7fb0c0003530 con 0x7fb0d40c7930 2024-03-17T23:56:03.799 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:03.796+0000 7fb0d9033640 1 -- 172.21.15.196:0/2953227043 >> v2:172.21.15.204:3300/0 conn(0x7fb0d40736b0 msgr2=0x7fb0d41635b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-17T23:56:03.799 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:03.796+0000 7fb0d9033640 1 --2- 172.21.15.196:0/2953227043 >> v2:172.21.15.204:3300/0 conn(0x7fb0d40736b0 0x7fb0d41635b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:03.799 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:03.796+0000 7fb0d9033640 1 -- 172.21.15.196:0/2953227043 >> v1:172.21.15.204:6789/0 conn(0x7fb0d4151de0 legacy=0x7fb0d40c7220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:03.799 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:03.796+0000 7fb0d9033640 1 -- 172.21.15.196:0/2953227043 --> v1:172.21.15.196:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0d40c6d00 con 0x7fb0d40c7930 2024-03-17T23:56:03.799 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:03.796+0000 7fb0d9033640 1 -- 172.21.15.196:0/2953227043 <== mon.0 v1:172.21.15.196:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 981458915 0 0) 0x7fb0c40016a0 con 0x7fb0d40c7930 2024-03-17T23:56:03.799 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:03.796+0000 7fb0d9033640 1 -- 172.21.15.196:0/2953227043 >> v1:172.21.15.196:6789/0 conn(0x7fb0d40c7930 legacy=0x7fb0d4158090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:03.799 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:03.796+0000 7fb0d9033640 1 --2- 172.21.15.196:0/2953227043 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb0c00039c0 0x7fb0c0003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:03.799 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:03.796+0000 7fb0d9033640 1 --2- 172.21.15.196:0/2953227043 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb0c0004810 0x7fb0c0004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:03.799 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:03.796+0000 7fb0d9033640 1 --2- 172.21.15.196:0/2953227043 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb0c00051d0 0x7fb0c000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:03.799 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:03.796+0000 7fb0d9033640 1 -- 172.21.15.196:0/2953227043 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fb0d40c6a20 con 0x7fb0c00039c0 2024-03-17T23:56:03.799 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:03.796+0000 7fb0d9033640 1 -- 172.21.15.196:0/2953227043 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7fb0c000c120 con 0x7fb0c00051d0 2024-03-17T23:56:03.799 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:03.796+0000 7fb0d9033640 1 -- 172.21.15.196:0/2953227043 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7fb0c000c320 con 0x7fb0c0004810 2024-03-17T23:56:03.800 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:03.796+0000 7fb0da836640 1 --2- 172.21.15.196:0/2953227043 >> v2:172.21.15.204:3300/0 conn(0x7fb0d40736b0 0x7fb0d41635b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-17T23:56:03.800 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:03.796+0000 7fb0da035640 1 --2- 172.21.15.196:0/2953227043 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb0c00039c0 0x7fb0c0003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:03.800 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:03.796+0000 7fb0da836640 1 --2- 172.21.15.196:0/2953227043 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb0c00051d0 0x7fb0c000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:03.800 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:03.796+0000 7fb0da035640 1 -- 172.21.15.196:0/2953227043 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb0c0004810 msgr2=0x7fb0c0004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-17T23:56:03.800 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:03.796+0000 7fb0da035640 1 --2- 172.21.15.196:0/2953227043 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb0c0004810 0x7fb0c0004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:03.800 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:03.796+0000 7fb0da035640 1 -- 172.21.15.196:0/2953227043 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb0c00051d0 msgr2=0x7fb0c000b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-17T23:56:03.800 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:03.796+0000 7fb0da035640 1 --2- 172.21.15.196:0/2953227043 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb0c00051d0 0x7fb0c000b9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:03.800 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:03.796+0000 7fb0da035640 1 -- 172.21.15.196:0/2953227043 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0c0003530 con 0x7fb0c00039c0 2024-03-17T23:56:03.800 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:03.796+0000 7fb0da836640 1 -- 172.21.15.196:0/2953227043 reap_dead start 2024-03-17T23:56:03.803 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:03.796+0000 7fb0da035640 1 --2- 172.21.15.196:0/2953227043 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb0c00039c0 0x7fb0c0003de0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fb0d0001780 tx=0x7fb0d001c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a89fcb6f034d553e server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:56:03.803 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:03.796+0000 7fb0d9033640 1 -- 172.21.15.196:0/2953227043 <== mon.0 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0d00013a0 con 0x7fb0c00039c0 2024-03-17T23:56:03.803 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:03.796+0000 7fb0d9033640 1 -- 172.21.15.196:0/2953227043 <== mon.0 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb0d00052f0 con 0x7fb0c00039c0 2024-03-17T23:56:03.804 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:03.796+0000 7fb0d9033640 1 -- 172.21.15.196:0/2953227043 <== mon.0 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0d0003840 con 0x7fb0c00039c0 2024-03-17T23:56:03.804 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:03.796+0000 7fb0dc299640 1 -- 172.21.15.196:0/2953227043 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb0c00039c0 msgr2=0x7fb0c0003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:03.804 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:03.796+0000 7fb0dc299640 1 --2- 172.21.15.196:0/2953227043 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb0c00039c0 0x7fb0c0003de0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fb0d0001780 tx=0x7fb0d001c400 comp rx=0 tx=0).stop 2024-03-17T23:56:03.804 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:03.800+0000 7fb0dc299640 1 -- 172.21.15.196:0/2953227043 shutdown_connections 2024-03-17T23:56:03.804 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:03.800+0000 7fb0dc299640 1 --2- 172.21.15.196:0/2953227043 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb0c00039c0 0x7fb0c0003de0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:03.804 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:03.800+0000 7fb0dc299640 1 -- 172.21.15.196:0/2953227043 >> 172.21.15.196:0/2953227043 conn(0x7fb0d406f5e0 msgr2=0x7fb0d406f9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-17T23:56:03.804 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:03.800+0000 7fb0dc299640 1 -- 172.21.15.196:0/2953227043 shutdown_connections 2024-03-17T23:56:03.804 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:03.800+0000 7fb0dc299640 1 -- 172.21.15.196:0/2953227043 wait complete. 2024-03-17T23:56:03.804 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:03.800+0000 7fb0dc299640 1 Processor -- start 2024-03-17T23:56:03.804 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:03.800+0000 7fb0dc299640 1 -- start start 2024-03-17T23:56:03.804 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:03.800+0000 7fb0dc299640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb0c00039c0 0x7fb0d415b620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:03.804 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:03.800+0000 7fb0dc299640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb0d415bb60 0x7fb0d41f69c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:03.805 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:03.800+0000 7fb0dc299640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb0d41e3df0 0x7fb0d41f6f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:03.805 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:03.800+0000 7fb0dc299640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fb0d41523d0 con 0x7fb0c00039c0 2024-03-17T23:56:03.805 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:03.800+0000 7fb0dc299640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7fb0d4158ab0 con 0x7fb0d41e3df0 2024-03-17T23:56:03.805 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:03.800+0000 7fb0dc299640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7fb0d40c7220 con 0x7fb0d415bb60 2024-03-17T23:56:03.805 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:03.800+0000 7fb0da035640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb0c00039c0 0x7fb0d415b620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:03.805 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:03.800+0000 7fb0da035640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb0c00039c0 0x7fb0d415b620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.196:34320/0 (socket says 172.21.15.196:34320) 2024-03-17T23:56:03.805 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:03.800+0000 7fb0da035640 1 -- 172.21.15.196:0/2783692157 learned_addr learned my addr 172.21.15.196:0/2783692157 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-03-17T23:56:03.805 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:03.800+0000 7fb0d9834640 1 --2- 172.21.15.196:0/2783692157 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb0d415bb60 0x7fb0d41f69c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:03.805 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:03.800+0000 7fb0da035640 1 -- 172.21.15.196:0/2783692157 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb0d415bb60 msgr2=0x7fb0d41f69c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:03.805 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:03.800+0000 7fb0da035640 1 --2- 172.21.15.196:0/2783692157 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb0d415bb60 0x7fb0d41f69c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:03.805 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:03.800+0000 7fb0da035640 1 -- 172.21.15.196:0/2783692157 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb0d41e3df0 msgr2=0x7fb0d41f6f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:03.805 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:03.800+0000 7fb0da035640 1 --2- 172.21.15.196:0/2783692157 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb0d41e3df0 0x7fb0d41f6f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:03.805 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:03.800+0000 7fb0da035640 1 -- 172.21.15.196:0/2783692157 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0d415a5c0 con 0x7fb0c00039c0 2024-03-17T23:56:03.806 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:03.800+0000 7fb0d9834640 1 --2- 172.21.15.196:0/2783692157 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb0d415bb60 0x7fb0d41f69c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-17T23:56:03.806 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:03.800+0000 7fb0da035640 1 --2- 172.21.15.196:0/2783692157 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb0c00039c0 0x7fb0d415b620 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fb0d001c8e0 tx=0x7fb0c0005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:56:03.806 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:03.800+0000 7fb0caffd640 1 -- 172.21.15.196:0/2783692157 <== mon.0 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0d0007a40 con 0x7fb0c00039c0 2024-03-17T23:56:03.806 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:03.800+0000 7fb0caffd640 1 -- 172.21.15.196:0/2783692157 <== mon.0 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb0d00ba070 con 0x7fb0c00039c0 2024-03-17T23:56:03.806 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:03.800+0000 7fb0dc299640 1 -- 172.21.15.196:0/2783692157 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb0d41e4790 con 0x7fb0c00039c0 2024-03-17T23:56:03.806 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:03.800+0000 7fb0caffd640 1 -- 172.21.15.196:0/2783692157 <== mon.0 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0d00054a0 con 0x7fb0c00039c0 2024-03-17T23:56:03.806 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:03.800+0000 7fb0dc299640 1 -- 172.21.15.196:0/2783692157 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0d415a860 con 0x7fb0c00039c0 2024-03-17T23:56:03.806 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:03.800+0000 7fb0dc299640 1 -- 172.21.15.196:0/2783692157 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb0d40689a0 con 0x7fb0c00039c0 2024-03-17T23:56:03.807 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:03.804+0000 7fb0caffd640 1 -- 172.21.15.196:0/2783692157 <== mon.0 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 5) ==== 87083+0+0 (secure 0 0 0) 0x7fb0d0007030 con 0x7fb0c00039c0 2024-03-17T23:56:03.807 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:03.804+0000 7fb0caffd640 1 --2- 172.21.15.196:0/2783692157 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7fb0b8067690 0x7fb0b8069b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:03.807 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:03.804+0000 7fb0caffd640 1 -- 172.21.15.196:0/2783692157 <== mon.0 v2:172.21.15.196:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fb0d011f860 con 0x7fb0c00039c0 2024-03-17T23:56:03.807 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:03.804+0000 7fb0d9834640 1 --2- 172.21.15.196:0/2783692157 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7fb0b8067690 0x7fb0b8069b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:03.807 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:03.804+0000 7fb0d9834640 1 --2- 172.21.15.196:0/2783692157 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7fb0b8067690 0x7fb0b8069b50 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fb0d414f0b0 tx=0x7fb0c4009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:56:03.813 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:03.812+0000 7fb0caffd640 1 -- 172.21.15.196:0/2783692157 <== mon.0 v2:172.21.15.196:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177849 (secure 0 0 0) 0x7fb0d0016110 con 0x7fb0c00039c0 2024-03-17T23:56:04.045 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:04.044+0000 7fb0dc299640 1 -- 172.21.15.196:0/2783692157 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7fb0d4072200 con 0x7fb0c00039c0 2024-03-17T23:56:04.666 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:04.664+0000 7fb0caffd640 1 -- 172.21.15.196:0/2783692157 <== mon.0 v2:172.21.15.196:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v8) ==== 122+0+0 (secure 0 0 0) 0x7fb0d011f020 con 0x7fb0c00039c0 2024-03-17T23:56:04.670 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:04.668+0000 7fb0dc299640 1 -- 172.21.15.196:0/2783692157 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7fb0b8067690 msgr2=0x7fb0b8069b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:04.670 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:04.668+0000 7fb0dc299640 1 --2- 172.21.15.196:0/2783692157 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7fb0b8067690 0x7fb0b8069b50 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fb0d414f0b0 tx=0x7fb0c4009040 comp rx=0 tx=0).stop 2024-03-17T23:56:04.670 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:04.668+0000 7fb0dc299640 1 -- 172.21.15.196:0/2783692157 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb0c00039c0 msgr2=0x7fb0d415b620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:04.670 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:04.668+0000 7fb0dc299640 1 --2- 172.21.15.196:0/2783692157 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb0c00039c0 0x7fb0d415b620 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fb0d001c8e0 tx=0x7fb0c0005840 comp rx=0 tx=0).stop 2024-03-17T23:56:04.670 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:04.668+0000 7fb0dc299640 1 -- 172.21.15.196:0/2783692157 shutdown_connections 2024-03-17T23:56:04.670 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:04.668+0000 7fb0dc299640 1 --2- 172.21.15.196:0/2783692157 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7fb0b8067690 0x7fb0b8069b50 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:04.670 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:04.668+0000 7fb0dc299640 1 --2- 172.21.15.196:0/2783692157 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb0d415bb60 0x7fb0d41f69c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:04.670 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:04.668+0000 7fb0dc299640 1 --2- 172.21.15.196:0/2783692157 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb0d41e3df0 0x7fb0d41f6f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:04.670 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:04.668+0000 7fb0dc299640 1 --2- 172.21.15.196:0/2783692157 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb0c00039c0 0x7fb0d415b620 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:04.670 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:04.668+0000 7fb0dc299640 1 -- 172.21.15.196:0/2783692157 >> 172.21.15.196:0/2783692157 conn(0x7fb0d406f5e0 msgr2=0x7fb0d41e6bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-17T23:56:04.670 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:04.668+0000 7fb0dc299640 1 -- 172.21.15.196:0/2783692157 shutdown_connections 2024-03-17T23:56:04.671 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:04.668+0000 7fb0dc299640 1 -- 172.21.15.196:0/2783692157 wait complete. 2024-03-17T23:56:04.695 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs session_timeout 300 2024-03-17T23:56:04.801 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:04.800+0000 7f605c88c640 1 Processor -- start 2024-03-17T23:56:04.801 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:04.800+0000 7f605c88c640 1 -- start start 2024-03-17T23:56:04.803 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:04.800+0000 7f605c88c640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f60580c4730 0x7f605806fde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:04.803 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:04.800+0000 7f605c88c640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f60580ca1d0 0x7f60580cd6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:04.803 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:04.800+0000 7f605c88c640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f60580c82e0 con 0x7f6058152000 2024-03-17T23:56:04.803 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:04.800+0000 7f605c88c640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7f6058070420 con 0x7f60580ca1d0 2024-03-17T23:56:04.803 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:04.800+0000 7f605c88c640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 -- 0x7f6058070790 con 0x7f60580c4730 2024-03-17T23:56:04.803 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:04.800+0000 7f6056d9d640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f60580ca1d0 0x7f60580cd6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:04.803 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:04.800+0000 7f605659c640 1 --1- >> v1:172.21.15.196:6789/0 conn(0x7f6058152000 0x7f605815ba80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.196:6789/0 says I am v1:172.21.15.196:50340/0 (socket says 172.21.15.196:50340) 2024-03-17T23:56:04.803 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:04.800+0000 7f605659c640 1 -- 172.21.15.196:0/3543009074 learned_addr learned my addr 172.21.15.196:0/3543009074 (peer_addr_for_me v1:172.21.15.196:0/0) 2024-03-17T23:56:04.803 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:04.800+0000 7f6055d9b640 1 --2- 172.21.15.196:0/3543009074 >> v2:172.21.15.204:3300/0 conn(0x7f60580c4730 0x7f605806fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:04.803 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:04.800+0000 7f6056d9d640 1 -- 172.21.15.196:0/3543009074 >> v2:172.21.15.204:3300/0 conn(0x7f60580c4730 msgr2=0x7f605806fde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-17T23:56:04.804 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:04.800+0000 7f6056d9d640 1 --2- 172.21.15.196:0/3543009074 >> v2:172.21.15.204:3300/0 conn(0x7f60580c4730 0x7f605806fde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:04.804 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:04.800+0000 7f6056d9d640 1 -- 172.21.15.196:0/3543009074 >> v1:172.21.15.196:6789/0 conn(0x7f6058152000 legacy=0x7f605815ba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:04.804 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:04.800+0000 7f605559a640 1 -- 172.21.15.196:0/3543009074 <== mon.0 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3501189103 0 0) 0x7f60580c82e0 con 0x7f6058152000 2024-03-17T23:56:04.804 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:04.800+0000 7f6056d9d640 1 -- 172.21.15.196:0/3543009074 --> v2:172.21.15.196:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60580c85c0 con 0x7f60580ca1d0 2024-03-17T23:56:04.805 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:04.804+0000 7f6056d9d640 1 --2- 172.21.15.196:0/3543009074 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f60580ca1d0 0x7f60580cd6b0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f605806c260 tx=0x7f605001f110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3a5c4b801986ec6 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:56:04.805 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:04.804+0000 7f605559a640 1 -- 172.21.15.196:0/3543009074 <== mon.0 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60500b4070 con 0x7f60580ca1d0 2024-03-17T23:56:04.805 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:04.804+0000 7f605559a640 1 -- 172.21.15.196:0/3543009074 <== mon.0 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f60500af600 con 0x7f60580ca1d0 2024-03-17T23:56:04.805 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:04.804+0000 7f605559a640 1 -- 172.21.15.196:0/3543009074 <== mon.0 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60500af9d0 con 0x7f60580ca1d0 2024-03-17T23:56:04.806 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:04.804+0000 7f605c88c640 1 -- 172.21.15.196:0/3543009074 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f60580ca1d0 msgr2=0x7f60580cd6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:04.806 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:04.804+0000 7f605c88c640 1 --2- 172.21.15.196:0/3543009074 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f60580ca1d0 0x7f60580cd6b0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f605806c260 tx=0x7f605001f110 comp rx=0 tx=0).stop 2024-03-17T23:56:04.806 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:04.804+0000 7f605c88c640 1 -- 172.21.15.196:0/3543009074 shutdown_connections 2024-03-17T23:56:04.806 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:04.804+0000 7f605c88c640 1 --2- 172.21.15.196:0/3543009074 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f60580ca1d0 0x7f60580cd6b0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:04.806 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:04.804+0000 7f605c88c640 1 --2- 172.21.15.196:0/3543009074 >> v2:172.21.15.204:3300/0 conn(0x7f60580c4730 0x7f605806fde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:04.806 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:04.804+0000 7f605c88c640 1 -- 172.21.15.196:0/3543009074 >> 172.21.15.196:0/3543009074 conn(0x7f605806b2b0 msgr2=0x7f605806b6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-17T23:56:04.807 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:04.804+0000 7f605c88c640 1 -- 172.21.15.196:0/3543009074 shutdown_connections 2024-03-17T23:56:04.807 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:04.804+0000 7f605c88c640 1 -- 172.21.15.196:0/3543009074 wait complete. 2024-03-17T23:56:04.807 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:04.804+0000 7f605c88c640 1 Processor -- start 2024-03-17T23:56:04.807 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:04.804+0000 7f605c88c640 1 -- start start 2024-03-17T23:56:04.809 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:04.804+0000 7f605c88c640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f60580c4730 0x7f60580c6820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:04.809 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:04.804+0000 7f605c88c640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f60580ca1d0 0x7f60580b1250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:04.810 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:04.804+0000 7f605c88c640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f6058152000 0x7f6058150a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:04.810 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:04.804+0000 7f605c88c640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f605815b560 con 0x7f60580c4730 2024-03-17T23:56:04.810 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:04.804+0000 7f605c88c640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f605815b280 con 0x7f6058152000 2024-03-17T23:56:04.810 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:04.804+0000 7f605c88c640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f60580b29a0 con 0x7f60580ca1d0 2024-03-17T23:56:04.810 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:04.804+0000 7f605659c640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f60580c4730 0x7f60580c6820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:04.810 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:04.808+0000 7f605659c640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f60580c4730 0x7f60580c6820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.196:34340/0 (socket says 172.21.15.196:34340) 2024-03-17T23:56:04.810 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:04.808+0000 7f605659c640 1 -- 172.21.15.196:0/3886969384 learned_addr learned my addr 172.21.15.196:0/3886969384 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-03-17T23:56:04.810 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:04.808+0000 7f6056d9d640 1 --2- 172.21.15.196:0/3886969384 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f6058152000 0x7f6058150a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:04.810 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:04.808+0000 7f6055d9b640 1 --2- 172.21.15.196:0/3886969384 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f60580ca1d0 0x7f60580b1250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:04.810 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:04.808+0000 7f605659c640 1 -- 172.21.15.196:0/3886969384 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f60580ca1d0 msgr2=0x7f60580b1250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:04.810 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:04.808+0000 7f605659c640 1 --2- 172.21.15.196:0/3886969384 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f60580ca1d0 0x7f60580b1250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:04.810 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:04.808+0000 7f605659c640 1 -- 172.21.15.196:0/3886969384 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f6058152000 msgr2=0x7f6058150a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:04.810 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:04.808+0000 7f605659c640 1 --2- 172.21.15.196:0/3886969384 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f6058152000 0x7f6058150a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:04.811 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:04.808+0000 7f605659c640 1 -- 172.21.15.196:0/3886969384 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60580c70a0 con 0x7f60580c4730 2024-03-17T23:56:04.811 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:04.808+0000 7f6056d9d640 1 --2- 172.21.15.196:0/3886969384 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f6058152000 0x7f6058150a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-17T23:56:04.811 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:04.808+0000 7f605659c640 1 --2- 172.21.15.196:0/3886969384 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f60580c4730 0x7f60580c6820 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f604800c480 tx=0x7f604800c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:56:04.811 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:04.808+0000 7f6046ffd640 1 -- 172.21.15.196:0/3886969384 <== mon.0 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6048018070 con 0x7f60580c4730 2024-03-17T23:56:04.811 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:04.808+0000 7f6046ffd640 1 -- 172.21.15.196:0/3886969384 <== mon.0 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6048007500 con 0x7f60580c4730 2024-03-17T23:56:04.811 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:04.808+0000 7f605c88c640 1 -- 172.21.15.196:0/3886969384 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f60580c5110 con 0x7f60580c4730 2024-03-17T23:56:04.811 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:04.808+0000 7f6046ffd640 1 -- 172.21.15.196:0/3886969384 <== mon.0 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6048004a30 con 0x7f60580c4730 2024-03-17T23:56:04.811 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:04.808+0000 7f605c88c640 1 -- 172.21.15.196:0/3886969384 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f60580c5690 con 0x7f60580c4730 2024-03-17T23:56:04.811 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:04.808+0000 7f605c88c640 1 -- 172.21.15.196:0/3886969384 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f60580689a0 con 0x7f60580c4730 2024-03-17T23:56:04.813 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:04.808+0000 7f6046ffd640 1 -- 172.21.15.196:0/3886969384 <== mon.0 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 5) ==== 87083+0+0 (secure 0 0 0) 0x7f604801b070 con 0x7f60580c4730 2024-03-17T23:56:04.813 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:04.808+0000 7f6046ffd640 1 --2- 172.21.15.196:0/3886969384 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f6038067660 0x7f6038069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:04.813 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:04.808+0000 7f6046ffd640 1 -- 172.21.15.196:0/3886969384 <== mon.0 v2:172.21.15.196:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f6048084f80 con 0x7f60580c4730 2024-03-17T23:56:04.814 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:04.808+0000 7f6055d9b640 1 --2- 172.21.15.196:0/3886969384 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f6038067660 0x7f6038069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:04.814 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:04.812+0000 7f6055d9b640 1 --2- 172.21.15.196:0/3886969384 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f6038067660 0x7f6038069b20 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f60580ca100 tx=0x7f604c008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:56:04.815 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:04.812+0000 7f6046ffd640 1 -- 172.21.15.196:0/3886969384 <== mon.0 v2:172.21.15.196:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177849 (secure 0 0 0) 0x7f6048055c70 con 0x7f60580c4730 2024-03-17T23:56:05.003 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:05.000+0000 7f605c88c640 1 -- 172.21.15.196:0/3886969384 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) -- 0x7f60580b2570 con 0x7f60580c4730 2024-03-17T23:56:05.617 INFO:tasks.ceph.mds.c.smithi196.stderr:2024-03-17T23:56:05.616+0000 7f7037ba5640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-03-17T23:56:05.617 INFO:tasks.ceph.mds.c.smithi196.stderr:2024-03-17T23:56:05.616+0000 7f7037ba5640 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2024-03-17T23:56:05.675 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:05.672+0000 7f6046ffd640 1 -- 172.21.15.196:0/3886969384 <== mon.0 v2:172.21.15.196:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v10) ==== 115+0+0 (secure 0 0 0) 0x7f6048055570 con 0x7f60580c4730 2024-03-17T23:56:05.679 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:05.676+0000 7f605c88c640 1 -- 172.21.15.196:0/3886969384 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f6038067660 msgr2=0x7f6038069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:05.679 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:05.676+0000 7f605c88c640 1 --2- 172.21.15.196:0/3886969384 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f6038067660 0x7f6038069b20 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f60580ca100 tx=0x7f604c008040 comp rx=0 tx=0).stop 2024-03-17T23:56:05.679 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:05.676+0000 7f605c88c640 1 -- 172.21.15.196:0/3886969384 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f60580c4730 msgr2=0x7f60580c6820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:05.679 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:05.676+0000 7f605c88c640 1 --2- 172.21.15.196:0/3886969384 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f60580c4730 0x7f60580c6820 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f604800c480 tx=0x7f604800c940 comp rx=0 tx=0).stop 2024-03-17T23:56:05.679 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:05.676+0000 7f605c88c640 1 -- 172.21.15.196:0/3886969384 shutdown_connections 2024-03-17T23:56:05.679 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:05.676+0000 7f605c88c640 1 --2- 172.21.15.196:0/3886969384 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f6038067660 0x7f6038069b20 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:05.679 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:05.676+0000 7f605c88c640 1 --2- 172.21.15.196:0/3886969384 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f60580ca1d0 0x7f60580b1250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:05.679 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:05.676+0000 7f605c88c640 1 --2- 172.21.15.196:0/3886969384 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f6058152000 0x7f6058150a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:05.679 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:05.676+0000 7f605c88c640 1 --2- 172.21.15.196:0/3886969384 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f60580c4730 0x7f60580c6820 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:05.679 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:05.676+0000 7f605c88c640 1 -- 172.21.15.196:0/3886969384 >> 172.21.15.196:0/3886969384 conn(0x7f605806b2b0 msgr2=0x7f60580cb750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-17T23:56:05.679 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:05.676+0000 7f605c88c640 1 -- 172.21.15.196:0/3886969384 shutdown_connections 2024-03-17T23:56:05.679 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:05.676+0000 7f605c88c640 1 -- 172.21.15.196:0/3886969384 wait complete. 2024-03-17T23:56:05.703 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-03-17T23:56:05.703 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-17T23:56:05.808 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:05.804+0000 7f4fa50fb640 1 Processor -- start 2024-03-17T23:56:05.808 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:05.804+0000 7f4fa50fb640 1 -- start start 2024-03-17T23:56:05.809 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:05.808+0000 7f4fa50fb640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4fa015a260 0x7f4fa015a660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:05.809 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:05.808+0000 7f4fa50fb640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f4fa0072430 0x7f4fa00728c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:05.810 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:05.808+0000 7f4fa50fb640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4fa0154620 con 0x7f4fa0154240 2024-03-17T23:56:05.810 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:05.808+0000 7f4fa50fb640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7f4fa00c7830 con 0x7f4fa0072430 2024-03-17T23:56:05.810 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:05.808+0000 7f4fa50fb640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f4fa00c7b10 con 0x7f4fa015a260 2024-03-17T23:56:05.810 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:05.808+0000 7f4f9ed9d640 1 --1- >> v1:172.21.15.196:6789/0 conn(0x7f4fa0154240 0x7f4fa006fca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.196:6789/0 says I am v1:172.21.15.196:50346/0 (socket says 172.21.15.196:50346) 2024-03-17T23:56:05.810 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:05.808+0000 7f4f9ed9d640 1 -- 172.21.15.196:0/3532693121 learned_addr learned my addr 172.21.15.196:0/3532693121 (peer_addr_for_me v1:172.21.15.196:0/0) 2024-03-17T23:56:05.810 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:05.808+0000 7f4f9f59e640 1 --2- 172.21.15.196:0/3532693121 >> v2:172.21.15.196:3300/0 conn(0x7f4fa0072430 0x7f4fa00728c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:05.810 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:05.808+0000 7f4f9dd9b640 1 -- 172.21.15.196:0/3532693121 <== mon.0 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3776512068 0 0) 0x7f4f90001120 con 0x7f4fa0154240 2024-03-17T23:56:05.810 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:05.808+0000 7f4f9e59c640 1 --2- 172.21.15.196:0/3532693121 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4fa015a260 0x7f4fa015a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:05.810 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:05.808+0000 7f4f9dd9b640 1 -- 172.21.15.196:0/3532693121 --> v1:172.21.15.196:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4f88003530 con 0x7f4fa0154240 2024-03-17T23:56:05.813 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:05.808+0000 7f4f9f59e640 1 -- 172.21.15.196:0/3532693121 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4fa015a260 msgr2=0x7f4fa015a660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-17T23:56:05.813 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:05.808+0000 7f4f9f59e640 1 --2- 172.21.15.196:0/3532693121 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4fa015a260 0x7f4fa015a660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:05.813 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:05.808+0000 7f4f9f59e640 1 -- 172.21.15.196:0/3532693121 >> v1:172.21.15.196:6789/0 conn(0x7f4fa0154240 legacy=0x7f4fa006fca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:05.813 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:05.808+0000 7f4f9f59e640 1 -- 172.21.15.196:0/3532693121 --> v2:172.21.15.196:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4fa00c7df0 con 0x7f4fa0072430 2024-03-17T23:56:05.813 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:05.808+0000 7f4f9e59c640 1 --2- 172.21.15.196:0/3532693121 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4fa015a260 0x7f4fa015a660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-17T23:56:05.814 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:05.812+0000 7f4f9f59e640 1 --2- 172.21.15.196:0/3532693121 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4fa0072430 0x7f4fa00728c0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f4f98009d90 tx=0x7f4f9801f150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf725a1ddb2e383d server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:56:05.814 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:05.812+0000 7f4f9dd9b640 1 -- 172.21.15.196:0/3532693121 <== mon.0 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f980b4070 con 0x7f4fa0072430 2024-03-17T23:56:05.814 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:05.812+0000 7f4f9dd9b640 1 -- 172.21.15.196:0/3532693121 <== mon.0 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f980af600 con 0x7f4fa0072430 2024-03-17T23:56:05.814 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:05.812+0000 7f4f9dd9b640 1 -- 172.21.15.196:0/3532693121 <== mon.0 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f980af9d0 con 0x7f4fa0072430 2024-03-17T23:56:05.814 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:05.812+0000 7f4fa50fb640 1 -- 172.21.15.196:0/3532693121 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4fa0072430 msgr2=0x7f4fa00728c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:05.814 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:05.812+0000 7f4fa50fb640 1 --2- 172.21.15.196:0/3532693121 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4fa0072430 0x7f4fa00728c0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f4f98009d90 tx=0x7f4f9801f150 comp rx=0 tx=0).stop 2024-03-17T23:56:05.814 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:05.812+0000 7f4fa50fb640 1 -- 172.21.15.196:0/3532693121 shutdown_connections 2024-03-17T23:56:05.814 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:05.812+0000 7f4fa50fb640 1 --2- 172.21.15.196:0/3532693121 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4fa0072430 0x7f4fa00728c0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:05.814 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:05.812+0000 7f4fa50fb640 1 --2- 172.21.15.196:0/3532693121 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4fa015a260 0x7f4fa015a660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:05.814 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:05.812+0000 7f4fa50fb640 1 -- 172.21.15.196:0/3532693121 >> 172.21.15.196:0/3532693121 conn(0x7f4fa00cc420 msgr2=0x7f4fa00cc830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-17T23:56:05.814 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:05.812+0000 7f4fa50fb640 1 -- 172.21.15.196:0/3532693121 shutdown_connections 2024-03-17T23:56:05.815 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:05.812+0000 7f4fa50fb640 1 -- 172.21.15.196:0/3532693121 wait complete. 2024-03-17T23:56:05.816 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:05.812+0000 7f4fa50fb640 1 Processor -- start 2024-03-17T23:56:05.817 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:05.812+0000 7f4fa50fb640 1 -- start start 2024-03-17T23:56:05.817 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:05.812+0000 7f4fa50fb640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4fa0072430 0x7f4fa0146bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:05.817 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:05.812+0000 7f4fa50fb640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4fa0154240 0x7f4fa0158080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:05.817 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:05.812+0000 7f4fa50fb640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4fa015a260 0x7f4fa01585c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:05.817 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:05.812+0000 7f4fa50fb640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f4fa00c8720 con 0x7f4fa015a260 2024-03-17T23:56:05.817 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:05.812+0000 7f4fa50fb640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f4fa00c83b0 con 0x7f4fa0154240 2024-03-17T23:56:05.817 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:05.812+0000 7f4fa50fb640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f4fa015aba0 con 0x7f4fa0072430 2024-03-17T23:56:05.817 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:05.812+0000 7f4f9f59e640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4fa015a260 0x7f4fa01585c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:05.817 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:05.812+0000 7f4f9f59e640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4fa015a260 0x7f4fa01585c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.196:34356/0 (socket says 172.21.15.196:34356) 2024-03-17T23:56:05.817 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:05.812+0000 7f4f9f59e640 1 -- 172.21.15.196:0/1808436010 learned_addr learned my addr 172.21.15.196:0/1808436010 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-03-17T23:56:05.817 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:05.812+0000 7f4f9ed9d640 1 --2- 172.21.15.196:0/1808436010 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4fa0072430 0x7f4fa0146bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:05.818 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:05.812+0000 7f4f9f59e640 1 -- 172.21.15.196:0/1808436010 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4fa0072430 msgr2=0x7f4fa0146bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:05.818 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:05.812+0000 7f4f9f59e640 1 --2- 172.21.15.196:0/1808436010 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4fa0072430 0x7f4fa0146bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:05.818 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:05.812+0000 7f4f9e59c640 1 --2- 172.21.15.196:0/1808436010 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4fa0154240 0x7f4fa0158080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:05.818 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:05.812+0000 7f4f9f59e640 1 -- 172.21.15.196:0/1808436010 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4fa0154240 msgr2=0x7f4fa0158080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:05.818 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:05.812+0000 7f4f9f59e640 1 --2- 172.21.15.196:0/1808436010 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4fa0154240 0x7f4fa0158080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:05.818 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:05.812+0000 7f4f9f59e640 1 -- 172.21.15.196:0/1808436010 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4fa0159ec0 con 0x7f4fa015a260 2024-03-17T23:56:05.818 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:05.812+0000 7f4f9f59e640 1 --2- 172.21.15.196:0/1808436010 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4fa015a260 0x7f4fa01585c0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f4f980b2040 tx=0x7f4f9801bef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:56:05.818 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:05.812+0000 7f4f877fe640 1 -- 172.21.15.196:0/1808436010 <== mon.0 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f980b4040 con 0x7f4fa015a260 2024-03-17T23:56:05.818 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:05.812+0000 7f4f877fe640 1 -- 172.21.15.196:0/1808436010 <== mon.0 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f980c1070 con 0x7f4fa015a260 2024-03-17T23:56:05.818 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:05.812+0000 7f4fa50fb640 1 -- 172.21.15.196:0/1808436010 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4fa0158d10 con 0x7f4fa015a260 2024-03-17T23:56:05.819 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:05.816+0000 7f4f877fe640 1 -- 172.21.15.196:0/1808436010 <== mon.0 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f98009450 con 0x7f4fa015a260 2024-03-17T23:56:05.819 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:05.816+0000 7f4fa50fb640 1 -- 172.21.15.196:0/1808436010 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4fa0159900 con 0x7f4fa015a260 2024-03-17T23:56:05.820 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:05.816+0000 7f4f857fa640 1 -- 172.21.15.196:0/1808436010 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4f780052a0 con 0x7f4fa015a260 2024-03-17T23:56:05.820 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:05.816+0000 7f4f877fe640 1 -- 172.21.15.196:0/1808436010 <== mon.0 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 5) ==== 87083+0+0 (secure 0 0 0) 0x7f4f980ba6b0 con 0x7f4fa015a260 2024-03-17T23:56:05.820 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:05.816+0000 7f4f877fe640 1 --2- 172.21.15.196:0/1808436010 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f4f8c067660 0x7f4f8c069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:05.820 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:05.816+0000 7f4f877fe640 1 -- 172.21.15.196:0/1808436010 <== mon.0 v2:172.21.15.196:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f4f98124190 con 0x7f4fa015a260 2024-03-17T23:56:05.820 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:05.816+0000 7f4f9ed9d640 1 --2- 172.21.15.196:0/1808436010 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f4f8c067660 0x7f4f8c069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:05.820 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:05.816+0000 7f4f9ed9d640 1 --2- 172.21.15.196:0/1808436010 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f4f8c067660 0x7f4f8c069b20 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f4f90007fd0 tx=0x7f4f90009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:56:05.827 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:05.824+0000 7f4f877fe640 1 -- 172.21.15.196:0/1808436010 <== mon.0 v2:172.21.15.196:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177849 (secure 0 0 0) 0x7f4f98018cb0 con 0x7f4fa015a260 2024-03-17T23:56:06.017 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:06.016+0000 7f4f857fa640 1 -- 172.21.15.196:0/1808436010 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4f78005860 con 0x7f4fa015a260 2024-03-17T23:56:06.018 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:06.016+0000 7f4f877fe640 1 -- 172.21.15.196:0/1808436010 <== mon.0 v2:172.21.15.196:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) ==== 94+0+6899 (secure 0 0 0) 0x7f4f980f4e10 con 0x7f4fa015a260 2024-03-17T23:56:06.018 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-03-17T23:56:06.019 INFO:teuthology.orchestra.run.smithi196.stdout:{"epoch":11,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4211,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6835/1901351791","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6834","nonce":1901351791},{"type":"v1","addr":"172.21.15.204:6835","nonce":1901351791}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4261,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6837/3888512151","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6836","nonce":3888512151},{"type":"v1","addr":"172.21.15.204:6837","nonce":3888512151}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":11,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-17T23:56:01.019247+0000","modified":"2024-03-17T23:56:05.682966+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3],"up":{"mds_0":4284,"mds_1":4281,"mds_2":4275,"mds_3":4264},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4264":{"gid":4264,"name":"f","rank":3,"incarnation":11,"state":"up:creating","state_seq":1,"addr":"172.21.15.204:6839/2849161202","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6838","nonce":2849161202},{"type":"v1","addr":"172.21.15.204:6839","nonce":2849161202}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4275":{"gid":4275,"name":"a","rank":2,"incarnation":9,"state":"up:active","state_seq":4,"addr":"172.21.15.196:6833/2075619627","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6832","nonce":2075619627},{"type":"v1","addr":"172.21.15.196:6833","nonce":2075619627}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4281":{"gid":4281,"name":"e","rank":1,"incarnation":7,"state":"up:active","state_seq":4,"addr":"172.21.15.196:6835/1837184297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6834","nonce":1837184297},{"type":"v1","addr":"172.21.15.196:6835","nonce":1837184297}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4284":{"gid":4284,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.196:6837/2436120950","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6836","nonce":2436120950},{"type":"v1","addr":"172.21.15.196:6837","nonce":2436120950}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4284,"qdb_cluster":[4284,4281,4275]},"id":1}]} 2024-03-17T23:56:06.019 INFO:teuthology.orchestra.run.smithi196.stderr:dumped fsmap epoch 11 2024-03-17T23:56:06.021 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:06.020+0000 7f4f857fa640 1 -- 172.21.15.196:0/1808436010 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f4f8c067660 msgr2=0x7f4f8c069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:06.021 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:06.020+0000 7f4f857fa640 1 --2- 172.21.15.196:0/1808436010 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f4f8c067660 0x7f4f8c069b20 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f4f90007fd0 tx=0x7f4f90009040 comp rx=0 tx=0).stop 2024-03-17T23:56:06.021 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:06.020+0000 7f4f857fa640 1 -- 172.21.15.196:0/1808436010 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4fa015a260 msgr2=0x7f4fa01585c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:06.021 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:06.020+0000 7f4f857fa640 1 --2- 172.21.15.196:0/1808436010 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4fa015a260 0x7f4fa01585c0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f4f980b2040 tx=0x7f4f9801bef0 comp rx=0 tx=0).stop 2024-03-17T23:56:06.021 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:06.020+0000 7f4f857fa640 1 -- 172.21.15.196:0/1808436010 shutdown_connections 2024-03-17T23:56:06.021 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:06.020+0000 7f4f857fa640 1 --2- 172.21.15.196:0/1808436010 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f4f8c067660 0x7f4f8c069b20 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:06.021 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:06.020+0000 7f4f857fa640 1 --2- 172.21.15.196:0/1808436010 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4fa015a260 0x7f4fa01585c0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:06.021 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:06.020+0000 7f4f857fa640 1 --2- 172.21.15.196:0/1808436010 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4fa0154240 0x7f4fa0158080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:06.021 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:06.020+0000 7f4f857fa640 1 --2- 172.21.15.196:0/1808436010 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4fa0072430 0x7f4fa0146bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:06.022 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:06.020+0000 7f4f857fa640 1 -- 172.21.15.196:0/1808436010 >> 172.21.15.196:0/1808436010 conn(0x7f4fa00cc420 msgr2=0x7f4fa0072c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-17T23:56:06.022 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:06.020+0000 7f4f857fa640 1 -- 172.21.15.196:0/1808436010 shutdown_connections 2024-03-17T23:56:06.022 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:06.020+0000 7f4f857fa640 1 -- 172.21.15.196:0/1808436010 wait complete. 2024-03-17T23:56:06.036 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-17T23:56:06.136 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:06.132+0000 7f626136f640 1 Processor -- start 2024-03-17T23:56:06.136 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:06.132+0000 7f626136f640 1 -- start start 2024-03-17T23:56:06.137 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:06.136+0000 7f626136f640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f625c1543e0 0x7f625c06d240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:06.137 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:06.136+0000 7f626136f640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f625c15d660 0x7f625c15daf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:06.137 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:06.136+0000 7f626136f640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f625c06d910 con 0x7f625c0b0e70 2024-03-17T23:56:06.138 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:06.136+0000 7f626136f640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7f625c06dbb0 con 0x7f625c15d660 2024-03-17T23:56:06.138 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:06.136+0000 7f626136f640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f625c0c6ab0 con 0x7f625c1543e0 2024-03-17T23:56:06.138 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:06.136+0000 7f625b7fe640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f625c15d660 0x7f625c15daf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:06.138 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:06.136+0000 7f625b7fe640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f625c15d660 0x7f625c15daf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.196:34364/0 (socket says 172.21.15.196:34364) 2024-03-17T23:56:06.138 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:06.136+0000 7f625b7fe640 1 -- 172.21.15.196:0/2706525437 learned_addr learned my addr 172.21.15.196:0/2706525437 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-03-17T23:56:06.138 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:06.136+0000 7f625affd640 1 --2- 172.21.15.196:0/2706525437 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f625c1543e0 0x7f625c06d240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:06.138 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:06.136+0000 7f625b7fe640 1 -- 172.21.15.196:0/2706525437 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f625c1543e0 msgr2=0x7f625c06d240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-17T23:56:06.138 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:06.136+0000 7f625b7fe640 1 --2- 172.21.15.196:0/2706525437 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f625c1543e0 0x7f625c06d240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:06.138 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:06.136+0000 7f625b7fe640 1 -- 172.21.15.196:0/2706525437 >> v1:172.21.15.204:6789/0 conn(0x7f625c0b0e70 legacy=0x7f625c072f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-17T23:56:06.138 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:06.136+0000 7f625b7fe640 1 -- 172.21.15.196:0/2706525437 --> v2:172.21.15.196:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f625c0c6d90 con 0x7f625c15d660 2024-03-17T23:56:06.140 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:06.140+0000 7f625b7fe640 1 --2- 172.21.15.196:0/2706525437 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f625c15d660 0x7f625c15daf0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f6254009e50 tx=0x7f625401f1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a716d94d7dd0317c server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:56:06.140 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:06.140+0000 7f6259ffb640 1 -- 172.21.15.196:0/2706525437 <== mon.0 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62540b4070 con 0x7f625c15d660 2024-03-17T23:56:06.140 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:06.140+0000 7f6259ffb640 1 -- 172.21.15.196:0/2706525437 <== mon.0 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f62540af400 con 0x7f625c15d660 2024-03-17T23:56:06.141 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:06.140+0000 7f6259ffb640 1 -- 172.21.15.196:0/2706525437 <== mon.0 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62540af7d0 con 0x7f625c15d660 2024-03-17T23:56:06.141 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:06.140+0000 7f626136f640 1 -- 172.21.15.196:0/2706525437 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f625c15d660 msgr2=0x7f625c15daf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:06.141 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:06.140+0000 7f626136f640 1 --2- 172.21.15.196:0/2706525437 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f625c15d660 0x7f625c15daf0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f6254009e50 tx=0x7f625401f1e0 comp rx=0 tx=0).stop 2024-03-17T23:56:06.141 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:06.140+0000 7f626136f640 1 -- 172.21.15.196:0/2706525437 shutdown_connections 2024-03-17T23:56:06.142 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:06.140+0000 7f626136f640 1 --2- 172.21.15.196:0/2706525437 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f625c15d660 0x7f625c15daf0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:06.142 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:06.140+0000 7f626136f640 1 --2- 172.21.15.196:0/2706525437 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f625c1543e0 0x7f625c06d240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:06.142 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:06.140+0000 7f626136f640 1 -- 172.21.15.196:0/2706525437 >> 172.21.15.196:0/2706525437 conn(0x7f625c0c89a0 msgr2=0x7f625c0c8db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-17T23:56:06.142 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:06.140+0000 7f626136f640 1 -- 172.21.15.196:0/2706525437 shutdown_connections 2024-03-17T23:56:06.142 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:06.140+0000 7f626136f640 1 -- 172.21.15.196:0/2706525437 wait complete. 2024-03-17T23:56:06.144 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:06.140+0000 7f626136f640 1 Processor -- start 2024-03-17T23:56:06.144 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:06.140+0000 7f626136f640 1 -- start start 2024-03-17T23:56:06.145 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:06.140+0000 7f626136f640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f625c0b0e70 0x7f625c0c9f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:06.145 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:06.140+0000 7f626136f640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f625c1543e0 0x7f625c14fb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:06.145 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:06.140+0000 7f626136f640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f625c15d660 0x7f625c14ca20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:06.145 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:06.140+0000 7f626136f640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f625c1547c0 con 0x7f625c15d660 2024-03-17T23:56:06.145 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:06.140+0000 7f626136f640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f625c071e60 con 0x7f625c0b0e70 2024-03-17T23:56:06.145 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:06.140+0000 7f626136f640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f625c073630 con 0x7f625c1543e0 2024-03-17T23:56:06.145 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:06.140+0000 7f625b7fe640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f625c15d660 0x7f625c14ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:06.145 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:06.140+0000 7f625b7fe640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f625c15d660 0x7f625c14ca20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.196:34380/0 (socket says 172.21.15.196:34380) 2024-03-17T23:56:06.145 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:06.140+0000 7f625b7fe640 1 -- 172.21.15.196:0/1163462748 learned_addr learned my addr 172.21.15.196:0/1163462748 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-03-17T23:56:06.146 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:06.140+0000 7f625affd640 1 --2- 172.21.15.196:0/1163462748 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f625c0b0e70 0x7f625c0c9f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:06.146 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:06.140+0000 7f625a7fc640 1 --2- 172.21.15.196:0/1163462748 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f625c1543e0 0x7f625c14fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:06.146 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:06.140+0000 7f625b7fe640 1 -- 172.21.15.196:0/1163462748 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f625c1543e0 msgr2=0x7f625c14fb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:06.146 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:06.140+0000 7f625b7fe640 1 --2- 172.21.15.196:0/1163462748 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f625c1543e0 0x7f625c14fb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:06.146 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:06.140+0000 7f625b7fe640 1 -- 172.21.15.196:0/1163462748 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f625c0b0e70 msgr2=0x7f625c0c9f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:06.146 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:06.140+0000 7f625b7fe640 1 --2- 172.21.15.196:0/1163462748 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f625c0b0e70 0x7f625c0c9f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:06.146 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:06.140+0000 7f625b7fe640 1 -- 172.21.15.196:0/1163462748 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f625c14e7a0 con 0x7f625c15d660 2024-03-17T23:56:06.146 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:06.140+0000 7f625affd640 1 --2- 172.21.15.196:0/1163462748 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f625c0b0e70 0x7f625c0c9f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-17T23:56:06.146 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:06.140+0000 7f625b7fe640 1 --2- 172.21.15.196:0/1163462748 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f625c15d660 0x7f625c14ca20 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f625401d890 tx=0x7f625401bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:56:06.146 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:06.140+0000 7f62437fe640 1 -- 172.21.15.196:0/1163462748 <== mon.0 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62540c0070 con 0x7f625c15d660 2024-03-17T23:56:06.146 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:06.140+0000 7f62437fe640 1 -- 172.21.15.196:0/1163462748 <== mon.0 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f62540090d0 con 0x7f625c15d660 2024-03-17T23:56:06.147 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:06.140+0000 7f626136f640 1 -- 172.21.15.196:0/1163462748 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f625c14ea80 con 0x7f625c15d660 2024-03-17T23:56:06.147 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:06.144+0000 7f62437fe640 1 -- 172.21.15.196:0/1163462748 <== mon.0 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62540b4040 con 0x7f625c15d660 2024-03-17T23:56:06.147 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:06.144+0000 7f626136f640 1 -- 172.21.15.196:0/1163462748 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f625c14f040 con 0x7f625c15d660 2024-03-17T23:56:06.147 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:06.144+0000 7f626136f640 1 -- 172.21.15.196:0/1163462748 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f625c0689a0 con 0x7f625c15d660 2024-03-17T23:56:06.147 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:06.144+0000 7f62437fe640 1 -- 172.21.15.196:0/1163462748 <== mon.0 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 5) ==== 87083+0+0 (secure 0 0 0) 0x7f62540c3070 con 0x7f625c15d660 2024-03-17T23:56:06.148 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:06.144+0000 7f62437fe640 1 --2- 172.21.15.196:0/1163462748 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f6248067660 0x7f6248069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:06.148 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:06.144+0000 7f62437fe640 1 -- 172.21.15.196:0/1163462748 <== mon.0 v2:172.21.15.196:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f6254122fd0 con 0x7f625c15d660 2024-03-17T23:56:06.148 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:06.144+0000 7f625affd640 1 --2- 172.21.15.196:0/1163462748 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f6248067660 0x7f6248069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:06.148 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:06.144+0000 7f625affd640 1 --2- 172.21.15.196:0/1163462748 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f6248067660 0x7f6248069b20 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f624c009840 tx=0x7f624c008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:56:06.154 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:06.152+0000 7f62437fe640 1 -- 172.21.15.196:0/1163462748 <== mon.0 v2:172.21.15.196:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177849 (secure 0 0 0) 0x7f6254018d40 con 0x7f625c15d660 2024-03-17T23:56:06.308 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:06.308+0000 7f626136f640 1 -- 172.21.15.196:0/1163462748 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f625c06cae0 con 0x7f625c15d660 2024-03-17T23:56:06.310 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:06.308+0000 7f62437fe640 1 -- 172.21.15.196:0/1163462748 <== mon.0 v2:172.21.15.196:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16641 (secure 0 0 0) 0x7f62540f3d10 con 0x7f625c15d660 2024-03-17T23:56:06.311 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-03-17T23:56:06.311 INFO:teuthology.orchestra.run.smithi196.stdout:{"epoch":21,"fsid":"b80f9c80-17ad-4126-8957-4c0c46f5b803","created":"2024-03-17T23:55:43.368838+0000","modified":"2024-03-17T23:56:02.157128+0000","last_up_change":"2024-03-17T23:55:54.132187+0000","last_in_change":"2024-03-17T23:55:46.016435+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-17T23:55:56.030640+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-17T23:55:58.658234+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-17T23:56:00.003208+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"224d699f-bc10-4661-a8b5-6ca73290ffa0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6806","nonce":1194547591},{"type":"v1","addr":"172.21.15.196:6807","nonce":1194547591}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6809","nonce":1194547591},{"type":"v1","addr":"172.21.15.196:6811","nonce":1194547591}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6814","nonce":1194547591},{"type":"v1","addr":"172.21.15.196:6815","nonce":1194547591}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6812","nonce":1194547591},{"type":"v1","addr":"172.21.15.196:6813","nonce":1194547591}]},"public_addr":"172.21.15.196:6807/1194547591","cluster_addr":"172.21.15.196:6811/1194547591","heartbeat_back_addr":"172.21.15.196:6815/1194547591","heartbeat_front_addr":"172.21.15.196:6813/1194547591","state":["exists","up"]},{"osd":1,"uuid":"d8d6a0b0-450b-4ab5-b143-d4f36286e81e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6800","nonce":1901246986},{"type":"v1","addr":"172.21.15.196:6801","nonce":1901246986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6802","nonce":1901246986},{"type":"v1","addr":"172.21.15.196:6803","nonce":1901246986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6808","nonce":1901246986},{"type":"v1","addr":"172.21.15.196:6810","nonce":1901246986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6804","nonce":1901246986},{"type":"v1","addr":"172.21.15.196:6805","nonce":1901246986}]},"public_addr":"172.21.15.196:6801/1901246986","cluster_addr":"172.21.15.196:6803/1901246986","heartbeat_back_addr":"172.21.15.196:6810/1901246986","heartbeat_front_addr":"172.21.15.196:6805/1901246986","state":["exists","up"]},{"osd":2,"uuid":"d732ba94-1db0-41ed-930a-5abb6188980a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6824","nonce":673819559},{"type":"v1","addr":"172.21.15.196:6825","nonce":673819559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6826","nonce":673819559},{"type":"v1","addr":"172.21.15.196:6827","nonce":673819559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6830","nonce":673819559},{"type":"v1","addr":"172.21.15.196:6831","nonce":673819559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6828","nonce":673819559},{"type":"v1","addr":"172.21.15.196:6829","nonce":673819559}]},"public_addr":"172.21.15.196:6825/673819559","cluster_addr":"172.21.15.196:6827/673819559","heartbeat_back_addr":"172.21.15.196:6831/673819559","heartbeat_front_addr":"172.21.15.196:6829/673819559","state":["exists","up"]},{"osd":3,"uuid":"b79cab98-a49f-4544-b6b0-546dcfbd47a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6816","nonce":1104340623},{"type":"v1","addr":"172.21.15.196:6817","nonce":1104340623}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6818","nonce":1104340623},{"type":"v1","addr":"172.21.15.196:6819","nonce":1104340623}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6822","nonce":1104340623},{"type":"v1","addr":"172.21.15.196:6823","nonce":1104340623}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6820","nonce":1104340623},{"type":"v1","addr":"172.21.15.196:6821","nonce":1104340623}]},"public_addr":"172.21.15.196:6817/1104340623","cluster_addr":"172.21.15.196:6819/1104340623","heartbeat_back_addr":"172.21.15.196:6823/1104340623","heartbeat_front_addr":"172.21.15.196:6821/1104340623","state":["exists","up"]},{"osd":4,"uuid":"d5892856-6eb4-4188-beb0-368f64169af1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6816","nonce":658561863},{"type":"v1","addr":"172.21.15.204:6818","nonce":658561863}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6819","nonce":658561863},{"type":"v1","addr":"172.21.15.204:6821","nonce":658561863}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6826","nonce":658561863},{"type":"v1","addr":"172.21.15.204:6828","nonce":658561863}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6823","nonce":658561863},{"type":"v1","addr":"172.21.15.204:6825","nonce":658561863}]},"public_addr":"172.21.15.204:6818/658561863","cluster_addr":"172.21.15.204:6821/658561863","heartbeat_back_addr":"172.21.15.204:6828/658561863","heartbeat_front_addr":"172.21.15.204:6825/658561863","state":["exists","up"]},{"osd":5,"uuid":"89d6b48d-aa8a-4cb8-aa2e-e0aae04928b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6817","nonce":3367327749},{"type":"v1","addr":"172.21.15.204:6820","nonce":3367327749}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6822","nonce":3367327749},{"type":"v1","addr":"172.21.15.204:6824","nonce":3367327749}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6830","nonce":3367327749},{"type":"v1","addr":"172.21.15.204:6831","nonce":3367327749}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6827","nonce":3367327749},{"type":"v1","addr":"172.21.15.204:6829","nonce":3367327749}]},"public_addr":"172.21.15.204:6820/3367327749","cluster_addr":"172.21.15.204:6824/3367327749","heartbeat_back_addr":"172.21.15.204:6831/3367327749","heartbeat_front_addr":"172.21.15.204:6829/3367327749","state":["exists","up"]},{"osd":6,"uuid":"ff7d0949-2836-42a6-a63d-bc5a4269e080","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6805","nonce":2586742078},{"type":"v1","addr":"172.21.15.204:6807","nonce":2586742078}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6809","nonce":2586742078},{"type":"v1","addr":"172.21.15.204:6811","nonce":2586742078}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6814","nonce":2586742078},{"type":"v1","addr":"172.21.15.204:6815","nonce":2586742078}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6812","nonce":2586742078},{"type":"v1","addr":"172.21.15.204:6813","nonce":2586742078}]},"public_addr":"172.21.15.204:6807/2586742078","cluster_addr":"172.21.15.204:6811/2586742078","heartbeat_back_addr":"172.21.15.204:6815/2586742078","heartbeat_front_addr":"172.21.15.204:6813/2586742078","state":["exists","up"]},{"osd":7,"uuid":"42bcc14b-70b3-4c59-bf81-41436e4eb272","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6800","nonce":3361860686},{"type":"v1","addr":"172.21.15.204:6801","nonce":3361860686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6802","nonce":3361860686},{"type":"v1","addr":"172.21.15.204:6803","nonce":3361860686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6808","nonce":3361860686},{"type":"v1","addr":"172.21.15.204:6810","nonce":3361860686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6804","nonce":3361860686},{"type":"v1","addr":"172.21.15.204:6806","nonce":3361860686}]},"public_addr":"172.21.15.204:6801/3361860686","cluster_addr":"172.21.15.204:6803/3361860686","heartbeat_back_addr":"172.21.15.204:6810/3361860686","heartbeat_front_addr":"172.21.15.204:6806/3361860686","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-17T23:55:51.372683+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-17T23:55:51.466291+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-17T23:55:51.608084+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-17T23:55:51.680819+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-17T23:55:51.528198+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-17T23:55:51.537065+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-17T23:55:51.558146+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-17T23:55:51.382540+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-17T23:56:06.313 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:06.312+0000 7f626136f640 1 -- 172.21.15.196:0/1163462748 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f6248067660 msgr2=0x7f6248069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:06.313 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:06.312+0000 7f626136f640 1 --2- 172.21.15.196:0/1163462748 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f6248067660 0x7f6248069b20 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f624c009840 tx=0x7f624c008040 comp rx=0 tx=0).stop 2024-03-17T23:56:06.313 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:06.312+0000 7f626136f640 1 -- 172.21.15.196:0/1163462748 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f625c15d660 msgr2=0x7f625c14ca20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:06.313 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:06.312+0000 7f626136f640 1 --2- 172.21.15.196:0/1163462748 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f625c15d660 0x7f625c14ca20 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f625401d890 tx=0x7f625401bf80 comp rx=0 tx=0).stop 2024-03-17T23:56:06.313 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:06.312+0000 7f626136f640 1 -- 172.21.15.196:0/1163462748 shutdown_connections 2024-03-17T23:56:06.313 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:06.312+0000 7f626136f640 1 --2- 172.21.15.196:0/1163462748 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f6248067660 0x7f6248069b20 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:06.313 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:06.312+0000 7f626136f640 1 --2- 172.21.15.196:0/1163462748 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f625c1543e0 0x7f625c14fb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:06.313 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:06.312+0000 7f626136f640 1 --2- 172.21.15.196:0/1163462748 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f625c15d660 0x7f625c14ca20 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:06.313 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:06.312+0000 7f626136f640 1 --2- 172.21.15.196:0/1163462748 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f625c0b0e70 0x7f625c0c9f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:06.313 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:06.312+0000 7f626136f640 1 -- 172.21.15.196:0/1163462748 >> 172.21.15.196:0/1163462748 conn(0x7f625c0c89a0 msgr2=0x7f625c0c26a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-17T23:56:06.313 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:06.312+0000 7f626136f640 1 -- 172.21.15.196:0/1163462748 shutdown_connections 2024-03-17T23:56:06.314 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:06.312+0000 7f626136f640 1 -- 172.21.15.196:0/1163462748 wait complete. 2024-03-17T23:56:06.328 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-03-17T23:56:06.328 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-17T23:56:06.429 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:06.428+0000 7f5ad519f640 1 Processor -- start 2024-03-17T23:56:06.429 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:06.428+0000 7f5ad519f640 1 -- start start 2024-03-17T23:56:06.431 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:06.428+0000 7f5ad519f640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f5ad0151c40 0x7f5ad00c80d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:06.431 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:06.428+0000 7f5ad519f640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5ad0157b60 0x7f5ad00c90d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:06.431 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:06.428+0000 7f5ad519f640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5ad01580a0 con 0x7f5ad0152020 2024-03-17T23:56:06.431 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:06.428+0000 7f5ad519f640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7f5ad0158360 con 0x7f5ad0151c40 2024-03-17T23:56:06.431 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:06.428+0000 7f5ad519f640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f5ad0158640 con 0x7f5ad0157b60 2024-03-17T23:56:06.431 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:06.428+0000 7f5aced9d640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f5ad0151c40 0x7f5ad00c80d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:06.431 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:06.428+0000 7f5aced9d640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f5ad0151c40 0x7f5ad00c80d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.196:34382/0 (socket says 172.21.15.196:34382) 2024-03-17T23:56:06.431 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:06.428+0000 7f5aced9d640 1 -- 172.21.15.196:0/4005106994 learned_addr learned my addr 172.21.15.196:0/4005106994 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-03-17T23:56:06.431 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:06.428+0000 7f5acf59e640 1 --2- 172.21.15.196:0/4005106994 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5ad0157b60 0x7f5ad00c90d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:06.432 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:06.428+0000 7f5aced9d640 1 -- 172.21.15.196:0/4005106994 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5ad0157b60 msgr2=0x7f5ad00c90d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-17T23:56:06.432 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:06.428+0000 7f5aced9d640 1 --2- 172.21.15.196:0/4005106994 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5ad0157b60 0x7f5ad00c90d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:06.432 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:06.428+0000 7f5aced9d640 1 -- 172.21.15.196:0/4005106994 >> v1:172.21.15.204:6789/0 conn(0x7f5ad0152020 legacy=0x7f5ad015b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-17T23:56:06.432 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:06.428+0000 7f5aced9d640 1 -- 172.21.15.196:0/4005106994 --> v2:172.21.15.196:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ad0158920 con 0x7f5ad0151c40 2024-03-17T23:56:06.434 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:06.432+0000 7f5aced9d640 1 --2- 172.21.15.196:0/4005106994 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5ad0151c40 0x7f5ad00c80d0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f5ac0009870 tx=0x7f5ac001c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c6fff6f08180f18 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:56:06.434 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:06.432+0000 7f5acdd9b640 1 -- 172.21.15.196:0/4005106994 <== mon.0 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ac00b0070 con 0x7f5ad0151c40 2024-03-17T23:56:06.434 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:06.432+0000 7f5acdd9b640 1 -- 172.21.15.196:0/4005106994 <== mon.0 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ac00ab600 con 0x7f5ad0151c40 2024-03-17T23:56:06.434 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:06.432+0000 7f5acdd9b640 1 -- 172.21.15.196:0/4005106994 <== mon.0 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ac00ab9d0 con 0x7f5ad0151c40 2024-03-17T23:56:06.434 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:06.432+0000 7f5ad519f640 1 -- 172.21.15.196:0/4005106994 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5ad0151c40 msgr2=0x7f5ad00c80d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:06.434 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:06.432+0000 7f5ad519f640 1 --2- 172.21.15.196:0/4005106994 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5ad0151c40 0x7f5ad00c80d0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f5ac0009870 tx=0x7f5ac001c520 comp rx=0 tx=0).stop 2024-03-17T23:56:06.434 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:06.432+0000 7f5ad519f640 1 -- 172.21.15.196:0/4005106994 shutdown_connections 2024-03-17T23:56:06.435 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:06.432+0000 7f5ad519f640 1 --2- 172.21.15.196:0/4005106994 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5ad0157b60 0x7f5ad00c90d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:06.435 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:06.432+0000 7f5ad519f640 1 --2- 172.21.15.196:0/4005106994 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5ad0151c40 0x7f5ad00c80d0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:06.435 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:06.432+0000 7f5ad519f640 1 -- 172.21.15.196:0/4005106994 >> 172.21.15.196:0/4005106994 conn(0x7f5ad0071020 msgr2=0x7f5ad0071430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-17T23:56:06.435 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:06.432+0000 7f5ad519f640 1 -- 172.21.15.196:0/4005106994 shutdown_connections 2024-03-17T23:56:06.435 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:06.432+0000 7f5ad519f640 1 -- 172.21.15.196:0/4005106994 wait complete. 2024-03-17T23:56:06.436 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:06.432+0000 7f5ad519f640 1 Processor -- start 2024-03-17T23:56:06.436 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:06.432+0000 7f5ad519f640 1 -- start start 2024-03-17T23:56:06.439 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:06.436+0000 7f5ad519f640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5ad0151c40 0x7f5ad00b31e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:06.439 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:06.436+0000 7f5ad519f640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5ad0152020 0x7f5ad0150b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:06.439 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:06.436+0000 7f5ad519f640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5ad0157b60 0x7f5ad01f4890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:06.439 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:06.436+0000 7f5ad519f640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f5ad0164e80 con 0x7f5ad0152020 2024-03-17T23:56:06.439 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:06.436+0000 7f5ad519f640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f5ad0164d00 con 0x7f5ad0151c40 2024-03-17T23:56:06.439 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:06.436+0000 7f5ad519f640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f5ad0165000 con 0x7f5ad0157b60 2024-03-17T23:56:06.439 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:06.436+0000 7f5ace59c640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5ad0152020 0x7f5ad0150b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:06.439 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:06.436+0000 7f5ace59c640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5ad0152020 0x7f5ad0150b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.196:34398/0 (socket says 172.21.15.196:34398) 2024-03-17T23:56:06.439 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:06.436+0000 7f5ace59c640 1 -- 172.21.15.196:0/725234776 learned_addr learned my addr 172.21.15.196:0/725234776 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-03-17T23:56:06.440 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:06.436+0000 7f5aced9d640 1 --2- 172.21.15.196:0/725234776 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5ad0151c40 0x7f5ad00b31e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:06.440 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:06.436+0000 7f5acf59e640 1 --2- 172.21.15.196:0/725234776 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5ad0157b60 0x7f5ad01f4890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:06.440 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:06.436+0000 7f5ace59c640 1 -- 172.21.15.196:0/725234776 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5ad0157b60 msgr2=0x7f5ad01f4890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:06.440 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:06.436+0000 7f5ace59c640 1 --2- 172.21.15.196:0/725234776 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5ad0157b60 0x7f5ad01f4890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:06.440 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:06.436+0000 7f5ace59c640 1 -- 172.21.15.196:0/725234776 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5ad0151c40 msgr2=0x7f5ad00b31e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:06.440 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:06.436+0000 7f5ace59c640 1 --2- 172.21.15.196:0/725234776 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5ad0151c40 0x7f5ad00b31e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:06.440 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:06.436+0000 7f5ace59c640 1 -- 172.21.15.196:0/725234776 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ad006f420 con 0x7f5ad0152020 2024-03-17T23:56:06.440 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:06.436+0000 7f5aced9d640 1 --2- 172.21.15.196:0/725234776 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5ad0151c40 0x7f5ad00b31e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-17T23:56:06.440 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:06.436+0000 7f5acf59e640 1 --2- 172.21.15.196:0/725234776 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5ad0157b60 0x7f5ad01f4890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-17T23:56:06.440 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:06.436+0000 7f5ace59c640 1 --2- 172.21.15.196:0/725234776 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5ad0152020 0x7f5ad0150b30 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f5ac400b440 tx=0x7f5ac400b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:56:06.440 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:06.436+0000 7f5ab77fe640 1 -- 172.21.15.196:0/725234776 <== mon.0 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ac4015020 con 0x7f5ad0152020 2024-03-17T23:56:06.440 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:06.436+0000 7f5ab77fe640 1 -- 172.21.15.196:0/725234776 <== mon.0 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ac4011850 con 0x7f5ad0152020 2024-03-17T23:56:06.440 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:06.436+0000 7f5ad519f640 1 -- 172.21.15.196:0/725234776 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ad006f180 con 0x7f5ad0152020 2024-03-17T23:56:06.441 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:06.436+0000 7f5ab77fe640 1 -- 172.21.15.196:0/725234776 <== mon.0 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ac4011c40 con 0x7f5ad0152020 2024-03-17T23:56:06.441 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:06.436+0000 7f5ad519f640 1 -- 172.21.15.196:0/725234776 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ad0158d20 con 0x7f5ad0152020 2024-03-17T23:56:06.441 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:06.436+0000 7f5ad519f640 1 -- 172.21.15.196:0/725234776 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5ad00689a0 con 0x7f5ad0152020 2024-03-17T23:56:06.442 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:06.436+0000 7f5ab77fe640 1 -- 172.21.15.196:0/725234776 <== mon.0 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 5) ==== 87083+0+0 (secure 0 0 0) 0x7f5ac4018020 con 0x7f5ad0152020 2024-03-17T23:56:06.442 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:06.440+0000 7f5ab77fe640 1 --2- 172.21.15.196:0/725234776 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f5abc067660 0x7f5abc069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:06.442 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:06.440+0000 7f5ab77fe640 1 -- 172.21.15.196:0/725234776 <== mon.0 v2:172.21.15.196:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f5ac4085c80 con 0x7f5ad0152020 2024-03-17T23:56:06.442 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:06.440+0000 7f5aced9d640 1 --2- 172.21.15.196:0/725234776 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f5abc067660 0x7f5abc069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:06.442 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:06.440+0000 7f5aced9d640 1 --2- 172.21.15.196:0/725234776 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f5abc067660 0x7f5abc069b20 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f5ac00ad000 tx=0x7f5ac0008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:56:06.447 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:06.444+0000 7f5ab77fe640 1 -- 172.21.15.196:0/725234776 <== mon.0 v2:172.21.15.196:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177849 (secure 0 0 0) 0x7f5ac401f020 con 0x7f5ad0152020 2024-03-17T23:56:06.563 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T23:56:06.566 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T23:56:06.602 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:06.600+0000 7f5ad519f640 1 -- 172.21.15.196:0/725234776 --> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f5ad00c8960 con 0x7f5abc067660 2024-03-17T23:56:06.621 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:06.620+0000 7f5ab77fe640 1 -- 172.21.15.196:0/725234776 <== mgr.4099 v2:172.21.15.204:6832/2505201055 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252081 (secure 0 0 0) 0x7f5ad00c8960 con 0x7f5abc067660 2024-03-17T23:56:06.623 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-03-17T23:56:06.625 INFO:teuthology.orchestra.run.smithi196.stderr:dumped all 2024-03-17T23:56:06.627 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:06.624+0000 7f5ad519f640 1 -- 172.21.15.196:0/725234776 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f5abc067660 msgr2=0x7f5abc069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:06.627 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:06.624+0000 7f5ad519f640 1 --2- 172.21.15.196:0/725234776 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f5abc067660 0x7f5abc069b20 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f5ac00ad000 tx=0x7f5ac0008040 comp rx=0 tx=0).stop 2024-03-17T23:56:06.627 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:06.624+0000 7f5ad519f640 1 -- 172.21.15.196:0/725234776 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5ad0152020 msgr2=0x7f5ad0150b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:06.627 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:06.624+0000 7f5ad519f640 1 --2- 172.21.15.196:0/725234776 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5ad0152020 0x7f5ad0150b30 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f5ac400b440 tx=0x7f5ac400b900 comp rx=0 tx=0).stop 2024-03-17T23:56:06.627 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:06.624+0000 7f5ad519f640 1 -- 172.21.15.196:0/725234776 shutdown_connections 2024-03-17T23:56:06.627 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:06.624+0000 7f5ad519f640 1 --2- 172.21.15.196:0/725234776 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f5abc067660 0x7f5abc069b20 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:06.627 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:06.624+0000 7f5ad519f640 1 --2- 172.21.15.196:0/725234776 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5ad0157b60 0x7f5ad01f4890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:06.628 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:06.624+0000 7f5ad519f640 1 --2- 172.21.15.196:0/725234776 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5ad0152020 0x7f5ad0150b30 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:06.628 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:06.624+0000 7f5ad519f640 1 --2- 172.21.15.196:0/725234776 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5ad0151c40 0x7f5ad00b31e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:06.628 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:06.624+0000 7f5ad519f640 1 -- 172.21.15.196:0/725234776 >> 172.21.15.196:0/725234776 conn(0x7f5ad0071020 msgr2=0x7f5ad01557b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-17T23:56:06.628 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:06.624+0000 7f5ad519f640 1 -- 172.21.15.196:0/725234776 shutdown_connections 2024-03-17T23:56:06.628 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:06.624+0000 7f5ad519f640 1 -- 172.21.15.196:0/725234776 wait complete. 2024-03-17T23:56:06.640 INFO:teuthology.orchestra.run.smithi196.stdout:{"pg_ready":true,"pg_map":{"version":20,"stamp":"2024-03-17T23:56:05.956361+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595590,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":283,"num_write_kb":2454,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":39,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":225,"ondisk_log_size":225,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218092,"kb_used_data":1940,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754756628,"statfs":{"total":773094113280,"available":772870787072,"internally_reserved":0,"allocated":1986560,"data_stored":1793298,"data_compressed":66348,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12748,"internal_metadata":221236788},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":49,"apply_latency_ms":49,"commit_latency_ns":49000000,"apply_latency_ns":49000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":5222,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":124,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":39,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.313399"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:02.164060+0000","last_change":"2024-03-17T23:56:01.208245+0000","last_active":"2024-03-17T23:56:02.164060+0000","last_peered":"2024-03-17T23:56:02.164060+0000","last_clean":"2024-03-17T23:56:02.164060+0000","last_became_active":"2024-03-17T23:56:01.207533+0000","last_became_peered":"2024-03-17T23:56:01.207533+0000","last_unstale":"2024-03-17T23:56:02.164060+0000","last_undegraded":"2024-03-17T23:56:02.164060+0000","last_fullsized":"2024-03-17T23:56:02.164060+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T09:33:28.935701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:02.756375+0000","last_change":"2024-03-17T23:56:01.193546+0000","last_active":"2024-03-17T23:56:02.756375+0000","last_peered":"2024-03-17T23:56:02.756375+0000","last_clean":"2024-03-17T23:56:02.756375+0000","last_became_active":"2024-03-17T23:56:01.192736+0000","last_became_peered":"2024-03-17T23:56:01.192736+0000","last_unstale":"2024-03-17T23:56:02.756375+0000","last_undegraded":"2024-03-17T23:56:02.756375+0000","last_fullsized":"2024-03-17T23:56:02.756375+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T07:03:18.208772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:02.858181+0000","last_change":"2024-03-17T23:56:01.188859+0000","last_active":"2024-03-17T23:56:02.858181+0000","last_peered":"2024-03-17T23:56:02.858181+0000","last_clean":"2024-03-17T23:56:02.858181+0000","last_became_active":"2024-03-17T23:56:01.188339+0000","last_became_peered":"2024-03-17T23:56:01.188339+0000","last_unstale":"2024-03-17T23:56:02.858181+0000","last_undegraded":"2024-03-17T23:56:02.858181+0000","last_fullsized":"2024-03-17T23:56:02.858181+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T05:26:03.654839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:02.169804+0000","last_change":"2024-03-17T23:56:01.204810+0000","last_active":"2024-03-17T23:56:02.169804+0000","last_peered":"2024-03-17T23:56:02.169804+0000","last_clean":"2024-03-17T23:56:02.169804+0000","last_became_active":"2024-03-17T23:56:01.196978+0000","last_became_peered":"2024-03-17T23:56:01.196978+0000","last_unstale":"2024-03-17T23:56:02.169804+0000","last_undegraded":"2024-03-17T23:56:02.169804+0000","last_fullsized":"2024-03-17T23:56:02.169804+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T06:25:58.489959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:02.162704+0000","last_change":"2024-03-17T23:56:01.195423+0000","last_active":"2024-03-17T23:56:02.162704+0000","last_peered":"2024-03-17T23:56:02.162704+0000","last_clean":"2024-03-17T23:56:02.162704+0000","last_became_active":"2024-03-17T23:56:01.194710+0000","last_became_peered":"2024-03-17T23:56:01.194710+0000","last_unstale":"2024-03-17T23:56:02.162704+0000","last_undegraded":"2024-03-17T23:56:02.162704+0000","last_fullsized":"2024-03-17T23:56:02.162704+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T06:25:58.489959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:02.169622+0000","last_change":"2024-03-17T23:56:01.204633+0000","last_active":"2024-03-17T23:56:02.169622+0000","last_peered":"2024-03-17T23:56:02.169622+0000","last_clean":"2024-03-17T23:56:02.169622+0000","last_became_active":"2024-03-17T23:56:01.192908+0000","last_became_peered":"2024-03-17T23:56:01.192908+0000","last_unstale":"2024-03-17T23:56:02.169622+0000","last_undegraded":"2024-03-17T23:56:02.169622+0000","last_fullsized":"2024-03-17T23:56:02.169622+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T03:49:46.522282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:02.163588+0000","last_change":"2024-03-17T23:56:01.208861+0000","last_active":"2024-03-17T23:56:02.163588+0000","last_peered":"2024-03-17T23:56:02.163588+0000","last_clean":"2024-03-17T23:56:02.163588+0000","last_became_active":"2024-03-17T23:56:01.199550+0000","last_became_peered":"2024-03-17T23:56:01.199550+0000","last_unstale":"2024-03-17T23:56:02.163588+0000","last_undegraded":"2024-03-17T23:56:02.163588+0000","last_fullsized":"2024-03-17T23:56:02.163588+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T00:21:36.556648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:02.855187+0000","last_change":"2024-03-17T23:56:01.212574+0000","last_active":"2024-03-17T23:56:02.855187+0000","last_peered":"2024-03-17T23:56:02.855187+0000","last_clean":"2024-03-17T23:56:02.855187+0000","last_became_active":"2024-03-17T23:56:01.211860+0000","last_became_peered":"2024-03-17T23:56:01.211860+0000","last_unstale":"2024-03-17T23:56:02.855187+0000","last_undegraded":"2024-03-17T23:56:02.855187+0000","last_fullsized":"2024-03-17T23:56:02.855187+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T02:15:18.353466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:02.164413+0000","last_change":"2024-03-17T23:56:01.214731+0000","last_active":"2024-03-17T23:56:02.164413+0000","last_peered":"2024-03-17T23:56:02.164413+0000","last_clean":"2024-03-17T23:56:02.164413+0000","last_became_active":"2024-03-17T23:56:01.213795+0000","last_became_peered":"2024-03-17T23:56:01.213795+0000","last_unstale":"2024-03-17T23:56:02.164413+0000","last_undegraded":"2024-03-17T23:56:02.164413+0000","last_fullsized":"2024-03-17T23:56:02.164413+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T11:32:23.716236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:02.856823+0000","last_change":"2024-03-17T23:56:01.212409+0000","last_active":"2024-03-17T23:56:02.856823+0000","last_peered":"2024-03-17T23:56:02.856823+0000","last_clean":"2024-03-17T23:56:02.856823+0000","last_became_active":"2024-03-17T23:56:01.211620+0000","last_became_peered":"2024-03-17T23:56:01.211620+0000","last_unstale":"2024-03-17T23:56:02.856823+0000","last_undegraded":"2024-03-17T23:56:02.856823+0000","last_fullsized":"2024-03-17T23:56:02.856823+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T11:40:55.653472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:02.856758+0000","last_change":"2024-03-17T23:56:01.212568+0000","last_active":"2024-03-17T23:56:02.856758+0000","last_peered":"2024-03-17T23:56:02.856758+0000","last_clean":"2024-03-17T23:56:02.856758+0000","last_became_active":"2024-03-17T23:56:01.211561+0000","last_became_peered":"2024-03-17T23:56:01.211561+0000","last_unstale":"2024-03-17T23:56:02.856758+0000","last_undegraded":"2024-03-17T23:56:02.856758+0000","last_fullsized":"2024-03-17T23:56:02.856758+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T02:46:13.650384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:02.165562+0000","last_change":"2024-03-17T23:56:01.186811+0000","last_active":"2024-03-17T23:56:02.165562+0000","last_peered":"2024-03-17T23:56:02.165562+0000","last_clean":"2024-03-17T23:56:02.165562+0000","last_became_active":"2024-03-17T23:56:01.186012+0000","last_became_peered":"2024-03-17T23:56:01.186012+0000","last_unstale":"2024-03-17T23:56:02.165562+0000","last_undegraded":"2024-03-17T23:56:02.165562+0000","last_fullsized":"2024-03-17T23:56:02.165562+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T10:35:20.142750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:02.855904+0000","last_change":"2024-03-17T23:56:01.213648+0000","last_active":"2024-03-17T23:56:02.855904+0000","last_peered":"2024-03-17T23:56:02.855904+0000","last_clean":"2024-03-17T23:56:02.855904+0000","last_became_active":"2024-03-17T23:56:01.205058+0000","last_became_peered":"2024-03-17T23:56:01.205058+0000","last_unstale":"2024-03-17T23:56:02.855904+0000","last_undegraded":"2024-03-17T23:56:02.855904+0000","last_fullsized":"2024-03-17T23:56:02.855904+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T03:49:46.522282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:02.857959+0000","last_change":"2024-03-17T23:56:01.196817+0000","last_active":"2024-03-17T23:56:02.857959+0000","last_peered":"2024-03-17T23:56:02.857959+0000","last_clean":"2024-03-17T23:56:02.857959+0000","last_became_active":"2024-03-17T23:56:01.195960+0000","last_became_peered":"2024-03-17T23:56:01.195960+0000","last_unstale":"2024-03-17T23:56:02.857959+0000","last_undegraded":"2024-03-17T23:56:02.857959+0000","last_fullsized":"2024-03-17T23:56:02.857959+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T10:13:51.662432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:02.756001+0000","last_change":"2024-03-17T23:56:01.182140+0000","last_active":"2024-03-17T23:56:02.756001+0000","last_peered":"2024-03-17T23:56:02.756001+0000","last_clean":"2024-03-17T23:56:02.756001+0000","last_became_active":"2024-03-17T23:56:01.181405+0000","last_became_peered":"2024-03-17T23:56:01.181405+0000","last_unstale":"2024-03-17T23:56:02.756001+0000","last_undegraded":"2024-03-17T23:56:02.756001+0000","last_fullsized":"2024-03-17T23:56:02.756001+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T02:46:13.650384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:02.169320+0000","last_change":"2024-03-17T23:56:01.194871+0000","last_active":"2024-03-17T23:56:02.169320+0000","last_peered":"2024-03-17T23:56:02.169320+0000","last_clean":"2024-03-17T23:56:02.169320+0000","last_became_active":"2024-03-17T23:56:01.193384+0000","last_became_peered":"2024-03-17T23:56:01.193384+0000","last_unstale":"2024-03-17T23:56:02.169320+0000","last_undegraded":"2024-03-17T23:56:02.169320+0000","last_fullsized":"2024-03-17T23:56:02.169320+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T11:40:55.653472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:02.170892+0000","last_change":"2024-03-17T23:56:01.209960+0000","last_active":"2024-03-17T23:56:02.170892+0000","last_peered":"2024-03-17T23:56:02.170892+0000","last_clean":"2024-03-17T23:56:02.170892+0000","last_became_active":"2024-03-17T23:56:01.209291+0000","last_became_peered":"2024-03-17T23:56:01.209291+0000","last_unstale":"2024-03-17T23:56:02.170892+0000","last_undegraded":"2024-03-17T23:56:02.170892+0000","last_fullsized":"2024-03-17T23:56:02.170892+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T03:01:01.120023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:02.355033+0000","last_change":"2024-03-17T23:56:01.186830+0000","last_active":"2024-03-17T23:56:02.355033+0000","last_peered":"2024-03-17T23:56:02.355033+0000","last_clean":"2024-03-17T23:56:02.355033+0000","last_became_active":"2024-03-17T23:56:01.186001+0000","last_became_peered":"2024-03-17T23:56:01.186001+0000","last_unstale":"2024-03-17T23:56:02.355033+0000","last_undegraded":"2024-03-17T23:56:02.355033+0000","last_fullsized":"2024-03-17T23:56:02.355033+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T01:56:02.340062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:02.163525+0000","last_change":"2024-03-17T23:56:01.195354+0000","last_active":"2024-03-17T23:56:02.163525+0000","last_peered":"2024-03-17T23:56:02.163525+0000","last_clean":"2024-03-17T23:56:02.163525+0000","last_became_active":"2024-03-17T23:56:01.194579+0000","last_became_peered":"2024-03-17T23:56:01.194579+0000","last_unstale":"2024-03-17T23:56:02.163525+0000","last_undegraded":"2024-03-17T23:56:02.163525+0000","last_fullsized":"2024-03-17T23:56:02.163525+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T07:53:44.598091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:02.855890+0000","last_change":"2024-03-17T23:56:01.193429+0000","last_active":"2024-03-17T23:56:02.855890+0000","last_peered":"2024-03-17T23:56:02.855890+0000","last_clean":"2024-03-17T23:56:02.855890+0000","last_became_active":"2024-03-17T23:56:01.192711+0000","last_became_peered":"2024-03-17T23:56:01.192711+0000","last_unstale":"2024-03-17T23:56:02.855890+0000","last_undegraded":"2024-03-17T23:56:02.855890+0000","last_fullsized":"2024-03-17T23:56:02.855890+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T08:24:06.922044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:02.858321+0000","last_change":"2024-03-17T23:56:01.203203+0000","last_active":"2024-03-17T23:56:02.858321+0000","last_peered":"2024-03-17T23:56:02.858321+0000","last_clean":"2024-03-17T23:56:02.858321+0000","last_became_active":"2024-03-17T23:56:01.202491+0000","last_became_peered":"2024-03-17T23:56:01.202491+0000","last_unstale":"2024-03-17T23:56:02.858321+0000","last_undegraded":"2024-03-17T23:56:02.858321+0000","last_fullsized":"2024-03-17T23:56:02.858321+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T11:35:21.037222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:02.169686+0000","last_change":"2024-03-17T23:56:01.215437+0000","last_active":"2024-03-17T23:56:02.169686+0000","last_peered":"2024-03-17T23:56:02.169686+0000","last_clean":"2024-03-17T23:56:02.169686+0000","last_became_active":"2024-03-17T23:56:01.214127+0000","last_became_peered":"2024-03-17T23:56:01.214127+0000","last_unstale":"2024-03-17T23:56:02.169686+0000","last_undegraded":"2024-03-17T23:56:02.169686+0000","last_fullsized":"2024-03-17T23:56:02.169686+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T04:45:41.506781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:02.855523+0000","last_change":"2024-03-17T23:56:01.213157+0000","last_active":"2024-03-17T23:56:02.855523+0000","last_peered":"2024-03-17T23:56:02.855523+0000","last_clean":"2024-03-17T23:56:02.855523+0000","last_became_active":"2024-03-17T23:56:01.205601+0000","last_became_peered":"2024-03-17T23:56:01.205601+0000","last_unstale":"2024-03-17T23:56:02.855523+0000","last_undegraded":"2024-03-17T23:56:02.855523+0000","last_fullsized":"2024-03-17T23:56:02.855523+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T00:26:55.287891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:02.169576+0000","last_change":"2024-03-17T23:56:01.194995+0000","last_active":"2024-03-17T23:56:02.169576+0000","last_peered":"2024-03-17T23:56:02.169576+0000","last_clean":"2024-03-17T23:56:02.169576+0000","last_became_active":"2024-03-17T23:56:01.194290+0000","last_became_peered":"2024-03-17T23:56:01.194290+0000","last_unstale":"2024-03-17T23:56:02.169576+0000","last_undegraded":"2024-03-17T23:56:02.169576+0000","last_fullsized":"2024-03-17T23:56:02.169576+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T07:03:18.208772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:02.856011+0000","last_change":"2024-03-17T23:56:01.205233+0000","last_active":"2024-03-17T23:56:02.856011+0000","last_peered":"2024-03-17T23:56:02.856011+0000","last_clean":"2024-03-17T23:56:02.856011+0000","last_became_active":"2024-03-17T23:56:01.204456+0000","last_became_peered":"2024-03-17T23:56:01.204456+0000","last_unstale":"2024-03-17T23:56:02.856011+0000","last_undegraded":"2024-03-17T23:56:02.856011+0000","last_fullsized":"2024-03-17T23:56:02.856011+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T06:25:58.489959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:02.856820+0000","last_change":"2024-03-17T23:56:01.210984+0000","last_active":"2024-03-17T23:56:02.856820+0000","last_peered":"2024-03-17T23:56:02.856820+0000","last_clean":"2024-03-17T23:56:02.856820+0000","last_became_active":"2024-03-17T23:56:01.210025+0000","last_became_peered":"2024-03-17T23:56:01.210025+0000","last_unstale":"2024-03-17T23:56:02.856820+0000","last_undegraded":"2024-03-17T23:56:02.856820+0000","last_fullsized":"2024-03-17T23:56:02.856820+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T00:26:55.287891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:02.756301+0000","last_change":"2024-03-17T23:56:01.205461+0000","last_active":"2024-03-17T23:56:02.756301+0000","last_peered":"2024-03-17T23:56:02.756301+0000","last_clean":"2024-03-17T23:56:02.756301+0000","last_became_active":"2024-03-17T23:56:01.204676+0000","last_became_peered":"2024-03-17T23:56:01.204676+0000","last_unstale":"2024-03-17T23:56:02.756301+0000","last_undegraded":"2024-03-17T23:56:02.756301+0000","last_fullsized":"2024-03-17T23:56:02.756301+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T11:40:55.653472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:02.855842+0000","last_change":"2024-03-17T23:56:01.205530+0000","last_active":"2024-03-17T23:56:02.855842+0000","last_peered":"2024-03-17T23:56:02.855842+0000","last_clean":"2024-03-17T23:56:02.855842+0000","last_became_active":"2024-03-17T23:56:01.204637+0000","last_became_peered":"2024-03-17T23:56:01.204637+0000","last_unstale":"2024-03-17T23:56:02.855842+0000","last_undegraded":"2024-03-17T23:56:02.855842+0000","last_fullsized":"2024-03-17T23:56:02.855842+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T07:03:18.208772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:02.858534+0000","last_change":"2024-03-17T23:56:01.207143+0000","last_active":"2024-03-17T23:56:02.858534+0000","last_peered":"2024-03-17T23:56:02.858534+0000","last_clean":"2024-03-17T23:56:02.858534+0000","last_became_active":"2024-03-17T23:56:01.206466+0000","last_became_peered":"2024-03-17T23:56:01.206466+0000","last_unstale":"2024-03-17T23:56:02.858534+0000","last_undegraded":"2024-03-17T23:56:02.858534+0000","last_fullsized":"2024-03-17T23:56:02.858534+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T02:46:13.650384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:02.170795+0000","last_change":"2024-03-17T23:56:01.205414+0000","last_active":"2024-03-17T23:56:02.170795+0000","last_peered":"2024-03-17T23:56:02.170795+0000","last_clean":"2024-03-17T23:56:02.170795+0000","last_became_active":"2024-03-17T23:56:01.204418+0000","last_became_peered":"2024-03-17T23:56:01.204418+0000","last_unstale":"2024-03-17T23:56:02.170795+0000","last_undegraded":"2024-03-17T23:56:02.170795+0000","last_fullsized":"2024-03-17T23:56:02.170795+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T03:59:56.032635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:02.354820+0000","last_change":"2024-03-17T23:56:01.213242+0000","last_active":"2024-03-17T23:56:02.354820+0000","last_peered":"2024-03-17T23:56:02.354820+0000","last_clean":"2024-03-17T23:56:02.354820+0000","last_became_active":"2024-03-17T23:56:01.212456+0000","last_became_peered":"2024-03-17T23:56:01.212456+0000","last_unstale":"2024-03-17T23:56:02.354820+0000","last_undegraded":"2024-03-17T23:56:02.354820+0000","last_fullsized":"2024-03-17T23:56:02.354820+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T11:11:33.525431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:02.855686+0000","last_change":"2024-03-17T23:56:01.197502+0000","last_active":"2024-03-17T23:56:02.855686+0000","last_peered":"2024-03-17T23:56:02.855686+0000","last_clean":"2024-03-17T23:56:02.855686+0000","last_became_active":"2024-03-17T23:56:01.196672+0000","last_became_peered":"2024-03-17T23:56:01.196672+0000","last_unstale":"2024-03-17T23:56:02.855686+0000","last_undegraded":"2024-03-17T23:56:02.855686+0000","last_fullsized":"2024-03-17T23:56:02.855686+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T05:26:03.654839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:02.165727+0000","last_change":"2024-03-17T23:56:01.169196+0000","last_active":"2024-03-17T23:56:02.165727+0000","last_peered":"2024-03-17T23:56:02.165727+0000","last_clean":"2024-03-17T23:56:02.165727+0000","last_became_active":"2024-03-17T23:56:01.168199+0000","last_became_peered":"2024-03-17T23:56:01.168199+0000","last_unstale":"2024-03-17T23:56:02.165727+0000","last_undegraded":"2024-03-17T23:56:02.165727+0000","last_fullsized":"2024-03-17T23:56:02.165727+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T11:11:33.525431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"21'5","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:03.681175+0000","last_change":"2024-03-17T23:56:00.675134+0000","last_active":"2024-03-17T23:56:03.681175+0000","last_peered":"2024-03-17T23:56:03.681175+0000","last_clean":"2024-03-17T23:56:03.681175+0000","last_became_active":"2024-03-17T23:56:00.674772+0000","last_became_peered":"2024-03-17T23:56:00.674772+0000","last_unstale":"2024-03-17T23:56:03.681175+0000","last_undegraded":"2024-03-17T23:56:03.681175+0000","last_fullsized":"2024-03-17T23:56:03.681175+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_clean_scrub_stamp":"2024-03-17T23:55:59.626739+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T07:03:16.148691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:02.858578+0000","last_change":"2024-03-17T23:56:01.199837+0000","last_active":"2024-03-17T23:56:02.858578+0000","last_peered":"2024-03-17T23:56:02.858578+0000","last_clean":"2024-03-17T23:56:02.858578+0000","last_became_active":"2024-03-17T23:56:01.199084+0000","last_became_peered":"2024-03-17T23:56:01.199084+0000","last_unstale":"2024-03-17T23:56:02.858578+0000","last_undegraded":"2024-03-17T23:56:02.858578+0000","last_fullsized":"2024-03-17T23:56:02.858578+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T00:26:55.287891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"21'3","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:04.690035+0000","last_change":"2024-03-17T23:56:00.683252+0000","last_active":"2024-03-17T23:56:04.690035+0000","last_peered":"2024-03-17T23:56:04.690035+0000","last_clean":"2024-03-17T23:56:04.690035+0000","last_became_active":"2024-03-17T23:56:00.682487+0000","last_became_peered":"2024-03-17T23:56:00.682487+0000","last_unstale":"2024-03-17T23:56:04.690035+0000","last_undegraded":"2024-03-17T23:56:04.690035+0000","last_fullsized":"2024-03-17T23:56:04.690035+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_clean_scrub_stamp":"2024-03-17T23:55:59.626739+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T04:07:26.256885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"21'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:04.689975+0000","last_change":"2024-03-17T23:56:00.688353+0000","last_active":"2024-03-17T23:56:04.689975+0000","last_peered":"2024-03-17T23:56:04.689975+0000","last_clean":"2024-03-17T23:56:04.689975+0000","last_became_active":"2024-03-17T23:56:00.688016+0000","last_became_peered":"2024-03-17T23:56:00.688016+0000","last_unstale":"2024-03-17T23:56:04.689975+0000","last_undegraded":"2024-03-17T23:56:04.689975+0000","last_fullsized":"2024-03-17T23:56:04.689975+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_clean_scrub_stamp":"2024-03-17T23:55:59.626739+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T09:07:52.005791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:02.855275+0000","last_change":"2024-03-17T23:56:01.211541+0000","last_active":"2024-03-17T23:56:02.855275+0000","last_peered":"2024-03-17T23:56:02.855275+0000","last_clean":"2024-03-17T23:56:02.855275+0000","last_became_active":"2024-03-17T23:56:01.205709+0000","last_became_peered":"2024-03-17T23:56:01.205709+0000","last_unstale":"2024-03-17T23:56:02.855275+0000","last_undegraded":"2024-03-17T23:56:02.855275+0000","last_fullsized":"2024-03-17T23:56:02.855275+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T11:35:21.037222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"21'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:02.169659+0000","last_change":"2024-03-17T23:56:00.690234+0000","last_active":"2024-03-17T23:56:02.169659+0000","last_peered":"2024-03-17T23:56:02.169659+0000","last_clean":"2024-03-17T23:56:02.169659+0000","last_became_active":"2024-03-17T23:56:00.689202+0000","last_became_peered":"2024-03-17T23:56:00.689202+0000","last_unstale":"2024-03-17T23:56:02.169659+0000","last_undegraded":"2024-03-17T23:56:02.169659+0000","last_fullsized":"2024-03-17T23:56:02.169659+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_clean_scrub_stamp":"2024-03-17T23:55:59.626739+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T05:52:39.451210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:02.755906+0000","last_change":"2024-03-17T23:56:01.194109+0000","last_active":"2024-03-17T23:56:02.755906+0000","last_peered":"2024-03-17T23:56:02.755906+0000","last_clean":"2024-03-17T23:56:02.755906+0000","last_became_active":"2024-03-17T23:56:01.192420+0000","last_became_peered":"2024-03-17T23:56:01.192420+0000","last_unstale":"2024-03-17T23:56:02.755906+0000","last_undegraded":"2024-03-17T23:56:02.755906+0000","last_fullsized":"2024-03-17T23:56:02.755906+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T08:24:06.922044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"21'3","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:03.685014+0000","last_change":"2024-03-17T23:56:00.696649+0000","last_active":"2024-03-17T23:56:03.685014+0000","last_peered":"2024-03-17T23:56:03.685014+0000","last_clean":"2024-03-17T23:56:03.685014+0000","last_became_active":"2024-03-17T23:56:00.696307+0000","last_became_peered":"2024-03-17T23:56:00.696307+0000","last_unstale":"2024-03-17T23:56:03.685014+0000","last_undegraded":"2024-03-17T23:56:03.685014+0000","last_fullsized":"2024-03-17T23:56:03.685014+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_clean_scrub_stamp":"2024-03-17T23:55:59.626739+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T07:28:27.310340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:02.170611+0000","last_change":"2024-03-17T23:56:01.194103+0000","last_active":"2024-03-17T23:56:02.170611+0000","last_peered":"2024-03-17T23:56:02.170611+0000","last_clean":"2024-03-17T23:56:02.170611+0000","last_became_active":"2024-03-17T23:56:01.193354+0000","last_became_peered":"2024-03-17T23:56:01.193354+0000","last_unstale":"2024-03-17T23:56:02.170611+0000","last_undegraded":"2024-03-17T23:56:02.170611+0000","last_fullsized":"2024-03-17T23:56:02.170611+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T00:21:36.556648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"21'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:03.683715+0000","last_change":"2024-03-17T23:56:00.689876+0000","last_active":"2024-03-17T23:56:03.683715+0000","last_peered":"2024-03-17T23:56:03.683715+0000","last_clean":"2024-03-17T23:56:03.683715+0000","last_became_active":"2024-03-17T23:56:00.688667+0000","last_became_peered":"2024-03-17T23:56:00.688667+0000","last_unstale":"2024-03-17T23:56:03.683715+0000","last_undegraded":"2024-03-17T23:56:03.683715+0000","last_fullsized":"2024-03-17T23:56:03.683715+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_clean_scrub_stamp":"2024-03-17T23:55:59.626739+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T09:45:24.650866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:02.858681+0000","last_change":"2024-03-17T23:56:01.215247+0000","last_active":"2024-03-17T23:56:02.858681+0000","last_peered":"2024-03-17T23:56:02.858681+0000","last_clean":"2024-03-17T23:56:02.858681+0000","last_became_active":"2024-03-17T23:56:01.214438+0000","last_became_peered":"2024-03-17T23:56:01.214438+0000","last_unstale":"2024-03-17T23:56:02.858681+0000","last_undegraded":"2024-03-17T23:56:02.858681+0000","last_fullsized":"2024-03-17T23:56:02.858681+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T11:40:55.653472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"21'4","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:02.756183+0000","last_change":"2024-03-17T23:56:00.677495+0000","last_active":"2024-03-17T23:56:02.756183+0000","last_peered":"2024-03-17T23:56:02.756183+0000","last_clean":"2024-03-17T23:56:02.756183+0000","last_became_active":"2024-03-17T23:56:00.677165+0000","last_became_peered":"2024-03-17T23:56:00.677165+0000","last_unstale":"2024-03-17T23:56:02.756183+0000","last_undegraded":"2024-03-17T23:56:02.756183+0000","last_fullsized":"2024-03-17T23:56:02.756183+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_clean_scrub_stamp":"2024-03-17T23:55:59.626739+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T04:07:26.256885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:02.165606+0000","last_change":"2024-03-17T23:56:01.190913+0000","last_active":"2024-03-17T23:56:02.165606+0000","last_peered":"2024-03-17T23:56:02.165606+0000","last_clean":"2024-03-17T23:56:02.165606+0000","last_became_active":"2024-03-17T23:56:01.190191+0000","last_became_peered":"2024-03-17T23:56:01.190191+0000","last_unstale":"2024-03-17T23:56:02.165606+0000","last_undegraded":"2024-03-17T23:56:02.165606+0000","last_fullsized":"2024-03-17T23:56:02.165606+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T09:57:50.285832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"21'8","reported_seq":22,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:03.681998+0000","last_change":"2024-03-17T23:56:00.686597+0000","last_active":"2024-03-17T23:56:03.681998+0000","last_peered":"2024-03-17T23:56:03.681998+0000","last_clean":"2024-03-17T23:56:03.681998+0000","last_became_active":"2024-03-17T23:56:00.685757+0000","last_became_peered":"2024-03-17T23:56:00.685757+0000","last_unstale":"2024-03-17T23:56:03.681998+0000","last_undegraded":"2024-03-17T23:56:03.681998+0000","last_fullsized":"2024-03-17T23:56:03.681998+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_clean_scrub_stamp":"2024-03-17T23:55:59.626739+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T10:35:19.139554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:02.162892+0000","last_change":"2024-03-17T23:56:01.216238+0000","last_active":"2024-03-17T23:56:02.162892+0000","last_peered":"2024-03-17T23:56:02.162892+0000","last_clean":"2024-03-17T23:56:02.162892+0000","last_became_active":"2024-03-17T23:56:01.215526+0000","last_became_peered":"2024-03-17T23:56:01.215526+0000","last_unstale":"2024-03-17T23:56:02.162892+0000","last_undegraded":"2024-03-17T23:56:02.162892+0000","last_fullsized":"2024-03-17T23:56:02.162892+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T03:18:40.457769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"21'6","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:04.688206+0000","last_change":"2024-03-17T23:56:00.682756+0000","last_active":"2024-03-17T23:56:04.688206+0000","last_peered":"2024-03-17T23:56:04.688206+0000","last_clean":"2024-03-17T23:56:04.688206+0000","last_became_active":"2024-03-17T23:56:00.682392+0000","last_became_peered":"2024-03-17T23:56:00.682392+0000","last_unstale":"2024-03-17T23:56:04.688206+0000","last_undegraded":"2024-03-17T23:56:04.688206+0000","last_fullsized":"2024-03-17T23:56:04.688206+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_clean_scrub_stamp":"2024-03-17T23:55:59.626739+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T04:54:08.515514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:02.858030+0000","last_change":"2024-03-17T23:56:01.218114+0000","last_active":"2024-03-17T23:56:02.858030+0000","last_peered":"2024-03-17T23:56:02.858030+0000","last_clean":"2024-03-17T23:56:02.858030+0000","last_became_active":"2024-03-17T23:56:01.217434+0000","last_became_peered":"2024-03-17T23:56:01.217434+0000","last_unstale":"2024-03-17T23:56:02.858030+0000","last_undegraded":"2024-03-17T23:56:02.858030+0000","last_fullsized":"2024-03-17T23:56:02.858030+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T06:56:40.687109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"21'3","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:03.679983+0000","last_change":"2024-03-17T23:56:00.696766+0000","last_active":"2024-03-17T23:56:03.679983+0000","last_peered":"2024-03-17T23:56:03.679983+0000","last_clean":"2024-03-17T23:56:03.679983+0000","last_became_active":"2024-03-17T23:56:00.695592+0000","last_became_peered":"2024-03-17T23:56:00.695592+0000","last_unstale":"2024-03-17T23:56:03.679983+0000","last_undegraded":"2024-03-17T23:56:03.679983+0000","last_fullsized":"2024-03-17T23:56:03.679983+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_clean_scrub_stamp":"2024-03-17T23:55:59.626739+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T04:07:26.256885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:02.162832+0000","last_change":"2024-03-17T23:56:01.208385+0000","last_active":"2024-03-17T23:56:02.162832+0000","last_peered":"2024-03-17T23:56:02.162832+0000","last_clean":"2024-03-17T23:56:02.162832+0000","last_became_active":"2024-03-17T23:56:01.207791+0000","last_became_peered":"2024-03-17T23:56:01.207791+0000","last_unstale":"2024-03-17T23:56:02.162832+0000","last_undegraded":"2024-03-17T23:56:02.162832+0000","last_fullsized":"2024-03-17T23:56:02.162832+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T11:08:21.695552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"21'3","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:04.692348+0000","last_change":"2024-03-17T23:56:00.686159+0000","last_active":"2024-03-17T23:56:04.692348+0000","last_peered":"2024-03-17T23:56:04.692348+0000","last_clean":"2024-03-17T23:56:04.692348+0000","last_became_active":"2024-03-17T23:56:00.685354+0000","last_became_peered":"2024-03-17T23:56:00.685354+0000","last_unstale":"2024-03-17T23:56:04.692348+0000","last_undegraded":"2024-03-17T23:56:04.692348+0000","last_fullsized":"2024-03-17T23:56:04.692348+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_clean_scrub_stamp":"2024-03-17T23:55:59.626739+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T09:45:24.650866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:02.855800+0000","last_change":"2024-03-17T23:56:01.197137+0000","last_active":"2024-03-17T23:56:02.855800+0000","last_peered":"2024-03-17T23:56:02.855800+0000","last_clean":"2024-03-17T23:56:02.855800+0000","last_became_active":"2024-03-17T23:56:01.196356+0000","last_became_peered":"2024-03-17T23:56:01.196356+0000","last_unstale":"2024-03-17T23:56:02.855800+0000","last_undegraded":"2024-03-17T23:56:02.855800+0000","last_fullsized":"2024-03-17T23:56:02.855800+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T11:35:21.037222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"21'15","reported_seq":29,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:04.693167+0000","last_change":"2024-03-17T23:56:00.682828+0000","last_active":"2024-03-17T23:56:04.693167+0000","last_peered":"2024-03-17T23:56:04.693167+0000","last_clean":"2024-03-17T23:56:04.693167+0000","last_became_active":"2024-03-17T23:56:00.682469+0000","last_became_peered":"2024-03-17T23:56:00.682469+0000","last_unstale":"2024-03-17T23:56:04.693167+0000","last_undegraded":"2024-03-17T23:56:04.693167+0000","last_fullsized":"2024-03-17T23:56:04.693167+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_clean_scrub_stamp":"2024-03-17T23:55:59.626739+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T05:52:39.451210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:02.163955+0000","last_change":"2024-03-17T23:56:01.209356+0000","last_active":"2024-03-17T23:56:02.163955+0000","last_peered":"2024-03-17T23:56:02.163955+0000","last_clean":"2024-03-17T23:56:02.163955+0000","last_became_active":"2024-03-17T23:56:01.208381+0000","last_became_peered":"2024-03-17T23:56:01.208381+0000","last_unstale":"2024-03-17T23:56:02.163955+0000","last_undegraded":"2024-03-17T23:56:02.163955+0000","last_fullsized":"2024-03-17T23:56:02.163955+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T03:01:01.120023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:02.165789+0000","last_change":"2024-03-17T23:56:00.683595+0000","last_active":"2024-03-17T23:56:02.165789+0000","last_peered":"2024-03-17T23:56:02.165789+0000","last_clean":"2024-03-17T23:56:02.165789+0000","last_became_active":"2024-03-17T23:56:00.681338+0000","last_became_peered":"2024-03-17T23:56:00.681338+0000","last_unstale":"2024-03-17T23:56:02.165789+0000","last_undegraded":"2024-03-17T23:56:02.165789+0000","last_fullsized":"2024-03-17T23:56:02.165789+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_clean_scrub_stamp":"2024-03-17T23:55:59.626739+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T08:58:55.725638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:02.163647+0000","last_change":"2024-03-17T23:56:01.212669+0000","last_active":"2024-03-17T23:56:02.163647+0000","last_peered":"2024-03-17T23:56:02.163647+0000","last_clean":"2024-03-17T23:56:02.163647+0000","last_became_active":"2024-03-17T23:56:01.206691+0000","last_became_peered":"2024-03-17T23:56:01.206691+0000","last_unstale":"2024-03-17T23:56:02.163647+0000","last_undegraded":"2024-03-17T23:56:02.163647+0000","last_fullsized":"2024-03-17T23:56:02.163647+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T03:59:56.032635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:02.354955+0000","last_change":"2024-03-17T23:56:00.690801+0000","last_active":"2024-03-17T23:56:02.354955+0000","last_peered":"2024-03-17T23:56:02.354955+0000","last_clean":"2024-03-17T23:56:02.354955+0000","last_became_active":"2024-03-17T23:56:00.690516+0000","last_became_peered":"2024-03-17T23:56:00.690516+0000","last_unstale":"2024-03-17T23:56:02.354955+0000","last_undegraded":"2024-03-17T23:56:02.354955+0000","last_fullsized":"2024-03-17T23:56:02.354955+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_clean_scrub_stamp":"2024-03-17T23:55:59.626739+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T09:07:52.005791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:02.164761+0000","last_change":"2024-03-17T23:56:01.213733+0000","last_active":"2024-03-17T23:56:02.164761+0000","last_peered":"2024-03-17T23:56:02.164761+0000","last_clean":"2024-03-17T23:56:02.164761+0000","last_became_active":"2024-03-17T23:56:01.213095+0000","last_became_peered":"2024-03-17T23:56:01.213095+0000","last_unstale":"2024-03-17T23:56:02.164761+0000","last_undegraded":"2024-03-17T23:56:02.164761+0000","last_fullsized":"2024-03-17T23:56:02.164761+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T08:57:40.944494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:02.756259+0000","last_change":"2024-03-17T23:56:00.672267+0000","last_active":"2024-03-17T23:56:02.756259+0000","last_peered":"2024-03-17T23:56:02.756259+0000","last_clean":"2024-03-17T23:56:02.756259+0000","last_became_active":"2024-03-17T23:56:00.671655+0000","last_became_peered":"2024-03-17T23:56:00.671655+0000","last_unstale":"2024-03-17T23:56:02.756259+0000","last_undegraded":"2024-03-17T23:56:02.756259+0000","last_fullsized":"2024-03-17T23:56:02.756259+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_clean_scrub_stamp":"2024-03-17T23:55:59.626739+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T09:45:24.650866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:02.170496+0000","last_change":"2024-03-17T23:56:01.204789+0000","last_active":"2024-03-17T23:56:02.170496+0000","last_peered":"2024-03-17T23:56:02.170496+0000","last_clean":"2024-03-17T23:56:02.170496+0000","last_became_active":"2024-03-17T23:56:01.196002+0000","last_became_peered":"2024-03-17T23:56:01.196002+0000","last_unstale":"2024-03-17T23:56:02.170496+0000","last_undegraded":"2024-03-17T23:56:02.170496+0000","last_fullsized":"2024-03-17T23:56:02.170496+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T07:53:44.598091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"21'3","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:04.690994+0000","last_change":"2024-03-17T23:56:00.679054+0000","last_active":"2024-03-17T23:56:04.690994+0000","last_peered":"2024-03-17T23:56:04.690994+0000","last_clean":"2024-03-17T23:56:04.690994+0000","last_became_active":"2024-03-17T23:56:00.677831+0000","last_became_peered":"2024-03-17T23:56:00.677831+0000","last_unstale":"2024-03-17T23:56:04.690994+0000","last_undegraded":"2024-03-17T23:56:04.690994+0000","last_fullsized":"2024-03-17T23:56:04.690994+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_clean_scrub_stamp":"2024-03-17T23:55:59.626739+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T04:07:26.256885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:02.163086+0000","last_change":"2024-03-17T23:56:01.214619+0000","last_active":"2024-03-17T23:56:02.163086+0000","last_peered":"2024-03-17T23:56:02.163086+0000","last_clean":"2024-03-17T23:56:02.163086+0000","last_became_active":"2024-03-17T23:56:01.213960+0000","last_became_peered":"2024-03-17T23:56:01.213960+0000","last_unstale":"2024-03-17T23:56:02.163086+0000","last_undegraded":"2024-03-17T23:56:02.163086+0000","last_fullsized":"2024-03-17T23:56:02.163086+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T11:01:47.143880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":170,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:02.161950+0000","last_change":"2024-03-17T23:55:58.106405+0000","last_active":"2024-03-17T23:56:02.161950+0000","last_peered":"2024-03-17T23:56:02.161950+0000","last_clean":"2024-03-17T23:56:02.161950+0000","last_became_active":"2024-03-17T23:55:58.104493+0000","last_became_peered":"2024-03-17T23:55:58.104493+0000","last_unstale":"2024-03-17T23:56:02.161950+0000","last_undegraded":"2024-03-17T23:56:02.161950+0000","last_fullsized":"2024-03-17T23:56:02.161950+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:55:56.609001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:55:56.609001+0000","last_clean_scrub_stamp":"2024-03-17T23:55:56.609001+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T08:58:52.707900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"21'3","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:03.680702+0000","last_change":"2024-03-17T23:56:00.678791+0000","last_active":"2024-03-17T23:56:03.680702+0000","last_peered":"2024-03-17T23:56:03.680702+0000","last_clean":"2024-03-17T23:56:03.680702+0000","last_became_active":"2024-03-17T23:56:00.677660+0000","last_became_peered":"2024-03-17T23:56:00.677660+0000","last_unstale":"2024-03-17T23:56:03.680702+0000","last_undegraded":"2024-03-17T23:56:03.680702+0000","last_fullsized":"2024-03-17T23:56:03.680702+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_clean_scrub_stamp":"2024-03-17T23:55:59.626739+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T07:28:27.310340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:02.855352+0000","last_change":"2024-03-17T23:56:01.213073+0000","last_active":"2024-03-17T23:56:02.855352+0000","last_peered":"2024-03-17T23:56:02.855352+0000","last_clean":"2024-03-17T23:56:02.855352+0000","last_became_active":"2024-03-17T23:56:01.212434+0000","last_became_peered":"2024-03-17T23:56:01.212434+0000","last_unstale":"2024-03-17T23:56:02.855352+0000","last_undegraded":"2024-03-17T23:56:02.855352+0000","last_fullsized":"2024-03-17T23:56:02.855352+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T08:24:06.922044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"21'3","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:04.687323+0000","last_change":"2024-03-17T23:56:00.700634+0000","last_active":"2024-03-17T23:56:04.687323+0000","last_peered":"2024-03-17T23:56:04.687323+0000","last_clean":"2024-03-17T23:56:04.687323+0000","last_became_active":"2024-03-17T23:56:00.691617+0000","last_became_peered":"2024-03-17T23:56:00.691617+0000","last_unstale":"2024-03-17T23:56:04.687323+0000","last_undegraded":"2024-03-17T23:56:04.687323+0000","last_fullsized":"2024-03-17T23:56:04.687323+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_clean_scrub_stamp":"2024-03-17T23:55:59.626739+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T11:11:32.522234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:02.857916+0000","last_change":"2024-03-17T23:56:01.199855+0000","last_active":"2024-03-17T23:56:02.857916+0000","last_peered":"2024-03-17T23:56:02.857916+0000","last_clean":"2024-03-17T23:56:02.857916+0000","last_became_active":"2024-03-17T23:56:01.199121+0000","last_became_peered":"2024-03-17T23:56:01.199121+0000","last_unstale":"2024-03-17T23:56:02.857916+0000","last_undegraded":"2024-03-17T23:56:02.857916+0000","last_fullsized":"2024-03-17T23:56:02.857916+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T09:59:28.908069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"21'4","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:04.687727+0000","last_change":"2024-03-17T23:56:00.686560+0000","last_active":"2024-03-17T23:56:04.687727+0000","last_peered":"2024-03-17T23:56:04.687727+0000","last_clean":"2024-03-17T23:56:04.687727+0000","last_became_active":"2024-03-17T23:56:00.686215+0000","last_became_peered":"2024-03-17T23:56:00.686215+0000","last_unstale":"2024-03-17T23:56:04.687727+0000","last_undegraded":"2024-03-17T23:56:04.687727+0000","last_fullsized":"2024-03-17T23:56:04.687727+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_clean_scrub_stamp":"2024-03-17T23:55:59.626739+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T07:28:27.310340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:02.755813+0000","last_change":"2024-03-17T23:56:01.193197+0000","last_active":"2024-03-17T23:56:02.755813+0000","last_peered":"2024-03-17T23:56:02.755813+0000","last_clean":"2024-03-17T23:56:02.755813+0000","last_became_active":"2024-03-17T23:56:01.192117+0000","last_became_peered":"2024-03-17T23:56:01.192117+0000","last_unstale":"2024-03-17T23:56:02.755813+0000","last_undegraded":"2024-03-17T23:56:02.755813+0000","last_fullsized":"2024-03-17T23:56:02.755813+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T11:35:21.037222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"21'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:02.170320+0000","last_change":"2024-03-17T23:56:00.696254+0000","last_active":"2024-03-17T23:56:02.170320+0000","last_peered":"2024-03-17T23:56:02.170320+0000","last_clean":"2024-03-17T23:56:02.170320+0000","last_became_active":"2024-03-17T23:56:00.694605+0000","last_became_peered":"2024-03-17T23:56:00.694605+0000","last_unstale":"2024-03-17T23:56:02.170320+0000","last_undegraded":"2024-03-17T23:56:02.170320+0000","last_fullsized":"2024-03-17T23:56:02.170320+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_clean_scrub_stamp":"2024-03-17T23:55:59.626739+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T10:35:19.139554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:02.165616+0000","last_change":"2024-03-17T23:56:01.188278+0000","last_active":"2024-03-17T23:56:02.165616+0000","last_peered":"2024-03-17T23:56:02.165616+0000","last_clean":"2024-03-17T23:56:02.165616+0000","last_became_active":"2024-03-17T23:56:01.187571+0000","last_became_peered":"2024-03-17T23:56:01.187571+0000","last_unstale":"2024-03-17T23:56:02.165616+0000","last_undegraded":"2024-03-17T23:56:02.165616+0000","last_fullsized":"2024-03-17T23:56:02.165616+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T09:45:25.654063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:02.756107+0000","last_change":"2024-03-17T23:56:00.680290+0000","last_active":"2024-03-17T23:56:02.756107+0000","last_peered":"2024-03-17T23:56:02.756107+0000","last_clean":"2024-03-17T23:56:02.756107+0000","last_became_active":"2024-03-17T23:56:00.679981+0000","last_became_peered":"2024-03-17T23:56:00.679981+0000","last_unstale":"2024-03-17T23:56:02.756107+0000","last_undegraded":"2024-03-17T23:56:02.756107+0000","last_fullsized":"2024-03-17T23:56:02.756107+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_clean_scrub_stamp":"2024-03-17T23:55:59.626739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T10:35:19.139554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:02.170359+0000","last_change":"2024-03-17T23:56:01.216640+0000","last_active":"2024-03-17T23:56:02.170359+0000","last_peered":"2024-03-17T23:56:02.170359+0000","last_clean":"2024-03-17T23:56:02.170359+0000","last_became_active":"2024-03-17T23:56:01.216145+0000","last_became_peered":"2024-03-17T23:56:01.216145+0000","last_unstale":"2024-03-17T23:56:02.170359+0000","last_undegraded":"2024-03-17T23:56:02.170359+0000","last_fullsized":"2024-03-17T23:56:02.170359+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T11:01:47.143880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"21'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:02.163408+0000","last_change":"2024-03-17T23:56:00.692896+0000","last_active":"2024-03-17T23:56:02.163408+0000","last_peered":"2024-03-17T23:56:02.163408+0000","last_clean":"2024-03-17T23:56:02.163408+0000","last_became_active":"2024-03-17T23:56:00.692054+0000","last_became_peered":"2024-03-17T23:56:00.692054+0000","last_unstale":"2024-03-17T23:56:02.163408+0000","last_undegraded":"2024-03-17T23:56:02.163408+0000","last_fullsized":"2024-03-17T23:56:02.163408+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_clean_scrub_stamp":"2024-03-17T23:55:59.626739+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T10:55:17.061099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:02.756195+0000","last_change":"2024-03-17T23:56:01.189102+0000","last_active":"2024-03-17T23:56:02.756195+0000","last_peered":"2024-03-17T23:56:02.756195+0000","last_clean":"2024-03-17T23:56:02.756195+0000","last_became_active":"2024-03-17T23:56:01.188353+0000","last_became_peered":"2024-03-17T23:56:01.188353+0000","last_unstale":"2024-03-17T23:56:02.756195+0000","last_undegraded":"2024-03-17T23:56:02.756195+0000","last_fullsized":"2024-03-17T23:56:02.756195+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T00:26:55.287891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"21'3","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:04.686323+0000","last_change":"2024-03-17T23:56:00.689216+0000","last_active":"2024-03-17T23:56:04.686323+0000","last_peered":"2024-03-17T23:56:04.686323+0000","last_clean":"2024-03-17T23:56:04.686323+0000","last_became_active":"2024-03-17T23:56:00.688978+0000","last_became_peered":"2024-03-17T23:56:00.688978+0000","last_unstale":"2024-03-17T23:56:04.686323+0000","last_undegraded":"2024-03-17T23:56:04.686323+0000","last_fullsized":"2024-03-17T23:56:04.686323+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_clean_scrub_stamp":"2024-03-17T23:55:59.626739+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T09:57:49.282635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:02.856072+0000","last_change":"2024-03-17T23:56:01.212041+0000","last_active":"2024-03-17T23:56:02.856072+0000","last_peered":"2024-03-17T23:56:02.856072+0000","last_clean":"2024-03-17T23:56:02.856072+0000","last_became_active":"2024-03-17T23:56:01.211359+0000","last_became_peered":"2024-03-17T23:56:01.211359+0000","last_unstale":"2024-03-17T23:56:02.856072+0000","last_undegraded":"2024-03-17T23:56:02.856072+0000","last_fullsized":"2024-03-17T23:56:02.856072+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T11:08:21.695552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"21'4","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:03.684293+0000","last_change":"2024-03-17T23:56:00.686768+0000","last_active":"2024-03-17T23:56:03.684293+0000","last_peered":"2024-03-17T23:56:03.684293+0000","last_clean":"2024-03-17T23:56:03.684293+0000","last_became_active":"2024-03-17T23:56:00.685461+0000","last_became_peered":"2024-03-17T23:56:00.685461+0000","last_unstale":"2024-03-17T23:56:03.684293+0000","last_undegraded":"2024-03-17T23:56:03.684293+0000","last_fullsized":"2024-03-17T23:56:03.684293+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_clean_scrub_stamp":"2024-03-17T23:55:59.626739+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T05:52:39.451210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:02.858191+0000","last_change":"2024-03-17T23:56:01.196364+0000","last_active":"2024-03-17T23:56:02.858191+0000","last_peered":"2024-03-17T23:56:02.858191+0000","last_clean":"2024-03-17T23:56:02.858191+0000","last_became_active":"2024-03-17T23:56:01.191450+0000","last_became_peered":"2024-03-17T23:56:01.191450+0000","last_unstale":"2024-03-17T23:56:02.858191+0000","last_undegraded":"2024-03-17T23:56:02.858191+0000","last_fullsized":"2024-03-17T23:56:02.858191+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T02:15:18.353466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"21'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:03.681131+0000","last_change":"2024-03-17T23:56:00.691812+0000","last_active":"2024-03-17T23:56:03.681131+0000","last_peered":"2024-03-17T23:56:03.681131+0000","last_clean":"2024-03-17T23:56:03.681131+0000","last_became_active":"2024-03-17T23:56:00.691381+0000","last_became_peered":"2024-03-17T23:56:00.691381+0000","last_unstale":"2024-03-17T23:56:03.681131+0000","last_undegraded":"2024-03-17T23:56:03.681131+0000","last_fullsized":"2024-03-17T23:56:03.681131+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_clean_scrub_stamp":"2024-03-17T23:55:59.626739+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T10:35:19.139554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:02.165033+0000","last_change":"2024-03-17T23:56:01.195278+0000","last_active":"2024-03-17T23:56:02.165033+0000","last_peered":"2024-03-17T23:56:02.165033+0000","last_clean":"2024-03-17T23:56:02.165033+0000","last_became_active":"2024-03-17T23:56:01.192316+0000","last_became_peered":"2024-03-17T23:56:01.192316+0000","last_unstale":"2024-03-17T23:56:02.165033+0000","last_undegraded":"2024-03-17T23:56:02.165033+0000","last_fullsized":"2024-03-17T23:56:02.165033+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T04:07:27.260081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"21'3","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:03.680520+0000","last_change":"2024-03-17T23:56:00.703680+0000","last_active":"2024-03-17T23:56:03.680520+0000","last_peered":"2024-03-17T23:56:03.680520+0000","last_clean":"2024-03-17T23:56:03.680520+0000","last_became_active":"2024-03-17T23:56:00.703439+0000","last_became_peered":"2024-03-17T23:56:00.703439+0000","last_unstale":"2024-03-17T23:56:03.680520+0000","last_undegraded":"2024-03-17T23:56:03.680520+0000","last_fullsized":"2024-03-17T23:56:03.680520+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_clean_scrub_stamp":"2024-03-17T23:55:59.626739+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T11:11:32.522234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:02.855387+0000","last_change":"2024-03-17T23:56:01.191678+0000","last_active":"2024-03-17T23:56:02.855387+0000","last_peered":"2024-03-17T23:56:02.855387+0000","last_clean":"2024-03-17T23:56:02.855387+0000","last_became_active":"2024-03-17T23:56:01.190681+0000","last_became_peered":"2024-03-17T23:56:01.190681+0000","last_unstale":"2024-03-17T23:56:02.855387+0000","last_undegraded":"2024-03-17T23:56:02.855387+0000","last_fullsized":"2024-03-17T23:56:02.855387+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T02:46:13.650384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"21'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:02.756012+0000","last_change":"2024-03-17T23:56:00.679281+0000","last_active":"2024-03-17T23:56:02.756012+0000","last_peered":"2024-03-17T23:56:02.756012+0000","last_clean":"2024-03-17T23:56:02.756012+0000","last_became_active":"2024-03-17T23:56:00.678950+0000","last_became_peered":"2024-03-17T23:56:00.678950+0000","last_unstale":"2024-03-17T23:56:02.756012+0000","last_undegraded":"2024-03-17T23:56:02.756012+0000","last_fullsized":"2024-03-17T23:56:02.756012+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_clean_scrub_stamp":"2024-03-17T23:55:59.626739+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T05:52:39.451210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:02.855656+0000","last_change":"2024-03-17T23:56:01.215539+0000","last_active":"2024-03-17T23:56:02.855656+0000","last_peered":"2024-03-17T23:56:02.855656+0000","last_clean":"2024-03-17T23:56:02.855656+0000","last_became_active":"2024-03-17T23:56:01.211163+0000","last_became_peered":"2024-03-17T23:56:01.211163+0000","last_unstale":"2024-03-17T23:56:02.855656+0000","last_undegraded":"2024-03-17T23:56:02.855656+0000","last_fullsized":"2024-03-17T23:56:02.855656+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T11:40:55.653472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"21'4","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:03.679557+0000","last_change":"2024-03-17T23:56:00.692384+0000","last_active":"2024-03-17T23:56:03.679557+0000","last_peered":"2024-03-17T23:56:03.679557+0000","last_clean":"2024-03-17T23:56:03.679557+0000","last_became_active":"2024-03-17T23:56:00.684178+0000","last_became_peered":"2024-03-17T23:56:00.684178+0000","last_unstale":"2024-03-17T23:56:03.679557+0000","last_undegraded":"2024-03-17T23:56:03.679557+0000","last_fullsized":"2024-03-17T23:56:03.679557+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_clean_scrub_stamp":"2024-03-17T23:55:59.626739+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T09:45:24.650866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:02.855803+0000","last_change":"2024-03-17T23:56:01.193547+0000","last_active":"2024-03-17T23:56:02.855803+0000","last_peered":"2024-03-17T23:56:02.855803+0000","last_clean":"2024-03-17T23:56:02.855803+0000","last_became_active":"2024-03-17T23:56:01.192775+0000","last_became_peered":"2024-03-17T23:56:01.192775+0000","last_unstale":"2024-03-17T23:56:02.855803+0000","last_undegraded":"2024-03-17T23:56:02.855803+0000","last_fullsized":"2024-03-17T23:56:02.855803+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T02:15:18.353466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:02.170196+0000","last_change":"2024-03-17T23:56:01.178436+0000","last_active":"2024-03-17T23:56:02.170196+0000","last_peered":"2024-03-17T23:56:02.170196+0000","last_clean":"2024-03-17T23:56:02.170196+0000","last_became_active":"2024-03-17T23:56:01.177533+0000","last_became_peered":"2024-03-17T23:56:01.177533+0000","last_unstale":"2024-03-17T23:56:02.170196+0000","last_undegraded":"2024-03-17T23:56:02.170196+0000","last_fullsized":"2024-03-17T23:56:02.170196+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T03:18:40.457769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:02.162605+0000","last_change":"2024-03-17T23:56:00.691483+0000","last_active":"2024-03-17T23:56:02.162605+0000","last_peered":"2024-03-17T23:56:02.162605+0000","last_clean":"2024-03-17T23:56:02.162605+0000","last_became_active":"2024-03-17T23:56:00.684714+0000","last_became_peered":"2024-03-17T23:56:00.684714+0000","last_unstale":"2024-03-17T23:56:02.162605+0000","last_undegraded":"2024-03-17T23:56:02.162605+0000","last_fullsized":"2024-03-17T23:56:02.162605+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_clean_scrub_stamp":"2024-03-17T23:55:59.626739+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T09:57:49.282635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:02.169948+0000","last_change":"2024-03-17T23:56:01.194350+0000","last_active":"2024-03-17T23:56:02.169948+0000","last_peered":"2024-03-17T23:56:02.169948+0000","last_clean":"2024-03-17T23:56:02.169948+0000","last_became_active":"2024-03-17T23:56:01.193625+0000","last_became_peered":"2024-03-17T23:56:01.193625+0000","last_unstale":"2024-03-17T23:56:02.169948+0000","last_undegraded":"2024-03-17T23:56:02.169948+0000","last_fullsized":"2024-03-17T23:56:02.169948+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T11:08:21.695552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"21'4","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:04.688429+0000","last_change":"2024-03-17T23:56:00.699785+0000","last_active":"2024-03-17T23:56:04.688429+0000","last_peered":"2024-03-17T23:56:04.688429+0000","last_clean":"2024-03-17T23:56:04.688429+0000","last_became_active":"2024-03-17T23:56:00.699049+0000","last_became_peered":"2024-03-17T23:56:00.699049+0000","last_unstale":"2024-03-17T23:56:04.688429+0000","last_undegraded":"2024-03-17T23:56:04.688429+0000","last_fullsized":"2024-03-17T23:56:04.688429+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_clean_scrub_stamp":"2024-03-17T23:55:59.626739+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T01:56:01.336865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:02.858502+0000","last_change":"2024-03-17T23:56:01.208117+0000","last_active":"2024-03-17T23:56:02.858502+0000","last_peered":"2024-03-17T23:56:02.858502+0000","last_clean":"2024-03-17T23:56:02.858502+0000","last_became_active":"2024-03-17T23:56:01.207342+0000","last_became_peered":"2024-03-17T23:56:01.207342+0000","last_unstale":"2024-03-17T23:56:02.858502+0000","last_undegraded":"2024-03-17T23:56:02.858502+0000","last_fullsized":"2024-03-17T23:56:02.858502+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T08:24:06.922044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"21'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:02.855982+0000","last_change":"2024-03-17T23:56:00.691595+0000","last_active":"2024-03-17T23:56:02.855982+0000","last_peered":"2024-03-17T23:56:02.855982+0000","last_clean":"2024-03-17T23:56:02.855982+0000","last_became_active":"2024-03-17T23:56:00.690892+0000","last_became_peered":"2024-03-17T23:56:00.690892+0000","last_unstale":"2024-03-17T23:56:02.855982+0000","last_undegraded":"2024-03-17T23:56:02.855982+0000","last_fullsized":"2024-03-17T23:56:02.855982+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_clean_scrub_stamp":"2024-03-17T23:55:59.626739+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T07:28:27.310340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:02.855919+0000","last_change":"2024-03-17T23:56:01.212430+0000","last_active":"2024-03-17T23:56:02.855919+0000","last_peered":"2024-03-17T23:56:02.855919+0000","last_clean":"2024-03-17T23:56:02.855919+0000","last_became_active":"2024-03-17T23:56:01.204930+0000","last_became_peered":"2024-03-17T23:56:01.204930+0000","last_unstale":"2024-03-17T23:56:02.855919+0000","last_undegraded":"2024-03-17T23:56:02.855919+0000","last_fullsized":"2024-03-17T23:56:02.855919+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T04:45:41.506781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"21'9","reported_seq":23,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:04.690385+0000","last_change":"2024-03-17T23:56:00.682405+0000","last_active":"2024-03-17T23:56:04.690385+0000","last_peered":"2024-03-17T23:56:04.690385+0000","last_clean":"2024-03-17T23:56:04.690385+0000","last_became_active":"2024-03-17T23:56:00.681938+0000","last_became_peered":"2024-03-17T23:56:00.681938+0000","last_unstale":"2024-03-17T23:56:04.690385+0000","last_undegraded":"2024-03-17T23:56:04.690385+0000","last_fullsized":"2024-03-17T23:56:04.690385+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_clean_scrub_stamp":"2024-03-17T23:55:59.626739+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T07:03:16.148691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":5222,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":124,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":39,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":163840,"data_stored":10444,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":108,"ondisk_log_size":108,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66348,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574852,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":303104,"data_stored":667289,"data_compressed":33174,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574852,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":233472,"data_stored":77307,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574851,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":229376,"data_stored":76367,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":229376,"data_stored":75731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":241664,"data_stored":77929,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574853,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":75605,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574852,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":233472,"data_stored":76437,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574851,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":299008,"data_stored":666633,"data_compressed":33174,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33174,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33174,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2324,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":714,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1378,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2290,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-17T23:56:06.644 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-17T23:56:06.785 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:06.784+0000 7f75c71bf640 1 Processor -- start 2024-03-17T23:56:06.785 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:06.784+0000 7f75c71bf640 1 -- start start 2024-03-17T23:56:06.787 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:06.784+0000 7f75c71bf640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f75c0154240 0x7f75c006fca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:06.787 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:06.784+0000 7f75c71bf640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f75c0072430 0x7f75c00728c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:06.787 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:06.784+0000 7f75c71bf640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f75c0154620 con 0x7f75c015a260 2024-03-17T23:56:06.787 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:06.784+0000 7f75c71bf640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7f75c00701e0 con 0x7f75c0154240 2024-03-17T23:56:06.787 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:06.784+0000 7f75c71bf640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f75c00c7830 con 0x7f75c0072430 2024-03-17T23:56:06.787 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:06.784+0000 7f75bffff640 1 --1- >> v1:172.21.15.196:6789/0 conn(0x7f75c015a260 0x7f75c015a680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.196:6789/0 says I am v1:172.21.15.196:50358/0 (socket says 172.21.15.196:50358) 2024-03-17T23:56:06.787 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:06.784+0000 7f75bffff640 1 -- 172.21.15.196:0/1684756825 learned_addr learned my addr 172.21.15.196:0/1684756825 (peer_addr_for_me v1:172.21.15.196:0/0) 2024-03-17T23:56:06.787 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:06.784+0000 7f75c4f5b640 1 --2- 172.21.15.196:0/1684756825 >> v2:172.21.15.196:3300/0 conn(0x7f75c0154240 0x7f75c006fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:06.788 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:06.784+0000 7f75c575c640 1 --2- 172.21.15.196:0/1684756825 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f75c0072430 0x7f75c00728c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:06.788 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:06.784+0000 7f75bf7fe640 1 -- 172.21.15.196:0/1684756825 <== mon.0 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2851808785 0 0) 0x7f75ac001120 con 0x7f75c015a260 2024-03-17T23:56:06.788 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:06.784+0000 7f75bf7fe640 1 -- 172.21.15.196:0/1684756825 --> v1:172.21.15.196:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f75b0003530 con 0x7f75c015a260 2024-03-17T23:56:06.788 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:06.784+0000 7f75c4f5b640 1 -- 172.21.15.196:0/1684756825 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f75c0072430 msgr2=0x7f75c00728c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-17T23:56:06.788 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:06.784+0000 7f75c4f5b640 1 --2- 172.21.15.196:0/1684756825 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f75c0072430 0x7f75c00728c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:06.788 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:06.784+0000 7f75c4f5b640 1 -- 172.21.15.196:0/1684756825 >> v1:172.21.15.196:6789/0 conn(0x7f75c015a260 legacy=0x7f75c015a680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:06.788 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:06.784+0000 7f75c4f5b640 1 -- 172.21.15.196:0/1684756825 --> v2:172.21.15.196:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75c00c7b10 con 0x7f75c0154240 2024-03-17T23:56:06.790 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:06.788+0000 7f75c4f5b640 1 --2- 172.21.15.196:0/1684756825 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f75c0154240 0x7f75c006fca0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f75b40097c0 tx=0x7f75b401ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2ec55cf883db762 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:56:06.790 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:06.788+0000 7f75bf7fe640 1 -- 172.21.15.196:0/1684756825 <== mon.0 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75b40b5070 con 0x7f75c0154240 2024-03-17T23:56:06.790 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:06.788+0000 7f75bf7fe640 1 -- 172.21.15.196:0/1684756825 <== mon.0 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f75b40a8910 con 0x7f75c0154240 2024-03-17T23:56:06.790 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:06.788+0000 7f75bf7fe640 1 -- 172.21.15.196:0/1684756825 <== mon.0 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75b40a8ce0 con 0x7f75c0154240 2024-03-17T23:56:06.791 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:06.788+0000 7f75c71bf640 1 -- 172.21.15.196:0/1684756825 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f75c0154240 msgr2=0x7f75c006fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:06.791 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:06.788+0000 7f75c71bf640 1 --2- 172.21.15.196:0/1684756825 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f75c0154240 0x7f75c006fca0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f75b40097c0 tx=0x7f75b401ec50 comp rx=0 tx=0).stop 2024-03-17T23:56:06.791 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:06.788+0000 7f75c71bf640 1 -- 172.21.15.196:0/1684756825 shutdown_connections 2024-03-17T23:56:06.791 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:06.788+0000 7f75c71bf640 1 --2- 172.21.15.196:0/1684756825 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f75c0072430 0x7f75c00728c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:06.791 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:06.788+0000 7f75c71bf640 1 --2- 172.21.15.196:0/1684756825 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f75c0154240 0x7f75c006fca0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:06.791 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:06.788+0000 7f75c71bf640 1 -- 172.21.15.196:0/1684756825 >> 172.21.15.196:0/1684756825 conn(0x7f75c00cc420 msgr2=0x7f75c00cc830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-17T23:56:06.791 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:06.788+0000 7f75c71bf640 1 -- 172.21.15.196:0/1684756825 shutdown_connections 2024-03-17T23:56:06.791 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:06.788+0000 7f75c71bf640 1 -- 172.21.15.196:0/1684756825 wait complete. 2024-03-17T23:56:06.792 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:06.792+0000 7f75c71bf640 1 Processor -- start 2024-03-17T23:56:06.792 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:06.792+0000 7f75c71bf640 1 -- start start 2024-03-17T23:56:06.795 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:06.792+0000 7f75c71bf640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f75c0072430 0x7f75c015df60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:06.795 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:06.792+0000 7f75c71bf640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f75c0154240 0x7f75c01f30c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:06.795 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:06.792+0000 7f75c71bf640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f75c015a260 0x7f75c00c56b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:06.795 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:06.792+0000 7f75c71bf640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f75c00c83b0 con 0x7f75c0072430 2024-03-17T23:56:06.795 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:06.792+0000 7f75c71bf640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f75c00c80d0 con 0x7f75c0154240 2024-03-17T23:56:06.795 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:06.792+0000 7f75c71bf640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f75c00c8720 con 0x7f75c015a260 2024-03-17T23:56:06.795 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:06.792+0000 7f75c4f5b640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f75c0072430 0x7f75c015df60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:06.796 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:06.792+0000 7f75c4f5b640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f75c0072430 0x7f75c015df60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.196:34408/0 (socket says 172.21.15.196:34408) 2024-03-17T23:56:06.796 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:06.792+0000 7f75c4f5b640 1 -- 172.21.15.196:0/2071448699 learned_addr learned my addr 172.21.15.196:0/2071448699 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-03-17T23:56:06.796 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:06.792+0000 7f75bffff640 1 --2- 172.21.15.196:0/2071448699 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f75c0154240 0x7f75c01f30c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:06.796 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:06.792+0000 7f75c575c640 1 --2- 172.21.15.196:0/2071448699 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f75c015a260 0x7f75c00c56b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:06.796 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:06.792+0000 7f75c4f5b640 1 -- 172.21.15.196:0/2071448699 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f75c015a260 msgr2=0x7f75c00c56b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:06.796 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:06.792+0000 7f75c4f5b640 1 --2- 172.21.15.196:0/2071448699 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f75c015a260 0x7f75c00c56b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:06.796 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:06.792+0000 7f75c4f5b640 1 -- 172.21.15.196:0/2071448699 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f75c0154240 msgr2=0x7f75c01f30c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:06.796 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:06.792+0000 7f75c4f5b640 1 --2- 172.21.15.196:0/2071448699 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f75c0154240 0x7f75c01f30c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:06.796 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:06.792+0000 7f75c4f5b640 1 -- 172.21.15.196:0/2071448699 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75c01f3d50 con 0x7f75c0072430 2024-03-17T23:56:06.796 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:06.792+0000 7f75c575c640 1 --2- 172.21.15.196:0/2071448699 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f75c015a260 0x7f75c00c56b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-17T23:56:06.796 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:06.792+0000 7f75c4f5b640 1 --2- 172.21.15.196:0/2071448699 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f75c0072430 0x7f75c015df60 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f75b4009710 tx=0x7f75b401b9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:56:06.796 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:06.792+0000 7f75bd7fa640 1 -- 172.21.15.196:0/2071448699 <== mon.0 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75b40bf070 con 0x7f75c0072430 2024-03-17T23:56:06.796 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:06.792+0000 7f75bd7fa640 1 -- 172.21.15.196:0/2071448699 <== mon.0 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f75b40b0640 con 0x7f75c0072430 2024-03-17T23:56:06.796 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:06.792+0000 7f75c71bf640 1 -- 172.21.15.196:0/2071448699 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f75c01f3a70 con 0x7f75c0072430 2024-03-17T23:56:06.796 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:06.792+0000 7f75bd7fa640 1 -- 172.21.15.196:0/2071448699 <== mon.0 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75b40b5040 con 0x7f75c0072430 2024-03-17T23:56:06.797 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:06.792+0000 7f75c71bf640 1 -- 172.21.15.196:0/2071448699 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75c0158950 con 0x7f75c0072430 2024-03-17T23:56:06.797 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:06.792+0000 7f75c71bf640 1 -- 172.21.15.196:0/2071448699 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f75c00689a0 con 0x7f75c0072430 2024-03-17T23:56:06.797 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:06.796+0000 7f75bd7fa640 1 -- 172.21.15.196:0/2071448699 <== mon.0 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 5) ==== 87083+0+0 (secure 0 0 0) 0x7f75b40c2070 con 0x7f75c0072430 2024-03-17T23:56:06.797 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:06.796+0000 7f75bd7fa640 1 --2- 172.21.15.196:0/2071448699 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f75a4067660 0x7f75a4069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:06.797 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:06.796+0000 7f75bd7fa640 1 -- 172.21.15.196:0/2071448699 <== mon.0 v2:172.21.15.196:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f75b4121e50 con 0x7f75c0072430 2024-03-17T23:56:06.798 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:06.796+0000 7f75bffff640 1 --2- 172.21.15.196:0/2071448699 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f75a4067660 0x7f75a4069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:06.798 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:06.796+0000 7f75bffff640 1 --2- 172.21.15.196:0/2071448699 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f75a4067660 0x7f75a4069b20 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f75c0157ad0 tx=0x7f75ac007ae0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:56:06.801 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:06.800+0000 7f75bd7fa640 1 -- 172.21.15.196:0/2071448699 <== mon.0 v2:172.21.15.196:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177849 (secure 0 0 0) 0x7f75b40187b0 con 0x7f75c0072430 2024-03-17T23:56:06.989 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:06.988+0000 7f75c71bf640 1 -- 172.21.15.196:0/2071448699 --> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f75c006fa80 con 0x7f75a4067660 2024-03-17T23:56:07.006 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:07.004+0000 7f75bd7fa640 1 -- 172.21.15.196:0/2071448699 <== mgr.4099 v2:172.21.15.204:6832/2505201055 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252081 (secure 0 0 0) 0x7f75c006fa80 con 0x7f75a4067660 2024-03-17T23:56:07.008 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-03-17T23:56:07.009 INFO:teuthology.orchestra.run.smithi196.stderr:dumped all 2024-03-17T23:56:07.011 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:07.008+0000 7f75c71bf640 1 -- 172.21.15.196:0/2071448699 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f75a4067660 msgr2=0x7f75a4069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:07.011 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:07.008+0000 7f75c71bf640 1 --2- 172.21.15.196:0/2071448699 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f75a4067660 0x7f75a4069b20 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f75c0157ad0 tx=0x7f75ac007ae0 comp rx=0 tx=0).stop 2024-03-17T23:56:07.011 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:07.008+0000 7f75c71bf640 1 -- 172.21.15.196:0/2071448699 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f75c0072430 msgr2=0x7f75c015df60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:07.011 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:07.008+0000 7f75c71bf640 1 --2- 172.21.15.196:0/2071448699 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f75c0072430 0x7f75c015df60 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f75b4009710 tx=0x7f75b401b9f0 comp rx=0 tx=0).stop 2024-03-17T23:56:07.011 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:07.008+0000 7f75c71bf640 1 -- 172.21.15.196:0/2071448699 shutdown_connections 2024-03-17T23:56:07.011 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:07.008+0000 7f75c71bf640 1 --2- 172.21.15.196:0/2071448699 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f75a4067660 0x7f75a4069b20 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:07.011 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:07.008+0000 7f75c71bf640 1 --2- 172.21.15.196:0/2071448699 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f75c015a260 0x7f75c00c56b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:07.011 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:07.008+0000 7f75c71bf640 1 --2- 172.21.15.196:0/2071448699 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f75c0154240 0x7f75c01f30c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:07.011 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:07.008+0000 7f75c71bf640 1 --2- 172.21.15.196:0/2071448699 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f75c0072430 0x7f75c015df60 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:07.011 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:07.008+0000 7f75c71bf640 1 -- 172.21.15.196:0/2071448699 >> 172.21.15.196:0/2071448699 conn(0x7f75c00cc420 msgr2=0x7f75c0151920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-17T23:56:07.011 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:07.008+0000 7f75c71bf640 1 -- 172.21.15.196:0/2071448699 shutdown_connections 2024-03-17T23:56:07.011 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:07.008+0000 7f75c71bf640 1 -- 172.21.15.196:0/2071448699 wait complete. 2024-03-17T23:56:07.028 INFO:teuthology.orchestra.run.smithi196.stdout:{"pg_ready":true,"pg_map":{"version":20,"stamp":"2024-03-17T23:56:05.956361+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595590,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":283,"num_write_kb":2454,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":39,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":225,"ondisk_log_size":225,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218092,"kb_used_data":1940,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754756628,"statfs":{"total":773094113280,"available":772870787072,"internally_reserved":0,"allocated":1986560,"data_stored":1793298,"data_compressed":66348,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12748,"internal_metadata":221236788},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":49,"apply_latency_ms":49,"commit_latency_ns":49000000,"apply_latency_ns":49000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":5222,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":124,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":39,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.313399"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:02.164060+0000","last_change":"2024-03-17T23:56:01.208245+0000","last_active":"2024-03-17T23:56:02.164060+0000","last_peered":"2024-03-17T23:56:02.164060+0000","last_clean":"2024-03-17T23:56:02.164060+0000","last_became_active":"2024-03-17T23:56:01.207533+0000","last_became_peered":"2024-03-17T23:56:01.207533+0000","last_unstale":"2024-03-17T23:56:02.164060+0000","last_undegraded":"2024-03-17T23:56:02.164060+0000","last_fullsized":"2024-03-17T23:56:02.164060+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T09:33:28.935701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:02.756375+0000","last_change":"2024-03-17T23:56:01.193546+0000","last_active":"2024-03-17T23:56:02.756375+0000","last_peered":"2024-03-17T23:56:02.756375+0000","last_clean":"2024-03-17T23:56:02.756375+0000","last_became_active":"2024-03-17T23:56:01.192736+0000","last_became_peered":"2024-03-17T23:56:01.192736+0000","last_unstale":"2024-03-17T23:56:02.756375+0000","last_undegraded":"2024-03-17T23:56:02.756375+0000","last_fullsized":"2024-03-17T23:56:02.756375+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T07:03:18.208772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:02.858181+0000","last_change":"2024-03-17T23:56:01.188859+0000","last_active":"2024-03-17T23:56:02.858181+0000","last_peered":"2024-03-17T23:56:02.858181+0000","last_clean":"2024-03-17T23:56:02.858181+0000","last_became_active":"2024-03-17T23:56:01.188339+0000","last_became_peered":"2024-03-17T23:56:01.188339+0000","last_unstale":"2024-03-17T23:56:02.858181+0000","last_undegraded":"2024-03-17T23:56:02.858181+0000","last_fullsized":"2024-03-17T23:56:02.858181+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T05:26:03.654839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:02.169804+0000","last_change":"2024-03-17T23:56:01.204810+0000","last_active":"2024-03-17T23:56:02.169804+0000","last_peered":"2024-03-17T23:56:02.169804+0000","last_clean":"2024-03-17T23:56:02.169804+0000","last_became_active":"2024-03-17T23:56:01.196978+0000","last_became_peered":"2024-03-17T23:56:01.196978+0000","last_unstale":"2024-03-17T23:56:02.169804+0000","last_undegraded":"2024-03-17T23:56:02.169804+0000","last_fullsized":"2024-03-17T23:56:02.169804+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T06:25:58.489959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:02.162704+0000","last_change":"2024-03-17T23:56:01.195423+0000","last_active":"2024-03-17T23:56:02.162704+0000","last_peered":"2024-03-17T23:56:02.162704+0000","last_clean":"2024-03-17T23:56:02.162704+0000","last_became_active":"2024-03-17T23:56:01.194710+0000","last_became_peered":"2024-03-17T23:56:01.194710+0000","last_unstale":"2024-03-17T23:56:02.162704+0000","last_undegraded":"2024-03-17T23:56:02.162704+0000","last_fullsized":"2024-03-17T23:56:02.162704+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T06:25:58.489959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:02.169622+0000","last_change":"2024-03-17T23:56:01.204633+0000","last_active":"2024-03-17T23:56:02.169622+0000","last_peered":"2024-03-17T23:56:02.169622+0000","last_clean":"2024-03-17T23:56:02.169622+0000","last_became_active":"2024-03-17T23:56:01.192908+0000","last_became_peered":"2024-03-17T23:56:01.192908+0000","last_unstale":"2024-03-17T23:56:02.169622+0000","last_undegraded":"2024-03-17T23:56:02.169622+0000","last_fullsized":"2024-03-17T23:56:02.169622+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T03:49:46.522282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:02.163588+0000","last_change":"2024-03-17T23:56:01.208861+0000","last_active":"2024-03-17T23:56:02.163588+0000","last_peered":"2024-03-17T23:56:02.163588+0000","last_clean":"2024-03-17T23:56:02.163588+0000","last_became_active":"2024-03-17T23:56:01.199550+0000","last_became_peered":"2024-03-17T23:56:01.199550+0000","last_unstale":"2024-03-17T23:56:02.163588+0000","last_undegraded":"2024-03-17T23:56:02.163588+0000","last_fullsized":"2024-03-17T23:56:02.163588+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T00:21:36.556648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:02.855187+0000","last_change":"2024-03-17T23:56:01.212574+0000","last_active":"2024-03-17T23:56:02.855187+0000","last_peered":"2024-03-17T23:56:02.855187+0000","last_clean":"2024-03-17T23:56:02.855187+0000","last_became_active":"2024-03-17T23:56:01.211860+0000","last_became_peered":"2024-03-17T23:56:01.211860+0000","last_unstale":"2024-03-17T23:56:02.855187+0000","last_undegraded":"2024-03-17T23:56:02.855187+0000","last_fullsized":"2024-03-17T23:56:02.855187+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T02:15:18.353466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:02.164413+0000","last_change":"2024-03-17T23:56:01.214731+0000","last_active":"2024-03-17T23:56:02.164413+0000","last_peered":"2024-03-17T23:56:02.164413+0000","last_clean":"2024-03-17T23:56:02.164413+0000","last_became_active":"2024-03-17T23:56:01.213795+0000","last_became_peered":"2024-03-17T23:56:01.213795+0000","last_unstale":"2024-03-17T23:56:02.164413+0000","last_undegraded":"2024-03-17T23:56:02.164413+0000","last_fullsized":"2024-03-17T23:56:02.164413+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T11:32:23.716236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:02.856823+0000","last_change":"2024-03-17T23:56:01.212409+0000","last_active":"2024-03-17T23:56:02.856823+0000","last_peered":"2024-03-17T23:56:02.856823+0000","last_clean":"2024-03-17T23:56:02.856823+0000","last_became_active":"2024-03-17T23:56:01.211620+0000","last_became_peered":"2024-03-17T23:56:01.211620+0000","last_unstale":"2024-03-17T23:56:02.856823+0000","last_undegraded":"2024-03-17T23:56:02.856823+0000","last_fullsized":"2024-03-17T23:56:02.856823+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T11:40:55.653472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:02.856758+0000","last_change":"2024-03-17T23:56:01.212568+0000","last_active":"2024-03-17T23:56:02.856758+0000","last_peered":"2024-03-17T23:56:02.856758+0000","last_clean":"2024-03-17T23:56:02.856758+0000","last_became_active":"2024-03-17T23:56:01.211561+0000","last_became_peered":"2024-03-17T23:56:01.211561+0000","last_unstale":"2024-03-17T23:56:02.856758+0000","last_undegraded":"2024-03-17T23:56:02.856758+0000","last_fullsized":"2024-03-17T23:56:02.856758+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T02:46:13.650384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:02.165562+0000","last_change":"2024-03-17T23:56:01.186811+0000","last_active":"2024-03-17T23:56:02.165562+0000","last_peered":"2024-03-17T23:56:02.165562+0000","last_clean":"2024-03-17T23:56:02.165562+0000","last_became_active":"2024-03-17T23:56:01.186012+0000","last_became_peered":"2024-03-17T23:56:01.186012+0000","last_unstale":"2024-03-17T23:56:02.165562+0000","last_undegraded":"2024-03-17T23:56:02.165562+0000","last_fullsized":"2024-03-17T23:56:02.165562+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T10:35:20.142750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:02.855904+0000","last_change":"2024-03-17T23:56:01.213648+0000","last_active":"2024-03-17T23:56:02.855904+0000","last_peered":"2024-03-17T23:56:02.855904+0000","last_clean":"2024-03-17T23:56:02.855904+0000","last_became_active":"2024-03-17T23:56:01.205058+0000","last_became_peered":"2024-03-17T23:56:01.205058+0000","last_unstale":"2024-03-17T23:56:02.855904+0000","last_undegraded":"2024-03-17T23:56:02.855904+0000","last_fullsized":"2024-03-17T23:56:02.855904+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T03:49:46.522282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:02.857959+0000","last_change":"2024-03-17T23:56:01.196817+0000","last_active":"2024-03-17T23:56:02.857959+0000","last_peered":"2024-03-17T23:56:02.857959+0000","last_clean":"2024-03-17T23:56:02.857959+0000","last_became_active":"2024-03-17T23:56:01.195960+0000","last_became_peered":"2024-03-17T23:56:01.195960+0000","last_unstale":"2024-03-17T23:56:02.857959+0000","last_undegraded":"2024-03-17T23:56:02.857959+0000","last_fullsized":"2024-03-17T23:56:02.857959+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T10:13:51.662432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:02.756001+0000","last_change":"2024-03-17T23:56:01.182140+0000","last_active":"2024-03-17T23:56:02.756001+0000","last_peered":"2024-03-17T23:56:02.756001+0000","last_clean":"2024-03-17T23:56:02.756001+0000","last_became_active":"2024-03-17T23:56:01.181405+0000","last_became_peered":"2024-03-17T23:56:01.181405+0000","last_unstale":"2024-03-17T23:56:02.756001+0000","last_undegraded":"2024-03-17T23:56:02.756001+0000","last_fullsized":"2024-03-17T23:56:02.756001+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T02:46:13.650384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:02.169320+0000","last_change":"2024-03-17T23:56:01.194871+0000","last_active":"2024-03-17T23:56:02.169320+0000","last_peered":"2024-03-17T23:56:02.169320+0000","last_clean":"2024-03-17T23:56:02.169320+0000","last_became_active":"2024-03-17T23:56:01.193384+0000","last_became_peered":"2024-03-17T23:56:01.193384+0000","last_unstale":"2024-03-17T23:56:02.169320+0000","last_undegraded":"2024-03-17T23:56:02.169320+0000","last_fullsized":"2024-03-17T23:56:02.169320+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T11:40:55.653472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:02.170892+0000","last_change":"2024-03-17T23:56:01.209960+0000","last_active":"2024-03-17T23:56:02.170892+0000","last_peered":"2024-03-17T23:56:02.170892+0000","last_clean":"2024-03-17T23:56:02.170892+0000","last_became_active":"2024-03-17T23:56:01.209291+0000","last_became_peered":"2024-03-17T23:56:01.209291+0000","last_unstale":"2024-03-17T23:56:02.170892+0000","last_undegraded":"2024-03-17T23:56:02.170892+0000","last_fullsized":"2024-03-17T23:56:02.170892+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T03:01:01.120023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:02.355033+0000","last_change":"2024-03-17T23:56:01.186830+0000","last_active":"2024-03-17T23:56:02.355033+0000","last_peered":"2024-03-17T23:56:02.355033+0000","last_clean":"2024-03-17T23:56:02.355033+0000","last_became_active":"2024-03-17T23:56:01.186001+0000","last_became_peered":"2024-03-17T23:56:01.186001+0000","last_unstale":"2024-03-17T23:56:02.355033+0000","last_undegraded":"2024-03-17T23:56:02.355033+0000","last_fullsized":"2024-03-17T23:56:02.355033+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T01:56:02.340062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:02.163525+0000","last_change":"2024-03-17T23:56:01.195354+0000","last_active":"2024-03-17T23:56:02.163525+0000","last_peered":"2024-03-17T23:56:02.163525+0000","last_clean":"2024-03-17T23:56:02.163525+0000","last_became_active":"2024-03-17T23:56:01.194579+0000","last_became_peered":"2024-03-17T23:56:01.194579+0000","last_unstale":"2024-03-17T23:56:02.163525+0000","last_undegraded":"2024-03-17T23:56:02.163525+0000","last_fullsized":"2024-03-17T23:56:02.163525+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T07:53:44.598091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:02.855890+0000","last_change":"2024-03-17T23:56:01.193429+0000","last_active":"2024-03-17T23:56:02.855890+0000","last_peered":"2024-03-17T23:56:02.855890+0000","last_clean":"2024-03-17T23:56:02.855890+0000","last_became_active":"2024-03-17T23:56:01.192711+0000","last_became_peered":"2024-03-17T23:56:01.192711+0000","last_unstale":"2024-03-17T23:56:02.855890+0000","last_undegraded":"2024-03-17T23:56:02.855890+0000","last_fullsized":"2024-03-17T23:56:02.855890+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T08:24:06.922044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:02.858321+0000","last_change":"2024-03-17T23:56:01.203203+0000","last_active":"2024-03-17T23:56:02.858321+0000","last_peered":"2024-03-17T23:56:02.858321+0000","last_clean":"2024-03-17T23:56:02.858321+0000","last_became_active":"2024-03-17T23:56:01.202491+0000","last_became_peered":"2024-03-17T23:56:01.202491+0000","last_unstale":"2024-03-17T23:56:02.858321+0000","last_undegraded":"2024-03-17T23:56:02.858321+0000","last_fullsized":"2024-03-17T23:56:02.858321+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T11:35:21.037222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:02.169686+0000","last_change":"2024-03-17T23:56:01.215437+0000","last_active":"2024-03-17T23:56:02.169686+0000","last_peered":"2024-03-17T23:56:02.169686+0000","last_clean":"2024-03-17T23:56:02.169686+0000","last_became_active":"2024-03-17T23:56:01.214127+0000","last_became_peered":"2024-03-17T23:56:01.214127+0000","last_unstale":"2024-03-17T23:56:02.169686+0000","last_undegraded":"2024-03-17T23:56:02.169686+0000","last_fullsized":"2024-03-17T23:56:02.169686+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T04:45:41.506781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:02.855523+0000","last_change":"2024-03-17T23:56:01.213157+0000","last_active":"2024-03-17T23:56:02.855523+0000","last_peered":"2024-03-17T23:56:02.855523+0000","last_clean":"2024-03-17T23:56:02.855523+0000","last_became_active":"2024-03-17T23:56:01.205601+0000","last_became_peered":"2024-03-17T23:56:01.205601+0000","last_unstale":"2024-03-17T23:56:02.855523+0000","last_undegraded":"2024-03-17T23:56:02.855523+0000","last_fullsized":"2024-03-17T23:56:02.855523+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T00:26:55.287891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:02.169576+0000","last_change":"2024-03-17T23:56:01.194995+0000","last_active":"2024-03-17T23:56:02.169576+0000","last_peered":"2024-03-17T23:56:02.169576+0000","last_clean":"2024-03-17T23:56:02.169576+0000","last_became_active":"2024-03-17T23:56:01.194290+0000","last_became_peered":"2024-03-17T23:56:01.194290+0000","last_unstale":"2024-03-17T23:56:02.169576+0000","last_undegraded":"2024-03-17T23:56:02.169576+0000","last_fullsized":"2024-03-17T23:56:02.169576+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T07:03:18.208772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:02.856011+0000","last_change":"2024-03-17T23:56:01.205233+0000","last_active":"2024-03-17T23:56:02.856011+0000","last_peered":"2024-03-17T23:56:02.856011+0000","last_clean":"2024-03-17T23:56:02.856011+0000","last_became_active":"2024-03-17T23:56:01.204456+0000","last_became_peered":"2024-03-17T23:56:01.204456+0000","last_unstale":"2024-03-17T23:56:02.856011+0000","last_undegraded":"2024-03-17T23:56:02.856011+0000","last_fullsized":"2024-03-17T23:56:02.856011+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T06:25:58.489959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:02.856820+0000","last_change":"2024-03-17T23:56:01.210984+0000","last_active":"2024-03-17T23:56:02.856820+0000","last_peered":"2024-03-17T23:56:02.856820+0000","last_clean":"2024-03-17T23:56:02.856820+0000","last_became_active":"2024-03-17T23:56:01.210025+0000","last_became_peered":"2024-03-17T23:56:01.210025+0000","last_unstale":"2024-03-17T23:56:02.856820+0000","last_undegraded":"2024-03-17T23:56:02.856820+0000","last_fullsized":"2024-03-17T23:56:02.856820+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T00:26:55.287891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:02.756301+0000","last_change":"2024-03-17T23:56:01.205461+0000","last_active":"2024-03-17T23:56:02.756301+0000","last_peered":"2024-03-17T23:56:02.756301+0000","last_clean":"2024-03-17T23:56:02.756301+0000","last_became_active":"2024-03-17T23:56:01.204676+0000","last_became_peered":"2024-03-17T23:56:01.204676+0000","last_unstale":"2024-03-17T23:56:02.756301+0000","last_undegraded":"2024-03-17T23:56:02.756301+0000","last_fullsized":"2024-03-17T23:56:02.756301+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T11:40:55.653472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:02.855842+0000","last_change":"2024-03-17T23:56:01.205530+0000","last_active":"2024-03-17T23:56:02.855842+0000","last_peered":"2024-03-17T23:56:02.855842+0000","last_clean":"2024-03-17T23:56:02.855842+0000","last_became_active":"2024-03-17T23:56:01.204637+0000","last_became_peered":"2024-03-17T23:56:01.204637+0000","last_unstale":"2024-03-17T23:56:02.855842+0000","last_undegraded":"2024-03-17T23:56:02.855842+0000","last_fullsized":"2024-03-17T23:56:02.855842+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T07:03:18.208772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:02.858534+0000","last_change":"2024-03-17T23:56:01.207143+0000","last_active":"2024-03-17T23:56:02.858534+0000","last_peered":"2024-03-17T23:56:02.858534+0000","last_clean":"2024-03-17T23:56:02.858534+0000","last_became_active":"2024-03-17T23:56:01.206466+0000","last_became_peered":"2024-03-17T23:56:01.206466+0000","last_unstale":"2024-03-17T23:56:02.858534+0000","last_undegraded":"2024-03-17T23:56:02.858534+0000","last_fullsized":"2024-03-17T23:56:02.858534+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T02:46:13.650384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:02.170795+0000","last_change":"2024-03-17T23:56:01.205414+0000","last_active":"2024-03-17T23:56:02.170795+0000","last_peered":"2024-03-17T23:56:02.170795+0000","last_clean":"2024-03-17T23:56:02.170795+0000","last_became_active":"2024-03-17T23:56:01.204418+0000","last_became_peered":"2024-03-17T23:56:01.204418+0000","last_unstale":"2024-03-17T23:56:02.170795+0000","last_undegraded":"2024-03-17T23:56:02.170795+0000","last_fullsized":"2024-03-17T23:56:02.170795+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T03:59:56.032635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:02.354820+0000","last_change":"2024-03-17T23:56:01.213242+0000","last_active":"2024-03-17T23:56:02.354820+0000","last_peered":"2024-03-17T23:56:02.354820+0000","last_clean":"2024-03-17T23:56:02.354820+0000","last_became_active":"2024-03-17T23:56:01.212456+0000","last_became_peered":"2024-03-17T23:56:01.212456+0000","last_unstale":"2024-03-17T23:56:02.354820+0000","last_undegraded":"2024-03-17T23:56:02.354820+0000","last_fullsized":"2024-03-17T23:56:02.354820+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T11:11:33.525431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:02.855686+0000","last_change":"2024-03-17T23:56:01.197502+0000","last_active":"2024-03-17T23:56:02.855686+0000","last_peered":"2024-03-17T23:56:02.855686+0000","last_clean":"2024-03-17T23:56:02.855686+0000","last_became_active":"2024-03-17T23:56:01.196672+0000","last_became_peered":"2024-03-17T23:56:01.196672+0000","last_unstale":"2024-03-17T23:56:02.855686+0000","last_undegraded":"2024-03-17T23:56:02.855686+0000","last_fullsized":"2024-03-17T23:56:02.855686+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T05:26:03.654839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:02.165727+0000","last_change":"2024-03-17T23:56:01.169196+0000","last_active":"2024-03-17T23:56:02.165727+0000","last_peered":"2024-03-17T23:56:02.165727+0000","last_clean":"2024-03-17T23:56:02.165727+0000","last_became_active":"2024-03-17T23:56:01.168199+0000","last_became_peered":"2024-03-17T23:56:01.168199+0000","last_unstale":"2024-03-17T23:56:02.165727+0000","last_undegraded":"2024-03-17T23:56:02.165727+0000","last_fullsized":"2024-03-17T23:56:02.165727+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T11:11:33.525431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"21'5","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:03.681175+0000","last_change":"2024-03-17T23:56:00.675134+0000","last_active":"2024-03-17T23:56:03.681175+0000","last_peered":"2024-03-17T23:56:03.681175+0000","last_clean":"2024-03-17T23:56:03.681175+0000","last_became_active":"2024-03-17T23:56:00.674772+0000","last_became_peered":"2024-03-17T23:56:00.674772+0000","last_unstale":"2024-03-17T23:56:03.681175+0000","last_undegraded":"2024-03-17T23:56:03.681175+0000","last_fullsized":"2024-03-17T23:56:03.681175+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_clean_scrub_stamp":"2024-03-17T23:55:59.626739+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T07:03:16.148691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:02.858578+0000","last_change":"2024-03-17T23:56:01.199837+0000","last_active":"2024-03-17T23:56:02.858578+0000","last_peered":"2024-03-17T23:56:02.858578+0000","last_clean":"2024-03-17T23:56:02.858578+0000","last_became_active":"2024-03-17T23:56:01.199084+0000","last_became_peered":"2024-03-17T23:56:01.199084+0000","last_unstale":"2024-03-17T23:56:02.858578+0000","last_undegraded":"2024-03-17T23:56:02.858578+0000","last_fullsized":"2024-03-17T23:56:02.858578+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T00:26:55.287891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"21'3","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:04.690035+0000","last_change":"2024-03-17T23:56:00.683252+0000","last_active":"2024-03-17T23:56:04.690035+0000","last_peered":"2024-03-17T23:56:04.690035+0000","last_clean":"2024-03-17T23:56:04.690035+0000","last_became_active":"2024-03-17T23:56:00.682487+0000","last_became_peered":"2024-03-17T23:56:00.682487+0000","last_unstale":"2024-03-17T23:56:04.690035+0000","last_undegraded":"2024-03-17T23:56:04.690035+0000","last_fullsized":"2024-03-17T23:56:04.690035+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_clean_scrub_stamp":"2024-03-17T23:55:59.626739+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T04:07:26.256885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"21'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:04.689975+0000","last_change":"2024-03-17T23:56:00.688353+0000","last_active":"2024-03-17T23:56:04.689975+0000","last_peered":"2024-03-17T23:56:04.689975+0000","last_clean":"2024-03-17T23:56:04.689975+0000","last_became_active":"2024-03-17T23:56:00.688016+0000","last_became_peered":"2024-03-17T23:56:00.688016+0000","last_unstale":"2024-03-17T23:56:04.689975+0000","last_undegraded":"2024-03-17T23:56:04.689975+0000","last_fullsized":"2024-03-17T23:56:04.689975+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_clean_scrub_stamp":"2024-03-17T23:55:59.626739+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T09:07:52.005791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:02.855275+0000","last_change":"2024-03-17T23:56:01.211541+0000","last_active":"2024-03-17T23:56:02.855275+0000","last_peered":"2024-03-17T23:56:02.855275+0000","last_clean":"2024-03-17T23:56:02.855275+0000","last_became_active":"2024-03-17T23:56:01.205709+0000","last_became_peered":"2024-03-17T23:56:01.205709+0000","last_unstale":"2024-03-17T23:56:02.855275+0000","last_undegraded":"2024-03-17T23:56:02.855275+0000","last_fullsized":"2024-03-17T23:56:02.855275+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T11:35:21.037222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"21'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:02.169659+0000","last_change":"2024-03-17T23:56:00.690234+0000","last_active":"2024-03-17T23:56:02.169659+0000","last_peered":"2024-03-17T23:56:02.169659+0000","last_clean":"2024-03-17T23:56:02.169659+0000","last_became_active":"2024-03-17T23:56:00.689202+0000","last_became_peered":"2024-03-17T23:56:00.689202+0000","last_unstale":"2024-03-17T23:56:02.169659+0000","last_undegraded":"2024-03-17T23:56:02.169659+0000","last_fullsized":"2024-03-17T23:56:02.169659+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_clean_scrub_stamp":"2024-03-17T23:55:59.626739+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T05:52:39.451210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:02.755906+0000","last_change":"2024-03-17T23:56:01.194109+0000","last_active":"2024-03-17T23:56:02.755906+0000","last_peered":"2024-03-17T23:56:02.755906+0000","last_clean":"2024-03-17T23:56:02.755906+0000","last_became_active":"2024-03-17T23:56:01.192420+0000","last_became_peered":"2024-03-17T23:56:01.192420+0000","last_unstale":"2024-03-17T23:56:02.755906+0000","last_undegraded":"2024-03-17T23:56:02.755906+0000","last_fullsized":"2024-03-17T23:56:02.755906+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T08:24:06.922044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"21'3","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:03.685014+0000","last_change":"2024-03-17T23:56:00.696649+0000","last_active":"2024-03-17T23:56:03.685014+0000","last_peered":"2024-03-17T23:56:03.685014+0000","last_clean":"2024-03-17T23:56:03.685014+0000","last_became_active":"2024-03-17T23:56:00.696307+0000","last_became_peered":"2024-03-17T23:56:00.696307+0000","last_unstale":"2024-03-17T23:56:03.685014+0000","last_undegraded":"2024-03-17T23:56:03.685014+0000","last_fullsized":"2024-03-17T23:56:03.685014+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_clean_scrub_stamp":"2024-03-17T23:55:59.626739+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T07:28:27.310340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:02.170611+0000","last_change":"2024-03-17T23:56:01.194103+0000","last_active":"2024-03-17T23:56:02.170611+0000","last_peered":"2024-03-17T23:56:02.170611+0000","last_clean":"2024-03-17T23:56:02.170611+0000","last_became_active":"2024-03-17T23:56:01.193354+0000","last_became_peered":"2024-03-17T23:56:01.193354+0000","last_unstale":"2024-03-17T23:56:02.170611+0000","last_undegraded":"2024-03-17T23:56:02.170611+0000","last_fullsized":"2024-03-17T23:56:02.170611+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T00:21:36.556648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"21'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:03.683715+0000","last_change":"2024-03-17T23:56:00.689876+0000","last_active":"2024-03-17T23:56:03.683715+0000","last_peered":"2024-03-17T23:56:03.683715+0000","last_clean":"2024-03-17T23:56:03.683715+0000","last_became_active":"2024-03-17T23:56:00.688667+0000","last_became_peered":"2024-03-17T23:56:00.688667+0000","last_unstale":"2024-03-17T23:56:03.683715+0000","last_undegraded":"2024-03-17T23:56:03.683715+0000","last_fullsized":"2024-03-17T23:56:03.683715+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_clean_scrub_stamp":"2024-03-17T23:55:59.626739+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T09:45:24.650866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:02.858681+0000","last_change":"2024-03-17T23:56:01.215247+0000","last_active":"2024-03-17T23:56:02.858681+0000","last_peered":"2024-03-17T23:56:02.858681+0000","last_clean":"2024-03-17T23:56:02.858681+0000","last_became_active":"2024-03-17T23:56:01.214438+0000","last_became_peered":"2024-03-17T23:56:01.214438+0000","last_unstale":"2024-03-17T23:56:02.858681+0000","last_undegraded":"2024-03-17T23:56:02.858681+0000","last_fullsized":"2024-03-17T23:56:02.858681+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T11:40:55.653472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"21'4","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:02.756183+0000","last_change":"2024-03-17T23:56:00.677495+0000","last_active":"2024-03-17T23:56:02.756183+0000","last_peered":"2024-03-17T23:56:02.756183+0000","last_clean":"2024-03-17T23:56:02.756183+0000","last_became_active":"2024-03-17T23:56:00.677165+0000","last_became_peered":"2024-03-17T23:56:00.677165+0000","last_unstale":"2024-03-17T23:56:02.756183+0000","last_undegraded":"2024-03-17T23:56:02.756183+0000","last_fullsized":"2024-03-17T23:56:02.756183+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_clean_scrub_stamp":"2024-03-17T23:55:59.626739+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T04:07:26.256885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:02.165606+0000","last_change":"2024-03-17T23:56:01.190913+0000","last_active":"2024-03-17T23:56:02.165606+0000","last_peered":"2024-03-17T23:56:02.165606+0000","last_clean":"2024-03-17T23:56:02.165606+0000","last_became_active":"2024-03-17T23:56:01.190191+0000","last_became_peered":"2024-03-17T23:56:01.190191+0000","last_unstale":"2024-03-17T23:56:02.165606+0000","last_undegraded":"2024-03-17T23:56:02.165606+0000","last_fullsized":"2024-03-17T23:56:02.165606+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T09:57:50.285832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"21'8","reported_seq":22,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:03.681998+0000","last_change":"2024-03-17T23:56:00.686597+0000","last_active":"2024-03-17T23:56:03.681998+0000","last_peered":"2024-03-17T23:56:03.681998+0000","last_clean":"2024-03-17T23:56:03.681998+0000","last_became_active":"2024-03-17T23:56:00.685757+0000","last_became_peered":"2024-03-17T23:56:00.685757+0000","last_unstale":"2024-03-17T23:56:03.681998+0000","last_undegraded":"2024-03-17T23:56:03.681998+0000","last_fullsized":"2024-03-17T23:56:03.681998+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_clean_scrub_stamp":"2024-03-17T23:55:59.626739+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T10:35:19.139554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:02.162892+0000","last_change":"2024-03-17T23:56:01.216238+0000","last_active":"2024-03-17T23:56:02.162892+0000","last_peered":"2024-03-17T23:56:02.162892+0000","last_clean":"2024-03-17T23:56:02.162892+0000","last_became_active":"2024-03-17T23:56:01.215526+0000","last_became_peered":"2024-03-17T23:56:01.215526+0000","last_unstale":"2024-03-17T23:56:02.162892+0000","last_undegraded":"2024-03-17T23:56:02.162892+0000","last_fullsized":"2024-03-17T23:56:02.162892+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T03:18:40.457769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"21'6","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:04.688206+0000","last_change":"2024-03-17T23:56:00.682756+0000","last_active":"2024-03-17T23:56:04.688206+0000","last_peered":"2024-03-17T23:56:04.688206+0000","last_clean":"2024-03-17T23:56:04.688206+0000","last_became_active":"2024-03-17T23:56:00.682392+0000","last_became_peered":"2024-03-17T23:56:00.682392+0000","last_unstale":"2024-03-17T23:56:04.688206+0000","last_undegraded":"2024-03-17T23:56:04.688206+0000","last_fullsized":"2024-03-17T23:56:04.688206+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_clean_scrub_stamp":"2024-03-17T23:55:59.626739+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T04:54:08.515514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:02.858030+0000","last_change":"2024-03-17T23:56:01.218114+0000","last_active":"2024-03-17T23:56:02.858030+0000","last_peered":"2024-03-17T23:56:02.858030+0000","last_clean":"2024-03-17T23:56:02.858030+0000","last_became_active":"2024-03-17T23:56:01.217434+0000","last_became_peered":"2024-03-17T23:56:01.217434+0000","last_unstale":"2024-03-17T23:56:02.858030+0000","last_undegraded":"2024-03-17T23:56:02.858030+0000","last_fullsized":"2024-03-17T23:56:02.858030+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T06:56:40.687109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"21'3","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:03.679983+0000","last_change":"2024-03-17T23:56:00.696766+0000","last_active":"2024-03-17T23:56:03.679983+0000","last_peered":"2024-03-17T23:56:03.679983+0000","last_clean":"2024-03-17T23:56:03.679983+0000","last_became_active":"2024-03-17T23:56:00.695592+0000","last_became_peered":"2024-03-17T23:56:00.695592+0000","last_unstale":"2024-03-17T23:56:03.679983+0000","last_undegraded":"2024-03-17T23:56:03.679983+0000","last_fullsized":"2024-03-17T23:56:03.679983+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_clean_scrub_stamp":"2024-03-17T23:55:59.626739+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T04:07:26.256885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:02.162832+0000","last_change":"2024-03-17T23:56:01.208385+0000","last_active":"2024-03-17T23:56:02.162832+0000","last_peered":"2024-03-17T23:56:02.162832+0000","last_clean":"2024-03-17T23:56:02.162832+0000","last_became_active":"2024-03-17T23:56:01.207791+0000","last_became_peered":"2024-03-17T23:56:01.207791+0000","last_unstale":"2024-03-17T23:56:02.162832+0000","last_undegraded":"2024-03-17T23:56:02.162832+0000","last_fullsized":"2024-03-17T23:56:02.162832+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T11:08:21.695552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"21'3","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:04.692348+0000","last_change":"2024-03-17T23:56:00.686159+0000","last_active":"2024-03-17T23:56:04.692348+0000","last_peered":"2024-03-17T23:56:04.692348+0000","last_clean":"2024-03-17T23:56:04.692348+0000","last_became_active":"2024-03-17T23:56:00.685354+0000","last_became_peered":"2024-03-17T23:56:00.685354+0000","last_unstale":"2024-03-17T23:56:04.692348+0000","last_undegraded":"2024-03-17T23:56:04.692348+0000","last_fullsized":"2024-03-17T23:56:04.692348+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_clean_scrub_stamp":"2024-03-17T23:55:59.626739+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T09:45:24.650866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:02.855800+0000","last_change":"2024-03-17T23:56:01.197137+0000","last_active":"2024-03-17T23:56:02.855800+0000","last_peered":"2024-03-17T23:56:02.855800+0000","last_clean":"2024-03-17T23:56:02.855800+0000","last_became_active":"2024-03-17T23:56:01.196356+0000","last_became_peered":"2024-03-17T23:56:01.196356+0000","last_unstale":"2024-03-17T23:56:02.855800+0000","last_undegraded":"2024-03-17T23:56:02.855800+0000","last_fullsized":"2024-03-17T23:56:02.855800+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T11:35:21.037222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"21'15","reported_seq":29,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:04.693167+0000","last_change":"2024-03-17T23:56:00.682828+0000","last_active":"2024-03-17T23:56:04.693167+0000","last_peered":"2024-03-17T23:56:04.693167+0000","last_clean":"2024-03-17T23:56:04.693167+0000","last_became_active":"2024-03-17T23:56:00.682469+0000","last_became_peered":"2024-03-17T23:56:00.682469+0000","last_unstale":"2024-03-17T23:56:04.693167+0000","last_undegraded":"2024-03-17T23:56:04.693167+0000","last_fullsized":"2024-03-17T23:56:04.693167+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_clean_scrub_stamp":"2024-03-17T23:55:59.626739+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T05:52:39.451210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:02.163955+0000","last_change":"2024-03-17T23:56:01.209356+0000","last_active":"2024-03-17T23:56:02.163955+0000","last_peered":"2024-03-17T23:56:02.163955+0000","last_clean":"2024-03-17T23:56:02.163955+0000","last_became_active":"2024-03-17T23:56:01.208381+0000","last_became_peered":"2024-03-17T23:56:01.208381+0000","last_unstale":"2024-03-17T23:56:02.163955+0000","last_undegraded":"2024-03-17T23:56:02.163955+0000","last_fullsized":"2024-03-17T23:56:02.163955+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T03:01:01.120023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:02.165789+0000","last_change":"2024-03-17T23:56:00.683595+0000","last_active":"2024-03-17T23:56:02.165789+0000","last_peered":"2024-03-17T23:56:02.165789+0000","last_clean":"2024-03-17T23:56:02.165789+0000","last_became_active":"2024-03-17T23:56:00.681338+0000","last_became_peered":"2024-03-17T23:56:00.681338+0000","last_unstale":"2024-03-17T23:56:02.165789+0000","last_undegraded":"2024-03-17T23:56:02.165789+0000","last_fullsized":"2024-03-17T23:56:02.165789+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_clean_scrub_stamp":"2024-03-17T23:55:59.626739+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T08:58:55.725638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:02.163647+0000","last_change":"2024-03-17T23:56:01.212669+0000","last_active":"2024-03-17T23:56:02.163647+0000","last_peered":"2024-03-17T23:56:02.163647+0000","last_clean":"2024-03-17T23:56:02.163647+0000","last_became_active":"2024-03-17T23:56:01.206691+0000","last_became_peered":"2024-03-17T23:56:01.206691+0000","last_unstale":"2024-03-17T23:56:02.163647+0000","last_undegraded":"2024-03-17T23:56:02.163647+0000","last_fullsized":"2024-03-17T23:56:02.163647+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T03:59:56.032635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:02.354955+0000","last_change":"2024-03-17T23:56:00.690801+0000","last_active":"2024-03-17T23:56:02.354955+0000","last_peered":"2024-03-17T23:56:02.354955+0000","last_clean":"2024-03-17T23:56:02.354955+0000","last_became_active":"2024-03-17T23:56:00.690516+0000","last_became_peered":"2024-03-17T23:56:00.690516+0000","last_unstale":"2024-03-17T23:56:02.354955+0000","last_undegraded":"2024-03-17T23:56:02.354955+0000","last_fullsized":"2024-03-17T23:56:02.354955+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_clean_scrub_stamp":"2024-03-17T23:55:59.626739+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T09:07:52.005791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:02.164761+0000","last_change":"2024-03-17T23:56:01.213733+0000","last_active":"2024-03-17T23:56:02.164761+0000","last_peered":"2024-03-17T23:56:02.164761+0000","last_clean":"2024-03-17T23:56:02.164761+0000","last_became_active":"2024-03-17T23:56:01.213095+0000","last_became_peered":"2024-03-17T23:56:01.213095+0000","last_unstale":"2024-03-17T23:56:02.164761+0000","last_undegraded":"2024-03-17T23:56:02.164761+0000","last_fullsized":"2024-03-17T23:56:02.164761+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T08:57:40.944494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:02.756259+0000","last_change":"2024-03-17T23:56:00.672267+0000","last_active":"2024-03-17T23:56:02.756259+0000","last_peered":"2024-03-17T23:56:02.756259+0000","last_clean":"2024-03-17T23:56:02.756259+0000","last_became_active":"2024-03-17T23:56:00.671655+0000","last_became_peered":"2024-03-17T23:56:00.671655+0000","last_unstale":"2024-03-17T23:56:02.756259+0000","last_undegraded":"2024-03-17T23:56:02.756259+0000","last_fullsized":"2024-03-17T23:56:02.756259+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_clean_scrub_stamp":"2024-03-17T23:55:59.626739+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T09:45:24.650866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:02.170496+0000","last_change":"2024-03-17T23:56:01.204789+0000","last_active":"2024-03-17T23:56:02.170496+0000","last_peered":"2024-03-17T23:56:02.170496+0000","last_clean":"2024-03-17T23:56:02.170496+0000","last_became_active":"2024-03-17T23:56:01.196002+0000","last_became_peered":"2024-03-17T23:56:01.196002+0000","last_unstale":"2024-03-17T23:56:02.170496+0000","last_undegraded":"2024-03-17T23:56:02.170496+0000","last_fullsized":"2024-03-17T23:56:02.170496+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T07:53:44.598091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"21'3","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:04.690994+0000","last_change":"2024-03-17T23:56:00.679054+0000","last_active":"2024-03-17T23:56:04.690994+0000","last_peered":"2024-03-17T23:56:04.690994+0000","last_clean":"2024-03-17T23:56:04.690994+0000","last_became_active":"2024-03-17T23:56:00.677831+0000","last_became_peered":"2024-03-17T23:56:00.677831+0000","last_unstale":"2024-03-17T23:56:04.690994+0000","last_undegraded":"2024-03-17T23:56:04.690994+0000","last_fullsized":"2024-03-17T23:56:04.690994+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_clean_scrub_stamp":"2024-03-17T23:55:59.626739+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T04:07:26.256885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:02.163086+0000","last_change":"2024-03-17T23:56:01.214619+0000","last_active":"2024-03-17T23:56:02.163086+0000","last_peered":"2024-03-17T23:56:02.163086+0000","last_clean":"2024-03-17T23:56:02.163086+0000","last_became_active":"2024-03-17T23:56:01.213960+0000","last_became_peered":"2024-03-17T23:56:01.213960+0000","last_unstale":"2024-03-17T23:56:02.163086+0000","last_undegraded":"2024-03-17T23:56:02.163086+0000","last_fullsized":"2024-03-17T23:56:02.163086+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T11:01:47.143880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":170,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:02.161950+0000","last_change":"2024-03-17T23:55:58.106405+0000","last_active":"2024-03-17T23:56:02.161950+0000","last_peered":"2024-03-17T23:56:02.161950+0000","last_clean":"2024-03-17T23:56:02.161950+0000","last_became_active":"2024-03-17T23:55:58.104493+0000","last_became_peered":"2024-03-17T23:55:58.104493+0000","last_unstale":"2024-03-17T23:56:02.161950+0000","last_undegraded":"2024-03-17T23:56:02.161950+0000","last_fullsized":"2024-03-17T23:56:02.161950+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:55:56.609001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:55:56.609001+0000","last_clean_scrub_stamp":"2024-03-17T23:55:56.609001+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T08:58:52.707900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"21'3","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:03.680702+0000","last_change":"2024-03-17T23:56:00.678791+0000","last_active":"2024-03-17T23:56:03.680702+0000","last_peered":"2024-03-17T23:56:03.680702+0000","last_clean":"2024-03-17T23:56:03.680702+0000","last_became_active":"2024-03-17T23:56:00.677660+0000","last_became_peered":"2024-03-17T23:56:00.677660+0000","last_unstale":"2024-03-17T23:56:03.680702+0000","last_undegraded":"2024-03-17T23:56:03.680702+0000","last_fullsized":"2024-03-17T23:56:03.680702+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_clean_scrub_stamp":"2024-03-17T23:55:59.626739+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T07:28:27.310340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:02.855352+0000","last_change":"2024-03-17T23:56:01.213073+0000","last_active":"2024-03-17T23:56:02.855352+0000","last_peered":"2024-03-17T23:56:02.855352+0000","last_clean":"2024-03-17T23:56:02.855352+0000","last_became_active":"2024-03-17T23:56:01.212434+0000","last_became_peered":"2024-03-17T23:56:01.212434+0000","last_unstale":"2024-03-17T23:56:02.855352+0000","last_undegraded":"2024-03-17T23:56:02.855352+0000","last_fullsized":"2024-03-17T23:56:02.855352+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T08:24:06.922044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"21'3","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:04.687323+0000","last_change":"2024-03-17T23:56:00.700634+0000","last_active":"2024-03-17T23:56:04.687323+0000","last_peered":"2024-03-17T23:56:04.687323+0000","last_clean":"2024-03-17T23:56:04.687323+0000","last_became_active":"2024-03-17T23:56:00.691617+0000","last_became_peered":"2024-03-17T23:56:00.691617+0000","last_unstale":"2024-03-17T23:56:04.687323+0000","last_undegraded":"2024-03-17T23:56:04.687323+0000","last_fullsized":"2024-03-17T23:56:04.687323+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_clean_scrub_stamp":"2024-03-17T23:55:59.626739+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T11:11:32.522234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:02.857916+0000","last_change":"2024-03-17T23:56:01.199855+0000","last_active":"2024-03-17T23:56:02.857916+0000","last_peered":"2024-03-17T23:56:02.857916+0000","last_clean":"2024-03-17T23:56:02.857916+0000","last_became_active":"2024-03-17T23:56:01.199121+0000","last_became_peered":"2024-03-17T23:56:01.199121+0000","last_unstale":"2024-03-17T23:56:02.857916+0000","last_undegraded":"2024-03-17T23:56:02.857916+0000","last_fullsized":"2024-03-17T23:56:02.857916+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T09:59:28.908069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"21'4","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:04.687727+0000","last_change":"2024-03-17T23:56:00.686560+0000","last_active":"2024-03-17T23:56:04.687727+0000","last_peered":"2024-03-17T23:56:04.687727+0000","last_clean":"2024-03-17T23:56:04.687727+0000","last_became_active":"2024-03-17T23:56:00.686215+0000","last_became_peered":"2024-03-17T23:56:00.686215+0000","last_unstale":"2024-03-17T23:56:04.687727+0000","last_undegraded":"2024-03-17T23:56:04.687727+0000","last_fullsized":"2024-03-17T23:56:04.687727+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_clean_scrub_stamp":"2024-03-17T23:55:59.626739+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T07:28:27.310340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:02.755813+0000","last_change":"2024-03-17T23:56:01.193197+0000","last_active":"2024-03-17T23:56:02.755813+0000","last_peered":"2024-03-17T23:56:02.755813+0000","last_clean":"2024-03-17T23:56:02.755813+0000","last_became_active":"2024-03-17T23:56:01.192117+0000","last_became_peered":"2024-03-17T23:56:01.192117+0000","last_unstale":"2024-03-17T23:56:02.755813+0000","last_undegraded":"2024-03-17T23:56:02.755813+0000","last_fullsized":"2024-03-17T23:56:02.755813+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T11:35:21.037222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"21'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:02.170320+0000","last_change":"2024-03-17T23:56:00.696254+0000","last_active":"2024-03-17T23:56:02.170320+0000","last_peered":"2024-03-17T23:56:02.170320+0000","last_clean":"2024-03-17T23:56:02.170320+0000","last_became_active":"2024-03-17T23:56:00.694605+0000","last_became_peered":"2024-03-17T23:56:00.694605+0000","last_unstale":"2024-03-17T23:56:02.170320+0000","last_undegraded":"2024-03-17T23:56:02.170320+0000","last_fullsized":"2024-03-17T23:56:02.170320+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_clean_scrub_stamp":"2024-03-17T23:55:59.626739+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T10:35:19.139554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:02.165616+0000","last_change":"2024-03-17T23:56:01.188278+0000","last_active":"2024-03-17T23:56:02.165616+0000","last_peered":"2024-03-17T23:56:02.165616+0000","last_clean":"2024-03-17T23:56:02.165616+0000","last_became_active":"2024-03-17T23:56:01.187571+0000","last_became_peered":"2024-03-17T23:56:01.187571+0000","last_unstale":"2024-03-17T23:56:02.165616+0000","last_undegraded":"2024-03-17T23:56:02.165616+0000","last_fullsized":"2024-03-17T23:56:02.165616+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T09:45:25.654063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:02.756107+0000","last_change":"2024-03-17T23:56:00.680290+0000","last_active":"2024-03-17T23:56:02.756107+0000","last_peered":"2024-03-17T23:56:02.756107+0000","last_clean":"2024-03-17T23:56:02.756107+0000","last_became_active":"2024-03-17T23:56:00.679981+0000","last_became_peered":"2024-03-17T23:56:00.679981+0000","last_unstale":"2024-03-17T23:56:02.756107+0000","last_undegraded":"2024-03-17T23:56:02.756107+0000","last_fullsized":"2024-03-17T23:56:02.756107+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_clean_scrub_stamp":"2024-03-17T23:55:59.626739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T10:35:19.139554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:02.170359+0000","last_change":"2024-03-17T23:56:01.216640+0000","last_active":"2024-03-17T23:56:02.170359+0000","last_peered":"2024-03-17T23:56:02.170359+0000","last_clean":"2024-03-17T23:56:02.170359+0000","last_became_active":"2024-03-17T23:56:01.216145+0000","last_became_peered":"2024-03-17T23:56:01.216145+0000","last_unstale":"2024-03-17T23:56:02.170359+0000","last_undegraded":"2024-03-17T23:56:02.170359+0000","last_fullsized":"2024-03-17T23:56:02.170359+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T11:01:47.143880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"21'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:02.163408+0000","last_change":"2024-03-17T23:56:00.692896+0000","last_active":"2024-03-17T23:56:02.163408+0000","last_peered":"2024-03-17T23:56:02.163408+0000","last_clean":"2024-03-17T23:56:02.163408+0000","last_became_active":"2024-03-17T23:56:00.692054+0000","last_became_peered":"2024-03-17T23:56:00.692054+0000","last_unstale":"2024-03-17T23:56:02.163408+0000","last_undegraded":"2024-03-17T23:56:02.163408+0000","last_fullsized":"2024-03-17T23:56:02.163408+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_clean_scrub_stamp":"2024-03-17T23:55:59.626739+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T10:55:17.061099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:02.756195+0000","last_change":"2024-03-17T23:56:01.189102+0000","last_active":"2024-03-17T23:56:02.756195+0000","last_peered":"2024-03-17T23:56:02.756195+0000","last_clean":"2024-03-17T23:56:02.756195+0000","last_became_active":"2024-03-17T23:56:01.188353+0000","last_became_peered":"2024-03-17T23:56:01.188353+0000","last_unstale":"2024-03-17T23:56:02.756195+0000","last_undegraded":"2024-03-17T23:56:02.756195+0000","last_fullsized":"2024-03-17T23:56:02.756195+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T00:26:55.287891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"21'3","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:04.686323+0000","last_change":"2024-03-17T23:56:00.689216+0000","last_active":"2024-03-17T23:56:04.686323+0000","last_peered":"2024-03-17T23:56:04.686323+0000","last_clean":"2024-03-17T23:56:04.686323+0000","last_became_active":"2024-03-17T23:56:00.688978+0000","last_became_peered":"2024-03-17T23:56:00.688978+0000","last_unstale":"2024-03-17T23:56:04.686323+0000","last_undegraded":"2024-03-17T23:56:04.686323+0000","last_fullsized":"2024-03-17T23:56:04.686323+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_clean_scrub_stamp":"2024-03-17T23:55:59.626739+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T09:57:49.282635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:02.856072+0000","last_change":"2024-03-17T23:56:01.212041+0000","last_active":"2024-03-17T23:56:02.856072+0000","last_peered":"2024-03-17T23:56:02.856072+0000","last_clean":"2024-03-17T23:56:02.856072+0000","last_became_active":"2024-03-17T23:56:01.211359+0000","last_became_peered":"2024-03-17T23:56:01.211359+0000","last_unstale":"2024-03-17T23:56:02.856072+0000","last_undegraded":"2024-03-17T23:56:02.856072+0000","last_fullsized":"2024-03-17T23:56:02.856072+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T11:08:21.695552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"21'4","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:03.684293+0000","last_change":"2024-03-17T23:56:00.686768+0000","last_active":"2024-03-17T23:56:03.684293+0000","last_peered":"2024-03-17T23:56:03.684293+0000","last_clean":"2024-03-17T23:56:03.684293+0000","last_became_active":"2024-03-17T23:56:00.685461+0000","last_became_peered":"2024-03-17T23:56:00.685461+0000","last_unstale":"2024-03-17T23:56:03.684293+0000","last_undegraded":"2024-03-17T23:56:03.684293+0000","last_fullsized":"2024-03-17T23:56:03.684293+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_clean_scrub_stamp":"2024-03-17T23:55:59.626739+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T05:52:39.451210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:02.858191+0000","last_change":"2024-03-17T23:56:01.196364+0000","last_active":"2024-03-17T23:56:02.858191+0000","last_peered":"2024-03-17T23:56:02.858191+0000","last_clean":"2024-03-17T23:56:02.858191+0000","last_became_active":"2024-03-17T23:56:01.191450+0000","last_became_peered":"2024-03-17T23:56:01.191450+0000","last_unstale":"2024-03-17T23:56:02.858191+0000","last_undegraded":"2024-03-17T23:56:02.858191+0000","last_fullsized":"2024-03-17T23:56:02.858191+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T02:15:18.353466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"21'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:03.681131+0000","last_change":"2024-03-17T23:56:00.691812+0000","last_active":"2024-03-17T23:56:03.681131+0000","last_peered":"2024-03-17T23:56:03.681131+0000","last_clean":"2024-03-17T23:56:03.681131+0000","last_became_active":"2024-03-17T23:56:00.691381+0000","last_became_peered":"2024-03-17T23:56:00.691381+0000","last_unstale":"2024-03-17T23:56:03.681131+0000","last_undegraded":"2024-03-17T23:56:03.681131+0000","last_fullsized":"2024-03-17T23:56:03.681131+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_clean_scrub_stamp":"2024-03-17T23:55:59.626739+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T10:35:19.139554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:02.165033+0000","last_change":"2024-03-17T23:56:01.195278+0000","last_active":"2024-03-17T23:56:02.165033+0000","last_peered":"2024-03-17T23:56:02.165033+0000","last_clean":"2024-03-17T23:56:02.165033+0000","last_became_active":"2024-03-17T23:56:01.192316+0000","last_became_peered":"2024-03-17T23:56:01.192316+0000","last_unstale":"2024-03-17T23:56:02.165033+0000","last_undegraded":"2024-03-17T23:56:02.165033+0000","last_fullsized":"2024-03-17T23:56:02.165033+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T04:07:27.260081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"21'3","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:03.680520+0000","last_change":"2024-03-17T23:56:00.703680+0000","last_active":"2024-03-17T23:56:03.680520+0000","last_peered":"2024-03-17T23:56:03.680520+0000","last_clean":"2024-03-17T23:56:03.680520+0000","last_became_active":"2024-03-17T23:56:00.703439+0000","last_became_peered":"2024-03-17T23:56:00.703439+0000","last_unstale":"2024-03-17T23:56:03.680520+0000","last_undegraded":"2024-03-17T23:56:03.680520+0000","last_fullsized":"2024-03-17T23:56:03.680520+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_clean_scrub_stamp":"2024-03-17T23:55:59.626739+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T11:11:32.522234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:02.855387+0000","last_change":"2024-03-17T23:56:01.191678+0000","last_active":"2024-03-17T23:56:02.855387+0000","last_peered":"2024-03-17T23:56:02.855387+0000","last_clean":"2024-03-17T23:56:02.855387+0000","last_became_active":"2024-03-17T23:56:01.190681+0000","last_became_peered":"2024-03-17T23:56:01.190681+0000","last_unstale":"2024-03-17T23:56:02.855387+0000","last_undegraded":"2024-03-17T23:56:02.855387+0000","last_fullsized":"2024-03-17T23:56:02.855387+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T02:46:13.650384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"21'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:02.756012+0000","last_change":"2024-03-17T23:56:00.679281+0000","last_active":"2024-03-17T23:56:02.756012+0000","last_peered":"2024-03-17T23:56:02.756012+0000","last_clean":"2024-03-17T23:56:02.756012+0000","last_became_active":"2024-03-17T23:56:00.678950+0000","last_became_peered":"2024-03-17T23:56:00.678950+0000","last_unstale":"2024-03-17T23:56:02.756012+0000","last_undegraded":"2024-03-17T23:56:02.756012+0000","last_fullsized":"2024-03-17T23:56:02.756012+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_clean_scrub_stamp":"2024-03-17T23:55:59.626739+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T05:52:39.451210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:02.855656+0000","last_change":"2024-03-17T23:56:01.215539+0000","last_active":"2024-03-17T23:56:02.855656+0000","last_peered":"2024-03-17T23:56:02.855656+0000","last_clean":"2024-03-17T23:56:02.855656+0000","last_became_active":"2024-03-17T23:56:01.211163+0000","last_became_peered":"2024-03-17T23:56:01.211163+0000","last_unstale":"2024-03-17T23:56:02.855656+0000","last_undegraded":"2024-03-17T23:56:02.855656+0000","last_fullsized":"2024-03-17T23:56:02.855656+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T11:40:55.653472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"21'4","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:03.679557+0000","last_change":"2024-03-17T23:56:00.692384+0000","last_active":"2024-03-17T23:56:03.679557+0000","last_peered":"2024-03-17T23:56:03.679557+0000","last_clean":"2024-03-17T23:56:03.679557+0000","last_became_active":"2024-03-17T23:56:00.684178+0000","last_became_peered":"2024-03-17T23:56:00.684178+0000","last_unstale":"2024-03-17T23:56:03.679557+0000","last_undegraded":"2024-03-17T23:56:03.679557+0000","last_fullsized":"2024-03-17T23:56:03.679557+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_clean_scrub_stamp":"2024-03-17T23:55:59.626739+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T09:45:24.650866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:02.855803+0000","last_change":"2024-03-17T23:56:01.193547+0000","last_active":"2024-03-17T23:56:02.855803+0000","last_peered":"2024-03-17T23:56:02.855803+0000","last_clean":"2024-03-17T23:56:02.855803+0000","last_became_active":"2024-03-17T23:56:01.192775+0000","last_became_peered":"2024-03-17T23:56:01.192775+0000","last_unstale":"2024-03-17T23:56:02.855803+0000","last_undegraded":"2024-03-17T23:56:02.855803+0000","last_fullsized":"2024-03-17T23:56:02.855803+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T02:15:18.353466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:02.170196+0000","last_change":"2024-03-17T23:56:01.178436+0000","last_active":"2024-03-17T23:56:02.170196+0000","last_peered":"2024-03-17T23:56:02.170196+0000","last_clean":"2024-03-17T23:56:02.170196+0000","last_became_active":"2024-03-17T23:56:01.177533+0000","last_became_peered":"2024-03-17T23:56:01.177533+0000","last_unstale":"2024-03-17T23:56:02.170196+0000","last_undegraded":"2024-03-17T23:56:02.170196+0000","last_fullsized":"2024-03-17T23:56:02.170196+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T03:18:40.457769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:02.162605+0000","last_change":"2024-03-17T23:56:00.691483+0000","last_active":"2024-03-17T23:56:02.162605+0000","last_peered":"2024-03-17T23:56:02.162605+0000","last_clean":"2024-03-17T23:56:02.162605+0000","last_became_active":"2024-03-17T23:56:00.684714+0000","last_became_peered":"2024-03-17T23:56:00.684714+0000","last_unstale":"2024-03-17T23:56:02.162605+0000","last_undegraded":"2024-03-17T23:56:02.162605+0000","last_fullsized":"2024-03-17T23:56:02.162605+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_clean_scrub_stamp":"2024-03-17T23:55:59.626739+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T09:57:49.282635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:02.169948+0000","last_change":"2024-03-17T23:56:01.194350+0000","last_active":"2024-03-17T23:56:02.169948+0000","last_peered":"2024-03-17T23:56:02.169948+0000","last_clean":"2024-03-17T23:56:02.169948+0000","last_became_active":"2024-03-17T23:56:01.193625+0000","last_became_peered":"2024-03-17T23:56:01.193625+0000","last_unstale":"2024-03-17T23:56:02.169948+0000","last_undegraded":"2024-03-17T23:56:02.169948+0000","last_fullsized":"2024-03-17T23:56:02.169948+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T11:08:21.695552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"21'4","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:04.688429+0000","last_change":"2024-03-17T23:56:00.699785+0000","last_active":"2024-03-17T23:56:04.688429+0000","last_peered":"2024-03-17T23:56:04.688429+0000","last_clean":"2024-03-17T23:56:04.688429+0000","last_became_active":"2024-03-17T23:56:00.699049+0000","last_became_peered":"2024-03-17T23:56:00.699049+0000","last_unstale":"2024-03-17T23:56:04.688429+0000","last_undegraded":"2024-03-17T23:56:04.688429+0000","last_fullsized":"2024-03-17T23:56:04.688429+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_clean_scrub_stamp":"2024-03-17T23:55:59.626739+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T01:56:01.336865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:02.858502+0000","last_change":"2024-03-17T23:56:01.208117+0000","last_active":"2024-03-17T23:56:02.858502+0000","last_peered":"2024-03-17T23:56:02.858502+0000","last_clean":"2024-03-17T23:56:02.858502+0000","last_became_active":"2024-03-17T23:56:01.207342+0000","last_became_peered":"2024-03-17T23:56:01.207342+0000","last_unstale":"2024-03-17T23:56:02.858502+0000","last_undegraded":"2024-03-17T23:56:02.858502+0000","last_fullsized":"2024-03-17T23:56:02.858502+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T08:24:06.922044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"21'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:02.855982+0000","last_change":"2024-03-17T23:56:00.691595+0000","last_active":"2024-03-17T23:56:02.855982+0000","last_peered":"2024-03-17T23:56:02.855982+0000","last_clean":"2024-03-17T23:56:02.855982+0000","last_became_active":"2024-03-17T23:56:00.690892+0000","last_became_peered":"2024-03-17T23:56:00.690892+0000","last_unstale":"2024-03-17T23:56:02.855982+0000","last_undegraded":"2024-03-17T23:56:02.855982+0000","last_fullsized":"2024-03-17T23:56:02.855982+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_clean_scrub_stamp":"2024-03-17T23:55:59.626739+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T07:28:27.310340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:02.855919+0000","last_change":"2024-03-17T23:56:01.212430+0000","last_active":"2024-03-17T23:56:02.855919+0000","last_peered":"2024-03-17T23:56:02.855919+0000","last_clean":"2024-03-17T23:56:02.855919+0000","last_became_active":"2024-03-17T23:56:01.204930+0000","last_became_peered":"2024-03-17T23:56:01.204930+0000","last_unstale":"2024-03-17T23:56:02.855919+0000","last_undegraded":"2024-03-17T23:56:02.855919+0000","last_fullsized":"2024-03-17T23:56:02.855919+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T04:45:41.506781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"21'9","reported_seq":23,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:04.690385+0000","last_change":"2024-03-17T23:56:00.682405+0000","last_active":"2024-03-17T23:56:04.690385+0000","last_peered":"2024-03-17T23:56:04.690385+0000","last_clean":"2024-03-17T23:56:04.690385+0000","last_became_active":"2024-03-17T23:56:00.681938+0000","last_became_peered":"2024-03-17T23:56:00.681938+0000","last_unstale":"2024-03-17T23:56:04.690385+0000","last_undegraded":"2024-03-17T23:56:04.690385+0000","last_fullsized":"2024-03-17T23:56:04.690385+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_clean_scrub_stamp":"2024-03-17T23:55:59.626739+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T07:03:16.148691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":5222,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":124,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":39,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":163840,"data_stored":10444,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":108,"ondisk_log_size":108,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66348,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574852,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":303104,"data_stored":667289,"data_compressed":33174,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574852,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":233472,"data_stored":77307,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574851,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":229376,"data_stored":76367,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":229376,"data_stored":75731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":241664,"data_stored":77929,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574853,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":75605,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574852,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":233472,"data_stored":76437,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574851,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":299008,"data_stored":666633,"data_compressed":33174,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33174,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33174,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2324,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":714,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1378,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2290,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-17T23:56:07.032 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-03-17T23:56:07.032 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-03-17T23:56:07.032 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-03-17T23:56:07.032 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-03-17T23:56:07.032 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-03-17T23:56:07.178 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:07.176+0000 7ff1501de640 1 Processor -- start 2024-03-17T23:56:07.178 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:07.176+0000 7ff1501de640 1 -- start start 2024-03-17T23:56:07.179 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:07.176+0000 7ff1501de640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7ff14806e440 0x7ff14806f9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:07.180 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:07.176+0000 7ff1501de640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7ff14806e820 0x7ff14815d360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:07.180 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:07.176+0000 7ff1501de640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff1480c7910 con 0x7ff1480706f0 2024-03-17T23:56:07.180 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:07.176+0000 7ff1501de640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7ff148070130 con 0x7ff14806e440 2024-03-17T23:56:07.180 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:07.176+0000 7ff1501de640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 -- 0x7ff148070410 con 0x7ff14806e820 2024-03-17T23:56:07.180 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:07.176+0000 7ff14df7a640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7ff14806e440 0x7ff14806f9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:07.180 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:07.176+0000 7ff14e77b640 1 --1- >> v1:172.21.15.196:6789/0 conn(0x7ff1480706f0 0x7ff148153b90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.196:6789/0 says I am v1:172.21.15.196:50364/0 (socket says 172.21.15.196:50364) 2024-03-17T23:56:07.180 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:07.176+0000 7ff14e77b640 1 -- 172.21.15.196:0/3561245613 learned_addr learned my addr 172.21.15.196:0/3561245613 (peer_addr_for_me v1:172.21.15.196:0/0) 2024-03-17T23:56:07.180 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:07.176+0000 7ff14d779640 1 --2- 172.21.15.196:0/3561245613 >> v2:172.21.15.204:3300/0 conn(0x7ff14806e820 0x7ff14815d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:07.180 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:07.176+0000 7ff14df7a640 1 -- 172.21.15.196:0/3561245613 >> v2:172.21.15.204:3300/0 conn(0x7ff14806e820 msgr2=0x7ff14815d360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-17T23:56:07.180 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:07.176+0000 7ff14df7a640 1 --2- 172.21.15.196:0/3561245613 >> v2:172.21.15.204:3300/0 conn(0x7ff14806e820 0x7ff14815d360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:07.180 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:07.176+0000 7ff14df7a640 1 -- 172.21.15.196:0/3561245613 >> v1:172.21.15.196:6789/0 conn(0x7ff1480706f0 legacy=0x7ff148153b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:07.180 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:07.176+0000 7ff14cf78640 1 -- 172.21.15.196:0/3561245613 <== mon.0 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 979665846 0 0) 0x7ff1480c7910 con 0x7ff1480706f0 2024-03-17T23:56:07.180 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:07.176+0000 7ff14df7a640 1 -- 172.21.15.196:0/3561245613 --> v2:172.21.15.196:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1480c7bb0 con 0x7ff14806e440 2024-03-17T23:56:07.182 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:07.180+0000 7ff14df7a640 1 --2- 172.21.15.196:0/3561245613 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff14806e440 0x7ff14806f9f0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7ff148157a00 tx=0x7ff14401ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c3efb5744d380f4 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:56:07.182 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:07.180+0000 7ff14cf78640 1 -- 172.21.15.196:0/3561245613 <== mon.0 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1440b5070 con 0x7ff14806e440 2024-03-17T23:56:07.182 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:07.180+0000 7ff14cf78640 1 -- 172.21.15.196:0/3561245613 <== mon.0 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff1440a8970 con 0x7ff14806e440 2024-03-17T23:56:07.182 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:07.180+0000 7ff14cf78640 1 -- 172.21.15.196:0/3561245613 <== mon.0 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1440a8d40 con 0x7ff14806e440 2024-03-17T23:56:07.183 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:07.180+0000 7ff1501de640 1 -- 172.21.15.196:0/3561245613 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff14806e440 msgr2=0x7ff14806f9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:07.183 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:07.180+0000 7ff1501de640 1 --2- 172.21.15.196:0/3561245613 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff14806e440 0x7ff14806f9f0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7ff148157a00 tx=0x7ff14401ec70 comp rx=0 tx=0).stop 2024-03-17T23:56:07.183 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:07.180+0000 7ff1501de640 1 -- 172.21.15.196:0/3561245613 shutdown_connections 2024-03-17T23:56:07.183 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:07.180+0000 7ff1501de640 1 --2- 172.21.15.196:0/3561245613 >> v2:172.21.15.204:3300/0 conn(0x7ff14806e820 0x7ff14815d360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:07.183 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:07.180+0000 7ff1501de640 1 --2- 172.21.15.196:0/3561245613 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff14806e440 0x7ff14806f9f0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:07.183 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:07.180+0000 7ff1501de640 1 -- 172.21.15.196:0/3561245613 >> 172.21.15.196:0/3561245613 conn(0x7ff14806c590 msgr2=0x7ff14806c9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-17T23:56:07.183 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:07.180+0000 7ff1501de640 1 -- 172.21.15.196:0/3561245613 shutdown_connections 2024-03-17T23:56:07.183 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:07.180+0000 7ff1501de640 1 -- 172.21.15.196:0/3561245613 wait complete. 2024-03-17T23:56:07.184 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:07.184+0000 7ff1501de640 1 Processor -- start 2024-03-17T23:56:07.184 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:07.184+0000 7ff1501de640 1 -- start start 2024-03-17T23:56:07.187 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:07.184+0000 7ff1501de640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff14806e440 0x7ff1480bca20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:07.187 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:07.184+0000 7ff1501de640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff14806e820 0x7ff1480be6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:07.187 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:07.184+0000 7ff1501de640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff1480706f0 0x7ff1480c9010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:07.187 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:07.184+0000 7ff1501de640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7ff14815d8a0 con 0x7ff1480706f0 2024-03-17T23:56:07.187 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:07.184+0000 7ff1501de640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7ff1480c8170 con 0x7ff14806e440 2024-03-17T23:56:07.187 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:07.184+0000 7ff1501de640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7ff14815da20 con 0x7ff14806e820 2024-03-17T23:56:07.187 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:07.184+0000 7ff14e77b640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff1480706f0 0x7ff1480c9010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:07.187 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:07.184+0000 7ff14e77b640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff1480706f0 0x7ff1480c9010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.196:34434/0 (socket says 172.21.15.196:34434) 2024-03-17T23:56:07.187 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:07.184+0000 7ff14e77b640 1 -- 172.21.15.196:0/1582327065 learned_addr learned my addr 172.21.15.196:0/1582327065 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-03-17T23:56:07.187 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:07.184+0000 7ff14df7a640 1 --2- 172.21.15.196:0/1582327065 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff14806e440 0x7ff1480bca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:07.187 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:07.184+0000 7ff14d779640 1 --2- 172.21.15.196:0/1582327065 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff14806e820 0x7ff1480be6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:07.188 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:07.184+0000 7ff14e77b640 1 -- 172.21.15.196:0/1582327065 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff14806e820 msgr2=0x7ff1480be6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:07.188 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:07.184+0000 7ff14e77b640 1 --2- 172.21.15.196:0/1582327065 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff14806e820 0x7ff1480be6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:07.188 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:07.184+0000 7ff14e77b640 1 -- 172.21.15.196:0/1582327065 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff14806e440 msgr2=0x7ff1480bca20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:07.188 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:07.184+0000 7ff14e77b640 1 --2- 172.21.15.196:0/1582327065 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff14806e440 0x7ff1480bca20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:07.188 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:07.184+0000 7ff14e77b640 1 -- 172.21.15.196:0/1582327065 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1480bd080 con 0x7ff1480706f0 2024-03-17T23:56:07.188 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:07.184+0000 7ff14df7a640 1 --2- 172.21.15.196:0/1582327065 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff14806e440 0x7ff1480bca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-17T23:56:07.188 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:07.184+0000 7ff14e77b640 1 --2- 172.21.15.196:0/1582327065 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff1480706f0 0x7ff1480c9010 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7ff14000c780 tx=0x7ff14000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:56:07.188 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:07.184+0000 7ff13e7fc640 1 -- 172.21.15.196:0/1582327065 <== mon.0 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff140018070 con 0x7ff1480706f0 2024-03-17T23:56:07.188 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:07.184+0000 7ff13e7fc640 1 -- 172.21.15.196:0/1582327065 <== mon.0 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff14000a640 con 0x7ff1480706f0 2024-03-17T23:56:07.188 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:07.184+0000 7ff1501de640 1 -- 172.21.15.196:0/1582327065 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1480bd340 con 0x7ff1480706f0 2024-03-17T23:56:07.188 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:07.184+0000 7ff13e7fc640 1 -- 172.21.15.196:0/1582327065 <== mon.0 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff14000aa30 con 0x7ff1480706f0 2024-03-17T23:56:07.188 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:07.184+0000 7ff1501de640 1 -- 172.21.15.196:0/1582327065 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1480bd900 con 0x7ff1480706f0 2024-03-17T23:56:07.189 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:07.184+0000 7ff12bfff640 1 -- 172.21.15.196:0/1582327065 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff1240052a0 con 0x7ff1480706f0 2024-03-17T23:56:07.189 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:07.188+0000 7ff13e7fc640 1 -- 172.21.15.196:0/1582327065 <== mon.0 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 5) ==== 87083+0+0 (secure 0 0 0) 0x7ff14001b070 con 0x7ff1480706f0 2024-03-17T23:56:07.189 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:07.188+0000 7ff13e7fc640 1 --2- 172.21.15.196:0/1582327065 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7ff12c067660 0x7ff12c069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:07.189 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:07.188+0000 7ff13e7fc640 1 -- 172.21.15.196:0/1582327065 <== mon.0 v2:172.21.15.196:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7ff140085130 con 0x7ff1480706f0 2024-03-17T23:56:07.189 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:07.188+0000 7ff14df7a640 1 --2- 172.21.15.196:0/1582327065 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7ff12c067660 0x7ff12c069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:07.190 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:07.188+0000 7ff14df7a640 1 --2- 172.21.15.196:0/1582327065 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7ff12c067660 0x7ff12c069b20 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7ff1440b2000 tx=0x7ff144008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:56:07.196 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:07.192+0000 7ff13e7fc640 1 -- 172.21.15.196:0/1582327065 <== mon.0 v2:172.21.15.196:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177849 (secure 0 0 0) 0x7ff140055f20 con 0x7ff1480706f0 2024-03-17T23:56:07.403 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:07.400+0000 7ff12bfff640 1 -- 172.21.15.196:0/1582327065 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7ff124005860 con 0x7ff1480706f0 2024-03-17T23:56:07.408 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:07.404+0000 7ff13e7fc640 1 -- 172.21.15.196:0/1582327065 <== mon.0 v2:172.21.15.196:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) ==== 74+0+166532 (secure 0 0 0) 0x7ff140055820 con 0x7ff1480706f0 2024-03-17T23:56:07.410 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-03-17T23:56:07.411 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:07.408+0000 7ff12bfff640 1 -- 172.21.15.196:0/1582327065 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7ff12c067660 msgr2=0x7ff12c069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:07.411 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:07.408+0000 7ff12bfff640 1 --2- 172.21.15.196:0/1582327065 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7ff12c067660 0x7ff12c069b20 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7ff1440b2000 tx=0x7ff144008040 comp rx=0 tx=0).stop 2024-03-17T23:56:07.411 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:07.408+0000 7ff12bfff640 1 -- 172.21.15.196:0/1582327065 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff1480706f0 msgr2=0x7ff1480c9010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:07.411 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:07.408+0000 7ff12bfff640 1 --2- 172.21.15.196:0/1582327065 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff1480706f0 0x7ff1480c9010 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7ff14000c780 tx=0x7ff14000cc40 comp rx=0 tx=0).stop 2024-03-17T23:56:07.411 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:07.408+0000 7ff12bfff640 1 -- 172.21.15.196:0/1582327065 shutdown_connections 2024-03-17T23:56:07.412 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:07.408+0000 7ff12bfff640 1 --2- 172.21.15.196:0/1582327065 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7ff12c067660 0x7ff12c069b20 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:07.412 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:07.408+0000 7ff12bfff640 1 --2- 172.21.15.196:0/1582327065 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff14806e820 0x7ff1480be6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:07.412 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:07.408+0000 7ff12bfff640 1 --2- 172.21.15.196:0/1582327065 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff1480706f0 0x7ff1480c9010 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:07.412 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:07.408+0000 7ff12bfff640 1 --2- 172.21.15.196:0/1582327065 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff14806e440 0x7ff1480bca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:07.412 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:07.408+0000 7ff12bfff640 1 -- 172.21.15.196:0/1582327065 >> 172.21.15.196:0/1582327065 conn(0x7ff14806c590 msgr2=0x7ff14815d170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-17T23:56:07.412 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:07.408+0000 7ff12bfff640 1 -- 172.21.15.196:0/1582327065 shutdown_connections 2024-03-17T23:56:07.412 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:07.408+0000 7ff12bfff640 1 -- 172.21.15.196:0/1582327065 wait complete. 2024-03-17T23:56:07.426 INFO:teuthology.orchestra.run.smithi196.stdout:{"epoch":5,"flags":0,"active_gid":4099,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6832","nonce":2505201055},{"type":"v1","addr":"172.21.15.204:6833","nonce":2505201055}]},"active_addr":"172.21.15.204:6833/2505201055","active_change":"2024-03-17T23:55:47.943871+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":4107,"name":"y","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.0.0","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.0.0","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.204:0","nonce":1960682365}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.204:0","nonce":867173667}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.204:0","nonce":4292287384}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.204:0","nonce":923611097}]}]} 2024-03-17T23:56:07.429 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-03-17T23:56:07.429 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-03-17T23:56:07.429 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-17T23:56:07.531 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:07.528+0000 7f9f6fec9640 1 Processor -- start 2024-03-17T23:56:07.531 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:07.528+0000 7f9f6fec9640 1 -- start start 2024-03-17T23:56:07.532 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:07.528+0000 7f9f6fec9640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f9f6815a260 0x7f9f6815a660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:07.532 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:07.528+0000 7f9f6fec9640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9f68072430 0x7f9f680728c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:07.533 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:07.528+0000 7f9f6fec9640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9f68154620 con 0x7f9f68154240 2024-03-17T23:56:07.533 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:07.528+0000 7f9f6d464640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f9f6815a260 0x7f9f6815a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:07.533 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:07.528+0000 7f9f6d464640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f9f6815a260 0x7f9f6815a660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.196:34450/0 (socket says 172.21.15.196:34450) 2024-03-17T23:56:07.533 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:07.528+0000 7f9f6dc65640 1 --1- >> v1:172.21.15.196:6789/0 conn(0x7f9f68154240 0x7f9f6806fca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.196:6789/0 says I am v1:172.21.15.196:50370/0 (socket says 172.21.15.196:50370) 2024-03-17T23:56:07.533 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:07.528+0000 7f9f6d464640 1 -- 172.21.15.196:0/2276162688 learned_addr learned my addr 172.21.15.196:0/2276162688 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-03-17T23:56:07.533 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:07.528+0000 7f9f6fec9640 1 -- 172.21.15.196:0/2276162688 --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7f9f680c7830 con 0x7f9f6815a260 2024-03-17T23:56:07.533 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:07.528+0000 7f9f6fec9640 1 -- 172.21.15.196:0/2276162688 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f9f680c7b10 con 0x7f9f68072430 2024-03-17T23:56:07.533 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:07.532+0000 7f9f6e466640 1 --2- 172.21.15.196:0/2276162688 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9f68072430 0x7f9f680728c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:07.533 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:07.532+0000 7f9f6cc63640 1 -- 172.21.15.196:0/2276162688 <== mon.0 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4187883496 0 0) 0x7f9f64001120 con 0x7f9f68154240 2024-03-17T23:56:07.533 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:07.532+0000 7f9f6cc63640 1 -- 172.21.15.196:0/2276162688 --> v1:172.21.15.196:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9f54003530 con 0x7f9f68154240 2024-03-17T23:56:07.533 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:07.532+0000 7f9f6d464640 1 -- 172.21.15.196:0/2276162688 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9f68072430 msgr2=0x7f9f680728c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-17T23:56:07.533 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:07.532+0000 7f9f6d464640 1 --2- 172.21.15.196:0/2276162688 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9f68072430 0x7f9f680728c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:07.533 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:07.532+0000 7f9f6d464640 1 -- 172.21.15.196:0/2276162688 >> v1:172.21.15.196:6789/0 conn(0x7f9f68154240 legacy=0x7f9f6806fca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:07.535 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:07.532+0000 7f9f6d464640 1 -- 172.21.15.196:0/2276162688 --> v2:172.21.15.196:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f680c7df0 con 0x7f9f6815a260 2024-03-17T23:56:07.536 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:07.532+0000 7f9f6d464640 1 --2- 172.21.15.196:0/2276162688 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9f6815a260 0x7f9f6815a660 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f9f58009870 tx=0x7f9f5801ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4df4fb66e5a2490 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:56:07.536 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:07.532+0000 7f9f6cc63640 1 -- 172.21.15.196:0/2276162688 <== mon.0 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f580b5070 con 0x7f9f6815a260 2024-03-17T23:56:07.536 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:07.532+0000 7f9f6cc63640 1 -- 172.21.15.196:0/2276162688 <== mon.0 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9f580a8a50 con 0x7f9f6815a260 2024-03-17T23:56:07.536 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:07.532+0000 7f9f6cc63640 1 -- 172.21.15.196:0/2276162688 <== mon.0 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f580a8e20 con 0x7f9f6815a260 2024-03-17T23:56:07.537 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:07.536+0000 7f9f6fec9640 1 -- 172.21.15.196:0/2276162688 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9f6815a260 msgr2=0x7f9f6815a660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:07.537 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:07.536+0000 7f9f6fec9640 1 --2- 172.21.15.196:0/2276162688 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9f6815a260 0x7f9f6815a660 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f9f58009870 tx=0x7f9f5801ed50 comp rx=0 tx=0).stop 2024-03-17T23:56:07.537 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:07.536+0000 7f9f6fec9640 1 -- 172.21.15.196:0/2276162688 shutdown_connections 2024-03-17T23:56:07.537 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:07.536+0000 7f9f6fec9640 1 --2- 172.21.15.196:0/2276162688 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9f68072430 0x7f9f680728c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:07.537 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:07.536+0000 7f9f6fec9640 1 --2- 172.21.15.196:0/2276162688 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9f6815a260 0x7f9f6815a660 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:07.537 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:07.536+0000 7f9f6fec9640 1 -- 172.21.15.196:0/2276162688 >> 172.21.15.196:0/2276162688 conn(0x7f9f680cc420 msgr2=0x7f9f680cc830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-17T23:56:07.537 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:07.536+0000 7f9f6fec9640 1 -- 172.21.15.196:0/2276162688 shutdown_connections 2024-03-17T23:56:07.537 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:07.536+0000 7f9f6fec9640 1 -- 172.21.15.196:0/2276162688 wait complete. 2024-03-17T23:56:07.539 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:07.536+0000 7f9f6fec9640 1 Processor -- start 2024-03-17T23:56:07.540 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:07.536+0000 7f9f6fec9640 1 -- start start 2024-03-17T23:56:07.540 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:07.536+0000 7f9f6fec9640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9f68072430 0x7f9f681f2ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:07.540 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:07.536+0000 7f9f6fec9640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9f68154240 0x7f9f681f3400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:07.540 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:07.536+0000 7f9f6fec9640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9f6815a260 0x7f9f681484d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:07.540 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:07.536+0000 7f9f6fec9640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f9f680c8720 con 0x7f9f68072430 2024-03-17T23:56:07.540 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:07.536+0000 7f9f6fec9640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f9f680c83b0 con 0x7f9f68154240 2024-03-17T23:56:07.540 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:07.536+0000 7f9f6fec9640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f9f6815aba0 con 0x7f9f6815a260 2024-03-17T23:56:07.540 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:07.536+0000 7f9f6dc65640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9f68072430 0x7f9f681f2ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:07.540 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:07.536+0000 7f9f6dc65640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9f68072430 0x7f9f681f2ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.196:34466/0 (socket says 172.21.15.196:34466) 2024-03-17T23:56:07.540 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:07.536+0000 7f9f6dc65640 1 -- 172.21.15.196:0/2078199221 learned_addr learned my addr 172.21.15.196:0/2078199221 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-03-17T23:56:07.540 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:07.536+0000 7f9f6d464640 1 --2- 172.21.15.196:0/2078199221 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9f68154240 0x7f9f681f3400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:07.540 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:07.536+0000 7f9f6e466640 1 --2- 172.21.15.196:0/2078199221 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9f6815a260 0x7f9f681484d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:07.540 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:07.536+0000 7f9f6dc65640 1 -- 172.21.15.196:0/2078199221 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9f6815a260 msgr2=0x7f9f681484d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:07.541 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:07.536+0000 7f9f6dc65640 1 --2- 172.21.15.196:0/2078199221 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9f6815a260 0x7f9f681484d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:07.541 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:07.536+0000 7f9f6dc65640 1 -- 172.21.15.196:0/2078199221 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9f68154240 msgr2=0x7f9f681f3400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:07.541 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:07.536+0000 7f9f6dc65640 1 --2- 172.21.15.196:0/2078199221 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9f68154240 0x7f9f681f3400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:07.541 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:07.536+0000 7f9f6dc65640 1 -- 172.21.15.196:0/2078199221 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f680c5130 con 0x7f9f68072430 2024-03-17T23:56:07.541 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:07.536+0000 7f9f6d464640 1 --2- 172.21.15.196:0/2078199221 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9f68154240 0x7f9f681f3400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-17T23:56:07.541 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:07.536+0000 7f9f6dc65640 1 --2- 172.21.15.196:0/2078199221 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9f68072430 0x7f9f681f2ec0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f9f6400c760 tx=0x7f9f6400cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:56:07.541 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:07.536+0000 7f9f5e7fc640 1 -- 172.21.15.196:0/2078199221 <== mon.0 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f64018070 con 0x7f9f68072430 2024-03-17T23:56:07.541 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:07.536+0000 7f9f5e7fc640 1 -- 172.21.15.196:0/2078199221 <== mon.0 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9f64007070 con 0x7f9f68072430 2024-03-17T23:56:07.541 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:07.536+0000 7f9f6fec9640 1 -- 172.21.15.196:0/2078199221 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9f680c5410 con 0x7f9f68072430 2024-03-17T23:56:07.541 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:07.536+0000 7f9f5e7fc640 1 -- 172.21.15.196:0/2078199221 <== mon.0 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f64007460 con 0x7f9f68072430 2024-03-17T23:56:07.541 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:07.536+0000 7f9f6fec9640 1 -- 172.21.15.196:0/2078199221 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9f680c59d0 con 0x7f9f68072430 2024-03-17T23:56:07.542 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:07.540+0000 7f9f6fec9640 1 -- 172.21.15.196:0/2078199221 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9f680689a0 con 0x7f9f68072430 2024-03-17T23:56:07.542 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:07.540+0000 7f9f5e7fc640 1 -- 172.21.15.196:0/2078199221 <== mon.0 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 5) ==== 87083+0+0 (secure 0 0 0) 0x7f9f6401b070 con 0x7f9f68072430 2024-03-17T23:56:07.542 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:07.540+0000 7f9f5e7fc640 1 --2- 172.21.15.196:0/2078199221 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f9f4c067660 0x7f9f4c069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:07.542 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:07.540+0000 7f9f5e7fc640 1 -- 172.21.15.196:0/2078199221 <== mon.0 v2:172.21.15.196:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f9f64084c70 con 0x7f9f68072430 2024-03-17T23:56:07.542 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:07.540+0000 7f9f6d464640 1 --2- 172.21.15.196:0/2078199221 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f9f4c067660 0x7f9f4c069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:07.543 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:07.540+0000 7f9f6d464640 1 --2- 172.21.15.196:0/2078199221 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f9f4c067660 0x7f9f4c069b20 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f9f580b2000 tx=0x7f9f580aa070 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:56:07.550 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:07.548+0000 7f9f5e7fc640 1 -- 172.21.15.196:0/2078199221 <== mon.0 v2:172.21.15.196:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177849 (secure 0 0 0) 0x7f9f68154620 con 0x7f9f68072430 2024-03-17T23:56:07.708 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:07.708+0000 7f9f6fec9640 1 -- 172.21.15.196:0/2078199221 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9f6806fa80 con 0x7f9f68072430 2024-03-17T23:56:07.709 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:07.708+0000 7f9f5e7fc640 1 -- 172.21.15.196:0/2078199221 <== mon.0 v2:172.21.15.196:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16641 (secure 0 0 0) 0x7f9f64055860 con 0x7f9f68072430 2024-03-17T23:56:07.709 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-03-17T23:56:07.709 INFO:teuthology.orchestra.run.smithi196.stdout:{"epoch":21,"fsid":"b80f9c80-17ad-4126-8957-4c0c46f5b803","created":"2024-03-17T23:55:43.368838+0000","modified":"2024-03-17T23:56:02.157128+0000","last_up_change":"2024-03-17T23:55:54.132187+0000","last_in_change":"2024-03-17T23:55:46.016435+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-17T23:55:56.030640+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-17T23:55:58.658234+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-17T23:56:00.003208+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"224d699f-bc10-4661-a8b5-6ca73290ffa0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6806","nonce":1194547591},{"type":"v1","addr":"172.21.15.196:6807","nonce":1194547591}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6809","nonce":1194547591},{"type":"v1","addr":"172.21.15.196:6811","nonce":1194547591}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6814","nonce":1194547591},{"type":"v1","addr":"172.21.15.196:6815","nonce":1194547591}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6812","nonce":1194547591},{"type":"v1","addr":"172.21.15.196:6813","nonce":1194547591}]},"public_addr":"172.21.15.196:6807/1194547591","cluster_addr":"172.21.15.196:6811/1194547591","heartbeat_back_addr":"172.21.15.196:6815/1194547591","heartbeat_front_addr":"172.21.15.196:6813/1194547591","state":["exists","up"]},{"osd":1,"uuid":"d8d6a0b0-450b-4ab5-b143-d4f36286e81e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6800","nonce":1901246986},{"type":"v1","addr":"172.21.15.196:6801","nonce":1901246986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6802","nonce":1901246986},{"type":"v1","addr":"172.21.15.196:6803","nonce":1901246986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6808","nonce":1901246986},{"type":"v1","addr":"172.21.15.196:6810","nonce":1901246986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6804","nonce":1901246986},{"type":"v1","addr":"172.21.15.196:6805","nonce":1901246986}]},"public_addr":"172.21.15.196:6801/1901246986","cluster_addr":"172.21.15.196:6803/1901246986","heartbeat_back_addr":"172.21.15.196:6810/1901246986","heartbeat_front_addr":"172.21.15.196:6805/1901246986","state":["exists","up"]},{"osd":2,"uuid":"d732ba94-1db0-41ed-930a-5abb6188980a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6824","nonce":673819559},{"type":"v1","addr":"172.21.15.196:6825","nonce":673819559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6826","nonce":673819559},{"type":"v1","addr":"172.21.15.196:6827","nonce":673819559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6830","nonce":673819559},{"type":"v1","addr":"172.21.15.196:6831","nonce":673819559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6828","nonce":673819559},{"type":"v1","addr":"172.21.15.196:6829","nonce":673819559}]},"public_addr":"172.21.15.196:6825/673819559","cluster_addr":"172.21.15.196:6827/673819559","heartbeat_back_addr":"172.21.15.196:6831/673819559","heartbeat_front_addr":"172.21.15.196:6829/673819559","state":["exists","up"]},{"osd":3,"uuid":"b79cab98-a49f-4544-b6b0-546dcfbd47a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6816","nonce":1104340623},{"type":"v1","addr":"172.21.15.196:6817","nonce":1104340623}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6818","nonce":1104340623},{"type":"v1","addr":"172.21.15.196:6819","nonce":1104340623}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6822","nonce":1104340623},{"type":"v1","addr":"172.21.15.196:6823","nonce":1104340623}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6820","nonce":1104340623},{"type":"v1","addr":"172.21.15.196:6821","nonce":1104340623}]},"public_addr":"172.21.15.196:6817/1104340623","cluster_addr":"172.21.15.196:6819/1104340623","heartbeat_back_addr":"172.21.15.196:6823/1104340623","heartbeat_front_addr":"172.21.15.196:6821/1104340623","state":["exists","up"]},{"osd":4,"uuid":"d5892856-6eb4-4188-beb0-368f64169af1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6816","nonce":658561863},{"type":"v1","addr":"172.21.15.204:6818","nonce":658561863}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6819","nonce":658561863},{"type":"v1","addr":"172.21.15.204:6821","nonce":658561863}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6826","nonce":658561863},{"type":"v1","addr":"172.21.15.204:6828","nonce":658561863}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6823","nonce":658561863},{"type":"v1","addr":"172.21.15.204:6825","nonce":658561863}]},"public_addr":"172.21.15.204:6818/658561863","cluster_addr":"172.21.15.204:6821/658561863","heartbeat_back_addr":"172.21.15.204:6828/658561863","heartbeat_front_addr":"172.21.15.204:6825/658561863","state":["exists","up"]},{"osd":5,"uuid":"89d6b48d-aa8a-4cb8-aa2e-e0aae04928b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6817","nonce":3367327749},{"type":"v1","addr":"172.21.15.204:6820","nonce":3367327749}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6822","nonce":3367327749},{"type":"v1","addr":"172.21.15.204:6824","nonce":3367327749}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6830","nonce":3367327749},{"type":"v1","addr":"172.21.15.204:6831","nonce":3367327749}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6827","nonce":3367327749},{"type":"v1","addr":"172.21.15.204:6829","nonce":3367327749}]},"public_addr":"172.21.15.204:6820/3367327749","cluster_addr":"172.21.15.204:6824/3367327749","heartbeat_back_addr":"172.21.15.204:6831/3367327749","heartbeat_front_addr":"172.21.15.204:6829/3367327749","state":["exists","up"]},{"osd":6,"uuid":"ff7d0949-2836-42a6-a63d-bc5a4269e080","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6805","nonce":2586742078},{"type":"v1","addr":"172.21.15.204:6807","nonce":2586742078}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6809","nonce":2586742078},{"type":"v1","addr":"172.21.15.204:6811","nonce":2586742078}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6814","nonce":2586742078},{"type":"v1","addr":"172.21.15.204:6815","nonce":2586742078}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6812","nonce":2586742078},{"type":"v1","addr":"172.21.15.204:6813","nonce":2586742078}]},"public_addr":"172.21.15.204:6807/2586742078","cluster_addr":"172.21.15.204:6811/2586742078","heartbeat_back_addr":"172.21.15.204:6815/2586742078","heartbeat_front_addr":"172.21.15.204:6813/2586742078","state":["exists","up"]},{"osd":7,"uuid":"42bcc14b-70b3-4c59-bf81-41436e4eb272","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6800","nonce":3361860686},{"type":"v1","addr":"172.21.15.204:6801","nonce":3361860686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6802","nonce":3361860686},{"type":"v1","addr":"172.21.15.204:6803","nonce":3361860686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6808","nonce":3361860686},{"type":"v1","addr":"172.21.15.204:6810","nonce":3361860686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6804","nonce":3361860686},{"type":"v1","addr":"172.21.15.204:6806","nonce":3361860686}]},"public_addr":"172.21.15.204:6801/3361860686","cluster_addr":"172.21.15.204:6803/3361860686","heartbeat_back_addr":"172.21.15.204:6810/3361860686","heartbeat_front_addr":"172.21.15.204:6806/3361860686","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-17T23:55:51.372683+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-17T23:55:51.466291+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-17T23:55:51.608084+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-17T23:55:51.680819+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-17T23:55:51.528198+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-17T23:55:51.537065+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-17T23:55:51.558146+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-17T23:55:51.382540+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-17T23:56:07.712 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:07.708+0000 7f9f6fec9640 1 -- 172.21.15.196:0/2078199221 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f9f4c067660 msgr2=0x7f9f4c069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:07.712 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:07.708+0000 7f9f6fec9640 1 --2- 172.21.15.196:0/2078199221 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f9f4c067660 0x7f9f4c069b20 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f9f580b2000 tx=0x7f9f580aa070 comp rx=0 tx=0).stop 2024-03-17T23:56:07.712 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:07.708+0000 7f9f6fec9640 1 -- 172.21.15.196:0/2078199221 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9f68072430 msgr2=0x7f9f681f2ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:07.712 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:07.708+0000 7f9f6fec9640 1 --2- 172.21.15.196:0/2078199221 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9f68072430 0x7f9f681f2ec0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f9f6400c760 tx=0x7f9f6400cc20 comp rx=0 tx=0).stop 2024-03-17T23:56:07.712 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:07.708+0000 7f9f6fec9640 1 -- 172.21.15.196:0/2078199221 shutdown_connections 2024-03-17T23:56:07.712 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:07.708+0000 7f9f6fec9640 1 --2- 172.21.15.196:0/2078199221 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f9f4c067660 0x7f9f4c069b20 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:07.712 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:07.708+0000 7f9f6fec9640 1 --2- 172.21.15.196:0/2078199221 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9f6815a260 0x7f9f681484d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:07.712 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:07.708+0000 7f9f6fec9640 1 --2- 172.21.15.196:0/2078199221 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9f68154240 0x7f9f681f3400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:07.712 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:07.708+0000 7f9f6fec9640 1 --2- 172.21.15.196:0/2078199221 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9f68072430 0x7f9f681f2ec0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:07.712 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:07.708+0000 7f9f6fec9640 1 -- 172.21.15.196:0/2078199221 >> 172.21.15.196:0/2078199221 conn(0x7f9f680cc420 msgr2=0x7f9f68151e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-17T23:56:07.712 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:07.708+0000 7f9f6fec9640 1 -- 172.21.15.196:0/2078199221 shutdown_connections 2024-03-17T23:56:07.712 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:07.708+0000 7f9f6fec9640 1 -- 172.21.15.196:0/2078199221 wait complete. 2024-03-17T23:56:07.726 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-03-17T23:56:07.727 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-17T23:56:07.828 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:07.824+0000 7f3b6e045640 1 Processor -- start 2024-03-17T23:56:07.828 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:07.824+0000 7f3b6e045640 1 -- start start 2024-03-17T23:56:07.829 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:07.828+0000 7f3b6e045640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f3b680c6fe0 0x7f3b6806fb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:07.829 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:07.828+0000 7f3b6e045640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3b680c74b0 con 0x7f3b6806be30 2024-03-17T23:56:07.830 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:07.828+0000 7f3b6e045640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3b68070420 con 0x7f3b68151d00 2024-03-17T23:56:07.830 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:07.828+0000 7f3b6e045640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7f3b68070700 con 0x7f3b680c6fe0 2024-03-17T23:56:07.830 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:07.828+0000 7f3b66ffd640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f3b680c6fe0 0x7f3b6806fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:07.830 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:07.828+0000 7f3b67fff640 1 --1- >> v1:172.21.15.196:6789/0 conn(0x7f3b6806be30 0x7f3b68157f20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.196:6789/0 says I am v1:172.21.15.196:50382/0 (socket says 172.21.15.196:50382) 2024-03-17T23:56:07.830 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:07.828+0000 7f3b67fff640 1 -- 172.21.15.196:0/3319022036 learned_addr learned my addr 172.21.15.196:0/3319022036 (peer_addr_for_me v1:172.21.15.196:0/0) 2024-03-17T23:56:07.830 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:07.828+0000 7f3b66ffd640 1 -- 172.21.15.196:0/3319022036 >> v1:172.21.15.204:6789/0 conn(0x7f3b68151d00 legacy=0x7f3b680c5cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:07.830 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:07.828+0000 7f3b66ffd640 1 -- 172.21.15.196:0/3319022036 >> v1:172.21.15.196:6789/0 conn(0x7f3b6806be30 legacy=0x7f3b68157f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:07.830 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:07.828+0000 7f3b66ffd640 1 -- 172.21.15.196:0/3319022036 --> v2:172.21.15.196:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b680709e0 con 0x7f3b680c6fe0 2024-03-17T23:56:07.831 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:07.828+0000 7f3b667fc640 1 -- 172.21.15.196:0/3319022036 <== mon.0 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2727851760 0 0) 0x7f3b680c74b0 con 0x7f3b6806be30 2024-03-17T23:56:07.832 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:07.832+0000 7f3b66ffd640 1 --2- 172.21.15.196:0/3319022036 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3b680c6fe0 0x7f3b6806fb80 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f3b5c0097f0 tx=0x7f3b5c01c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb188d35255dff12 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:56:07.833 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:07.832+0000 7f3b667fc640 1 -- 172.21.15.196:0/3319022036 <== mon.0 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b5c0b1070 con 0x7f3b680c6fe0 2024-03-17T23:56:07.833 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:07.832+0000 7f3b667fc640 1 -- 172.21.15.196:0/3319022036 <== mon.0 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b5c0ac410 con 0x7f3b680c6fe0 2024-03-17T23:56:07.833 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:07.832+0000 7f3b667fc640 1 -- 172.21.15.196:0/3319022036 <== mon.0 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b5c0ac7e0 con 0x7f3b680c6fe0 2024-03-17T23:56:07.833 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:07.832+0000 7f3b6e045640 1 -- 172.21.15.196:0/3319022036 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3b680c6fe0 msgr2=0x7f3b6806fb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:07.833 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:07.832+0000 7f3b6e045640 1 --2- 172.21.15.196:0/3319022036 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3b680c6fe0 0x7f3b6806fb80 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f3b5c0097f0 tx=0x7f3b5c01c4a0 comp rx=0 tx=0).stop 2024-03-17T23:56:07.834 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:07.832+0000 7f3b6e045640 1 -- 172.21.15.196:0/3319022036 shutdown_connections 2024-03-17T23:56:07.834 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:07.832+0000 7f3b6e045640 1 --2- 172.21.15.196:0/3319022036 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3b680c6fe0 0x7f3b6806fb80 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:07.834 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:07.832+0000 7f3b6e045640 1 -- 172.21.15.196:0/3319022036 >> 172.21.15.196:0/3319022036 conn(0x7f3b6806c3c0 msgr2=0x7f3b6806c7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-17T23:56:07.834 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:07.832+0000 7f3b6e045640 1 -- 172.21.15.196:0/3319022036 shutdown_connections 2024-03-17T23:56:07.834 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:07.832+0000 7f3b6e045640 1 -- 172.21.15.196:0/3319022036 wait complete. 2024-03-17T23:56:07.835 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:07.832+0000 7f3b6e045640 1 Processor -- start 2024-03-17T23:56:07.835 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:07.832+0000 7f3b6e045640 1 -- start start 2024-03-17T23:56:07.837 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:07.836+0000 7f3b6e045640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3b6806be30 0x7f3b680cba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:07.837 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:07.836+0000 7f3b6e045640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3b680c6fe0 0x7f3b68145980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:07.837 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:07.836+0000 7f3b6e045640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3b68151d00 0x7f3b6813d000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:07.837 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:07.836+0000 7f3b6e045640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f3b68165e70 con 0x7f3b6806be30 2024-03-17T23:56:07.837 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:07.836+0000 7f3b6e045640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f3b68165cf0 con 0x7f3b680c6fe0 2024-03-17T23:56:07.837 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:07.836+0000 7f3b6e045640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f3b68165ff0 con 0x7f3b68151d00 2024-03-17T23:56:07.837 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:07.836+0000 7f3b677fe640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3b6806be30 0x7f3b680cba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:07.838 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:07.836+0000 7f3b677fe640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3b6806be30 0x7f3b680cba70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.196:34498/0 (socket says 172.21.15.196:34498) 2024-03-17T23:56:07.838 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:07.836+0000 7f3b677fe640 1 -- 172.21.15.196:0/1229513044 learned_addr learned my addr 172.21.15.196:0/1229513044 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-03-17T23:56:07.838 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:07.836+0000 7f3b66ffd640 1 --2- 172.21.15.196:0/1229513044 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3b680c6fe0 0x7f3b68145980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:07.838 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:07.836+0000 7f3b67fff640 1 --2- 172.21.15.196:0/1229513044 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3b68151d00 0x7f3b6813d000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:07.838 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:07.836+0000 7f3b677fe640 1 -- 172.21.15.196:0/1229513044 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3b68151d00 msgr2=0x7f3b6813d000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:07.838 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:07.836+0000 7f3b677fe640 1 --2- 172.21.15.196:0/1229513044 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3b68151d00 0x7f3b6813d000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:07.838 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:07.836+0000 7f3b677fe640 1 -- 172.21.15.196:0/1229513044 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3b680c6fe0 msgr2=0x7f3b68145980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:07.838 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:07.836+0000 7f3b677fe640 1 --2- 172.21.15.196:0/1229513044 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3b680c6fe0 0x7f3b68145980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:07.838 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:07.836+0000 7f3b677fe640 1 -- 172.21.15.196:0/1229513044 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b681476a0 con 0x7f3b6806be30 2024-03-17T23:56:07.838 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:07.836+0000 7f3b67fff640 1 --2- 172.21.15.196:0/1229513044 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3b68151d00 0x7f3b6813d000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-17T23:56:07.838 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:07.836+0000 7f3b677fe640 1 --2- 172.21.15.196:0/1229513044 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3b6806be30 0x7f3b680cba70 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f3b58001e50 tx=0x7f3b58001e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:56:07.838 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:07.836+0000 7f3b4ffff640 1 -- 172.21.15.196:0/1229513044 <== mon.0 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b580052d0 con 0x7f3b6806be30 2024-03-17T23:56:07.838 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:07.836+0000 7f3b4ffff640 1 -- 172.21.15.196:0/1229513044 <== mon.0 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b58005470 con 0x7f3b6806be30 2024-03-17T23:56:07.838 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:07.836+0000 7f3b6e045640 1 -- 172.21.15.196:0/1229513044 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b68147980 con 0x7f3b6806be30 2024-03-17T23:56:07.839 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:07.836+0000 7f3b4ffff640 1 -- 172.21.15.196:0/1229513044 <== mon.0 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b58011ad0 con 0x7f3b6806be30 2024-03-17T23:56:07.839 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:07.836+0000 7f3b6e045640 1 -- 172.21.15.196:0/1229513044 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b68145180 con 0x7f3b6806be30 2024-03-17T23:56:07.840 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:07.836+0000 7f3b6e045640 1 -- 172.21.15.196:0/1229513044 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3b680689a0 con 0x7f3b6806be30 2024-03-17T23:56:07.840 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:07.836+0000 7f3b4ffff640 1 -- 172.21.15.196:0/1229513044 <== mon.0 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 5) ==== 87083+0+0 (secure 0 0 0) 0x7f3b58011c70 con 0x7f3b6806be30 2024-03-17T23:56:07.840 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:07.836+0000 7f3b4ffff640 1 --2- 172.21.15.196:0/1229513044 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f3b54067660 0x7f3b54069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:07.840 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:07.836+0000 7f3b4ffff640 1 -- 172.21.15.196:0/1229513044 <== mon.0 v2:172.21.15.196:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f3b58089370 con 0x7f3b6806be30 2024-03-17T23:56:07.840 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:07.836+0000 7f3b66ffd640 1 --2- 172.21.15.196:0/1229513044 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f3b54067660 0x7f3b54069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:07.840 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:07.840+0000 7f3b66ffd640 1 --2- 172.21.15.196:0/1229513044 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f3b54067660 0x7f3b54069b20 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f3b5c0ae000 tx=0x7f3b5c008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:56:07.844 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:07.840+0000 7f3b4ffff640 1 -- 172.21.15.196:0/1229513044 <== mon.0 v2:172.21.15.196:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177849 (secure 0 0 0) 0x7f3b5805a080 con 0x7f3b6806be30 2024-03-17T23:56:07.999 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:07.996+0000 7f3b6e045640 1 -- 172.21.15.196:0/1229513044 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f3b68158ac0 con 0x7f3b6806be30 2024-03-17T23:56:08.000 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:07.996+0000 7f3b4ffff640 1 -- 172.21.15.196:0/1229513044 <== mon.0 v2:172.21.15.196:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16641 (secure 0 0 0) 0x7f3b58059980 con 0x7f3b6806be30 2024-03-17T23:56:08.000 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-03-17T23:56:08.000 INFO:teuthology.orchestra.run.smithi196.stdout:{"epoch":21,"fsid":"b80f9c80-17ad-4126-8957-4c0c46f5b803","created":"2024-03-17T23:55:43.368838+0000","modified":"2024-03-17T23:56:02.157128+0000","last_up_change":"2024-03-17T23:55:54.132187+0000","last_in_change":"2024-03-17T23:55:46.016435+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-17T23:55:56.030640+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-17T23:55:58.658234+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-17T23:56:00.003208+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"224d699f-bc10-4661-a8b5-6ca73290ffa0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6806","nonce":1194547591},{"type":"v1","addr":"172.21.15.196:6807","nonce":1194547591}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6809","nonce":1194547591},{"type":"v1","addr":"172.21.15.196:6811","nonce":1194547591}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6814","nonce":1194547591},{"type":"v1","addr":"172.21.15.196:6815","nonce":1194547591}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6812","nonce":1194547591},{"type":"v1","addr":"172.21.15.196:6813","nonce":1194547591}]},"public_addr":"172.21.15.196:6807/1194547591","cluster_addr":"172.21.15.196:6811/1194547591","heartbeat_back_addr":"172.21.15.196:6815/1194547591","heartbeat_front_addr":"172.21.15.196:6813/1194547591","state":["exists","up"]},{"osd":1,"uuid":"d8d6a0b0-450b-4ab5-b143-d4f36286e81e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6800","nonce":1901246986},{"type":"v1","addr":"172.21.15.196:6801","nonce":1901246986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6802","nonce":1901246986},{"type":"v1","addr":"172.21.15.196:6803","nonce":1901246986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6808","nonce":1901246986},{"type":"v1","addr":"172.21.15.196:6810","nonce":1901246986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6804","nonce":1901246986},{"type":"v1","addr":"172.21.15.196:6805","nonce":1901246986}]},"public_addr":"172.21.15.196:6801/1901246986","cluster_addr":"172.21.15.196:6803/1901246986","heartbeat_back_addr":"172.21.15.196:6810/1901246986","heartbeat_front_addr":"172.21.15.196:6805/1901246986","state":["exists","up"]},{"osd":2,"uuid":"d732ba94-1db0-41ed-930a-5abb6188980a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6824","nonce":673819559},{"type":"v1","addr":"172.21.15.196:6825","nonce":673819559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6826","nonce":673819559},{"type":"v1","addr":"172.21.15.196:6827","nonce":673819559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6830","nonce":673819559},{"type":"v1","addr":"172.21.15.196:6831","nonce":673819559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6828","nonce":673819559},{"type":"v1","addr":"172.21.15.196:6829","nonce":673819559}]},"public_addr":"172.21.15.196:6825/673819559","cluster_addr":"172.21.15.196:6827/673819559","heartbeat_back_addr":"172.21.15.196:6831/673819559","heartbeat_front_addr":"172.21.15.196:6829/673819559","state":["exists","up"]},{"osd":3,"uuid":"b79cab98-a49f-4544-b6b0-546dcfbd47a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6816","nonce":1104340623},{"type":"v1","addr":"172.21.15.196:6817","nonce":1104340623}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6818","nonce":1104340623},{"type":"v1","addr":"172.21.15.196:6819","nonce":1104340623}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6822","nonce":1104340623},{"type":"v1","addr":"172.21.15.196:6823","nonce":1104340623}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6820","nonce":1104340623},{"type":"v1","addr":"172.21.15.196:6821","nonce":1104340623}]},"public_addr":"172.21.15.196:6817/1104340623","cluster_addr":"172.21.15.196:6819/1104340623","heartbeat_back_addr":"172.21.15.196:6823/1104340623","heartbeat_front_addr":"172.21.15.196:6821/1104340623","state":["exists","up"]},{"osd":4,"uuid":"d5892856-6eb4-4188-beb0-368f64169af1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6816","nonce":658561863},{"type":"v1","addr":"172.21.15.204:6818","nonce":658561863}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6819","nonce":658561863},{"type":"v1","addr":"172.21.15.204:6821","nonce":658561863}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6826","nonce":658561863},{"type":"v1","addr":"172.21.15.204:6828","nonce":658561863}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6823","nonce":658561863},{"type":"v1","addr":"172.21.15.204:6825","nonce":658561863}]},"public_addr":"172.21.15.204:6818/658561863","cluster_addr":"172.21.15.204:6821/658561863","heartbeat_back_addr":"172.21.15.204:6828/658561863","heartbeat_front_addr":"172.21.15.204:6825/658561863","state":["exists","up"]},{"osd":5,"uuid":"89d6b48d-aa8a-4cb8-aa2e-e0aae04928b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6817","nonce":3367327749},{"type":"v1","addr":"172.21.15.204:6820","nonce":3367327749}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6822","nonce":3367327749},{"type":"v1","addr":"172.21.15.204:6824","nonce":3367327749}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6830","nonce":3367327749},{"type":"v1","addr":"172.21.15.204:6831","nonce":3367327749}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6827","nonce":3367327749},{"type":"v1","addr":"172.21.15.204:6829","nonce":3367327749}]},"public_addr":"172.21.15.204:6820/3367327749","cluster_addr":"172.21.15.204:6824/3367327749","heartbeat_back_addr":"172.21.15.204:6831/3367327749","heartbeat_front_addr":"172.21.15.204:6829/3367327749","state":["exists","up"]},{"osd":6,"uuid":"ff7d0949-2836-42a6-a63d-bc5a4269e080","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6805","nonce":2586742078},{"type":"v1","addr":"172.21.15.204:6807","nonce":2586742078}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6809","nonce":2586742078},{"type":"v1","addr":"172.21.15.204:6811","nonce":2586742078}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6814","nonce":2586742078},{"type":"v1","addr":"172.21.15.204:6815","nonce":2586742078}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6812","nonce":2586742078},{"type":"v1","addr":"172.21.15.204:6813","nonce":2586742078}]},"public_addr":"172.21.15.204:6807/2586742078","cluster_addr":"172.21.15.204:6811/2586742078","heartbeat_back_addr":"172.21.15.204:6815/2586742078","heartbeat_front_addr":"172.21.15.204:6813/2586742078","state":["exists","up"]},{"osd":7,"uuid":"42bcc14b-70b3-4c59-bf81-41436e4eb272","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6800","nonce":3361860686},{"type":"v1","addr":"172.21.15.204:6801","nonce":3361860686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6802","nonce":3361860686},{"type":"v1","addr":"172.21.15.204:6803","nonce":3361860686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6808","nonce":3361860686},{"type":"v1","addr":"172.21.15.204:6810","nonce":3361860686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6804","nonce":3361860686},{"type":"v1","addr":"172.21.15.204:6806","nonce":3361860686}]},"public_addr":"172.21.15.204:6801/3361860686","cluster_addr":"172.21.15.204:6803/3361860686","heartbeat_back_addr":"172.21.15.204:6810/3361860686","heartbeat_front_addr":"172.21.15.204:6806/3361860686","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-17T23:55:51.372683+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-17T23:55:51.466291+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-17T23:55:51.608084+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-17T23:55:51.680819+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-17T23:55:51.528198+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-17T23:55:51.537065+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-17T23:55:51.558146+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-17T23:55:51.382540+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-17T23:56:08.003 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.000+0000 7f3b6e045640 1 -- 172.21.15.196:0/1229513044 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f3b54067660 msgr2=0x7f3b54069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:08.003 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.000+0000 7f3b6e045640 1 --2- 172.21.15.196:0/1229513044 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f3b54067660 0x7f3b54069b20 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f3b5c0ae000 tx=0x7f3b5c008040 comp rx=0 tx=0).stop 2024-03-17T23:56:08.003 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.000+0000 7f3b6e045640 1 -- 172.21.15.196:0/1229513044 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3b6806be30 msgr2=0x7f3b680cba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:08.003 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.000+0000 7f3b6e045640 1 --2- 172.21.15.196:0/1229513044 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3b6806be30 0x7f3b680cba70 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f3b58001e50 tx=0x7f3b58001e80 comp rx=0 tx=0).stop 2024-03-17T23:56:08.003 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.000+0000 7f3b6e045640 1 -- 172.21.15.196:0/1229513044 shutdown_connections 2024-03-17T23:56:08.003 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.000+0000 7f3b6e045640 1 --2- 172.21.15.196:0/1229513044 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f3b54067660 0x7f3b54069b20 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:08.003 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.000+0000 7f3b6e045640 1 --2- 172.21.15.196:0/1229513044 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3b68151d00 0x7f3b6813d000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:08.003 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.000+0000 7f3b6e045640 1 --2- 172.21.15.196:0/1229513044 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3b680c6fe0 0x7f3b68145980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:08.003 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.000+0000 7f3b6e045640 1 --2- 172.21.15.196:0/1229513044 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3b6806be30 0x7f3b680cba70 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:08.004 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.000+0000 7f3b6e045640 1 -- 172.21.15.196:0/1229513044 >> 172.21.15.196:0/1229513044 conn(0x7f3b6806c3c0 msgr2=0x7f3b68157e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-17T23:56:08.004 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.000+0000 7f3b6e045640 1 -- 172.21.15.196:0/1229513044 shutdown_connections 2024-03-17T23:56:08.004 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.000+0000 7f3b6e045640 1 -- 172.21.15.196:0/1229513044 wait complete. 2024-03-17T23:56:08.022 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-03-17T23:56:08.022 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-03-17T23:56:08.023 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-03-17T23:56:08.024 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-03-17T23:56:08.025 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-03-17T23:56:08.025 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-03-17T23:56:08.026 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-03-17T23:56:08.026 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-03-17T23:56:08.208 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.208+0000 7f8b48721640 1 Processor -- start 2024-03-17T23:56:08.210 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.208+0000 7f8b48721640 1 -- start start 2024-03-17T23:56:08.211 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.208+0000 7f8b48721640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8b4014fe60 0x7f8b40156710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:08.211 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.208+0000 7f8b48721640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f8b400734b0 0x7f8b40071630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:08.211 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.208+0000 7f8b48721640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f8b400c70c0 0x7f8b4006c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:08.211 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.208+0000 7f8b48721640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7f8b400c5d40 con 0x7f8b400734b0 2024-03-17T23:56:08.211 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.208+0000 7f8b48721640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 -- 0x7f8b400c6020 con 0x7f8b400c70c0 2024-03-17T23:56:08.211 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.208+0000 7f8b48721640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f8b400c6300 con 0x7f8b4014fe60 2024-03-17T23:56:08.211 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.208+0000 7f8b45cbc640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f8b400734b0 0x7f8b40071630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:08.211 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.208+0000 7f8b45cbc640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f8b400734b0 0x7f8b40071630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.196:34500/0 (socket says 172.21.15.196:34500) 2024-03-17T23:56:08.211 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.208+0000 7f8b45cbc640 1 -- 172.21.15.196:0/2044901203 learned_addr learned my addr 172.21.15.196:0/2044901203 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-03-17T23:56:08.211 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.208+0000 7f8b464bd640 1 --2- 172.21.15.196:0/2044901203 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8b4014fe60 0x7f8b40156710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:08.211 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.208+0000 7f8b46cbe640 1 --2- 172.21.15.196:0/2044901203 >> v2:172.21.15.204:3300/0 conn(0x7f8b400c70c0 0x7f8b4006c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:08.211 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.208+0000 7f8b45cbc640 1 -- 172.21.15.196:0/2044901203 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8b4014fe60 msgr2=0x7f8b40156710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-17T23:56:08.212 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.208+0000 7f8b45cbc640 1 --2- 172.21.15.196:0/2044901203 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8b4014fe60 0x7f8b40156710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:08.212 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.208+0000 7f8b45cbc640 1 -- 172.21.15.196:0/2044901203 >> v2:172.21.15.204:3300/0 conn(0x7f8b400c70c0 msgr2=0x7f8b4006c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-17T23:56:08.212 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.208+0000 7f8b45cbc640 1 --2- 172.21.15.196:0/2044901203 >> v2:172.21.15.204:3300/0 conn(0x7f8b400c70c0 0x7f8b4006c6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:08.212 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.208+0000 7f8b45cbc640 1 -- 172.21.15.196:0/2044901203 --> v2:172.21.15.196:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b400c65e0 con 0x7f8b400734b0 2024-03-17T23:56:08.213 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.212+0000 7f8b46cbe640 1 --2- 172.21.15.196:0/2044901203 >> v2:172.21.15.204:3300/0 conn(0x7f8b400c70c0 0x7f8b4006c6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-17T23:56:08.214 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.212+0000 7f8b464bd640 1 --2- 172.21.15.196:0/2044901203 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8b4014fe60 0x7f8b40156710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-17T23:56:08.214 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.212+0000 7f8b45cbc640 1 --2- 172.21.15.196:0/2044901203 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8b400734b0 0x7f8b40071630 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f8b4006d440 tx=0x7f8b3c01f5e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=edd35567e3ceae26 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:56:08.216 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.216+0000 7f8b454bb640 1 -- 172.21.15.196:0/2044901203 <== mon.0 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b3c0b4070 con 0x7f8b400734b0 2024-03-17T23:56:08.216 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.216+0000 7f8b454bb640 1 -- 172.21.15.196:0/2044901203 <== mon.0 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b3c0af600 con 0x7f8b400734b0 2024-03-17T23:56:08.217 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.216+0000 7f8b454bb640 1 -- 172.21.15.196:0/2044901203 <== mon.0 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b3c0afa10 con 0x7f8b400734b0 2024-03-17T23:56:08.217 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.216+0000 7f8b48721640 1 -- 172.21.15.196:0/2044901203 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8b400734b0 msgr2=0x7f8b40071630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:08.217 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.216+0000 7f8b48721640 1 --2- 172.21.15.196:0/2044901203 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8b400734b0 0x7f8b40071630 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f8b4006d440 tx=0x7f8b3c01f5e0 comp rx=0 tx=0).stop 2024-03-17T23:56:08.217 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.216+0000 7f8b48721640 1 -- 172.21.15.196:0/2044901203 shutdown_connections 2024-03-17T23:56:08.218 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.216+0000 7f8b48721640 1 --2- 172.21.15.196:0/2044901203 >> v2:172.21.15.204:3300/0 conn(0x7f8b400c70c0 0x7f8b4006c6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:08.218 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.216+0000 7f8b48721640 1 --2- 172.21.15.196:0/2044901203 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8b400734b0 0x7f8b40071630 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:08.218 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.216+0000 7f8b48721640 1 --2- 172.21.15.196:0/2044901203 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8b4014fe60 0x7f8b40156710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:08.218 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.216+0000 7f8b48721640 1 -- 172.21.15.196:0/2044901203 >> 172.21.15.196:0/2044901203 conn(0x7f8b400c7da0 msgr2=0x7f8b400c81b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-17T23:56:08.224 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.224+0000 7f8b48721640 1 -- 172.21.15.196:0/2044901203 shutdown_connections 2024-03-17T23:56:08.224 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.224+0000 7f8b48721640 1 -- 172.21.15.196:0/2044901203 wait complete. 2024-03-17T23:56:08.226 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.224+0000 7f8b48721640 1 Processor -- start 2024-03-17T23:56:08.226 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.224+0000 7f8b48721640 1 -- start start 2024-03-17T23:56:08.227 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.224+0000 7f8b48721640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8b400c70c0 0x7f8b401405c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:08.227 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.224+0000 7f8b48721640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8b4014fe60 0x7f8b40144710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:08.227 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.224+0000 7f8b48721640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8b40146440 0x7f8b4013ed80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:08.228 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.224+0000 7f8b48721640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f8b40071b70 con 0x7f8b4014fe60 2024-03-17T23:56:08.228 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.224+0000 7f8b48721640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f8b400c6ba0 con 0x7f8b40146440 2024-03-17T23:56:08.228 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.224+0000 7f8b48721640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f8b40150240 con 0x7f8b400c70c0 2024-03-17T23:56:08.228 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.224+0000 7f8b464bd640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8b400c70c0 0x7f8b401405c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:08.228 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.224+0000 7f8b46cbe640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8b40146440 0x7f8b4013ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:08.228 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.224+0000 7f8b464bd640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8b400c70c0 0x7f8b401405c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3301/0 says I am v2:172.21.15.196:48232/0 (socket says 172.21.15.196:48232) 2024-03-17T23:56:08.229 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.224+0000 7f8b464bd640 1 -- 172.21.15.196:0/1656464825 learned_addr learned my addr 172.21.15.196:0/1656464825 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-03-17T23:56:08.229 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.224+0000 7f8b45cbc640 1 --2- 172.21.15.196:0/1656464825 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8b4014fe60 0x7f8b40144710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:08.229 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.228+0000 7f8b46cbe640 1 -- 172.21.15.196:0/1656464825 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8b400c70c0 msgr2=0x7f8b401405c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:08.229 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.228+0000 7f8b46cbe640 1 --2- 172.21.15.196:0/1656464825 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8b400c70c0 0x7f8b401405c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:08.229 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.228+0000 7f8b46cbe640 1 -- 172.21.15.196:0/1656464825 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8b4014fe60 msgr2=0x7f8b40144710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:08.229 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.228+0000 7f8b46cbe640 1 --2- 172.21.15.196:0/1656464825 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8b4014fe60 0x7f8b40144710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:08.229 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.228+0000 7f8b46cbe640 1 -- 172.21.15.196:0/1656464825 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b400ca600 con 0x7f8b40146440 2024-03-17T23:56:08.229 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.228+0000 7f8b46cbe640 1 --2- 172.21.15.196:0/1656464825 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8b40146440 0x7f8b4013ed80 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f8b3800cdc0 tx=0x7f8b3800a710 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:56:08.232 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.232+0000 7fdca1d66640 1 Processor -- start 2024-03-17T23:56:08.232 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.232+0000 7fcacb6ad640 1 Processor -- start 2024-03-17T23:56:08.234 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.232+0000 7fdca1d66640 1 -- start start 2024-03-17T23:56:08.234 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.232+0000 7fdca1d66640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fdc9c0c6ee0 0x7fdc9c0c82d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:08.234 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.232+0000 7fdca1d66640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdc9c155f40 con 0x7fdc9c071ec0 2024-03-17T23:56:08.234 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.232+0000 7fdca1d66640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdc9c156220 con 0x7fdc9c14fe00 2024-03-17T23:56:08.234 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.232+0000 7fdca1d66640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7fdc9c156500 con 0x7fdc9c0c6ee0 2024-03-17T23:56:08.235 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.232+0000 7fcacb6ad640 1 -- start start 2024-03-17T23:56:08.235 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.232+0000 7fcacb6ad640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fcac40c7fc0 0x7fcac4070e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:08.235 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.232+0000 7fcacb6ad640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fcac40c43c0 0x7fcac4071340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:08.235 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.232+0000 7fcacb6ad640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcac415e1a0 con 0x7fcac4158410 2024-03-17T23:56:08.235 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.232+0000 7fcacb6ad640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7fcac40ca440 con 0x7fcac40c7fc0 2024-03-17T23:56:08.235 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.232+0000 7fcacb6ad640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7fcac40ca6e0 con 0x7fcac40c43c0 2024-03-17T23:56:08.235 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.232+0000 7fcac8c48640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fcac40c7fc0 0x7fcac4070e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:08.235 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.232+0000 7fcac8c48640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fcac40c7fc0 0x7fcac4070e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.196:34510/0 (socket says 172.21.15.196:34510) 2024-03-17T23:56:08.235 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.232+0000 7fcac8c48640 1 -- 172.21.15.196:0/2891391110 learned_addr learned my addr 172.21.15.196:0/2891391110 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-03-17T23:56:08.236 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.232+0000 7fdc9bfff640 1 --1- >> v1:172.21.15.196:6789/0 conn(0x7fdc9c071ec0 0x7fdc9c0c67d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.196:6789/0 says I am v1:172.21.15.196:50398/0 (socket says 172.21.15.196:50398) 2024-03-17T23:56:08.236 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.232+0000 7fdc9bfff640 1 -- 172.21.15.196:0/3581923531 learned_addr learned my addr 172.21.15.196:0/3581923531 (peer_addr_for_me v1:172.21.15.196:0/0) 2024-03-17T23:56:08.236 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.232+0000 7fdca1565640 1 --2- 172.21.15.196:0/3581923531 >> v2:172.21.15.196:3300/0 conn(0x7fdc9c0c6ee0 0x7fdc9c0c82d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:08.236 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.232+0000 7f8b36ffd640 1 -- 172.21.15.196:0/1656464825 <== mon.1 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b3801a070 con 0x7f8b40146440 2024-03-17T23:56:08.236 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.232+0000 7fcac9c4a640 1 --2- 172.21.15.196:0/2891391110 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fcac40c43c0 0x7fcac4071340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:08.237 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.232+0000 7f8b48721640 1 -- 172.21.15.196:0/1656464825 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b401561a0 con 0x7f8b40146440 2024-03-17T23:56:08.237 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.232+0000 7f8b48721640 1 -- 172.21.15.196:0/1656464825 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b400c9b50 con 0x7f8b40146440 2024-03-17T23:56:08.237 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.232+0000 7fcac8c48640 1 -- 172.21.15.196:0/2891391110 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fcac40c43c0 msgr2=0x7fcac4071340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-17T23:56:08.237 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.232+0000 7fcac8c48640 1 --2- 172.21.15.196:0/2891391110 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fcac40c43c0 0x7fcac4071340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:08.237 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.232+0000 7fcac8c48640 1 -- 172.21.15.196:0/2891391110 >> v1:172.21.15.196:6789/0 conn(0x7fcac4158410 legacy=0x7fcac4161710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-17T23:56:08.238 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.232+0000 7f8b36ffd640 1 -- 172.21.15.196:0/1656464825 <== mon.1 v2:172.21.15.204:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b3800d880 con 0x7f8b40146440 2024-03-17T23:56:08.238 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.232+0000 7fcac8c48640 1 -- 172.21.15.196:0/2891391110 --> v2:172.21.15.196:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcac415e420 con 0x7fcac40c7fc0 2024-03-17T23:56:08.238 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.232+0000 7f8b36ffd640 1 -- 172.21.15.196:0/1656464825 <== mon.1 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b3800dc70 con 0x7f8b40146440 2024-03-17T23:56:08.238 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.232+0000 7fdca1565640 1 -- 172.21.15.196:0/3581923531 >> v1:172.21.15.204:6789/0 conn(0x7fdc9c14fe00 legacy=0x7fdc9c0cb4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-17T23:56:08.239 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.232+0000 7fdca1565640 1 -- 172.21.15.196:0/3581923531 >> v1:172.21.15.196:6789/0 conn(0x7fdc9c071ec0 legacy=0x7fdc9c0c67d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:08.239 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.232+0000 7fdca1565640 1 -- 172.21.15.196:0/3581923531 --> v2:172.21.15.196:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc9c1567e0 con 0x7fdc9c0c6ee0 2024-03-17T23:56:08.239 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.236+0000 7fcac8c48640 1 --2- 172.21.15.196:0/2891391110 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcac40c7fc0 0x7fcac4070e00 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fcab4009870 tx=0x7fcab401c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b4dee62e5844156 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:56:08.239 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.236+0000 7fdca1565640 1 --2- 172.21.15.196:0/3581923531 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fdc9c0c6ee0 0x7fdc9c0c82d0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fdc9400be90 tx=0x7fdc94021240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d909f1bc5396c51b server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:56:08.240 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.236+0000 7fcdef0cb640 1 Processor -- start 2024-03-17T23:56:08.241 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.240+0000 7fdc9b7fe640 1 -- 172.21.15.196:0/3581923531 <== mon.0 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc940b8070 con 0x7fdc9c0c6ee0 2024-03-17T23:56:08.241 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.240+0000 7fdc9b7fe640 1 -- 172.21.15.196:0/3581923531 <== mon.0 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc940b3410 con 0x7fdc9c0c6ee0 2024-03-17T23:56:08.241 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.240+0000 7f8b36ffd640 1 -- 172.21.15.196:0/1656464825 <== mon.1 v2:172.21.15.204:3300/0 4 ==== mgrmap(e 5) ==== 87083+0+0 (secure 0 0 0) 0x7f8b3801d070 con 0x7f8b40146440 2024-03-17T23:56:08.242 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.236+0000 7fcdef0cb640 1 -- start start 2024-03-17T23:56:08.242 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.236+0000 7fcdef0cb640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fcde8158550 0x7fcde8071120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:08.242 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.240+0000 7f8b36ffd640 1 --2- 172.21.15.196:0/1656464825 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f8b24067760 0x7f8b24069c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:08.242 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.240+0000 7f8b36ffd640 1 -- 172.21.15.196:0/1656464825 <== mon.1 v2:172.21.15.204:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f8b38085e90 con 0x7f8b40146440 2024-03-17T23:56:08.242 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.240+0000 7f8b464bd640 1 --2- 172.21.15.196:0/1656464825 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f8b24067760 0x7f8b24069c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:08.243 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.240+0000 7f8b464bd640 1 --2- 172.21.15.196:0/1656464825 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f8b24067760 0x7f8b24069c20 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f8b30006fd0 tx=0x7f8b30008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:56:08.244 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.244+0000 7fdc9b7fe640 1 -- 172.21.15.196:0/3581923531 <== mon.0 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc940b3820 con 0x7fdc9c0c6ee0 2024-03-17T23:56:08.245 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.236+0000 7fcdef0cb640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fcde815f010 0x7fcde806b2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:08.245 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.236+0000 7fcdef0cb640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcde806e900 con 0x7fcde806b7f0 2024-03-17T23:56:08.245 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.236+0000 7fcdef0cb640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 -- 0x7fcde806ebe0 con 0x7fcde815f010 2024-03-17T23:56:08.245 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.236+0000 7fcdef0cb640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7fcde806eec0 con 0x7fcde8158550 2024-03-17T23:56:08.245 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.240+0000 7fcdee0c9640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fcde8158550 0x7fcde8071120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:08.245 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.240+0000 7fcdee0c9640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fcde8158550 0x7fcde8071120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3301/0 says I am v2:172.21.15.196:48252/0 (socket says 172.21.15.196:48252) 2024-03-17T23:56:08.245 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.240+0000 7fcdee0c9640 1 -- 172.21.15.196:0/4236028651 learned_addr learned my addr 172.21.15.196:0/4236028651 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-03-17T23:56:08.245 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.240+0000 7fcdee0c9640 1 -- 172.21.15.196:0/4236028651 >> v2:172.21.15.204:3300/0 conn(0x7fcde815f010 msgr2=0x7fcde806b2b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-17T23:56:08.245 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.240+0000 7fcded8c8640 1 --2- 172.21.15.196:0/4236028651 >> v2:172.21.15.204:3300/0 conn(0x7fcde815f010 0x7fcde806b2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:08.245 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.240+0000 7fcdee0c9640 1 --2- 172.21.15.196:0/4236028651 >> v2:172.21.15.204:3300/0 conn(0x7fcde815f010 0x7fcde806b2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:08.245 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.240+0000 7fcdee0c9640 1 -- 172.21.15.196:0/4236028651 >> v1:172.21.15.204:6789/0 conn(0x7fcde806b7f0 legacy=0x7fcde8072190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:08.245 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.240+0000 7fcdee0c9640 1 -- 172.21.15.196:0/4236028651 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcde806f1a0 con 0x7fcde8158550 2024-03-17T23:56:08.246 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.244+0000 7fcabbfff640 1 -- 172.21.15.196:0/2891391110 <== mon.0 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcab40a9620 con 0x7fcac40c7fc0 2024-03-17T23:56:08.246 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.244+0000 7f8b48721640 1 --2- 172.21.15.196:0/1656464825 >> [v2:172.21.15.196:6806/1194547591,v1:172.21.15.196:6807/1194547591] conn(0x7f8b28001660 0x7f8b28003b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:08.246 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.244+0000 7f8b45cbc640 1 --2- 172.21.15.196:0/1656464825 >> [v2:172.21.15.196:6806/1194547591,v1:172.21.15.196:6807/1194547591] conn(0x7f8b28001660 0x7f8b28003b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:08.246 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.244+0000 7f8b45cbc640 1 --2- 172.21.15.196:0/1656464825 >> [v2:172.21.15.196:6806/1194547591,v1:172.21.15.196:6807/1194547591] conn(0x7f8b28001660 0x7f8b28003b20 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:56:08.246 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.244+0000 7f8b48721640 1 -- 172.21.15.196:0/1656464825 --> [v2:172.21.15.196:6806/1194547591,v1:172.21.15.196:6807/1194547591] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f8b28006bc0 con 0x7f8b28001660 2024-03-17T23:56:08.247 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.244+0000 7fcdee0c9640 1 --2- 172.21.15.196:0/4236028651 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fcde8158550 0x7fcde8071120 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fcde0009e50 tx=0x7fcde001c970 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6483dd638869989c server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:56:08.247 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.244+0000 7fdca1d66640 1 -- 172.21.15.196:0/3581923531 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fdc9c0c6ee0 msgr2=0x7fdc9c0c82d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:08.247 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.244+0000 7fdca1d66640 1 --2- 172.21.15.196:0/3581923531 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fdc9c0c6ee0 0x7fdc9c0c82d0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fdc9400be90 tx=0x7fdc94021240 comp rx=0 tx=0).stop 2024-03-17T23:56:08.247 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.244+0000 7fdca1d66640 1 -- 172.21.15.196:0/3581923531 shutdown_connections 2024-03-17T23:56:08.247 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.244+0000 7fdca1d66640 1 --2- 172.21.15.196:0/3581923531 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fdc9c0c6ee0 0x7fdc9c0c82d0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:08.247 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.244+0000 7fdca1d66640 1 -- 172.21.15.196:0/3581923531 >> 172.21.15.196:0/3581923531 conn(0x7fdc9c0673f0 msgr2=0x7fdc9c06b2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-17T23:56:08.247 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.244+0000 7fdca1d66640 1 -- 172.21.15.196:0/3581923531 shutdown_connections 2024-03-17T23:56:08.247 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.244+0000 7fdca1d66640 1 -- 172.21.15.196:0/3581923531 wait complete. 2024-03-17T23:56:08.248 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.244+0000 7fcabbfff640 1 -- 172.21.15.196:0/2891391110 <== mon.0 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcab40a97c0 con 0x7fcac40c7fc0 2024-03-17T23:56:08.248 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.244+0000 7fcabbfff640 1 -- 172.21.15.196:0/2891391110 <== mon.0 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcab40a9b90 con 0x7fcac40c7fc0 2024-03-17T23:56:08.248 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.244+0000 7fcacb6ad640 1 -- 172.21.15.196:0/2891391110 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcac40c7fc0 msgr2=0x7fcac4070e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:08.248 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.244+0000 7fcacb6ad640 1 --2- 172.21.15.196:0/2891391110 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcac40c7fc0 0x7fcac4070e00 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fcab4009870 tx=0x7fcab401c560 comp rx=0 tx=0).stop 2024-03-17T23:56:08.248 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.244+0000 7fcacb6ad640 1 -- 172.21.15.196:0/2891391110 shutdown_connections 2024-03-17T23:56:08.248 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.244+0000 7fcacb6ad640 1 --2- 172.21.15.196:0/2891391110 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fcac40c43c0 0x7fcac4071340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:08.248 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.244+0000 7fcacb6ad640 1 --2- 172.21.15.196:0/2891391110 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcac40c7fc0 0x7fcac4070e00 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:08.248 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.244+0000 7fcacb6ad640 1 -- 172.21.15.196:0/2891391110 >> 172.21.15.196:0/2891391110 conn(0x7fcac40675f0 msgr2=0x7fcac406f4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-17T23:56:08.249 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.244+0000 7f8b36ffd640 1 -- 172.21.15.196:0/1656464825 <== osd.0 v2:172.21.15.196:6806/1194547591 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f8b28006bc0 con 0x7f8b28001660 2024-03-17T23:56:08.249 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.244+0000 7fdca1d66640 1 Processor -- start 2024-03-17T23:56:08.249 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.244+0000 7fdca1d66640 1 -- start start 2024-03-17T23:56:08.249 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.244+0000 7fcacb6ad640 1 -- 172.21.15.196:0/2891391110 shutdown_connections 2024-03-17T23:56:08.250 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.248+0000 7fdca1d66640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fdc9c071ec0 0x7fdc9c14bc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:08.250 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.248+0000 7fdca1d66640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fdc9c0c6ee0 0x7fdc9c1f80d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:08.250 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.248+0000 7fdca1d66640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fdc9c14fe00 0x7fdc9c1eabf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:08.251 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.248+0000 7fdca1d66640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fdc9c1501e0 con 0x7fdc9c0c6ee0 2024-03-17T23:56:08.251 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.248+0000 7fdca1d66640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7fdc9c155bf0 con 0x7fdc9c071ec0 2024-03-17T23:56:08.251 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.248+0000 7fdca1d66640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7fdc9c150360 con 0x7fdc9c14fe00 2024-03-17T23:56:08.251 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.248+0000 7fdc9bfff640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fdc9c0c6ee0 0x7fdc9c1f80d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:08.251 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.248+0000 7fdc9bfff640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fdc9c0c6ee0 0x7fdc9c1f80d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.196:34520/0 (socket says 172.21.15.196:34520) 2024-03-17T23:56:08.251 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.248+0000 7fdc9bfff640 1 -- 172.21.15.196:0/2224597753 learned_addr learned my addr 172.21.15.196:0/2224597753 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-03-17T23:56:08.251 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.248+0000 7fdca0d64640 1 --2- 172.21.15.196:0/2224597753 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fdc9c071ec0 0x7fdc9c14bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:08.251 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.248+0000 7fdca1565640 1 --2- 172.21.15.196:0/2224597753 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fdc9c14fe00 0x7fdc9c1eabf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:08.252 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.244+0000 7fcacb6ad640 1 -- 172.21.15.196:0/2891391110 wait complete. 2024-03-17T23:56:08.252 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.248+0000 7fcacb6ad640 1 Processor -- start 2024-03-17T23:56:08.252 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.248+0000 7fdca0d64640 1 -- 172.21.15.196:0/2224597753 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fdc9c14fe00 msgr2=0x7fdc9c1eabf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:08.253 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.248+0000 7fdca0d64640 1 --2- 172.21.15.196:0/2224597753 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fdc9c14fe00 0x7fdc9c1eabf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:08.253 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.248+0000 7fdca0d64640 1 -- 172.21.15.196:0/2224597753 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fdc9c0c6ee0 msgr2=0x7fdc9c1f80d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:08.253 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.248+0000 7fdca0d64640 1 --2- 172.21.15.196:0/2224597753 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fdc9c0c6ee0 0x7fdc9c1f80d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:08.253 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.248+0000 7fdca0d64640 1 -- 172.21.15.196:0/2224597753 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc9c1f8610 con 0x7fdc9c071ec0 2024-03-17T23:56:08.253 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.248+0000 7fdc9bfff640 1 --2- 172.21.15.196:0/2224597753 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fdc9c0c6ee0 0x7fdc9c1f80d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-17T23:56:08.253 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.248+0000 7fdca0d64640 1 --2- 172.21.15.196:0/2224597753 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fdc9c071ec0 0x7fdc9c14bc00 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fdc9000c440 tx=0x7fdc9000c900 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:56:08.253 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.248+0000 7fdc997fa640 1 -- 172.21.15.196:0/2224597753 <== mon.1 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc90011790 con 0x7fdc9c071ec0 2024-03-17T23:56:08.253 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.248+0000 7fdc997fa640 1 -- 172.21.15.196:0/2224597753 <== mon.1 v2:172.21.15.204:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc90017070 con 0x7fdc9c071ec0 2024-03-17T23:56:08.253 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.248+0000 7fdca1d66640 1 -- 172.21.15.196:0/2224597753 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdc9c14b020 con 0x7fdc9c071ec0 2024-03-17T23:56:08.253 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.248+0000 7fdc997fa640 1 -- 172.21.15.196:0/2224597753 <== mon.1 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc90011b70 con 0x7fdc9c071ec0 2024-03-17T23:56:08.253 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.248+0000 7fdca1d66640 1 -- 172.21.15.196:0/2224597753 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdc9c14b5e0 con 0x7fdc9c071ec0 2024-03-17T23:56:08.254 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.248+0000 7fcacb6ad640 1 -- start start 2024-03-17T23:56:08.254 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.248+0000 7fcacb6ad640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fcac40c43c0 0x7fcac40cdf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:08.254 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.248+0000 7fcacb6ad640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcac40c7fc0 0x7fcac40cc7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:08.254 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.248+0000 7fcacb6ad640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fcac4158410 0x7fcac4202f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:08.254 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.248+0000 7fcacb6ad640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fcac41587f0 con 0x7fcac40c7fc0 2024-03-17T23:56:08.254 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.248+0000 7fcacb6ad640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7fcac40caaf0 con 0x7fcac40c43c0 2024-03-17T23:56:08.254 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.248+0000 7fcacb6ad640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7fcac4158970 con 0x7fcac4158410 2024-03-17T23:56:08.255 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.248+0000 7fcac8c48640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcac40c7fc0 0x7fcac40cc7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:08.255 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.248+0000 7fcac8c48640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcac40c7fc0 0x7fcac40cc7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.196:34532/0 (socket says 172.21.15.196:34532) 2024-03-17T23:56:08.255 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.248+0000 7fcac8c48640 1 -- 172.21.15.196:0/1615324562 learned_addr learned my addr 172.21.15.196:0/1615324562 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-03-17T23:56:08.255 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.248+0000 7fcac9c4a640 1 --2- 172.21.15.196:0/1615324562 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fcac4158410 0x7fcac4202f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:08.255 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.248+0000 7fcac9449640 1 --2- 172.21.15.196:0/1615324562 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fcac40c43c0 0x7fcac40cdf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:08.255 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.248+0000 7fcac8c48640 1 -- 172.21.15.196:0/1615324562 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fcac4158410 msgr2=0x7fcac4202f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:08.255 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.248+0000 7fcac8c48640 1 --2- 172.21.15.196:0/1615324562 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fcac4158410 0x7fcac4202f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:08.255 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.248+0000 7fcac8c48640 1 -- 172.21.15.196:0/1615324562 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fcac40c43c0 msgr2=0x7fcac40cdf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:08.255 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.248+0000 7fcac8c48640 1 --2- 172.21.15.196:0/1615324562 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fcac40c43c0 0x7fcac40cdf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:08.255 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.248+0000 7fcac8c48640 1 -- 172.21.15.196:0/1615324562 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcac40b2590 con 0x7fcac40c7fc0 2024-03-17T23:56:08.255 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.248+0000 7fcac8c48640 1 --2- 172.21.15.196:0/1615324562 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcac40c7fc0 0x7fcac40cc7a0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fcab40ab040 tx=0x7fcab401ada0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:56:08.255 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.248+0000 7fcab9ffb640 1 -- 172.21.15.196:0/1615324562 <== mon.0 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcab40bf070 con 0x7fcac40c7fc0 2024-03-17T23:56:08.255 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.248+0000 7fcab9ffb640 1 -- 172.21.15.196:0/1615324562 <== mon.0 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcab40a9c80 con 0x7fcac40c7fc0 2024-03-17T23:56:08.256 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.248+0000 7fdc997fa640 1 -- 172.21.15.196:0/2224597753 <== mon.1 v2:172.21.15.204:3300/0 4 ==== mgrmap(e 5) ==== 87083+0+0 (secure 0 0 0) 0x7fdc90011d10 con 0x7fdc9c071ec0 2024-03-17T23:56:08.256 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.252+0000 7fcded0c7640 1 -- 172.21.15.196:0/4236028651 <== mon.2 v2:172.21.15.204:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcde00a5790 con 0x7fcde8158550 2024-03-17T23:56:08.256 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.252+0000 7fcded0c7640 1 -- 172.21.15.196:0/4236028651 <== mon.2 v2:172.21.15.204:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcde00a5930 con 0x7fcde8158550 2024-03-17T23:56:08.257 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.252+0000 7fdc997fa640 1 --2- 172.21.15.196:0/2224597753 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7fdc88067660 0x7fdc88069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:08.257 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.252+0000 7fdc997fa640 1 -- 172.21.15.196:0/2224597753 <== mon.1 v2:172.21.15.204:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fdc90085610 con 0x7fdc9c071ec0 2024-03-17T23:56:08.257 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.252+0000 7fcab9ffb640 1 -- 172.21.15.196:0/1615324562 <== mon.0 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcab40ba670 con 0x7fcac40c7fc0 2024-03-17T23:56:08.257 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.252+0000 7fcacb6ad640 1 -- 172.21.15.196:0/1615324562 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcac40b2870 con 0x7fcac40c7fc0 2024-03-17T23:56:08.257 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.252+0000 7fdc9bfff640 1 --2- 172.21.15.196:0/2224597753 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7fdc88067660 0x7fdc88069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:08.258 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.252+0000 7fcacb6ad640 1 -- 172.21.15.196:0/1615324562 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcac415c280 con 0x7fcac40c7fc0 2024-03-17T23:56:08.258 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.252+0000 7fdc9bfff640 1 --2- 172.21.15.196:0/2224597753 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7fdc88067660 0x7fdc88069b20 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fdc9c0c5b50 tx=0x7fdc8c00a210 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:56:08.258 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.252+0000 7fcdef0cb640 1 -- 172.21.15.196:0/4236028651 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fcde8158550 msgr2=0x7fcde8071120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:08.258 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.252+0000 7fcdef0cb640 1 --2- 172.21.15.196:0/4236028651 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fcde8158550 0x7fcde8071120 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fcde0009e50 tx=0x7fcde001c970 comp rx=0 tx=0).stop 2024-03-17T23:56:08.258 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.252+0000 7fcdef0cb640 1 -- 172.21.15.196:0/4236028651 shutdown_connections 2024-03-17T23:56:08.259 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.252+0000 7fcdef0cb640 1 --2- 172.21.15.196:0/4236028651 >> v2:172.21.15.204:3300/0 conn(0x7fcde815f010 0x7fcde806b2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:08.259 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.252+0000 7fcdef0cb640 1 --2- 172.21.15.196:0/4236028651 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fcde8158550 0x7fcde8071120 secure :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fcde0009e50 tx=0x7fcde001c970 comp rx=0 tx=0).stop 2024-03-17T23:56:08.259 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.252+0000 7fcdef0cb640 1 -- 172.21.15.196:0/4236028651 >> 172.21.15.196:0/4236028651 conn(0x7fcde80cb3a0 msgr2=0x7fcde80cb7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-17T23:56:08.259 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.252+0000 7fcdef0cb640 1 -- 172.21.15.196:0/4236028651 shutdown_connections 2024-03-17T23:56:08.259 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.252+0000 7fcdef0cb640 1 -- 172.21.15.196:0/4236028651 wait complete. 2024-03-17T23:56:08.259 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.252+0000 7fcab9ffb640 1 -- 172.21.15.196:0/1615324562 <== mon.0 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 5) ==== 87083+0+0 (secure 0 0 0) 0x7fcab40c2070 con 0x7fcac40c7fc0 2024-03-17T23:56:08.259 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.252+0000 7fcab9ffb640 1 --2- 172.21.15.196:0/1615324562 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7fcab0067820 0x7fcab0069ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:08.260 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.252+0000 7fcab9ffb640 1 -- 172.21.15.196:0/1615324562 <== mon.0 v2:172.21.15.196:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fcab411f440 con 0x7fcac40c7fc0 2024-03-17T23:56:08.260 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.256+0000 7fcac9449640 1 --2- 172.21.15.196:0/1615324562 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7fcab0067820 0x7fcab0069ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:08.260 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.256+0000 7fcdef0cb640 1 Processor -- start 2024-03-17T23:56:08.260 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.256+0000 7fcdef0cb640 1 -- start start 2024-03-17T23:56:08.260 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.256+0000 7fcac9449640 1 --2- 172.21.15.196:0/1615324562 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7fcab0067820 0x7fcab0069ce0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fcac0001810 tx=0x7fcac0009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:56:08.262 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.256+0000 7fcdef0cb640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fcde806b7f0 0x7fcde8145fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:08.262 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.256+0000 7fcdef0cb640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcde815f010 0x7fcde814e560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:08.262 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.256+0000 7fcdef0cb640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fcde814eaa0 0x7fcde814ffe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:08.262 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.256+0000 7fcded8c8640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcde815f010 0x7fcde814e560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:08.262 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.256+0000 7fcdee0c9640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fcde806b7f0 0x7fcde8145fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:08.262 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.256+0000 7fcded8c8640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcde815f010 0x7fcde814e560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.196:34538/0 (socket says 172.21.15.196:34538) 2024-03-17T23:56:08.262 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.256+0000 7fcdee0c9640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fcde806b7f0 0x7fcde8145fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3300/0 says I am v2:172.21.15.196:50152/0 (socket says 172.21.15.196:50152) 2024-03-17T23:56:08.262 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.256+0000 7fcdef0cb640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fcde806e550 con 0x7fcde815f010 2024-03-17T23:56:08.262 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.256+0000 7fcdef0cb640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7fcde806f480 con 0x7fcde806b7f0 2024-03-17T23:56:08.262 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.256+0000 7fcdef0cb640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7fcde81596f0 con 0x7fcde814eaa0 2024-03-17T23:56:08.262 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.256+0000 7fcded8c8640 1 -- 172.21.15.196:0/1334455757 learned_addr learned my addr 172.21.15.196:0/1334455757 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-03-17T23:56:08.262 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.256+0000 7fcdee8ca640 1 --2- 172.21.15.196:0/1334455757 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fcde814eaa0 0x7fcde814ffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:08.263 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.256+0000 7fcded8c8640 1 -- 172.21.15.196:0/1334455757 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fcde814eaa0 msgr2=0x7fcde814ffe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:08.263 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.256+0000 7fcded8c8640 1 --2- 172.21.15.196:0/1334455757 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fcde814eaa0 0x7fcde814ffe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:08.263 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.256+0000 7fcded8c8640 1 -- 172.21.15.196:0/1334455757 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fcde806b7f0 msgr2=0x7fcde8145fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:08.263 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.256+0000 7fcded8c8640 1 --2- 172.21.15.196:0/1334455757 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fcde806b7f0 0x7fcde8145fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:08.263 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.256+0000 7fcded8c8640 1 -- 172.21.15.196:0/1334455757 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcde8160300 con 0x7fcde815f010 2024-03-17T23:56:08.263 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.256+0000 7fcded8c8640 1 --2- 172.21.15.196:0/1334455757 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcde815f010 0x7fcde814e560 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fcdd800c5f0 tx=0x7fcdd800cab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:56:08.263 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.256+0000 7fcddeffd640 1 -- 172.21.15.196:0/1334455757 <== mon.0 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdd8015070 con 0x7fcde815f010 2024-03-17T23:56:08.263 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.256+0000 7fcddeffd640 1 -- 172.21.15.196:0/1334455757 <== mon.0 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcdd8011800 con 0x7fcde815f010 2024-03-17T23:56:08.263 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.256+0000 7fcddeffd640 1 -- 172.21.15.196:0/1334455757 <== mon.0 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdd8011bd0 con 0x7fcde815f010 2024-03-17T23:56:08.263 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.256+0000 7fcdef0cb640 1 -- 172.21.15.196:0/1334455757 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcde81605e0 con 0x7fcde815f010 2024-03-17T23:56:08.264 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.256+0000 7fdca1d66640 1 --2- 172.21.15.196:0/2224597753 >> [v2:172.21.15.204:6817/3367327749,v1:172.21.15.204:6820/3367327749] conn(0x7fdc9c1f7730 0x7fdc9c1529f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:08.264 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.256+0000 7fdca1d66640 1 -- 172.21.15.196:0/2224597753 --> [v2:172.21.15.204:6817/3367327749,v1:172.21.15.204:6820/3367327749] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fdc9c04f550 con 0x7fdc9c1f7730 2024-03-17T23:56:08.264 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.256+0000 7fcdef0cb640 1 -- 172.21.15.196:0/1334455757 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcde8160ba0 con 0x7fcde815f010 2024-03-17T23:56:08.264 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.260+0000 7fdca1565640 1 --2- 172.21.15.196:0/2224597753 >> [v2:172.21.15.204:6817/3367327749,v1:172.21.15.204:6820/3367327749] conn(0x7fdc9c1f7730 0x7fdc9c1529f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:08.265 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.260+0000 7fcacb6ad640 1 --2- 172.21.15.196:0/1615324562 >> [v2:172.21.15.204:6805/2586742078,v1:172.21.15.204:6807/2586742078] conn(0x7fcaa4001660 0x7fcaa4003b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:08.265 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.260+0000 7fcacb6ad640 1 -- 172.21.15.196:0/1615324562 --> [v2:172.21.15.204:6805/2586742078,v1:172.21.15.204:6807/2586742078] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fcaa4006bc0 con 0x7fcaa4001660 2024-03-17T23:56:08.265 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.260+0000 7fcac9c4a640 1 --2- 172.21.15.196:0/1615324562 >> [v2:172.21.15.204:6805/2586742078,v1:172.21.15.204:6807/2586742078] conn(0x7fcaa4001660 0x7fcaa4003b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:08.265 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.260+0000 7fdca1565640 1 --2- 172.21.15.196:0/2224597753 >> [v2:172.21.15.204:6817/3367327749,v1:172.21.15.204:6820/3367327749] conn(0x7fdc9c1f7730 0x7fdc9c1529f0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:56:08.266 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.260+0000 7fcac9c4a640 1 --2- 172.21.15.196:0/1615324562 >> [v2:172.21.15.204:6805/2586742078,v1:172.21.15.204:6807/2586742078] conn(0x7fcaa4001660 0x7fcaa4003b20 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:56:08.266 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.260+0000 7fcab9ffb640 1 -- 172.21.15.196:0/1615324562 <== osd.6 v2:172.21.15.204:6805/2586742078 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fcaa4006bc0 con 0x7fcaa4001660 2024-03-17T23:56:08.266 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.260+0000 7fcddeffd640 1 -- 172.21.15.196:0/1334455757 <== mon.0 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 5) ==== 87083+0+0 (secure 0 0 0) 0x7fcdd8018070 con 0x7fcde815f010 2024-03-17T23:56:08.266 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.260+0000 7fdc997fa640 1 -- 172.21.15.196:0/2224597753 <== osd.5 v2:172.21.15.204:6817/3367327749 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fdc9c04f550 con 0x7fdc9c1f7730 2024-03-17T23:56:08.267 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.260+0000 7fcddeffd640 1 --2- 172.21.15.196:0/1334455757 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7fcdcc067760 0x7fcdcc069c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:08.267 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.260+0000 7fcddeffd640 1 -- 172.21.15.196:0/1334455757 <== mon.0 v2:172.21.15.196:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fcdd80855c0 con 0x7fcde815f010 2024-03-17T23:56:08.267 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.260+0000 7fcdee0c9640 1 --2- 172.21.15.196:0/1334455757 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7fcdcc067760 0x7fcdcc069c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:08.267 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.260+0000 7fcdee0c9640 1 --2- 172.21.15.196:0/1334455757 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7fcdcc067760 0x7fcdcc069c20 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fcde00ae000 tx=0x7fcde00a7070 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:56:08.281 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.280+0000 7fcdef0cb640 1 --2- 172.21.15.196:0/1334455757 >> [v2:172.21.15.196:6800/1901246986,v1:172.21.15.196:6801/1901246986] conn(0x7fcde8160da0 0x7fcde8072090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:08.281 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.280+0000 7fcdef0cb640 1 -- 172.21.15.196:0/1334455757 --> [v2:172.21.15.196:6800/1901246986,v1:172.21.15.196:6801/1901246986] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fcde804f550 con 0x7fcde8160da0 2024-03-17T23:56:08.282 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.280+0000 7fcdee8ca640 1 --2- 172.21.15.196:0/1334455757 >> [v2:172.21.15.196:6800/1901246986,v1:172.21.15.196:6801/1901246986] conn(0x7fcde8160da0 0x7fcde8072090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:08.282 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.280+0000 7fcdee8ca640 1 --2- 172.21.15.196:0/1334455757 >> [v2:172.21.15.196:6800/1901246986,v1:172.21.15.196:6801/1901246986] conn(0x7fcde8160da0 0x7fcde8072090 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:56:08.283 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.280+0000 7fcddeffd640 1 -- 172.21.15.196:0/1334455757 <== osd.1 v2:172.21.15.196:6800/1901246986 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fcde804f550 con 0x7fcde8160da0 2024-03-17T23:56:08.288 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.288+0000 7fcacb6ad640 1 -- 172.21.15.196:0/1615324562 --> [v2:172.21.15.204:6805/2586742078,v1:172.21.15.204:6807/2586742078] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fcaa4005ca0 con 0x7fcaa4001660 2024-03-17T23:56:08.289 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.288+0000 7fcab9ffb640 1 -- 172.21.15.196:0/1615324562 <== osd.6 v2:172.21.15.204:6805/2586742078 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fcaa4005ca0 con 0x7fcaa4001660 2024-03-17T23:56:08.290 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.288+0000 7fcaaf7fe640 1 -- 172.21.15.196:0/1615324562 >> [v2:172.21.15.204:6805/2586742078,v1:172.21.15.204:6807/2586742078] conn(0x7fcaa4001660 msgr2=0x7fcaa4003b20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:08.291 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.288+0000 7fcaaf7fe640 1 --2- 172.21.15.196:0/1615324562 >> [v2:172.21.15.204:6805/2586742078,v1:172.21.15.204:6807/2586742078] conn(0x7fcaa4001660 0x7fcaa4003b20 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:08.291 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.288+0000 7fcaaf7fe640 1 -- 172.21.15.196:0/1615324562 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7fcab0067820 msgr2=0x7fcab0069ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:08.291 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.288+0000 7fcaaf7fe640 1 --2- 172.21.15.196:0/1615324562 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7fcab0067820 0x7fcab0069ce0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fcac0001810 tx=0x7fcac0009040 comp rx=0 tx=0).stop 2024-03-17T23:56:08.291 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.288+0000 7fcaaf7fe640 1 -- 172.21.15.196:0/1615324562 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcac40c7fc0 msgr2=0x7fcac40cc7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:08.291 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.288+0000 7fcaaf7fe640 1 --2- 172.21.15.196:0/1615324562 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcac40c7fc0 0x7fcac40cc7a0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fcab40ab040 tx=0x7fcab401ada0 comp rx=0 tx=0).stop 2024-03-17T23:56:08.291 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.288+0000 7fcac9c4a640 1 -- 172.21.15.196:0/1615324562 reap_dead start 2024-03-17T23:56:08.297 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.296+0000 7fcaaf7fe640 1 -- 172.21.15.196:0/1615324562 shutdown_connections 2024-03-17T23:56:08.297 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.296+0000 7fcaaf7fe640 1 -- 172.21.15.196:0/1615324562 >> 172.21.15.196:0/1615324562 conn(0x7fcac40675f0 msgr2=0x7fcac414a750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-17T23:56:08.297 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.296+0000 7fcaaf7fe640 1 -- 172.21.15.196:0/1615324562 shutdown_connections 2024-03-17T23:56:08.297 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.296+0000 7fcaaf7fe640 1 -- 172.21.15.196:0/1615324562 wait complete. 2024-03-17T23:56:08.303 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.300+0000 7f8b48721640 1 -- 172.21.15.196:0/1656464825 --> [v2:172.21.15.196:6806/1194547591,v1:172.21.15.196:6807/1194547591] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f8b28005c50 con 0x7f8b28001660 2024-03-17T23:56:08.304 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.300+0000 7f8b36ffd640 1 -- 172.21.15.196:0/1656464825 <== osd.0 v2:172.21.15.196:6806/1194547591 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f8b28005c50 con 0x7f8b28001660 2024-03-17T23:56:08.307 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.304+0000 7fdca1d66640 1 -- 172.21.15.196:0/2224597753 --> [v2:172.21.15.204:6817/3367327749,v1:172.21.15.204:6820/3367327749] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fdc9c154880 con 0x7fdc9c1f7730 2024-03-17T23:56:08.307 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.304+0000 7fdc997fa640 1 -- 172.21.15.196:0/2224597753 <== osd.5 v2:172.21.15.204:6817/3367327749 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fdc9c154880 con 0x7fdc9c1f7730 2024-03-17T23:56:08.308 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.304+0000 7f92d5cce640 1 Processor -- start 2024-03-17T23:56:08.308 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.304+0000 7f92d5cce640 1 -- start start 2024-03-17T23:56:08.308 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.304+0000 7f92d5cce640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f92c80f6bf0 0x7f92c80fd3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:08.309 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.304+0000 7f92d5cce640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f92c8045be0 con 0x7f92c8046c80 2024-03-17T23:56:08.312 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.304+0000 7f92d5cce640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f92c8045ec0 con 0x7f92c8045480 2024-03-17T23:56:08.312 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.304+0000 7f92d5cce640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 -- 0x7f92c8050ea0 con 0x7f92c80f6bf0 2024-03-17T23:56:08.312 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.304+0000 7f92cffff640 1 --1- >> v1:172.21.15.196:6789/0 conn(0x7f92c8046c80 0x7f92c81072b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.196:6789/0 says I am v1:172.21.15.196:50412/0 (socket says 172.21.15.196:50412) 2024-03-17T23:56:08.312 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.304+0000 7f92cffff640 1 -- 172.21.15.196:0/1282305291 learned_addr learned my addr 172.21.15.196:0/1282305291 (peer_addr_for_me v1:172.21.15.196:0/0) 2024-03-17T23:56:08.312 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.304+0000 7f92ce7fc640 1 -- 172.21.15.196:0/1282305291 <== mon.0 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 204054727 0 0) 0x7f92c8045be0 con 0x7f92c8046c80 2024-03-17T23:56:08.312 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.304+0000 7f92cf7fe640 1 --2- 172.21.15.196:0/1282305291 >> v2:172.21.15.204:3300/0 conn(0x7f92c80f6bf0 0x7f92c80fd3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:08.312 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.308+0000 7f92ce7fc640 1 -- 172.21.15.196:0/1282305291 --> v1:172.21.15.196:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f92c0003980 con 0x7f92c8046c80 2024-03-17T23:56:08.312 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.308+0000 7f92ce7fc640 1 -- 172.21.15.196:0/1282305291 <== mon.1 v1:172.21.15.204:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2617411402 0 0) 0x7f92c8045ec0 con 0x7f92c8045480 2024-03-17T23:56:08.312 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.308+0000 7f92ce7fc640 1 -- 172.21.15.196:0/1282305291 --> v1:172.21.15.204:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f92c8045be0 con 0x7f92c8045480 2024-03-17T23:56:08.312 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.308+0000 7f92ce7fc640 1 -- 172.21.15.196:0/1282305291 <== mon.0 v1:172.21.15.196:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 739017103 0 0) 0x7f92c0003980 con 0x7f92c8046c80 2024-03-17T23:56:08.312 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.308+0000 7f92ce7fc640 1 -- 172.21.15.196:0/1282305291 >> v2:172.21.15.204:3300/0 conn(0x7f92c80f6bf0 msgr2=0x7f92c80fd3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-17T23:56:08.312 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.308+0000 7f92ce7fc640 1 --2- 172.21.15.196:0/1282305291 >> v2:172.21.15.204:3300/0 conn(0x7f92c80f6bf0 0x7f92c80fd3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:08.313 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.308+0000 7f92ce7fc640 1 -- 172.21.15.196:0/1282305291 >> v1:172.21.15.204:6789/0 conn(0x7f92c8045480 legacy=0x7f92c804b0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:08.313 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.308+0000 7f92ce7fc640 1 -- 172.21.15.196:0/1282305291 --> v1:172.21.15.196:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92c80461a0 con 0x7f92c8046c80 2024-03-17T23:56:08.313 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.308+0000 7f92ce7fc640 1 -- 172.21.15.196:0/1282305291 <== mon.0 v1:172.21.15.196:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 981458915 0 0) 0x7f92d004fa70 con 0x7f92c8046c80 2024-03-17T23:56:08.313 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.308+0000 7f92ce7fc640 1 -- 172.21.15.196:0/1282305291 >> v1:172.21.15.196:6789/0 conn(0x7f92c8046c80 legacy=0x7f92c81072b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:08.313 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.308+0000 7f92ce7fc640 1 --2- 172.21.15.196:0/1282305291 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f92c0003e40 0x7f92c0004220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:08.313 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.308+0000 7f92ce7fc640 1 --2- 172.21.15.196:0/1282305291 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f92c0004760 0x7f92c0008c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:08.313 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.308+0000 7f92ce7fc640 1 --2- 172.21.15.196:0/1282305291 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f92c00091e0 0x7f92c000b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:08.313 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.308+0000 7f92ce7fc640 1 -- 172.21.15.196:0/1282305291 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f92c000beb0 con 0x7f92c0004760 2024-03-17T23:56:08.313 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.308+0000 7f92ce7fc640 1 -- 172.21.15.196:0/1282305291 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f92c000c060 con 0x7f92c0003e40 2024-03-17T23:56:08.313 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.308+0000 7f92ce7fc640 1 -- 172.21.15.196:0/1282305291 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f92c000c260 con 0x7f92c00091e0 2024-03-17T23:56:08.313 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.308+0000 7f92ceffd640 1 --2- 172.21.15.196:0/1282305291 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f92c0004760 0x7f92c0008c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:08.313 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.308+0000 7f92cf7fe640 1 --2- 172.21.15.196:0/1282305291 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f92c0003e40 0x7f92c0004220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:08.313 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.308+0000 7f92cffff640 1 --2- 172.21.15.196:0/1282305291 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f92c00091e0 0x7f92c000b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:08.314 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.308+0000 7f92ceffd640 1 -- 172.21.15.196:0/1282305291 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f92c00091e0 msgr2=0x7f92c000b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-17T23:56:08.314 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.308+0000 7f92ceffd640 1 --2- 172.21.15.196:0/1282305291 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f92c00091e0 0x7f92c000b6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:08.314 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.308+0000 7f92ceffd640 1 -- 172.21.15.196:0/1282305291 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f92c0003e40 msgr2=0x7f92c0004220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-17T23:56:08.314 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.308+0000 7f92ceffd640 1 --2- 172.21.15.196:0/1282305291 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f92c0003e40 0x7f92c0004220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:08.314 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.308+0000 7fdca1d66640 1 -- 172.21.15.196:0/2224597753 >> [v2:172.21.15.204:6817/3367327749,v1:172.21.15.204:6820/3367327749] conn(0x7fdc9c1f7730 msgr2=0x7fdc9c1529f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:08.314 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.308+0000 7fdca1d66640 1 --2- 172.21.15.196:0/2224597753 >> [v2:172.21.15.204:6817/3367327749,v1:172.21.15.204:6820/3367327749] conn(0x7fdc9c1f7730 0x7fdc9c1529f0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:08.315 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.308+0000 7f92ceffd640 1 -- 172.21.15.196:0/1282305291 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92c0003980 con 0x7f92c0004760 2024-03-17T23:56:08.315 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.308+0000 7fcdef0cb640 1 -- 172.21.15.196:0/1334455757 --> [v2:172.21.15.196:6800/1901246986,v1:172.21.15.196:6801/1901246986] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fcde81525e0 con 0x7fcde8160da0 2024-03-17T23:56:08.315 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.308+0000 7fcddeffd640 1 -- 172.21.15.196:0/1334455757 <== osd.1 v2:172.21.15.196:6800/1901246986 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fcde81525e0 con 0x7fcde8160da0 2024-03-17T23:56:08.315 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.308+0000 7fdca1d66640 1 -- 172.21.15.196:0/2224597753 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7fdc88067660 msgr2=0x7fdc88069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:08.316 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.308+0000 7fdca1d66640 1 --2- 172.21.15.196:0/2224597753 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7fdc88067660 0x7fdc88069b20 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fdc9c0c5b50 tx=0x7fdc8c00a210 comp rx=0 tx=0).stop 2024-03-17T23:56:08.316 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.308+0000 7fdca1d66640 1 -- 172.21.15.196:0/2224597753 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fdc9c071ec0 msgr2=0x7fdc9c14bc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:08.316 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.308+0000 7f8b34ff9640 1 -- 172.21.15.196:0/1656464825 >> [v2:172.21.15.196:6806/1194547591,v1:172.21.15.196:6807/1194547591] conn(0x7f8b28001660 msgr2=0x7f8b28003b20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:08.316 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.308+0000 7f8b34ff9640 1 --2- 172.21.15.196:0/1656464825 >> [v2:172.21.15.196:6806/1194547591,v1:172.21.15.196:6807/1194547591] conn(0x7f8b28001660 0x7f8b28003b20 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:08.317 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.308+0000 7f8b34ff9640 1 -- 172.21.15.196:0/1656464825 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f8b24067760 msgr2=0x7f8b24069c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:08.317 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.308+0000 7f8b34ff9640 1 --2- 172.21.15.196:0/1656464825 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f8b24067760 0x7f8b24069c20 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f8b30006fd0 tx=0x7f8b30008040 comp rx=0 tx=0).stop 2024-03-17T23:56:08.317 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.308+0000 7f8b34ff9640 1 -- 172.21.15.196:0/1656464825 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8b40146440 msgr2=0x7f8b4013ed80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:08.317 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.308+0000 7f8b34ff9640 1 --2- 172.21.15.196:0/1656464825 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8b40146440 0x7f8b4013ed80 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f8b3800cdc0 tx=0x7f8b3800a710 comp rx=0 tx=0).stop 2024-03-17T23:56:08.317 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.308+0000 7f8b46cbe640 1 -- 172.21.15.196:0/1656464825 reap_dead start 2024-03-17T23:56:08.317 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.308+0000 7f92cffff640 1 -- 172.21.15.196:0/1282305291 reap_dead start 2024-03-17T23:56:08.317 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.312+0000 7fd85ee68640 1 Processor -- start 2024-03-17T23:56:08.317 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.312+0000 7fd85ee68640 1 -- start start 2024-03-17T23:56:08.318 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.308+0000 7fdca1d66640 1 --2- 172.21.15.196:0/2224597753 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fdc9c071ec0 0x7fdc9c14bc00 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fdc9000c440 tx=0x7fdc9000c900 comp rx=0 tx=0).stop 2024-03-17T23:56:08.318 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.312+0000 7f92ceffd640 1 --2- 172.21.15.196:0/1282305291 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f92c0004760 0x7f92c0008c50 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f92bc000fc0 tx=0x7f92bc01cae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8f0fc0da6a67ee2 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:56:08.318 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.312+0000 7fdca1565640 1 -- 172.21.15.196:0/2224597753 reap_dead start 2024-03-17T23:56:08.319 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.312+0000 7fd85ee68640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fd8580715e0 0x7fd858071a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:08.319 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.312+0000 7fd85ee68640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fd8580c78d0 0x7fd8580c7ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:08.319 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.312+0000 7fd85ee68640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd85806c070 con 0x7fd85814ff60 2024-03-17T23:56:08.319 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.312+0000 7fd85ee68640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7fd8580c8820 con 0x7fd8580c78d0 2024-03-17T23:56:08.319 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.312+0000 7fd85ee68640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 -- 0x7fd858155e00 con 0x7fd8580715e0 2024-03-17T23:56:08.319 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.312+0000 7fd85d405640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fd8580c78d0 0x7fd8580c7ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:08.319 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.312+0000 7fd85d405640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fd8580c78d0 0x7fd8580c7ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.196:34548/0 (socket says 172.21.15.196:34548) 2024-03-17T23:56:08.319 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.312+0000 7fd85d405640 1 -- 172.21.15.196:0/3141930148 learned_addr learned my addr 172.21.15.196:0/3141930148 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-03-17T23:56:08.319 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.312+0000 7fd85d405640 1 -- 172.21.15.196:0/3141930148 >> v2:172.21.15.204:3300/0 conn(0x7fd8580715e0 msgr2=0x7fd858071a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-17T23:56:08.319 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.312+0000 7fd85d405640 1 --2- 172.21.15.196:0/3141930148 >> v2:172.21.15.204:3300/0 conn(0x7fd8580715e0 0x7fd858071a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:08.320 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.312+0000 7f92ce7fc640 1 -- 172.21.15.196:0/1282305291 <== mon.0 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92bc007b80 con 0x7f92c0004760 2024-03-17T23:56:08.320 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.312+0000 7f92ce7fc640 1 -- 172.21.15.196:0/1282305291 <== mon.0 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f92bc0a9070 con 0x7f92c0004760 2024-03-17T23:56:08.320 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.312+0000 7f92ce7fc640 1 -- 172.21.15.196:0/1282305291 <== mon.0 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92bc003600 con 0x7f92c0004760 2024-03-17T23:56:08.320 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.312+0000 7f92d5cce640 1 -- 172.21.15.196:0/1282305291 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f92c0004760 msgr2=0x7f92c0008c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:08.320 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.312+0000 7f92d5cce640 1 --2- 172.21.15.196:0/1282305291 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f92c0004760 0x7f92c0008c50 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f92bc000fc0 tx=0x7f92bc01cae0 comp rx=0 tx=0).stop 2024-03-17T23:56:08.320 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.312+0000 7fdca1d66640 1 -- 172.21.15.196:0/2224597753 shutdown_connections 2024-03-17T23:56:08.320 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.312+0000 7fdca1d66640 1 -- 172.21.15.196:0/2224597753 >> 172.21.15.196:0/2224597753 conn(0x7fdc9c0673f0 msgr2=0x7fdc9c072900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-17T23:56:08.321 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.312+0000 7f92d5cce640 1 -- 172.21.15.196:0/1282305291 shutdown_connections 2024-03-17T23:56:08.321 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.312+0000 7f92d5cce640 1 --2- 172.21.15.196:0/1282305291 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f92c0004760 0x7f92c0008c50 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:08.321 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.312+0000 7f92d5cce640 1 -- 172.21.15.196:0/1282305291 >> 172.21.15.196:0/1282305291 conn(0x7f92c80501c0 msgr2=0x7f92c80505d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-17T23:56:08.321 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.312+0000 7f92d5cce640 1 -- 172.21.15.196:0/1282305291 shutdown_connections 2024-03-17T23:56:08.321 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.312+0000 7f92d5cce640 1 -- 172.21.15.196:0/1282305291 wait complete. 2024-03-17T23:56:08.321 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.316+0000 7f92d5cce640 1 Processor -- start 2024-03-17T23:56:08.322 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.312+0000 7fd85d405640 1 -- 172.21.15.196:0/3141930148 >> v1:172.21.15.196:6789/0 conn(0x7fd85814ff60 legacy=0x7fd85806b2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-17T23:56:08.322 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.312+0000 7fd85d405640 1 -- 172.21.15.196:0/3141930148 --> v2:172.21.15.196:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd858071f70 con 0x7fd8580c78d0 2024-03-17T23:56:08.322 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.316+0000 7fd85d405640 1 --2- 172.21.15.196:0/3141930148 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd8580c78d0 0x7fd8580c7ce0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fd8580c6dc0 tx=0x7fd85001efe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=afb66c1ea4119dbe server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:56:08.322 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.316+0000 7f8b34ff9640 1 -- 172.21.15.196:0/1656464825 shutdown_connections 2024-03-17T23:56:08.322 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.316+0000 7f8b34ff9640 1 -- 172.21.15.196:0/1656464825 >> 172.21.15.196:0/1656464825 conn(0x7f8b400c7da0 msgr2=0x7f8b400c4200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-17T23:56:08.322 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.316+0000 7f8b34ff9640 1 -- 172.21.15.196:0/1656464825 shutdown_connections 2024-03-17T23:56:08.322 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.316+0000 7f8b34ff9640 1 -- 172.21.15.196:0/1656464825 wait complete. 2024-03-17T23:56:08.322 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.316+0000 7fd8577fe640 1 -- 172.21.15.196:0/3141930148 <== mon.0 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8500a8bf0 con 0x7fd8580c78d0 2024-03-17T23:56:08.323 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.316+0000 7f92d5cce640 1 -- start start 2024-03-17T23:56:08.323 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.316+0000 7f92d5cce640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f92c0004760 0x7f92c80fd4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:08.323 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.316+0000 7f92d5cce640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f92c8195b10 0x7f92c8192eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:08.323 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.316+0000 7f92d5cce640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f92c8187f30 0x7f92c804dfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:08.323 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.316+0000 7f92d5cce640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f92c80f6fd0 con 0x7f92c8187f30 2024-03-17T23:56:08.323 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.316+0000 7f92d5cce640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f92c80467f0 con 0x7f92c8195b10 2024-03-17T23:56:08.323 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.316+0000 7f92d5cce640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f92c804c640 con 0x7f92c0004760 2024-03-17T23:56:08.323 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.316+0000 7f92cf7fe640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f92c0004760 0x7f92c80fd4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:08.323 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.316+0000 7f92cffff640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f92c8187f30 0x7f92c804dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:08.323 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.316+0000 7f92cf7fe640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f92c0004760 0x7f92c80fd4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3301/0 says I am v2:172.21.15.196:48316/0 (socket says 172.21.15.196:48316) 2024-03-17T23:56:08.324 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.316+0000 7f92cf7fe640 1 -- 172.21.15.196:0/53298209 learned_addr learned my addr 172.21.15.196:0/53298209 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-03-17T23:56:08.324 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.316+0000 7f92ceffd640 1 --2- 172.21.15.196:0/53298209 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f92c8195b10 0x7f92c8192eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:08.324 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.316+0000 7fd8577fe640 1 -- 172.21.15.196:0/3141930148 <== mon.0 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd8500a8d90 con 0x7fd8580c78d0 2024-03-17T23:56:08.324 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.316+0000 7fd8577fe640 1 -- 172.21.15.196:0/3141930148 <== mon.0 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8500b0610 con 0x7fd8580c78d0 2024-03-17T23:56:08.324 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.316+0000 7f92cffff640 1 -- 172.21.15.196:0/53298209 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f92c0004760 msgr2=0x7f92c80fd4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:08.324 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.316+0000 7f92cffff640 1 --2- 172.21.15.196:0/53298209 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f92c0004760 0x7f92c80fd4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:08.325 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.316+0000 7f92cffff640 1 -- 172.21.15.196:0/53298209 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f92c8195b10 msgr2=0x7f92c8192eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:08.325 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.316+0000 7f92cffff640 1 --2- 172.21.15.196:0/53298209 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f92c8195b10 0x7f92c8192eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:08.325 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.316+0000 7f92cffff640 1 -- 172.21.15.196:0/53298209 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92c8196130 con 0x7f92c8187f30 2024-03-17T23:56:08.325 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.316+0000 7f92cf7fe640 1 --2- 172.21.15.196:0/53298209 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f92c0004760 0x7f92c80fd4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-17T23:56:08.325 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.316+0000 7fdca1d66640 1 -- 172.21.15.196:0/2224597753 shutdown_connections 2024-03-17T23:56:08.325 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.316+0000 7fdca1d66640 1 -- 172.21.15.196:0/2224597753 wait complete. 2024-03-17T23:56:08.325 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.316+0000 7f92cffff640 1 --2- 172.21.15.196:0/53298209 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f92c8187f30 0x7f92c804dfc0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f92d0064d80 tx=0x7f92d00739e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:56:08.326 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.316+0000 7f92bbfff640 1 -- 172.21.15.196:0/53298209 <== mon.0 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92d006ca20 con 0x7f92c8187f30 2024-03-17T23:56:08.326 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.316+0000 7fd85ee68640 1 -- 172.21.15.196:0/3141930148 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd8580c78d0 msgr2=0x7fd8580c7ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:08.326 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.316+0000 7fd85ee68640 1 --2- 172.21.15.196:0/3141930148 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd8580c78d0 0x7fd8580c7ce0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fd8580c6dc0 tx=0x7fd85001efe0 comp rx=0 tx=0).stop 2024-03-17T23:56:08.327 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.316+0000 7f92d5cce640 1 -- 172.21.15.196:0/53298209 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f92c81969b0 con 0x7f92c8187f30 2024-03-17T23:56:08.327 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.316+0000 7f92d5cce640 1 -- 172.21.15.196:0/53298209 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92c81966d0 con 0x7f92c8187f30 2024-03-17T23:56:08.327 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.320+0000 7f92bbfff640 1 -- 172.21.15.196:0/53298209 <== mon.0 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f92d006cc00 con 0x7f92c8187f30 2024-03-17T23:56:08.327 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.320+0000 7f92bbfff640 1 -- 172.21.15.196:0/53298209 <== mon.0 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92d00a5410 con 0x7f92c8187f30 2024-03-17T23:56:08.327 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.320+0000 7f92bbfff640 1 -- 172.21.15.196:0/53298209 <== mon.0 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 5) ==== 87083+0+0 (secure 0 0 0) 0x7f92d006d040 con 0x7f92c8187f30 2024-03-17T23:56:08.327 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.320+0000 7f92bbfff640 1 --2- 172.21.15.196:0/53298209 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f92c0069530 0x7f92c006b9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:08.327 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.320+0000 7f92bbfff640 1 -- 172.21.15.196:0/53298209 <== mon.0 v2:172.21.15.196:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f92d0114b20 con 0x7f92c8187f30 2024-03-17T23:56:08.327 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.320+0000 7f92cf7fe640 1 --2- 172.21.15.196:0/53298209 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f92c0069530 0x7f92c006b9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:08.327 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.320+0000 7fcdef0cb640 1 -- 172.21.15.196:0/1334455757 >> [v2:172.21.15.196:6800/1901246986,v1:172.21.15.196:6801/1901246986] conn(0x7fcde8160da0 msgr2=0x7fcde8072090 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:08.327 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.320+0000 7fcdef0cb640 1 --2- 172.21.15.196:0/1334455757 >> [v2:172.21.15.196:6800/1901246986,v1:172.21.15.196:6801/1901246986] conn(0x7fcde8160da0 0x7fcde8072090 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:08.328 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.320+0000 7fd85ee68640 1 -- 172.21.15.196:0/3141930148 shutdown_connections 2024-03-17T23:56:08.328 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.320+0000 7fd85ee68640 1 --2- 172.21.15.196:0/3141930148 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd8580c78d0 0x7fd8580c7ce0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:08.328 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.320+0000 7fd85ee68640 1 --2- 172.21.15.196:0/3141930148 >> v2:172.21.15.204:3300/0 conn(0x7fd8580715e0 0x7fd858071a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:08.328 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.320+0000 7fd85ee68640 1 -- 172.21.15.196:0/3141930148 >> 172.21.15.196:0/3141930148 conn(0x7fd85806ec10 msgr2=0x7fd85806f020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-17T23:56:08.328 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.320+0000 7fd85ee68640 1 -- 172.21.15.196:0/3141930148 shutdown_connections 2024-03-17T23:56:08.328 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.320+0000 7fd85ee68640 1 -- 172.21.15.196:0/3141930148 wait complete. 2024-03-17T23:56:08.328 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.320+0000 7f92cf7fe640 1 --2- 172.21.15.196:0/53298209 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f92c0069530 0x7f92c006b9f0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f92c40060f0 tx=0x7f92c400e040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:56:08.329 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.320+0000 7f5b1ecef640 1 Processor -- start 2024-03-17T23:56:08.329 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.320+0000 7f5b1ecef640 1 -- start start 2024-03-17T23:56:08.329 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.324+0000 7f5b1ecef640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f5b1806b2b0 0x7f5b1806b6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:08.329 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.324+0000 7f5b1ecef640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5b180c64b0 con 0x7f5b180727b0 2024-03-17T23:56:08.329 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.324+0000 7f5b1ecef640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5b18071470 con 0x7f5b1814fe80 2024-03-17T23:56:08.329 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.324+0000 7f5b1ecef640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 -- 0x7f5b18071240 con 0x7f5b1806b2b0 2024-03-17T23:56:08.330 INFO:teuthology.orchestra.run.smithi196.stdout:55834574853 2024-03-17T23:56:08.330 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-03-17T23:56:08.330 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.324+0000 7fcdef0cb640 1 -- 172.21.15.196:0/1334455757 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7fcdcc067760 msgr2=0x7fcdcc069c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:08.330 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.324+0000 7fcdef0cb640 1 --2- 172.21.15.196:0/1334455757 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7fcdcc067760 0x7fcdcc069c20 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fcde00ae000 tx=0x7fcde00a7070 comp rx=0 tx=0).stop 2024-03-17T23:56:08.331 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.324+0000 7fcdef0cb640 1 -- 172.21.15.196:0/1334455757 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcde815f010 msgr2=0x7fcde814e560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:08.331 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.324+0000 7fcdef0cb640 1 --2- 172.21.15.196:0/1334455757 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcde815f010 0x7fcde814e560 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fcdd800c5f0 tx=0x7fcdd800cab0 comp rx=0 tx=0).stop 2024-03-17T23:56:08.331 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.324+0000 7fcdee8ca640 1 -- 172.21.15.196:0/1334455757 reap_dead start 2024-03-17T23:56:08.332 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.324+0000 7f5b1d4ec640 1 --1- >> v1:172.21.15.196:6789/0 conn(0x7f5b180727b0 0x7f5b180c5da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.196:6789/0 says I am v1:172.21.15.196:50438/0 (socket says 172.21.15.196:50438) 2024-03-17T23:56:08.332 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.324+0000 7f5b1d4ec640 1 -- 172.21.15.196:0/3776817182 learned_addr learned my addr 172.21.15.196:0/3776817182 (peer_addr_for_me v1:172.21.15.196:0/0) 2024-03-17T23:56:08.332 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.324+0000 7f5b1cceb640 1 -- 172.21.15.196:0/3776817182 <== mon.0 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1771792867 0 0) 0x7f5b180c64b0 con 0x7f5b180727b0 2024-03-17T23:56:08.332 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.324+0000 7f5b1cceb640 1 -- 172.21.15.196:0/3776817182 --> v1:172.21.15.196:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5b04003530 con 0x7f5b180727b0 2024-03-17T23:56:08.332 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.324+0000 7f5b1cceb640 1 -- 172.21.15.196:0/3776817182 <== mon.0 v1:172.21.15.196:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2733740534 0 0) 0x7f5b04003530 con 0x7f5b180727b0 2024-03-17T23:56:08.332 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.324+0000 7f5b1cceb640 1 -- 172.21.15.196:0/3776817182 >> v2:172.21.15.204:3300/0 conn(0x7f5b1806b2b0 msgr2=0x7f5b1806b6b0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-03-17T23:56:08.332 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.324+0000 7f5b1cceb640 1 --2- 172.21.15.196:0/3776817182 >> v2:172.21.15.204:3300/0 conn(0x7f5b1806b2b0 0x7f5b1806b6b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:08.332 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.324+0000 7f5b1cceb640 1 -- 172.21.15.196:0/3776817182 >> v1:172.21.15.204:6789/0 conn(0x7f5b1814fe80 legacy=0x7f5b18156880 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-03-17T23:56:08.332 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.324+0000 7f5b1cceb640 1 -- 172.21.15.196:0/3776817182 --> v1:172.21.15.196:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b18159490 con 0x7f5b180727b0 2024-03-17T23:56:08.332 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.324+0000 7f5b1cceb640 1 -- 172.21.15.196:0/3776817182 <== mon.0 v1:172.21.15.196:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 981458915 0 0) 0x7f5b10001a00 con 0x7f5b180727b0 2024-03-17T23:56:08.332 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.324+0000 7f5b1cceb640 1 -- 172.21.15.196:0/3776817182 >> v1:172.21.15.196:6789/0 conn(0x7f5b180727b0 legacy=0x7f5b180c5da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:08.332 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.324+0000 7f5b1cceb640 1 --2- 172.21.15.196:0/3776817182 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5b040039c0 0x7f5b04003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:08.332 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.324+0000 7f5b1cceb640 1 --2- 172.21.15.196:0/3776817182 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5b04004810 0x7f5b04004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:08.332 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.324+0000 7f5b1cceb640 1 --2- 172.21.15.196:0/3776817182 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5b040052f0 0x7f5b0400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:08.333 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.324+0000 7f5b1cceb640 1 -- 172.21.15.196:0/3776817182 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f5b0400c280 con 0x7f5b04004810 2024-03-17T23:56:08.333 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.324+0000 7f5b1cceb640 1 -- 172.21.15.196:0/3776817182 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f5b0400c430 con 0x7f5b040052f0 2024-03-17T23:56:08.333 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.324+0000 7f5b1cceb640 1 -- 172.21.15.196:0/3776817182 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f5b0400c630 con 0x7f5b040039c0 2024-03-17T23:56:08.333 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.324+0000 7f5b1d4ec640 1 --2- 172.21.15.196:0/3776817182 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5b04004810 0x7f5b04004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:08.333 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.324+0000 7f5b1d4ec640 1 -- 172.21.15.196:0/3776817182 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5b040039c0 msgr2=0x7f5b04003dc0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-17T23:56:08.333 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.324+0000 7f5b1d4ec640 1 --2- 172.21.15.196:0/3776817182 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5b040039c0 0x7f5b04003dc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:08.333 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.324+0000 7f5b1d4ec640 1 -- 172.21.15.196:0/3776817182 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5b040052f0 msgr2=0x7f5b0400b9d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-17T23:56:08.333 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.324+0000 7f5b1d4ec640 1 --2- 172.21.15.196:0/3776817182 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5b040052f0 0x7f5b0400b9d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:08.333 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.324+0000 7f5b1d4ec640 1 -- 172.21.15.196:0/3776817182 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b04003530 con 0x7f5b04004810 2024-03-17T23:56:08.333 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.324+0000 7fd85ee68640 1 Processor -- start 2024-03-17T23:56:08.334 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.324+0000 7fd85ee68640 1 -- start start 2024-03-17T23:56:08.334 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.324+0000 7fd85ee68640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd8580715e0 0x7fd858157080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:08.334 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.324+0000 7fd85ee68640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd8580c78d0 0x7fd8581f4600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:08.334 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.324+0000 7fd85ee68640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd85814ff60 0x7fd858145c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:08.334 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.324+0000 7fd85ee68640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fd858156660 con 0x7fd8580c78d0 2024-03-17T23:56:08.334 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.324+0000 7fd85ee68640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7fd858156380 con 0x7fd85814ff60 2024-03-17T23:56:08.334 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.324+0000 7fd85ee68640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7fd858150340 con 0x7fd8580715e0 2024-03-17T23:56:08.334 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.324+0000 7fd85d405640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd85814ff60 0x7fd858145c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:08.334 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.324+0000 7fd85cc04640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd8580715e0 0x7fd858157080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:08.334 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.324+0000 7fd85cc04640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd8580715e0 0x7fd858157080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3301/0 says I am v2:172.21.15.196:48326/0 (socket says 172.21.15.196:48326) 2024-03-17T23:56:08.334 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.324+0000 7fd85cc04640 1 -- 172.21.15.196:0/1035451956 learned_addr learned my addr 172.21.15.196:0/1035451956 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-03-17T23:56:08.334 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.324+0000 7fd857fff640 1 --2- 172.21.15.196:0/1035451956 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd8580c78d0 0x7fd8581f4600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:08.334 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.324+0000 7fd857fff640 1 -- 172.21.15.196:0/1035451956 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd8580715e0 msgr2=0x7fd858157080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:08.335 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.324+0000 7fd857fff640 1 --2- 172.21.15.196:0/1035451956 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd8580715e0 0x7fd858157080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:08.335 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.324+0000 7fd857fff640 1 -- 172.21.15.196:0/1035451956 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd85814ff60 msgr2=0x7fd858145c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:08.335 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.324+0000 7fd857fff640 1 --2- 172.21.15.196:0/1035451956 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd85814ff60 0x7fd858145c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:08.335 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.324+0000 7fd857fff640 1 -- 172.21.15.196:0/1035451956 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd858157cd0 con 0x7fd8580c78d0 2024-03-17T23:56:08.335 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.324+0000 7fd857fff640 1 --2- 172.21.15.196:0/1035451956 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd8580c78d0 0x7fd8581f4600 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fd84c00b3f0 tx=0x7fd84c00b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:56:08.335 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.324+0000 7fd8557fa640 1 -- 172.21.15.196:0/1035451956 <== mon.0 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd84c015020 con 0x7fd8580c78d0 2024-03-17T23:56:08.335 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.324+0000 7fd8557fa640 1 -- 172.21.15.196:0/1035451956 <== mon.0 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd84c011830 con 0x7fd8580c78d0 2024-03-17T23:56:08.335 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.324+0000 7fd85ee68640 1 -- 172.21.15.196:0/1035451956 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd85806bc20 con 0x7fd8580c78d0 2024-03-17T23:56:08.335 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.324+0000 7fd8557fa640 1 -- 172.21.15.196:0/1035451956 <== mon.0 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd84c011c20 con 0x7fd8580c78d0 2024-03-17T23:56:08.335 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.324+0000 7fd85ee68640 1 -- 172.21.15.196:0/1035451956 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd858158270 con 0x7fd8580c78d0 2024-03-17T23:56:08.336 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.328+0000 7f92d5cce640 1 --2- 172.21.15.196:0/53298209 >> [v2:172.21.15.196:6816/1104340623,v1:172.21.15.196:6817/1104340623] conn(0x7f92b0001660 0x7f92b0003b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:08.336 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.328+0000 7f92d5cce640 1 -- 172.21.15.196:0/53298209 --> [v2:172.21.15.196:6816/1104340623,v1:172.21.15.196:6817/1104340623] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f92b0006bc0 con 0x7f92b0001660 2024-03-17T23:56:08.336 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.328+0000 7f92ceffd640 1 --2- 172.21.15.196:0/53298209 >> [v2:172.21.15.196:6816/1104340623,v1:172.21.15.196:6817/1104340623] conn(0x7f92b0001660 0x7f92b0003b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:08.336 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.328+0000 7f92ceffd640 1 --2- 172.21.15.196:0/53298209 >> [v2:172.21.15.196:6816/1104340623,v1:172.21.15.196:6817/1104340623] conn(0x7f92b0001660 0x7f92b0003b20 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:56:08.336 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.328+0000 7fd8557fa640 1 -- 172.21.15.196:0/1035451956 <== mon.0 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 5) ==== 87083+0+0 (secure 0 0 0) 0x7fd84c018020 con 0x7fd8580c78d0 2024-03-17T23:56:08.336 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.328+0000 7fd85ee68640 1 -- 172.21.15.196:0/1035451956 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fd85804f550 con 0x7fd8580c78d0 2024-03-17T23:56:08.336 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.328+0000 7f92bbfff640 1 -- 172.21.15.196:0/53298209 <== osd.3 v2:172.21.15.196:6816/1104340623 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f92b0006bc0 con 0x7f92b0001660 2024-03-17T23:56:08.337 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.328+0000 7f5b1d4ec640 1 --2- 172.21.15.196:0/3776817182 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5b04004810 0x7f5b04004c90 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f5b10005440 tx=0x7f5b1001f7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50244f5d3f1ce0af server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:56:08.337 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.328+0000 7fcdef0cb640 1 -- 172.21.15.196:0/1334455757 shutdown_connections 2024-03-17T23:56:08.337 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.328+0000 7fcdef0cb640 1 -- 172.21.15.196:0/1334455757 >> 172.21.15.196:0/1334455757 conn(0x7fcde80cb3a0 msgr2=0x7fcde81575d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-17T23:56:08.337 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.328+0000 7fcdef0cb640 1 -- 172.21.15.196:0/1334455757 shutdown_connections 2024-03-17T23:56:08.337 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.328+0000 7fcdef0cb640 1 -- 172.21.15.196:0/1334455757 wait complete. 2024-03-17T23:56:08.338 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.328+0000 7f5b1e4ee640 1 -- 172.21.15.196:0/3776817182 reap_dead start 2024-03-17T23:56:08.338 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.328+0000 7fd8557fa640 1 --2- 172.21.15.196:0/1035451956 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7fd8400677b0 0x7fd840069c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:08.338 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.328+0000 7fd8557fa640 1 -- 172.21.15.196:0/1035451956 <== mon.0 v2:172.21.15.196:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fd84c085690 con 0x7fd8580c78d0 2024-03-17T23:56:08.338 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.328+0000 7fd8557fa640 1 --2- 172.21.15.196:0/1035451956 >> [v2:172.21.15.196:6824/673819559,v1:172.21.15.196:6825/673819559] conn(0x7fd84006f950 0x7fd840071d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:08.338 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.328+0000 7fd8557fa640 1 -- 172.21.15.196:0/1035451956 --> [v2:172.21.15.196:6824/673819559,v1:172.21.15.196:6825/673819559] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd84c004460 con 0x7fd84006f950 2024-03-17T23:56:08.339 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.328+0000 7fd85d405640 1 --2- 172.21.15.196:0/1035451956 >> [v2:172.21.15.196:6824/673819559,v1:172.21.15.196:6825/673819559] conn(0x7fd84006f950 0x7fd840071d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:08.339 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.328+0000 7fd85cc04640 1 --2- 172.21.15.196:0/1035451956 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7fd8400677b0 0x7fd840069c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:08.339 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.328+0000 7fd85d405640 1 --2- 172.21.15.196:0/1035451956 >> [v2:172.21.15.196:6824/673819559,v1:172.21.15.196:6825/673819559] conn(0x7fd84006f950 0x7fd840071d70 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:56:08.339 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.332+0000 7fd85cc04640 1 --2- 172.21.15.196:0/1035451956 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7fd8400677b0 0x7fd840069c70 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fd8480099a0 tx=0x7fd8480090e0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:56:08.339 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.332+0000 7fd8557fa640 1 -- 172.21.15.196:0/1035451956 <== osd.2 v2:172.21.15.196:6824/673819559 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fd84c004460 con 0x7fd84006f950 2024-03-17T23:56:08.339 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.332+0000 7f5b1cceb640 1 -- 172.21.15.196:0/3776817182 <== mon.0 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b10005060 con 0x7f5b04004810 2024-03-17T23:56:08.339 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.332+0000 7f5b1cceb640 1 -- 172.21.15.196:0/3776817182 <== mon.0 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b10008270 con 0x7f5b04004810 2024-03-17T23:56:08.339 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.332+0000 7f5b1cceb640 1 -- 172.21.15.196:0/3776817182 <== mon.0 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b100ab070 con 0x7f5b04004810 2024-03-17T23:56:08.340 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.332+0000 7fd8557fa640 1 -- 172.21.15.196:0/1035451956 <== mon.0 v2:172.21.15.196:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fd84c051ec0 con 0x7fd8580c78d0 2024-03-17T23:56:08.340 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.332+0000 7f5b1ecef640 1 -- 172.21.15.196:0/3776817182 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5b04004810 msgr2=0x7f5b04004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:08.341 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.332+0000 7f5b1ecef640 1 --2- 172.21.15.196:0/3776817182 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5b04004810 0x7f5b04004c90 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f5b10005440 tx=0x7f5b1001f7f0 comp rx=0 tx=0).stop 2024-03-17T23:56:08.350 INFO:teuthology.orchestra.run.smithi196.stdout:55834574852 2024-03-17T23:56:08.350 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-03-17T23:56:08.351 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.348+0000 7f5b1ecef640 1 -- 172.21.15.196:0/3776817182 shutdown_connections 2024-03-17T23:56:08.351 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.348+0000 7f5b1ecef640 1 --2- 172.21.15.196:0/3776817182 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5b04004810 0x7f5b04004c90 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:08.351 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.348+0000 7f5b1ecef640 1 -- 172.21.15.196:0/3776817182 >> 172.21.15.196:0/3776817182 conn(0x7f5b180cb3a0 msgr2=0x7f5b180cb7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-17T23:56:08.351 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.348+0000 7f5b1ecef640 1 -- 172.21.15.196:0/3776817182 shutdown_connections 2024-03-17T23:56:08.352 INFO:teuthology.orchestra.run.smithi196.stdout:55834574852 2024-03-17T23:56:08.352 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-03-17T23:56:08.353 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.348+0000 7f5b1ecef640 1 -- 172.21.15.196:0/3776817182 wait complete. 2024-03-17T23:56:08.353 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.348+0000 7f5b1ecef640 1 Processor -- start 2024-03-17T23:56:08.354 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.352+0000 7f5b1ecef640 1 -- start start 2024-03-17T23:56:08.354 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.352+0000 7f5b1ecef640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5b04004810 0x7f5b18144a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:08.354 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.352+0000 7f5b1ecef640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5b1814e450 0x7f5b18146d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:08.354 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.352+0000 7f5b1ecef640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5b181fdc10 0x7f5b181fe0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:08.354 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.352+0000 7f5b1ecef640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f5b18150260 con 0x7f5b04004810 2024-03-17T23:56:08.354 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.352+0000 7f5b1ecef640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f5b18159a50 con 0x7f5b1814e450 2024-03-17T23:56:08.354 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.352+0000 7f5b1ecef640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f5b18071b00 con 0x7f5b181fdc10 2024-03-17T23:56:08.354 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.352+0000 7f5b1e4ee640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5b181fdc10 0x7f5b181fe0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:08.355 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.352+0000 7f5b1d4ec640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5b1814e450 0x7f5b18146d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:08.355 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.352+0000 7f5b1e4ee640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5b181fdc10 0x7f5b181fe0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3301/0 says I am v2:172.21.15.196:48334/0 (socket says 172.21.15.196:48334) 2024-03-17T23:56:08.355 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.352+0000 7f5b1e4ee640 1 -- 172.21.15.196:0/355702335 learned_addr learned my addr 172.21.15.196:0/355702335 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-03-17T23:56:08.356 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.352+0000 7f5b1dced640 1 --2- 172.21.15.196:0/355702335 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5b04004810 0x7f5b18144a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:08.356 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.352+0000 7f5b1e4ee640 1 -- 172.21.15.196:0/355702335 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5b1814e450 msgr2=0x7f5b18146d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:08.356 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.352+0000 7f5b1e4ee640 1 --2- 172.21.15.196:0/355702335 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5b1814e450 0x7f5b18146d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:08.356 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.352+0000 7f5b1e4ee640 1 -- 172.21.15.196:0/355702335 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5b04004810 msgr2=0x7f5b18144a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:08.356 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.352+0000 7f5b1e4ee640 1 --2- 172.21.15.196:0/355702335 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5b04004810 0x7f5b18144a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:08.356 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.352+0000 7f5b1e4ee640 1 -- 172.21.15.196:0/355702335 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b181450d0 con 0x7f5b181fdc10 2024-03-17T23:56:08.356 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.352+0000 7f5b1e4ee640 1 --2- 172.21.15.196:0/355702335 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5b181fdc10 0x7f5b181fe0c0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f5b18070ab0 tx=0x7f5b1400b820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:56:08.357 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.352+0000 7f5b0e7fc640 1 -- 172.21.15.196:0/355702335 <== mon.2 v2:172.21.15.204:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b14016070 con 0x7f5b181fdc10 2024-03-17T23:56:08.357 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.352+0000 7f5b1ecef640 1 -- 172.21.15.196:0/355702335 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5b181453b0 con 0x7f5b181fdc10 2024-03-17T23:56:08.357 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.356+0000 7f5b1ecef640 1 -- 172.21.15.196:0/355702335 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f5b1814ab00 con 0x7f5b181fdc10 2024-03-17T23:56:08.357 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.356+0000 7f5b0e7fc640 1 -- 172.21.15.196:0/355702335 <== mon.2 v2:172.21.15.204:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b14003c90 con 0x7f5b181fdc10 2024-03-17T23:56:08.360 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.360+0000 7f5b0e7fc640 1 -- 172.21.15.196:0/355702335 <== mon.2 v2:172.21.15.204:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b14005310 con 0x7f5b181fdc10 2024-03-17T23:56:08.360 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.360+0000 7f5b0e7fc640 1 -- 172.21.15.196:0/355702335 <== mon.2 v2:172.21.15.204:3301/0 4 ==== mgrmap(e 5) ==== 87083+0+0 (secure 0 0 0) 0x7f5b14019070 con 0x7f5b181fdc10 2024-03-17T23:56:08.361 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.360+0000 7f5b0e7fc640 1 --2- 172.21.15.196:0/355702335 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f5b040696e0 0x7f5b0406bba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:08.361 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.360+0000 7f5b0e7fc640 1 -- 172.21.15.196:0/355702335 <== mon.2 v2:172.21.15.204:3301/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f5b14084870 con 0x7f5b181fdc10 2024-03-17T23:56:08.361 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.360+0000 7f5b1dced640 1 --2- 172.21.15.196:0/355702335 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f5b040696e0 0x7f5b0406bba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:08.362 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.360+0000 7f5b1dced640 1 --2- 172.21.15.196:0/355702335 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f5b040696e0 0x7f5b0406bba0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f5b18050860 tx=0x7f5b08009060 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:56:08.362 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.360+0000 7f5b1ecef640 1 --2- 172.21.15.196:0/355702335 >> [v2:172.21.15.204:6816/658561863,v1:172.21.15.204:6818/658561863] conn(0x7f5b00001660 0x7f5b00003b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:08.362 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.360+0000 7f5b1ecef640 1 -- 172.21.15.196:0/355702335 --> [v2:172.21.15.204:6816/658561863,v1:172.21.15.204:6818/658561863] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f5b00006bc0 con 0x7f5b00001660 2024-03-17T23:56:08.363 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.360+0000 7f5b1d4ec640 1 --2- 172.21.15.196:0/355702335 >> [v2:172.21.15.204:6816/658561863,v1:172.21.15.204:6818/658561863] conn(0x7f5b00001660 0x7f5b00003b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:08.363 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.360+0000 7f5b1d4ec640 1 --2- 172.21.15.196:0/355702335 >> [v2:172.21.15.204:6816/658561863,v1:172.21.15.204:6818/658561863] conn(0x7f5b00001660 0x7f5b00003b20 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:56:08.364 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.364+0000 7f5b0e7fc640 1 -- 172.21.15.196:0/355702335 <== osd.4 v2:172.21.15.204:6816/658561863 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f5b00006bc0 con 0x7f5b00001660 2024-03-17T23:56:08.365 INFO:teuthology.orchestra.run.smithi196.stdout:55834574853 2024-03-17T23:56:08.366 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-03-17T23:56:08.368 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.368+0000 7fd85ee68640 1 -- 172.21.15.196:0/1035451956 --> [v2:172.21.15.196:6824/673819559,v1:172.21.15.196:6825/673819559] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fd834001000 con 0x7fd84006f950 2024-03-17T23:56:08.369 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.368+0000 7f0e52337640 1 Processor -- start 2024-03-17T23:56:08.369 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.368+0000 7f0e52337640 1 -- start start 2024-03-17T23:56:08.369 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.368+0000 7fd8557fa640 1 -- 172.21.15.196:0/1035451956 <== osd.2 v2:172.21.15.196:6824/673819559 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fd834001000 con 0x7fd84006f950 2024-03-17T23:56:08.370 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.368+0000 7f92d5cce640 1 -- 172.21.15.196:0/53298209 --> [v2:172.21.15.196:6816/1104340623,v1:172.21.15.196:6817/1104340623] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f92b0005c50 con 0x7f92b0001660 2024-03-17T23:56:08.370 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.368+0000 7fd85ee68640 1 -- 172.21.15.196:0/1035451956 >> [v2:172.21.15.196:6824/673819559,v1:172.21.15.196:6825/673819559] conn(0x7fd84006f950 msgr2=0x7fd840071d70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:08.370 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.368+0000 7fd85ee68640 1 --2- 172.21.15.196:0/1035451956 >> [v2:172.21.15.196:6824/673819559,v1:172.21.15.196:6825/673819559] conn(0x7fd84006f950 0x7fd840071d70 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:08.371 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.368+0000 7fd85ee68640 1 -- 172.21.15.196:0/1035451956 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7fd8400677b0 msgr2=0x7fd840069c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:08.371 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.368+0000 7fd85ee68640 1 --2- 172.21.15.196:0/1035451956 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7fd8400677b0 0x7fd840069c70 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fd8480099a0 tx=0x7fd8480090e0 comp rx=0 tx=0).stop 2024-03-17T23:56:08.371 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.368+0000 7fd85ee68640 1 -- 172.21.15.196:0/1035451956 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd8580c78d0 msgr2=0x7fd8581f4600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:08.371 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.368+0000 7fd85ee68640 1 --2- 172.21.15.196:0/1035451956 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd8580c78d0 0x7fd8581f4600 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fd84c00b3f0 tx=0x7fd84c00b8b0 comp rx=0 tx=0).stop 2024-03-17T23:56:08.371 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.368+0000 7fd85d405640 1 -- 172.21.15.196:0/1035451956 reap_dead start 2024-03-17T23:56:08.371 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.368+0000 7f0e52337640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f0e4c0c8300 0x7f0e4c0c28a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:08.371 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.368+0000 7f0e52337640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0e4c0c86e0 0x7f0e4c1579e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:08.371 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.368+0000 7f0e52337640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0e4c0c6b20 con 0x7f0e4c157f20 2024-03-17T23:56:08.371 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.368+0000 7f0e52337640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7f0e4c15b100 con 0x7f0e4c0c8300 2024-03-17T23:56:08.371 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.368+0000 7f0e52337640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f0e4c15be80 con 0x7f0e4c0c86e0 2024-03-17T23:56:08.371 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.368+0000 7f0e508d4640 1 --1- >> v1:172.21.15.196:6789/0 conn(0x7f0e4c157f20 0x7f0e4c151890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.196:6789/0 says I am v1:172.21.15.196:50442/0 (socket says 172.21.15.196:50442) 2024-03-17T23:56:08.371 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.368+0000 7f0e508d4640 1 -- 172.21.15.196:0/1304212258 learned_addr learned my addr 172.21.15.196:0/1304212258 (peer_addr_for_me v1:172.21.15.196:0/0) 2024-03-17T23:56:08.372 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.368+0000 7fd85ee68640 1 -- 172.21.15.196:0/1035451956 shutdown_connections 2024-03-17T23:56:08.372 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.368+0000 7fd85ee68640 1 -- 172.21.15.196:0/1035451956 >> 172.21.15.196:0/1035451956 conn(0x7fd85806ec10 msgr2=0x7fd85814e0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-17T23:56:08.372 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.368+0000 7f92bbfff640 1 -- 172.21.15.196:0/53298209 <== osd.3 v2:172.21.15.196:6816/1104340623 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f92b0005c50 con 0x7f92b0001660 2024-03-17T23:56:08.372 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.368+0000 7f0e4bfff640 1 --2- 172.21.15.196:0/1304212258 >> v2:172.21.15.196:3300/0 conn(0x7f0e4c0c8300 0x7f0e4c0c28a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:08.373 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.368+0000 7f0e4b7fe640 1 --2- 172.21.15.196:0/1304212258 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0e4c0c86e0 0x7f0e4c1579e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:08.373 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.368+0000 7f0e4bfff640 1 -- 172.21.15.196:0/1304212258 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0e4c0c86e0 msgr2=0x7f0e4c1579e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-17T23:56:08.373 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.368+0000 7f0e4bfff640 1 --2- 172.21.15.196:0/1304212258 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0e4c0c86e0 0x7f0e4c1579e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:08.373 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.368+0000 7f0e4bfff640 1 -- 172.21.15.196:0/1304212258 >> v1:172.21.15.196:6789/0 conn(0x7f0e4c157f20 legacy=0x7f0e4c151890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:08.373 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.368+0000 7f0e4bfff640 1 -- 172.21.15.196:0/1304212258 --> v2:172.21.15.196:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e4c0c6860 con 0x7f0e4c0c8300 2024-03-17T23:56:08.374 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.372+0000 7fd85ee68640 1 -- 172.21.15.196:0/1035451956 shutdown_connections 2024-03-17T23:56:08.374 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.372+0000 7fd85ee68640 1 -- 172.21.15.196:0/1035451956 wait complete. 2024-03-17T23:56:08.374 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.372+0000 7f0e4bfff640 1 --2- 172.21.15.196:0/1304212258 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0e4c0c8300 0x7f0e4c0c28a0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f0e3c009a20 tx=0x7f0e3c01c5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b6830cc3d1824f9 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:56:08.375 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.372+0000 7f92d5cce640 1 -- 172.21.15.196:0/53298209 >> [v2:172.21.15.196:6816/1104340623,v1:172.21.15.196:6817/1104340623] conn(0x7f92b0001660 msgr2=0x7f92b0003b20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:08.375 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.372+0000 7f92d5cce640 1 --2- 172.21.15.196:0/53298209 >> [v2:172.21.15.196:6816/1104340623,v1:172.21.15.196:6817/1104340623] conn(0x7f92b0001660 0x7f92b0003b20 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:08.375 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.372+0000 7f0e4affd640 1 -- 172.21.15.196:0/1304212258 <== mon.0 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e3c0aa670 con 0x7f0e4c0c8300 2024-03-17T23:56:08.375 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.372+0000 7f92d5cce640 1 -- 172.21.15.196:0/53298209 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f92c0069530 msgr2=0x7f92c006b9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:08.375 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.372+0000 7f92d5cce640 1 --2- 172.21.15.196:0/53298209 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f92c0069530 0x7f92c006b9f0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f92c40060f0 tx=0x7f92c400e040 comp rx=0 tx=0).stop 2024-03-17T23:56:08.376 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.372+0000 7f0e4affd640 1 -- 172.21.15.196:0/1304212258 <== mon.0 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0e3c0af070 con 0x7f0e4c0c8300 2024-03-17T23:56:08.376 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.372+0000 7f92d5cce640 1 -- 172.21.15.196:0/53298209 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f92c8187f30 msgr2=0x7f92c804dfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:08.376 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.372+0000 7f92d5cce640 1 --2- 172.21.15.196:0/53298209 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f92c8187f30 0x7f92c804dfc0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f92d0064d80 tx=0x7f92d00739e0 comp rx=0 tx=0).stop 2024-03-17T23:56:08.377 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.372+0000 7f92cffff640 1 -- 172.21.15.196:0/53298209 reap_dead start 2024-03-17T23:56:08.377 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.372+0000 7f92d5cce640 1 -- 172.21.15.196:0/53298209 shutdown_connections 2024-03-17T23:56:08.377 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.372+0000 7f92d5cce640 1 -- 172.21.15.196:0/53298209 >> 172.21.15.196:0/53298209 conn(0x7f92c80501c0 msgr2=0x7f92c80f4420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-17T23:56:08.377 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.372+0000 7f92d5cce640 1 -- 172.21.15.196:0/53298209 shutdown_connections 2024-03-17T23:56:08.377 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.372+0000 7f92d5cce640 1 -- 172.21.15.196:0/53298209 wait complete. 2024-03-17T23:56:08.377 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.372+0000 7f0e52337640 1 -- 172.21.15.196:0/1304212258 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0e4c0c8300 msgr2=0x7f0e4c0c28a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:08.377 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.372+0000 7f0e52337640 1 --2- 172.21.15.196:0/1304212258 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0e4c0c8300 0x7f0e4c0c28a0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f0e3c009a20 tx=0x7f0e3c01c5b0 comp rx=0 tx=0).stop 2024-03-17T23:56:08.378 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.376+0000 7f0e52337640 1 -- 172.21.15.196:0/1304212258 shutdown_connections 2024-03-17T23:56:08.378 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.376+0000 7f0e52337640 1 --2- 172.21.15.196:0/1304212258 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0e4c0c86e0 0x7f0e4c1579e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:08.378 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.376+0000 7f0e52337640 1 --2- 172.21.15.196:0/1304212258 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0e4c0c8300 0x7f0e4c0c28a0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:08.378 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.376+0000 7f0e52337640 1 -- 172.21.15.196:0/1304212258 >> 172.21.15.196:0/1304212258 conn(0x7f0e4c06ec10 msgr2=0x7f0e4c06f020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-17T23:56:08.378 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.376+0000 7f0e52337640 1 -- 172.21.15.196:0/1304212258 shutdown_connections 2024-03-17T23:56:08.378 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.376+0000 7f0e52337640 1 -- 172.21.15.196:0/1304212258 wait complete. 2024-03-17T23:56:08.378 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.376+0000 7f0e52337640 1 Processor -- start 2024-03-17T23:56:08.380 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.376+0000 7f0e52337640 1 -- start start 2024-03-17T23:56:08.380 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.376+0000 7f0e52337640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0e4c0c8300 0x7f0e4c1fc8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:08.380 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.380+0000 7f0e4bfff640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0e4c0c8300 0x7f0e4c1fc8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:08.380 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.380+0000 7f0e4bfff640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0e4c0c8300 0x7f0e4c1fc8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.196:34618/0 (socket says 172.21.15.196:34618) 2024-03-17T23:56:08.381 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.380+0000 7f0e52337640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0e4c0c86e0 0x7f0e4c14b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:08.381 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.380+0000 7f0e52337640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0e4c157f20 0x7f0e4c0ca110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:08.381 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.380+0000 7f0e4b7fe640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0e4c0c86e0 0x7f0e4c14b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:08.381 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.380+0000 7f0e4b7fe640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0e4c0c86e0 0x7f0e4c14b0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3301/0 says I am v2:172.21.15.196:48352/0 (socket says 172.21.15.196:48352) 2024-03-17T23:56:08.381 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.380+0000 7f0e4b7fe640 1 -- 172.21.15.196:0/2352451484 learned_addr learned my addr 172.21.15.196:0/2352451484 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-03-17T23:56:08.381 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.380+0000 7f0e508d4640 1 --2- 172.21.15.196:0/2352451484 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0e4c157f20 0x7f0e4c0ca110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:08.383 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.380+0000 7f0e52337640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f0e4c15b960 con 0x7f0e4c0c8300 2024-03-17T23:56:08.383 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.380+0000 7f0e52337640 1 -- 172.21.15.196:0/2352451484 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f0e4c15b680 con 0x7f0e4c157f20 2024-03-17T23:56:08.383 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.380+0000 7f0e52337640 1 -- 172.21.15.196:0/2352451484 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f0e4c0c2de0 con 0x7f0e4c0c86e0 2024-03-17T23:56:08.383 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.380+0000 7f0e508d4640 1 -- 172.21.15.196:0/2352451484 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0e4c0c86e0 msgr2=0x7f0e4c14b0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:08.383 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.380+0000 7f0e508d4640 1 --2- 172.21.15.196:0/2352451484 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0e4c0c86e0 0x7f0e4c14b0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:08.383 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.380+0000 7f0e508d4640 1 -- 172.21.15.196:0/2352451484 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0e4c0c8300 msgr2=0x7f0e4c1fc8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:08.383 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.380+0000 7f0e508d4640 1 --2- 172.21.15.196:0/2352451484 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0e4c0c8300 0x7f0e4c1fc8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:08.383 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.380+0000 7f0e508d4640 1 -- 172.21.15.196:0/2352451484 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e4c1fce00 con 0x7f0e4c157f20 2024-03-17T23:56:08.383 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.380+0000 7f0e508d4640 1 --2- 172.21.15.196:0/2352451484 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0e4c157f20 0x7f0e4c0ca110 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f0e44001610 tx=0x7f0e44009430 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:56:08.383 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.380+0000 7f0e48ff9640 1 -- 172.21.15.196:0/2352451484 <== mon.1 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e44009ab0 con 0x7f0e4c157f20 2024-03-17T23:56:08.384 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.380+0000 7f0e48ff9640 1 -- 172.21.15.196:0/2352451484 <== mon.1 v2:172.21.15.204:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0e44009c70 con 0x7f0e4c157f20 2024-03-17T23:56:08.384 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.380+0000 7f0e48ff9640 1 -- 172.21.15.196:0/2352451484 <== mon.1 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e440062b0 con 0x7f0e4c157f20 2024-03-17T23:56:08.384 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.380+0000 7f0e52337640 1 -- 172.21.15.196:0/2352451484 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0e4c14b630 con 0x7f0e4c157f20 2024-03-17T23:56:08.384 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.380+0000 7f0e52337640 1 -- 172.21.15.196:0/2352451484 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0e4c151ed0 con 0x7f0e4c157f20 2024-03-17T23:56:08.386 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.384+0000 7f0e48ff9640 1 -- 172.21.15.196:0/2352451484 <== mon.1 v2:172.21.15.204:3300/0 4 ==== mgrmap(e 5) ==== 87083+0+0 (secure 0 0 0) 0x7f0e44006450 con 0x7f0e4c157f20 2024-03-17T23:56:08.386 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.384+0000 7f0e48ff9640 1 --2- 172.21.15.196:0/2352451484 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f0e34067870 0x7f0e34069d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:08.387 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.384+0000 7f0e48ff9640 1 -- 172.21.15.196:0/2352451484 <== mon.1 v2:172.21.15.204:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f0e44087a50 con 0x7f0e4c157f20 2024-03-17T23:56:08.387 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.384+0000 7f0e4bfff640 1 --2- 172.21.15.196:0/2352451484 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f0e34067870 0x7f0e34069d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:08.388 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.384+0000 7f0e4bfff640 1 --2- 172.21.15.196:0/2352451484 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f0e34067870 0x7f0e34069d30 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f0e3c0ae000 tx=0x7f0e3c0a7000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:56:08.391 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.388+0000 7f5b1ecef640 1 -- 172.21.15.196:0/355702335 --> [v2:172.21.15.204:6816/658561863,v1:172.21.15.204:6818/658561863] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f5b00005c50 con 0x7f5b00001660 2024-03-17T23:56:08.392 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.392+0000 7f5b0e7fc640 1 -- 172.21.15.196:0/355702335 <== osd.4 v2:172.21.15.204:6816/658561863 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f5b00005c50 con 0x7f5b00001660 2024-03-17T23:56:08.402 INFO:teuthology.orchestra.run.smithi196.stdout:55834574854 2024-03-17T23:56:08.402 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-03-17T23:56:08.403 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.400+0000 7f0e52337640 1 --2- 172.21.15.196:0/2352451484 >> [v2:172.21.15.204:6800/3361860686,v1:172.21.15.204:6801/3361860686] conn(0x7f0e2c001660 0x7f0e2c003b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:08.403 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.400+0000 7f0e52337640 1 -- 172.21.15.196:0/2352451484 --> [v2:172.21.15.204:6800/3361860686,v1:172.21.15.204:6801/3361860686] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f0e2c006bc0 con 0x7f0e2c001660 2024-03-17T23:56:08.403 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.400+0000 7f0e4b7fe640 1 --2- 172.21.15.196:0/2352451484 >> [v2:172.21.15.204:6800/3361860686,v1:172.21.15.204:6801/3361860686] conn(0x7f0e2c001660 0x7f0e2c003b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:08.404 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.400+0000 7f5afbfff640 1 -- 172.21.15.196:0/355702335 >> [v2:172.21.15.204:6816/658561863,v1:172.21.15.204:6818/658561863] conn(0x7f5b00001660 msgr2=0x7f5b00003b20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:08.404 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.400+0000 7f5afbfff640 1 --2- 172.21.15.196:0/355702335 >> [v2:172.21.15.204:6816/658561863,v1:172.21.15.204:6818/658561863] conn(0x7f5b00001660 0x7f5b00003b20 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:08.404 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.400+0000 7f5afbfff640 1 -- 172.21.15.196:0/355702335 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f5b040696e0 msgr2=0x7f5b0406bba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:08.404 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.400+0000 7f0e4b7fe640 1 --2- 172.21.15.196:0/2352451484 >> [v2:172.21.15.204:6800/3361860686,v1:172.21.15.204:6801/3361860686] conn(0x7f0e2c001660 0x7f0e2c003b20 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:56:08.405 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.400+0000 7f5afbfff640 1 --2- 172.21.15.196:0/355702335 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f5b040696e0 0x7f5b0406bba0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f5b18050860 tx=0x7f5b08009060 comp rx=0 tx=0).stop 2024-03-17T23:56:08.405 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.400+0000 7f5afbfff640 1 -- 172.21.15.196:0/355702335 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5b181fdc10 msgr2=0x7f5b181fe0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:08.405 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.400+0000 7f5afbfff640 1 --2- 172.21.15.196:0/355702335 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5b181fdc10 0x7f5b181fe0c0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f5b18070ab0 tx=0x7f5b1400b820 comp rx=0 tx=0).stop 2024-03-17T23:56:08.405 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.400+0000 7f5b1e4ee640 1 -- 172.21.15.196:0/355702335 reap_dead start 2024-03-17T23:56:08.405 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.400+0000 7f5afbfff640 1 -- 172.21.15.196:0/355702335 shutdown_connections 2024-03-17T23:56:08.406 INFO:teuthology.orchestra.run.smithi196.stdout:55834574855 2024-03-17T23:56:08.406 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-03-17T23:56:08.407 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.404+0000 7f5afbfff640 1 -- 172.21.15.196:0/355702335 >> 172.21.15.196:0/355702335 conn(0x7f5b180cb3a0 msgr2=0x7f5b180c3a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-17T23:56:08.407 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.404+0000 7f5afbfff640 1 -- 172.21.15.196:0/355702335 shutdown_connections 2024-03-17T23:56:08.407 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.404+0000 7f5afbfff640 1 -- 172.21.15.196:0/355702335 wait complete. 2024-03-17T23:56:08.408 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.404+0000 7f0e48ff9640 1 -- 172.21.15.196:0/2352451484 <== osd.7 v2:172.21.15.204:6800/3361860686 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f0e2c006bc0 con 0x7f0e2c001660 2024-03-17T23:56:08.445 INFO:teuthology.orchestra.run.smithi196.stdout:55834574854 2024-03-17T23:56:08.445 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-03-17T23:56:08.456 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.456+0000 7f0e52337640 1 -- 172.21.15.196:0/2352451484 --> [v2:172.21.15.204:6800/3361860686,v1:172.21.15.204:6801/3361860686] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f0e2c005ca0 con 0x7f0e2c001660 2024-03-17T23:56:08.457 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.456+0000 7f0e48ff9640 1 -- 172.21.15.196:0/2352451484 <== osd.7 v2:172.21.15.204:6800/3361860686 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f0e2c005ca0 con 0x7f0e2c001660 2024-03-17T23:56:08.469 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.468+0000 7f0e52337640 1 -- 172.21.15.196:0/2352451484 >> [v2:172.21.15.204:6800/3361860686,v1:172.21.15.204:6801/3361860686] conn(0x7f0e2c001660 msgr2=0x7f0e2c003b20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:08.469 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.468+0000 7f0e52337640 1 --2- 172.21.15.196:0/2352451484 >> [v2:172.21.15.204:6800/3361860686,v1:172.21.15.204:6801/3361860686] conn(0x7f0e2c001660 0x7f0e2c003b20 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:08.469 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.468+0000 7f0e52337640 1 -- 172.21.15.196:0/2352451484 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f0e34067870 msgr2=0x7f0e34069d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:08.469 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.468+0000 7f0e52337640 1 --2- 172.21.15.196:0/2352451484 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f0e34067870 0x7f0e34069d30 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f0e3c0ae000 tx=0x7f0e3c0a7000 comp rx=0 tx=0).stop 2024-03-17T23:56:08.469 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.468+0000 7f0e52337640 1 -- 172.21.15.196:0/2352451484 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0e4c157f20 msgr2=0x7f0e4c0ca110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:08.469 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.468+0000 7f0e52337640 1 --2- 172.21.15.196:0/2352451484 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0e4c157f20 0x7f0e4c0ca110 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f0e44001610 tx=0x7f0e44009430 comp rx=0 tx=0).stop 2024-03-17T23:56:08.469 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.468+0000 7f0e508d4640 1 -- 172.21.15.196:0/2352451484 reap_dead start 2024-03-17T23:56:08.469 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.468+0000 7f0e52337640 1 -- 172.21.15.196:0/2352451484 shutdown_connections 2024-03-17T23:56:08.469 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.468+0000 7f0e52337640 1 -- 172.21.15.196:0/2352451484 >> 172.21.15.196:0/2352451484 conn(0x7f0e4c06ec10 msgr2=0x7f0e4c14f320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-17T23:56:08.469 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.468+0000 7f0e52337640 1 -- 172.21.15.196:0/2352451484 shutdown_connections 2024-03-17T23:56:08.469 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.468+0000 7f0e52337640 1 -- 172.21.15.196:0/2352451484 wait complete. 2024-03-17T23:56:08.507 INFO:teuthology.orchestra.run.smithi196.stdout:55834574853 2024-03-17T23:56:08.507 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-03-17T23:56:08.554 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.552+0000 7f0ea860e640 1 Processor -- start 2024-03-17T23:56:08.554 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.552+0000 7f0ea860e640 1 -- start start 2024-03-17T23:56:08.555 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.552+0000 7f0ea860e640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f0e9804c480 0x7f0e980dd540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:08.555 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.552+0000 7f0ea860e640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0e9804af10 0x7f0e9804b380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:08.555 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.552+0000 7f0ea860e640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0e980339d0 con 0x7f0e980d6c60 2024-03-17T23:56:08.555 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.552+0000 7f0ea860e640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7f0e980062c0 con 0x7f0e9804c480 2024-03-17T23:56:08.555 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.552+0000 7f0ea860e640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f0e980065a0 con 0x7f0e9804af10 2024-03-17T23:56:08.555 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.552+0000 7f0ea5ba9640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f0e9804c480 0x7f0e980dd540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:08.555 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.552+0000 7f0ea5ba9640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f0e9804c480 0x7f0e980dd540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.196:34622/0 (socket says 172.21.15.196:34622) 2024-03-17T23:56:08.556 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.552+0000 7f0ea5ba9640 1 -- 172.21.15.196:0/2136659722 learned_addr learned my addr 172.21.15.196:0/2136659722 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-03-17T23:56:08.556 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.552+0000 7f0ea6bab640 1 --2- 172.21.15.196:0/2136659722 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0e9804af10 0x7f0e9804b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:08.556 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.552+0000 7f0ea6bab640 1 -- 172.21.15.196:0/2136659722 >> v2:172.21.15.196:3300/0 conn(0x7f0e9804c480 msgr2=0x7f0e980dd540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-17T23:56:08.556 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.552+0000 7f0ea6bab640 1 --2- 172.21.15.196:0/2136659722 >> v2:172.21.15.196:3300/0 conn(0x7f0e9804c480 0x7f0e980dd540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:08.556 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.552+0000 7f0ea6bab640 1 -- 172.21.15.196:0/2136659722 >> v1:172.21.15.196:6789/0 conn(0x7f0e980d6c60 legacy=0x7f0e980332c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:08.556 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.552+0000 7f0ea6bab640 1 -- 172.21.15.196:0/2136659722 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e98006880 con 0x7f0e9804af10 2024-03-17T23:56:08.559 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.556+0000 7f0ea6bab640 1 --2- 172.21.15.196:0/2136659722 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0e9804af10 0x7f0e9804b380 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f0e9c0097c0 tx=0x7f0e9c020740 comp rx=0 tx=0).ready entity=mon.2 client_cookie=410200e3d109f58a server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:56:08.560 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.552+0000 7fcc7e2f7640 1 Processor -- start 2024-03-17T23:56:08.561 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.560+0000 7f0ea53a8640 1 -- 172.21.15.196:0/2136659722 <== mon.2 v2:172.21.15.204:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e9c0ae3f0 con 0x7f0e9804af10 2024-03-17T23:56:08.561 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.552+0000 7fcc7e2f7640 1 -- start start 2024-03-17T23:56:08.561 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.556+0000 7fcc7e2f7640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fcc780cb710 0x7fcc781674e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:08.561 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.556+0000 7fcc7e2f7640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fcc780cbaf0 0x7fcc780c6440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:08.561 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.556+0000 7fcc7e2f7640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcc780c6e80 con 0x7fcc780c6980 2024-03-17T23:56:08.562 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.556+0000 7fcc7e2f7640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 -- 0x7fcc780c73d0 con 0x7fcc780cbaf0 2024-03-17T23:56:08.562 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.556+0000 7fcc7e2f7640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7fcc780c76b0 con 0x7fcc780cb710 2024-03-17T23:56:08.562 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.556+0000 7fcc7daf6640 1 --1- >> v1:172.21.15.196:6789/0 conn(0x7fcc780c6980 0x7fcc78163e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.196:6789/0 says I am v1:172.21.15.196:50464/0 (socket says 172.21.15.196:50464) 2024-03-17T23:56:08.562 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.556+0000 7fcc7daf6640 1 -- 172.21.15.196:0/1223219763 learned_addr learned my addr 172.21.15.196:0/1223219763 (peer_addr_for_me v1:172.21.15.196:0/0) 2024-03-17T23:56:08.562 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.556+0000 7fcc7d2f5640 1 --2- 172.21.15.196:0/1223219763 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fcc780cb710 0x7fcc781674e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:08.562 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.556+0000 7fcc7caf4640 1 --2- 172.21.15.196:0/1223219763 >> v2:172.21.15.204:3300/0 conn(0x7fcc780cbaf0 0x7fcc780c6440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:08.562 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.556+0000 7fcc6ffff640 1 -- 172.21.15.196:0/1223219763 <== mon.0 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3103585862 0 0) 0x7fcc780c6e80 con 0x7fcc780c6980 2024-03-17T23:56:08.562 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.560+0000 7fcc6ffff640 1 -- 172.21.15.196:0/1223219763 --> v1:172.21.15.196:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcc64003510 con 0x7fcc780c6980 2024-03-17T23:56:08.562 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.560+0000 7f0ea53a8640 1 -- 172.21.15.196:0/2136659722 <== mon.2 v2:172.21.15.204:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0e9c0b3070 con 0x7f0e9804af10 2024-03-17T23:56:08.564 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.560+0000 7fcc6ffff640 1 -- 172.21.15.196:0/1223219763 <== mon.0 v1:172.21.15.196:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3574141207 0 0) 0x7fcc64003510 con 0x7fcc780c6980 2024-03-17T23:56:08.564 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.560+0000 7fcc6ffff640 1 -- 172.21.15.196:0/1223219763 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fcc780cb710 msgr2=0x7fcc781674e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-17T23:56:08.564 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.560+0000 7fcc6ffff640 1 --2- 172.21.15.196:0/1223219763 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fcc780cb710 0x7fcc781674e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:08.564 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.560+0000 7fcc6ffff640 1 -- 172.21.15.196:0/1223219763 >> v2:172.21.15.204:3300/0 conn(0x7fcc780cbaf0 msgr2=0x7fcc780c6440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-17T23:56:08.564 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.560+0000 7fcc6ffff640 1 --2- 172.21.15.196:0/1223219763 >> v2:172.21.15.204:3300/0 conn(0x7fcc780cbaf0 0x7fcc780c6440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:08.564 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.560+0000 7fcc6ffff640 1 -- 172.21.15.196:0/1223219763 --> v1:172.21.15.196:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc780c7990 con 0x7fcc780c6980 2024-03-17T23:56:08.564 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.560+0000 7fcc6ffff640 1 -- 172.21.15.196:0/1223219763 <== mon.0 v1:172.21.15.196:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 981458915 0 0) 0x7fcc70001a00 con 0x7fcc780c6980 2024-03-17T23:56:08.564 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.560+0000 7fcc6ffff640 1 -- 172.21.15.196:0/1223219763 >> v1:172.21.15.196:6789/0 conn(0x7fcc780c6980 legacy=0x7fcc78163e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:08.564 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.560+0000 7fcc6ffff640 1 --2- 172.21.15.196:0/1223219763 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fcc64003b20 0x7fcc64003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:08.564 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.560+0000 7fcc6ffff640 1 --2- 172.21.15.196:0/1223219763 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fcc780cb710 0x7fcc640045c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:08.565 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.560+0000 7fcc6ffff640 1 --2- 172.21.15.196:0/1223219763 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcc64004c40 0x7fcc640050c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:08.565 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.560+0000 7fcc6ffff640 1 -- 172.21.15.196:0/1223219763 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fcc780c73d0 con 0x7fcc64004c40 2024-03-17T23:56:08.565 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.560+0000 7f0ea860e640 1 -- 172.21.15.196:0/2136659722 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0e9804af10 msgr2=0x7f0e9804b380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:08.565 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.560+0000 7f0ea860e640 1 --2- 172.21.15.196:0/2136659722 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0e9804af10 0x7f0e9804b380 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f0e9c0097c0 tx=0x7f0e9c020740 comp rx=0 tx=0).stop 2024-03-17T23:56:08.566 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.560+0000 7fcc6ffff640 1 -- 172.21.15.196:0/1223219763 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7fcc780c76b0 con 0x7fcc64003b20 2024-03-17T23:56:08.566 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.560+0000 7fcc6ffff640 1 -- 172.21.15.196:0/1223219763 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7fcc6400baf0 con 0x7fcc780cb710 2024-03-17T23:56:08.566 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.560+0000 7fcc7d2f5640 1 --2- 172.21.15.196:0/1223219763 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fcc64003b20 0x7fcc64003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:08.566 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.560+0000 7fcc7daf6640 1 --2- 172.21.15.196:0/1223219763 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcc64004c40 0x7fcc640050c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:08.566 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.560+0000 7fcc7d2f5640 1 -- 172.21.15.196:0/1223219763 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fcc780cb710 msgr2=0x7fcc640045c0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-03-17T23:56:08.566 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.560+0000 7fcc7d2f5640 1 --2- 172.21.15.196:0/1223219763 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fcc780cb710 0x7fcc640045c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:08.566 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.560+0000 7fcc7d2f5640 1 -- 172.21.15.196:0/1223219763 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcc64004c40 msgr2=0x7fcc640050c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-17T23:56:08.566 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.560+0000 7fcc7d2f5640 1 --2- 172.21.15.196:0/1223219763 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcc64004c40 0x7fcc640050c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:08.566 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.560+0000 7fcc7d2f5640 1 -- 172.21.15.196:0/1223219763 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc780c7990 con 0x7fcc64003b20 2024-03-17T23:56:08.567 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.560+0000 7f0ea860e640 1 -- 172.21.15.196:0/2136659722 shutdown_connections 2024-03-17T23:56:08.567 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.560+0000 7f0ea860e640 1 --2- 172.21.15.196:0/2136659722 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0e9804af10 0x7f0e9804b380 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:08.567 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.560+0000 7f0ea860e640 1 --2- 172.21.15.196:0/2136659722 >> v2:172.21.15.196:3300/0 conn(0x7f0e9804c480 0x7f0e980dd540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:08.567 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.560+0000 7f0ea860e640 1 -- 172.21.15.196:0/2136659722 >> 172.21.15.196:0/2136659722 conn(0x7f0e98050190 msgr2=0x7f0e980505a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-17T23:56:08.567 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.560+0000 7f0ea860e640 1 -- 172.21.15.196:0/2136659722 shutdown_connections 2024-03-17T23:56:08.567 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.560+0000 7f0ea860e640 1 -- 172.21.15.196:0/2136659722 wait complete. 2024-03-17T23:56:08.567 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.564+0000 7f0ea860e640 1 Processor -- start 2024-03-17T23:56:08.568 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.564+0000 7fcc7d2f5640 1 --2- 172.21.15.196:0/1223219763 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fcc64003b20 0x7fcc64003f40 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fcc7400aaa0 tx=0x7fcc74025270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=955598a377dc2e7c server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:56:08.568 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.564+0000 7f0ea860e640 1 -- start start 2024-03-17T23:56:08.568 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.564+0000 7f0ea860e640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0e9804af10 0x7f0e9817c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:08.568 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.564+0000 7f0ea860e640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0e9804c480 0x7f0e980c9d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:08.568 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.564+0000 7f0ea860e640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0e980d6c60 0x7f0e980db980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:08.568 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.564+0000 7f0ea860e640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f0e980d7040 con 0x7f0e9804af10 2024-03-17T23:56:08.568 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.564+0000 7f0ea860e640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f0e98007640 con 0x7f0e9804c480 2024-03-17T23:56:08.568 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.564+0000 7f0ea860e640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f0e980d71c0 con 0x7f0e980d6c60 2024-03-17T23:56:08.568 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.564+0000 7f0ea63aa640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0e9804af10 0x7f0e9817c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:08.569 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.564+0000 7f0ea63aa640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0e9804af10 0x7f0e9817c5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.196:34638/0 (socket says 172.21.15.196:34638) 2024-03-17T23:56:08.569 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.564+0000 7f0ea63aa640 1 -- 172.21.15.196:0/802563760 learned_addr learned my addr 172.21.15.196:0/802563760 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-03-17T23:56:08.569 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.564+0000 7fcc6ffff640 1 -- 172.21.15.196:0/1223219763 <== mon.1 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc740b9070 con 0x7fcc64003b20 2024-03-17T23:56:08.569 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.564+0000 7f0ea5ba9640 1 --2- 172.21.15.196:0/802563760 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0e9804c480 0x7f0e980c9d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:08.569 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.564+0000 7f0ea6bab640 1 --2- 172.21.15.196:0/802563760 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0e980d6c60 0x7f0e980db980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:08.570 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.564+0000 7fcc6ffff640 1 -- 172.21.15.196:0/1223219763 <== mon.1 v2:172.21.15.204:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc740b4600 con 0x7fcc64003b20 2024-03-17T23:56:08.570 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.564+0000 7fcc7e2f7640 1 -- 172.21.15.196:0/1223219763 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fcc64003b20 msgr2=0x7fcc64003f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:08.570 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.564+0000 7fcc7e2f7640 1 --2- 172.21.15.196:0/1223219763 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fcc64003b20 0x7fcc64003f40 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fcc7400aaa0 tx=0x7fcc74025270 comp rx=0 tx=0).stop 2024-03-17T23:56:08.570 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.564+0000 7fcc7daf6640 1 -- 172.21.15.196:0/1223219763 reap_dead start 2024-03-17T23:56:08.571 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.564+0000 7f0ea63aa640 1 -- 172.21.15.196:0/802563760 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0e980d6c60 msgr2=0x7f0e980db980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:08.571 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.564+0000 7f0ea63aa640 1 --2- 172.21.15.196:0/802563760 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0e980d6c60 0x7f0e980db980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:08.571 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.564+0000 7f0ea63aa640 1 -- 172.21.15.196:0/802563760 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0e9804c480 msgr2=0x7f0e980c9d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:08.571 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.564+0000 7f0ea63aa640 1 --2- 172.21.15.196:0/802563760 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0e9804c480 0x7f0e980c9d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:08.571 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.564+0000 7f0ea63aa640 1 -- 172.21.15.196:0/802563760 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e980e0ce0 con 0x7f0e9804af10 2024-03-17T23:56:08.571 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.564+0000 7f0ea63aa640 1 --2- 172.21.15.196:0/802563760 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0e9804af10 0x7f0e9817c5d0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f0e9000c750 tx=0x7f0e9000cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:56:08.571 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.564+0000 7fcc7e2f7640 1 -- 172.21.15.196:0/1223219763 shutdown_connections 2024-03-17T23:56:08.571 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.564+0000 7fcc7e2f7640 1 -- 172.21.15.196:0/1223219763 >> 172.21.15.196:0/1223219763 conn(0x7fcc780673f0 msgr2=0x7fcc7806b2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-17T23:56:08.571 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.564+0000 7fcc7e2f7640 1 -- 172.21.15.196:0/1223219763 shutdown_connections 2024-03-17T23:56:08.572 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.564+0000 7f0e96ffd640 1 -- 172.21.15.196:0/802563760 <== mon.0 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e90017070 con 0x7f0e9804af10 2024-03-17T23:56:08.572 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.564+0000 7f0e96ffd640 1 -- 172.21.15.196:0/802563760 <== mon.0 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0e90005280 con 0x7f0e9804af10 2024-03-17T23:56:08.572 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.568+0000 7f67ff016640 1 Processor -- start 2024-03-17T23:56:08.572 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.568+0000 7f67ff016640 1 -- start start 2024-03-17T23:56:08.573 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.568+0000 7f0ea860e640 1 -- 172.21.15.196:0/802563760 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0e9804f730 con 0x7f0e9804af10 2024-03-17T23:56:08.573 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.568+0000 7f0ea860e640 1 -- 172.21.15.196:0/802563760 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0e9817cb10 con 0x7f0e9804af10 2024-03-17T23:56:08.573 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.568+0000 7f0e96ffd640 1 -- 172.21.15.196:0/802563760 <== mon.0 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e90003820 con 0x7f0e9804af10 2024-03-17T23:56:08.573 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.568+0000 7f67ff016640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f67f8150ce0 0x7f67f8072e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:08.573 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.568+0000 7f67ff016640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f67f8073390 0x7f67f8156ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:08.573 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.568+0000 7f67ff016640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f67f81569f0 con 0x7f67f80c2910 2024-03-17T23:56:08.573 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.568+0000 7f67ff016640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7f67f815a180 con 0x7f67f8150ce0 2024-03-17T23:56:08.574 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.568+0000 7f67ff016640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 -- 0x7f67f815a460 con 0x7f67f8073390 2024-03-17T23:56:08.574 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.564+0000 7f41bc8f9640 1 Processor -- start 2024-03-17T23:56:08.574 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.568+0000 7f67fd5b3640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f67f8073390 0x7f67f8156ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:08.574 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.568+0000 7f67fd5b3640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f67f8073390 0x7f67f8156ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3300/0 says I am v2:172.21.15.196:50224/0 (socket says 172.21.15.196:50224) 2024-03-17T23:56:08.574 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.568+0000 7f67fd5b3640 1 -- 172.21.15.196:0/1071477505 learned_addr learned my addr 172.21.15.196:0/1071477505 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-03-17T23:56:08.575 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.564+0000 7f41bc8f9640 1 -- start start 2024-03-17T23:56:08.577 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.564+0000 7fcc7e2f7640 1 -- 172.21.15.196:0/1223219763 wait complete. 2024-03-17T23:56:08.577 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.568+0000 7fcc7e2f7640 1 Processor -- start 2024-03-17T23:56:08.577 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.568+0000 7fcc7e2f7640 1 -- start start 2024-03-17T23:56:08.577 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.568+0000 7fcc7e2f7640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcc64003b20 0x7fcc78165a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:08.577 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.568+0000 7fcc7e2f7640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fcc781674d0 0x7fcc78158130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:08.577 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.568+0000 7fcc7e2f7640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fcc78158670 0x7fcc78200680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:08.577 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.568+0000 7fcc7e2f7640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fcc78164520 con 0x7fcc64003b20 2024-03-17T23:56:08.577 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.568+0000 7fcc7e2f7640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7fcc780c7f50 con 0x7fcc781674d0 2024-03-17T23:56:08.577 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.568+0000 7fcc7e2f7640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7fcc781646a0 con 0x7fcc78158670 2024-03-17T23:56:08.577 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.568+0000 7fcc7caf4640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fcc781674d0 0x7fcc78158130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:08.577 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.568+0000 7fcc7caf4640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fcc781674d0 0x7fcc78158130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3300/0 says I am v2:172.21.15.196:50232/0 (socket says 172.21.15.196:50232) 2024-03-17T23:56:08.578 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.568+0000 7fcc7caf4640 1 -- 172.21.15.196:0/4016076219 learned_addr learned my addr 172.21.15.196:0/4016076219 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-03-17T23:56:08.578 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.568+0000 7fcc7daf6640 1 --2- 172.21.15.196:0/4016076219 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fcc78158670 0x7fcc78200680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:08.578 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.568+0000 7fcc7caf4640 1 -- 172.21.15.196:0/4016076219 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fcc78158670 msgr2=0x7fcc78200680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:08.578 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.568+0000 7fcc7caf4640 1 --2- 172.21.15.196:0/4016076219 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fcc78158670 0x7fcc78200680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:08.578 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.568+0000 7fcc7caf4640 1 -- 172.21.15.196:0/4016076219 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcc64003b20 msgr2=0x7fcc78165a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:08.578 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.568+0000 7fcc7caf4640 1 --2- 172.21.15.196:0/4016076219 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcc64003b20 0x7fcc78165a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:08.578 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.568+0000 7fcc7caf4640 1 -- 172.21.15.196:0/4016076219 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc7816a780 con 0x7fcc781674d0 2024-03-17T23:56:08.578 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.568+0000 7fcc7caf4640 1 --2- 172.21.15.196:0/4016076219 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fcc781674d0 0x7fcc78158130 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fcc6800d890 tx=0x7fcc6800dd50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:56:08.578 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.568+0000 7f67fd5b3640 1 -- 172.21.15.196:0/1071477505 >> v2:172.21.15.196:3300/0 conn(0x7f67f8150ce0 msgr2=0x7f67f8072e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-17T23:56:08.579 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.568+0000 7f67fd5b3640 1 --2- 172.21.15.196:0/1071477505 >> v2:172.21.15.196:3300/0 conn(0x7f67f8150ce0 0x7f67f8072e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:08.579 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.568+0000 7f67fd5b3640 1 -- 172.21.15.196:0/1071477505 >> v1:172.21.15.204:6789/0 conn(0x7f67f80c2910 legacy=0x7f67f80c81a0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-03-17T23:56:08.579 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.568+0000 7f67fd5b3640 1 -- 172.21.15.196:0/1071477505 --> v2:172.21.15.204:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67f815a740 con 0x7f67f8073390 2024-03-17T23:56:08.579 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.572+0000 7f0e96ffd640 1 -- 172.21.15.196:0/802563760 <== mon.0 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 5) ==== 87083+0+0 (secure 0 0 0) 0x7f0e9001a070 con 0x7f0e9804af10 2024-03-17T23:56:08.579 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.572+0000 7f67fd5b3640 1 --2- 172.21.15.196:0/1071477505 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f67f8073390 0x7f67f8156ef0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f67f80c9250 tx=0x7f67ec01c500 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fbdba3fab26aac09 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:56:08.579 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.572+0000 7f67f77fe640 1 -- 172.21.15.196:0/1071477505 <== mon.1 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67ec0b1070 con 0x7f67f8073390 2024-03-17T23:56:08.580 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.576+0000 7fcc6dffb640 1 -- 172.21.15.196:0/4016076219 <== mon.1 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc6801a070 con 0x7fcc781674d0 2024-03-17T23:56:08.580 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.572+0000 7f67f77fe640 1 -- 172.21.15.196:0/1071477505 <== mon.1 v2:172.21.15.204:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f67ec0ac630 con 0x7f67f8073390 2024-03-17T23:56:08.580 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.572+0000 7f67f77fe640 1 -- 172.21.15.196:0/1071477505 <== mon.1 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67ec0a8050 con 0x7f67f8073390 2024-03-17T23:56:08.580 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.576+0000 7f67ff016640 1 -- 172.21.15.196:0/1071477505 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f67f8073390 msgr2=0x7f67f8156ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:08.580 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.576+0000 7f67ff016640 1 --2- 172.21.15.196:0/1071477505 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f67f8073390 0x7f67f8156ef0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f67f80c9250 tx=0x7f67ec01c500 comp rx=0 tx=0).stop 2024-03-17T23:56:08.581 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.576+0000 7fcc6dffb640 1 -- 172.21.15.196:0/4016076219 <== mon.1 v2:172.21.15.204:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc6800c8e0 con 0x7fcc781674d0 2024-03-17T23:56:08.581 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.576+0000 7f0e96ffd640 1 --2- 172.21.15.196:0/802563760 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f0e8c067880 0x7f0e8c069d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:08.581 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.576+0000 7f0e96ffd640 1 -- 172.21.15.196:0/802563760 <== mon.0 v2:172.21.15.196:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f0e90084d80 con 0x7f0e9804af10 2024-03-17T23:56:08.581 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.568+0000 7f41bc8f9640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f41b80c36e0 0x7f41b8167490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:08.582 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.568+0000 7f41bc8f9640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f41b81640d0 0x7f41b80c6440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:08.582 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.568+0000 7f41bc8f9640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f41b80c73d0 con 0x7f41b80c6980 2024-03-17T23:56:08.582 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.568+0000 7f41bc8f9640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 -- 0x7f41b81679d0 con 0x7f41b81640d0 2024-03-17T23:56:08.582 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.568+0000 7f41bc8f9640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f41b80c76b0 con 0x7f41b80c36e0 2024-03-17T23:56:08.582 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.568+0000 7f41b6d9d640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f41b80c36e0 0x7f41b8167490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:08.582 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.568+0000 7f41b659c640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f41b81640d0 0x7f41b80c6440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:08.582 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.572+0000 7f41b659c640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f41b81640d0 0x7f41b80c6440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3300/0 says I am v2:172.21.15.196:50240/0 (socket says 172.21.15.196:50240) 2024-03-17T23:56:08.582 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.572+0000 7f41b659c640 1 -- 172.21.15.196:0/615983198 learned_addr learned my addr 172.21.15.196:0/615983198 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-03-17T23:56:08.582 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.572+0000 7f41b6d9d640 1 -- 172.21.15.196:0/615983198 >> v2:172.21.15.204:3300/0 conn(0x7f41b81640d0 msgr2=0x7f41b80c6440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-17T23:56:08.582 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.572+0000 7f41b6d9d640 1 --2- 172.21.15.196:0/615983198 >> v2:172.21.15.204:3300/0 conn(0x7f41b81640d0 0x7f41b80c6440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:08.582 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.572+0000 7f41b6d9d640 1 -- 172.21.15.196:0/615983198 >> v1:172.21.15.196:6789/0 conn(0x7f41b80c6980 legacy=0x7f41b80cb4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:08.582 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.572+0000 7f41b6d9d640 1 -- 172.21.15.196:0/615983198 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41b80c7990 con 0x7f41b80c36e0 2024-03-17T23:56:08.583 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.576+0000 7f0ea5ba9640 1 --2- 172.21.15.196:0/802563760 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f0e8c067880 0x7f0e8c069d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:08.583 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.576+0000 7f41b6d9d640 1 --2- 172.21.15.196:0/615983198 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f41b80c36e0 0x7f41b8167490 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f41b0009d80 tx=0x7f41b002d9a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e3ededc923785309 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:56:08.583 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.576+0000 7f67ff016640 1 -- 172.21.15.196:0/1071477505 shutdown_connections 2024-03-17T23:56:08.583 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.576+0000 7f67ff016640 1 --2- 172.21.15.196:0/1071477505 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f67f8073390 0x7f67f8156ef0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:08.583 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.576+0000 7f67ff016640 1 --2- 172.21.15.196:0/1071477505 >> v2:172.21.15.196:3300/0 conn(0x7f67f8150ce0 0x7f67f8072e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:08.584 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.576+0000 7f67ff016640 1 -- 172.21.15.196:0/1071477505 >> 172.21.15.196:0/1071477505 conn(0x7f67f806ec10 msgr2=0x7f67f806f020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-17T23:56:08.584 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.576+0000 7fcc6dffb640 1 -- 172.21.15.196:0/4016076219 <== mon.1 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc68007e60 con 0x7fcc781674d0 2024-03-17T23:56:08.584 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.576+0000 7fcc7e2f7640 1 -- 172.21.15.196:0/4016076219 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcc7816aa40 con 0x7fcc781674d0 2024-03-17T23:56:08.584 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.576+0000 7fcc7e2f7640 1 -- 172.21.15.196:0/4016076219 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcc7815b7c0 con 0x7fcc781674d0 2024-03-17T23:56:08.584 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.576+0000 7f67ff016640 1 -- 172.21.15.196:0/1071477505 shutdown_connections 2024-03-17T23:56:08.585 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.576+0000 7f41b5d9b640 1 -- 172.21.15.196:0/615983198 <== mon.2 v2:172.21.15.204:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41b00c3070 con 0x7f41b80c36e0 2024-03-17T23:56:08.585 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.576+0000 7f41b5d9b640 1 -- 172.21.15.196:0/615983198 <== mon.2 v2:172.21.15.204:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41b00b6960 con 0x7f41b80c36e0 2024-03-17T23:56:08.585 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.576+0000 7f41b5d9b640 1 -- 172.21.15.196:0/615983198 <== mon.2 v2:172.21.15.204:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41b00b6d70 con 0x7f41b80c36e0 2024-03-17T23:56:08.585 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.576+0000 7f41bc8f9640 1 -- 172.21.15.196:0/615983198 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f41b80c36e0 msgr2=0x7f41b8167490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:08.585 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.576+0000 7f41bc8f9640 1 --2- 172.21.15.196:0/615983198 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f41b80c36e0 0x7f41b8167490 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f41b0009d80 tx=0x7f41b002d9a0 comp rx=0 tx=0).stop 2024-03-17T23:56:08.585 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.576+0000 7f67ff016640 1 -- 172.21.15.196:0/1071477505 wait complete. 2024-03-17T23:56:08.586 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.576+0000 7f67ff016640 1 Processor -- start 2024-03-17T23:56:08.586 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.576+0000 7fcc6dffb640 1 -- 172.21.15.196:0/4016076219 <== mon.1 v2:172.21.15.204:3300/0 4 ==== mgrmap(e 5) ==== 87083+0+0 (secure 0 0 0) 0x7fcc6801d070 con 0x7fcc781674d0 2024-03-17T23:56:08.586 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.580+0000 7f41bc8f9640 1 -- 172.21.15.196:0/615983198 shutdown_connections 2024-03-17T23:56:08.586 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.580+0000 7f41bc8f9640 1 --2- 172.21.15.196:0/615983198 >> v2:172.21.15.204:3300/0 conn(0x7f41b81640d0 0x7f41b80c6440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:08.586 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.580+0000 7f41bc8f9640 1 --2- 172.21.15.196:0/615983198 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f41b80c36e0 0x7f41b8167490 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:08.586 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.580+0000 7f41bc8f9640 1 -- 172.21.15.196:0/615983198 >> 172.21.15.196:0/615983198 conn(0x7f41b80673f0 msgr2=0x7f41b806b2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-17T23:56:08.587 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.580+0000 7fcc6dffb640 1 --2- 172.21.15.196:0/4016076219 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7fcc5c067730 0x7fcc5c069bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:08.587 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.580+0000 7f41bc8f9640 1 -- 172.21.15.196:0/615983198 shutdown_connections 2024-03-17T23:56:08.587 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.580+0000 7fcc6dffb640 1 -- 172.21.15.196:0/4016076219 <== mon.1 v2:172.21.15.204:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fcc68084f30 con 0x7fcc781674d0 2024-03-17T23:56:08.587 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.580+0000 7fcc7d2f5640 1 --2- 172.21.15.196:0/4016076219 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7fcc5c067730 0x7fcc5c069bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:08.588 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.576+0000 7f67ff016640 1 -- start start 2024-03-17T23:56:08.588 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.580+0000 7f67ff016640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f67f8073390 0x7f67f8159a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:08.588 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.580+0000 7f67ff016640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f67f80c2910 0x7f67f81523d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:08.588 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.580+0000 7f67ff016640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f67f8150ce0 0x7f67f8151320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:08.588 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.580+0000 7f67ff016640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f67f80c88b0 con 0x7f67f8150ce0 2024-03-17T23:56:08.588 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.580+0000 7f67ff016640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f67f81510c0 con 0x7f67f8073390 2024-03-17T23:56:08.588 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.580+0000 7f67ff016640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f67f80c8a30 con 0x7f67f80c2910 2024-03-17T23:56:08.588 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.580+0000 7f67fcdb2640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f67f8073390 0x7f67f8159a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:08.589 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.580+0000 7f67fcdb2640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f67f8073390 0x7f67f8159a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3300/0 says I am v2:172.21.15.196:50250/0 (socket says 172.21.15.196:50250) 2024-03-17T23:56:08.589 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.580+0000 7f67fcdb2640 1 -- 172.21.15.196:0/3488152422 learned_addr learned my addr 172.21.15.196:0/3488152422 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-03-17T23:56:08.589 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.580+0000 7f67f7fff640 1 --2- 172.21.15.196:0/3488152422 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f67f80c2910 0x7f67f81523d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:08.589 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.580+0000 7fcc7d2f5640 1 --2- 172.21.15.196:0/4016076219 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7fcc5c067730 0x7fcc5c069bf0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fcc740b6000 tx=0x7fcc74023ab0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:56:08.589 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.580+0000 7f0ea5ba9640 1 --2- 172.21.15.196:0/802563760 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f0e8c067880 0x7f0e8c069d40 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f0ea0062e50 tx=0x7f0ea008e040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:56:08.590 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.580+0000 7f41bc8f9640 1 -- 172.21.15.196:0/615983198 wait complete. 2024-03-17T23:56:08.590 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.580+0000 7f41bc8f9640 1 Processor -- start 2024-03-17T23:56:08.590 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.580+0000 7f67fcdb2640 1 -- 172.21.15.196:0/3488152422 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f67f80c2910 msgr2=0x7f67f81523d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:08.590 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.580+0000 7f67fcdb2640 1 --2- 172.21.15.196:0/3488152422 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f67f80c2910 0x7f67f81523d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:08.591 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.580+0000 7f67fcdb2640 1 -- 172.21.15.196:0/3488152422 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f67f8150ce0 msgr2=0x7f67f8151320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:08.591 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.580+0000 7f67fcdb2640 1 --2- 172.21.15.196:0/3488152422 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f67f8150ce0 0x7f67f8151320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:08.591 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.580+0000 7f67fcdb2640 1 -- 172.21.15.196:0/3488152422 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67f80c0760 con 0x7f67f8073390 2024-03-17T23:56:08.591 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.580+0000 7f67fcdb2640 1 --2- 172.21.15.196:0/3488152422 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f67f8073390 0x7f67f8159a20 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f67f000ba50 tx=0x7f67f000bf10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:56:08.591 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.580+0000 7f67f57fa640 1 -- 172.21.15.196:0/3488152422 <== mon.1 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67f0019070 con 0x7f67f8073390 2024-03-17T23:56:08.591 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.580+0000 7f67ff016640 1 -- 172.21.15.196:0/3488152422 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f67f80c0a00 con 0x7f67f8073390 2024-03-17T23:56:08.591 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.580+0000 7f67ff016640 1 -- 172.21.15.196:0/3488152422 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67f80c0fc0 con 0x7f67f8073390 2024-03-17T23:56:08.591 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.580+0000 7f67f57fa640 1 -- 172.21.15.196:0/3488152422 <== mon.1 v2:172.21.15.204:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f67f000cc00 con 0x7f67f8073390 2024-03-17T23:56:08.591 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.580+0000 7f41bc8f9640 1 -- start start 2024-03-17T23:56:08.591 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.580+0000 7f41bc8f9640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f41b80c36e0 0x7f41b815b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:08.591 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.580+0000 7f41bc8f9640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f41b80c6980 0x7f41b815bad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:08.592 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.580+0000 7f67f57fa640 1 -- 172.21.15.196:0/3488152422 <== mon.1 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67f0014440 con 0x7f67f8073390 2024-03-17T23:56:08.592 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.580+0000 7f41bc8f9640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f41b81640d0 0x7f41b815c010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:08.592 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.580+0000 7f41bc8f9640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f41b81646b0 con 0x7f41b81640d0 2024-03-17T23:56:08.592 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.580+0000 7f41bc8f9640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f41b8164530 con 0x7f41b80c36e0 2024-03-17T23:56:08.593 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.580+0000 7f41bc8f9640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f41b816d270 con 0x7f41b80c6980 2024-03-17T23:56:08.593 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.580+0000 7f41b6d9d640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f41b80c36e0 0x7f41b815b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:08.593 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.580+0000 7f41b659c640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f41b80c6980 0x7f41b815bad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:08.593 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.580+0000 7f41b6d9d640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f41b80c36e0 0x7f41b815b0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3300/0 says I am v2:172.21.15.196:50258/0 (socket says 172.21.15.196:50258) 2024-03-17T23:56:08.593 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.580+0000 7f41b659c640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f41b80c6980 0x7f41b815bad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3301/0 says I am v2:172.21.15.196:48424/0 (socket says 172.21.15.196:48424) 2024-03-17T23:56:08.593 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.580+0000 7f41b6d9d640 1 -- 172.21.15.196:0/1061221614 learned_addr learned my addr 172.21.15.196:0/1061221614 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-03-17T23:56:08.593 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.580+0000 7f41b759e640 1 --2- 172.21.15.196:0/1061221614 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f41b81640d0 0x7f41b815c010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:08.593 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.580+0000 7f0ea860e640 1 -- 172.21.15.196:0/802563760 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0e980053a0 con 0x7f0e9804af10 2024-03-17T23:56:08.594 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.580+0000 7f41b6d9d640 1 -- 172.21.15.196:0/1061221614 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f41b80c6980 msgr2=0x7f41b815bad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:08.594 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.580+0000 7f41b6d9d640 1 --2- 172.21.15.196:0/1061221614 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f41b80c6980 0x7f41b815bad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:08.594 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.580+0000 7f41b6d9d640 1 -- 172.21.15.196:0/1061221614 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f41b81640d0 msgr2=0x7f41b815c010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:08.594 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.580+0000 7f41b6d9d640 1 --2- 172.21.15.196:0/1061221614 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f41b81640d0 0x7f41b815c010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:08.594 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.580+0000 7f41b6d9d640 1 -- 172.21.15.196:0/1061221614 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41b80ca150 con 0x7f41b80c36e0 2024-03-17T23:56:08.594 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.580+0000 7f41b6d9d640 1 --2- 172.21.15.196:0/1061221614 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f41b80c36e0 0x7f41b815b0d0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f41b002a5b0 tx=0x7f41b002a740 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:56:08.594 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.588+0000 7fcc7e2f7640 1 -- 172.21.15.196:0/4016076219 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcc7804f550 con 0x7fcc781674d0 2024-03-17T23:56:08.595 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.592+0000 7f0e96ffd640 1 -- 172.21.15.196:0/802563760 <== mon.0 v2:172.21.15.196:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177849 (secure 0 0 0) 0x7f0e90055390 con 0x7f0e9804af10 2024-03-17T23:56:08.596 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.592+0000 7f67f57fa640 1 -- 172.21.15.196:0/3488152422 <== mon.1 v2:172.21.15.204:3300/0 4 ==== mgrmap(e 5) ==== 87083+0+0 (secure 0 0 0) 0x7f67f001c070 con 0x7f67f8073390 2024-03-17T23:56:08.596 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.592+0000 7f67f57fa640 1 --2- 172.21.15.196:0/3488152422 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f67dc067660 0x7f67dc069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:08.596 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.592+0000 7f67f57fa640 1 -- 172.21.15.196:0/3488152422 <== mon.1 v2:172.21.15.204:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f67f00855a0 con 0x7f67f8073390 2024-03-17T23:56:08.596 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.592+0000 7f67f7fff640 1 --2- 172.21.15.196:0/3488152422 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f67dc067660 0x7f67dc069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:08.596 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.592+0000 7f67ff016640 1 -- 172.21.15.196:0/3488152422 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f67d40052a0 con 0x7f67f8073390 2024-03-17T23:56:08.596 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.592+0000 7f67f7fff640 1 --2- 172.21.15.196:0/3488152422 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f67dc067660 0x7f67dc069b20 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f67f80c4fc0 tx=0x7f67e80090e0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:56:08.596 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.596+0000 7f419f7fe640 1 -- 172.21.15.196:0/1061221614 <== mon.1 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41b00cc020 con 0x7f41b80c36e0 2024-03-17T23:56:08.597 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.596+0000 7f419f7fe640 1 -- 172.21.15.196:0/1061221614 <== mon.1 v2:172.21.15.204:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41b00be640 con 0x7f41b80c36e0 2024-03-17T23:56:08.597 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.596+0000 7f419f7fe640 1 -- 172.21.15.196:0/1061221614 <== mon.1 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41b00c3040 con 0x7f41b80c36e0 2024-03-17T23:56:08.603 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.600+0000 7fcc6dffb640 1 -- 172.21.15.196:0/4016076219 <== mon.1 v2:172.21.15.204:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177849 (secure 0 0 0) 0x7fcc6800ccb0 con 0x7fcc781674d0 2024-03-17T23:56:08.604 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.604+0000 7f41bc8f9640 1 -- 172.21.15.196:0/1061221614 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f41b815a970 con 0x7f41b80c36e0 2024-03-17T23:56:08.604 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.604+0000 7f41bc8f9640 1 -- 172.21.15.196:0/1061221614 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41b80c93a0 con 0x7f41b80c36e0 2024-03-17T23:56:08.615 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.612+0000 7f67f57fa640 1 -- 172.21.15.196:0/3488152422 <== mon.1 v2:172.21.15.204:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177849 (secure 0 0 0) 0x7f67f0055b30 con 0x7f67f8073390 2024-03-17T23:56:08.617 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.616+0000 7f419f7fe640 1 -- 172.21.15.196:0/1061221614 <== mon.1 v2:172.21.15.204:3300/0 4 ==== mgrmap(e 5) ==== 87083+0+0 (secure 0 0 0) 0x7f41b00cf020 con 0x7f41b80c36e0 2024-03-17T23:56:08.617 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.616+0000 7f419f7fe640 1 --2- 172.21.15.196:0/1061221614 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f41a4067760 0x7f41a4069c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:08.617 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.616+0000 7f419f7fe640 1 -- 172.21.15.196:0/1061221614 <== mon.1 v2:172.21.15.204:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f41b0002020 con 0x7f41b80c36e0 2024-03-17T23:56:08.618 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.616+0000 7f41b659c640 1 --2- 172.21.15.196:0/1061221614 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f41a4067760 0x7f41a4069c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:08.618 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.616+0000 7f41b659c640 1 --2- 172.21.15.196:0/1061221614 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f41a4067760 0x7f41a4069c20 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f41b8166ab0 tx=0x7f41a8008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:56:08.628 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.628+0000 7f41bc8f9640 1 -- 172.21.15.196:0/1061221614 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f41b804f550 con 0x7f41b80c36e0 2024-03-17T23:56:08.641 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.640+0000 7f419f7fe640 1 -- 172.21.15.196:0/1061221614 <== mon.1 v2:172.21.15.204:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177849 (secure 0 0 0) 0x7f41b0027590 con 0x7f41b80c36e0 2024-03-17T23:56:08.690 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.688+0000 7fd31a0cf640 1 Processor -- start 2024-03-17T23:56:08.690 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.688+0000 7fd31a0cf640 1 -- start start 2024-03-17T23:56:08.693 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.688+0000 7fd31a0cf640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd314071ec0 0x7fd3140c67d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:08.693 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.688+0000 7fd31a0cf640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fd3140c6d10 0x7fd3140c82d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:08.693 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.688+0000 7fd31a0cf640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd314155f40 con 0x7fd31414fe00 2024-03-17T23:56:08.693 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.688+0000 7fd31a0cf640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 -- 0x7fd314156220 con 0x7fd3140c6d10 2024-03-17T23:56:08.693 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.688+0000 7fd31a0cf640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7fd314156500 con 0x7fd314071ec0 2024-03-17T23:56:08.693 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.688+0000 7fd3188cc640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd314071ec0 0x7fd3140c67d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:08.693 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.688+0000 7fd3198ce640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fd3140c6d10 0x7fd3140c82d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:08.693 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.688+0000 7fd3188cc640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd314071ec0 0x7fd3140c67d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3301/0 says I am v2:172.21.15.196:48430/0 (socket says 172.21.15.196:48430) 2024-03-17T23:56:08.693 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.688+0000 7fd3188cc640 1 -- 172.21.15.196:0/378480520 learned_addr learned my addr 172.21.15.196:0/378480520 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-03-17T23:56:08.693 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.692+0000 7fd3188cc640 1 -- 172.21.15.196:0/378480520 >> v2:172.21.15.204:3300/0 conn(0x7fd3140c6d10 msgr2=0x7fd3140c82d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-17T23:56:08.693 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.692+0000 7fd3188cc640 1 --2- 172.21.15.196:0/378480520 >> v2:172.21.15.204:3300/0 conn(0x7fd3140c6d10 0x7fd3140c82d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:08.694 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.692+0000 7fd3188cc640 1 -- 172.21.15.196:0/378480520 >> v1:172.21.15.204:6789/0 conn(0x7fd31414fe00 legacy=0x7fd3140cb4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:08.694 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.692+0000 7fd3188cc640 1 -- 172.21.15.196:0/378480520 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3141567e0 con 0x7fd314071ec0 2024-03-17T23:56:08.696 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.692+0000 7fd3188cc640 1 --2- 172.21.15.196:0/378480520 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd314071ec0 0x7fd3140c67d0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fd3100091e0 tx=0x7fd31001c590 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b437efa1b7cdf0e1 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:56:08.700 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.700+0000 7fd30bfff640 1 -- 172.21.15.196:0/378480520 <== mon.2 v2:172.21.15.204:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3100a8620 con 0x7fd314071ec0 2024-03-17T23:56:08.700 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.700+0000 7fd30bfff640 1 -- 172.21.15.196:0/378480520 <== mon.2 v2:172.21.15.204:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd3100a87c0 con 0x7fd314071ec0 2024-03-17T23:56:08.702 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.700+0000 7fd31a0cf640 1 -- 172.21.15.196:0/378480520 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd314071ec0 msgr2=0x7fd3140c67d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:08.702 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.700+0000 7fd31a0cf640 1 --2- 172.21.15.196:0/378480520 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd314071ec0 0x7fd3140c67d0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fd3100091e0 tx=0x7fd31001c590 comp rx=0 tx=0).stop 2024-03-17T23:56:08.703 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.700+0000 7fd31a0cf640 1 -- 172.21.15.196:0/378480520 shutdown_connections 2024-03-17T23:56:08.704 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.700+0000 7fd31a0cf640 1 --2- 172.21.15.196:0/378480520 >> v2:172.21.15.204:3300/0 conn(0x7fd3140c6d10 0x7fd3140c82d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:08.704 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.700+0000 7fd31a0cf640 1 --2- 172.21.15.196:0/378480520 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd314071ec0 0x7fd3140c67d0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:08.704 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.700+0000 7fd31a0cf640 1 -- 172.21.15.196:0/378480520 >> 172.21.15.196:0/378480520 conn(0x7fd3140673f0 msgr2=0x7fd31406b2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-17T23:56:08.708 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.708+0000 7fd31a0cf640 1 -- 172.21.15.196:0/378480520 shutdown_connections 2024-03-17T23:56:08.711 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.708+0000 7fd31a0cf640 1 -- 172.21.15.196:0/378480520 wait complete. 2024-03-17T23:56:08.711 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.708+0000 7fd31a0cf640 1 Processor -- start 2024-03-17T23:56:08.713 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.708+0000 7fd31a0cf640 1 -- start start 2024-03-17T23:56:08.713 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.712+0000 7fd31a0cf640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd314071ec0 0x7fd31414b230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:08.713 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.712+0000 7fd31a0cf640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd3140c6d10 0x7fd3140ca100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:08.714 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.712+0000 7fd31a0cf640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd31414fe00 0x7fd3140cb190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:08.714 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.712+0000 7fd31a0cf640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fd3141501e0 con 0x7fd31414fe00 2024-03-17T23:56:08.714 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.712+0000 7fd31a0cf640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7fd314155bf0 con 0x7fd314071ec0 2024-03-17T23:56:08.714 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.712+0000 7fd31a0cf640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7fd314150360 con 0x7fd3140c6d10 2024-03-17T23:56:08.714 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.712+0000 7fd3198ce640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd31414fe00 0x7fd3140cb190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:08.714 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.712+0000 7fd3198ce640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd31414fe00 0x7fd3140cb190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.196:34674/0 (socket says 172.21.15.196:34674) 2024-03-17T23:56:08.714 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.712+0000 7fd3190cd640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd314071ec0 0x7fd31414b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:08.714 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.712+0000 7fd3198ce640 1 -- 172.21.15.196:0/1842794034 learned_addr learned my addr 172.21.15.196:0/1842794034 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-03-17T23:56:08.714 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.712+0000 7fd3188cc640 1 --2- 172.21.15.196:0/1842794034 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd3140c6d10 0x7fd3140ca100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:08.715 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.712+0000 7fd3198ce640 1 -- 172.21.15.196:0/1842794034 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd3140c6d10 msgr2=0x7fd3140ca100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:08.715 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.712+0000 7fd3198ce640 1 --2- 172.21.15.196:0/1842794034 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd3140c6d10 0x7fd3140ca100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:08.715 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.712+0000 7fd3198ce640 1 -- 172.21.15.196:0/1842794034 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd314071ec0 msgr2=0x7fd31414b230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:08.715 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.712+0000 7fd3198ce640 1 --2- 172.21.15.196:0/1842794034 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd314071ec0 0x7fd31414b230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:08.715 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.712+0000 7fd3198ce640 1 -- 172.21.15.196:0/1842794034 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd314159ea0 con 0x7fd31414fe00 2024-03-17T23:56:08.715 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.712+0000 7fd3198ce640 1 --2- 172.21.15.196:0/1842794034 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd31414fe00 0x7fd3140cb190 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fd30c00e5b0 tx=0x7fd30c00ea70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:56:08.724 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.720+0000 7fd309ffb640 1 -- 172.21.15.196:0/1842794034 <== mon.0 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd30c015030 con 0x7fd31414fe00 2024-03-17T23:56:08.724 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.720+0000 7fd309ffb640 1 -- 172.21.15.196:0/1842794034 <== mon.0 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd30c011660 con 0x7fd31414fe00 2024-03-17T23:56:08.724 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.720+0000 7fd309ffb640 1 -- 172.21.15.196:0/1842794034 <== mon.0 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd30c011a30 con 0x7fd31414fe00 2024-03-17T23:56:08.725 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.724+0000 7fd31a0cf640 1 -- 172.21.15.196:0/1842794034 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd314157000 con 0x7fd31414fe00 2024-03-17T23:56:08.725 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.724+0000 7fd31a0cf640 1 -- 172.21.15.196:0/1842794034 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3141575c0 con 0x7fd31414fe00 2024-03-17T23:56:08.726 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.724+0000 7fd309ffb640 1 -- 172.21.15.196:0/1842794034 <== mon.0 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 5) ==== 87083+0+0 (secure 0 0 0) 0x7fd30c018030 con 0x7fd31414fe00 2024-03-17T23:56:08.727 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.724+0000 7fd309ffb640 1 --2- 172.21.15.196:0/1842794034 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7fd2f8067730 0x7fd2f8069bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:08.727 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.724+0000 7fd309ffb640 1 -- 172.21.15.196:0/1842794034 <== mon.0 v2:172.21.15.196:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fd30c085f60 con 0x7fd31414fe00 2024-03-17T23:56:08.728 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.724+0000 7fd3190cd640 1 --2- 172.21.15.196:0/1842794034 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7fd2f8067730 0x7fd2f8069bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:08.728 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.724+0000 7fd31a0cf640 1 -- 172.21.15.196:0/1842794034 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd31404f550 con 0x7fd31414fe00 2024-03-17T23:56:08.736 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.736+0000 7f4c589bc640 1 Processor -- start 2024-03-17T23:56:08.736 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.736+0000 7f4c589bc640 1 -- start start 2024-03-17T23:56:08.737 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.736+0000 7fd309ffb640 1 -- 172.21.15.196:0/1842794034 <== mon.0 v2:172.21.15.196:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177849 (secure 0 0 0) 0x7fd30c0b26d0 con 0x7fd31414fe00 2024-03-17T23:56:08.739 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.736+0000 7fd3190cd640 1 --2- 172.21.15.196:0/1842794034 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7fd2f8067730 0x7fd2f8069bf0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fd304009fd0 tx=0x7fd304009a80 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:56:08.744 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.736+0000 7f4c589bc640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f4c540c5ca0 0x7f4c5406d440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:08.744 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.736+0000 7f4c589bc640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4c540c3a80 con 0x7f4c540c7630 2024-03-17T23:56:08.744 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.736+0000 7f4c589bc640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4c5406c6c0 con 0x7f4c541520b0 2024-03-17T23:56:08.744 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.736+0000 7f4c589bc640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 -- 0x7f4c5406cfb0 con 0x7f4c540c5ca0 2024-03-17T23:56:08.744 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.736+0000 7f4c51d9b640 1 --1- >> v1:172.21.15.196:6789/0 conn(0x7f4c540c7630 0x7f4c541582b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.196:6789/0 says I am v1:172.21.15.196:50478/0 (socket says 172.21.15.196:50478) 2024-03-17T23:56:08.744 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.736+0000 7f4c51d9b640 1 -- 172.21.15.196:0/3142619279 learned_addr learned my addr 172.21.15.196:0/3142619279 (peer_addr_for_me v1:172.21.15.196:0/0) 2024-03-17T23:56:08.745 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.736+0000 7f4c52d9d640 1 --2- 172.21.15.196:0/3142619279 >> v2:172.21.15.204:3300/0 conn(0x7f4c540c5ca0 0x7f4c5406d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:08.745 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.736+0000 7f4c52d9d640 1 -- 172.21.15.196:0/3142619279 >> v1:172.21.15.204:6789/0 conn(0x7f4c541520b0 legacy=0x7f4c54157ba0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-17T23:56:08.745 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.736+0000 7f4c52d9d640 1 -- 172.21.15.196:0/3142619279 >> v1:172.21.15.196:6789/0 conn(0x7f4c540c7630 legacy=0x7f4c541582b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:08.745 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.736+0000 7f4c52d9d640 1 -- 172.21.15.196:0/3142619279 --> v2:172.21.15.204:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c540c3d20 con 0x7f4c540c5ca0 2024-03-17T23:56:08.745 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.740+0000 7f4c52d9d640 1 --2- 172.21.15.196:0/3142619279 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4c540c5ca0 0x7f4c5406d440 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f4c4c014480 tx=0x7f4c4c024f00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=11897d296ccabe23 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:56:08.750 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.748+0000 7f4c5159a640 1 -- 172.21.15.196:0/3142619279 <== mon.1 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c4c0ba070 con 0x7f4c540c5ca0 2024-03-17T23:56:08.750 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.748+0000 7f4c5159a640 1 -- 172.21.15.196:0/3142619279 <== mon.1 v2:172.21.15.204:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c4c0b5440 con 0x7f4c540c5ca0 2024-03-17T23:56:08.750 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.748+0000 7f4c5159a640 1 -- 172.21.15.196:0/3142619279 <== mon.1 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c4c0b5810 con 0x7f4c540c5ca0 2024-03-17T23:56:08.751 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.748+0000 7f4c589bc640 1 -- 172.21.15.196:0/3142619279 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4c540c5ca0 msgr2=0x7f4c5406d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:08.751 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.748+0000 7f4c589bc640 1 --2- 172.21.15.196:0/3142619279 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4c540c5ca0 0x7f4c5406d440 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f4c4c014480 tx=0x7f4c4c024f00 comp rx=0 tx=0).stop 2024-03-17T23:56:08.756 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.752+0000 7f4c589bc640 1 -- 172.21.15.196:0/3142619279 shutdown_connections 2024-03-17T23:56:08.756 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.752+0000 7f4c589bc640 1 --2- 172.21.15.196:0/3142619279 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4c540c5ca0 0x7f4c5406d440 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:08.756 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.752+0000 7f4c589bc640 1 -- 172.21.15.196:0/3142619279 >> 172.21.15.196:0/3142619279 conn(0x7f4c540c7da0 msgr2=0x7f4c540c81b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-17T23:56:08.756 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.756+0000 7f4c589bc640 1 -- 172.21.15.196:0/3142619279 shutdown_connections 2024-03-17T23:56:08.756 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.756+0000 7f4c589bc640 1 -- 172.21.15.196:0/3142619279 wait complete. 2024-03-17T23:56:08.758 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.756+0000 7f4c589bc640 1 Processor -- start 2024-03-17T23:56:08.758 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.756+0000 7f4c589bc640 1 -- start start 2024-03-17T23:56:08.759 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.756+0000 7f4c589bc640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4c540c5ca0 0x7f4c54158160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:08.760 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.756+0000 7f4c589bc640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4c540c7630 0x7f4c541586a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:08.760 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.756+0000 7f4c589bc640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4c541520b0 0x7f4c54071300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:08.760 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.756+0000 7f4c589bc640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f4c5406cc40 con 0x7f4c540c5ca0 2024-03-17T23:56:08.760 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.756+0000 7f4c589bc640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f4c5406c960 con 0x7f4c541520b0 2024-03-17T23:56:08.760 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.756+0000 7f4c589bc640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f4c540cc140 con 0x7f4c540c7630 2024-03-17T23:56:08.761 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.756+0000 7f4c51d9b640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4c540c7630 0x7f4c541586a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:08.761 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.756+0000 7f4c5259c640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4c540c5ca0 0x7f4c54158160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:08.761 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.756+0000 7f4c51d9b640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4c540c7630 0x7f4c541586a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3301/0 says I am v2:172.21.15.196:48460/0 (socket says 172.21.15.196:48460) 2024-03-17T23:56:08.761 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.756+0000 7f4c51d9b640 1 -- 172.21.15.196:0/3341228506 learned_addr learned my addr 172.21.15.196:0/3341228506 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-03-17T23:56:08.761 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.756+0000 7f4c52d9d640 1 --2- 172.21.15.196:0/3341228506 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4c541520b0 0x7f4c54071300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:08.761 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.760+0000 7f4c51d9b640 1 -- 172.21.15.196:0/3341228506 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4c541520b0 msgr2=0x7f4c54071300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:08.762 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.760+0000 7f4c51d9b640 1 --2- 172.21.15.196:0/3341228506 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4c541520b0 0x7f4c54071300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:08.762 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.760+0000 7f4c51d9b640 1 -- 172.21.15.196:0/3341228506 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4c540c5ca0 msgr2=0x7f4c54158160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:08.762 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.760+0000 7f4c51d9b640 1 --2- 172.21.15.196:0/3341228506 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4c540c5ca0 0x7f4c54158160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:08.762 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.760+0000 7f4c51d9b640 1 -- 172.21.15.196:0/3341228506 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c54152740 con 0x7f4c540c7630 2024-03-17T23:56:08.762 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.760+0000 7f4c51d9b640 1 --2- 172.21.15.196:0/3341228506 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4c540c7630 0x7f4c541586a0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f4c48009f30 tx=0x7f4c4800c4f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:56:08.762 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.760+0000 7f4c42ffd640 1 -- 172.21.15.196:0/3341228506 <== mon.2 v2:172.21.15.204:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c48019070 con 0x7f4c540c7630 2024-03-17T23:56:08.762 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.760+0000 7f4c589bc640 1 -- 172.21.15.196:0/3341228506 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4c54152a20 con 0x7f4c540c7630 2024-03-17T23:56:08.762 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.760+0000 7f4c589bc640 1 -- 172.21.15.196:0/3341228506 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f4c54152fe0 con 0x7f4c540c7630 2024-03-17T23:56:08.762 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.760+0000 7f4c42ffd640 1 -- 172.21.15.196:0/3341228506 <== mon.2 v2:172.21.15.204:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c48007af0 con 0x7f4c540c7630 2024-03-17T23:56:08.762 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.760+0000 7f4c42ffd640 1 -- 172.21.15.196:0/3341228506 <== mon.2 v2:172.21.15.204:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c48009070 con 0x7f4c540c7630 2024-03-17T23:56:08.763 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.760+0000 7f4c42ffd640 1 -- 172.21.15.196:0/3341228506 <== mon.2 v2:172.21.15.204:3301/0 4 ==== mgrmap(e 5) ==== 87083+0+0 (secure 0 0 0) 0x7f4c4801c070 con 0x7f4c540c7630 2024-03-17T23:56:08.764 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.764+0000 7f4c42ffd640 1 --2- 172.21.15.196:0/3341228506 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f4c3c0677b0 0x7f4c3c069c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:08.764 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.764+0000 7f4c42ffd640 1 -- 172.21.15.196:0/3341228506 <== mon.2 v2:172.21.15.204:3301/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f4c48087670 con 0x7f4c540c7630 2024-03-17T23:56:08.765 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.764+0000 7f4c5259c640 1 --2- 172.21.15.196:0/3341228506 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f4c3c0677b0 0x7f4c3c069c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:08.765 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.764+0000 7f4c5259c640 1 --2- 172.21.15.196:0/3341228506 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f4c3c0677b0 0x7f4c3c069c70 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f4c44006fd0 tx=0x7f4c44009060 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:56:08.776 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.776+0000 7f4c589bc640 1 -- 172.21.15.196:0/3341228506 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4c380052a0 con 0x7f4c540c7630 2024-03-17T23:56:08.776 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.776+0000 7f0b16d3e640 1 Processor -- start 2024-03-17T23:56:08.790 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.788+0000 7f0b16d3e640 1 -- start start 2024-03-17T23:56:08.790 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.788+0000 7f0b16d3e640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f0b100727b0 0x7f0b100c5da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:08.790 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.788+0000 7f0b16d3e640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0b10071470 con 0x7f0b1006b2b0 2024-03-17T23:56:08.790 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.788+0000 7f0b16d3e640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0b10159490 con 0x7f0b1014fe80 2024-03-17T23:56:08.790 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.788+0000 7f0b16d3e640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7f0b10071240 con 0x7f0b100727b0 2024-03-17T23:56:08.790 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.788+0000 7f4c42ffd640 1 -- 172.21.15.196:0/3341228506 <== mon.2 v2:172.21.15.204:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177849 (secure 0 0 0) 0x7f4c48057c00 con 0x7f4c540c7630 2024-03-17T23:56:08.791 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.788+0000 7f0b15d3c640 1 --1- >> v1:172.21.15.204:6789/0 conn(0x7f0b1014fe80 0x7f0b10156880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.204:6789/0 says I am v1:172.21.15.196:60146/0 (socket says 172.21.15.196:60146) 2024-03-17T23:56:08.791 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.788+0000 7f0b15d3c640 1 -- 172.21.15.196:0/3724628196 learned_addr learned my addr 172.21.15.196:0/3724628196 (peer_addr_for_me v1:172.21.15.196:0/0) 2024-03-17T23:56:08.791 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.788+0000 7f0b1553b640 1 --2- 172.21.15.196:0/3724628196 >> v2:172.21.15.196:3300/0 conn(0x7f0b100727b0 0x7f0b100c5da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:08.791 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.788+0000 7f0b1553b640 1 -- 172.21.15.196:0/3724628196 >> v1:172.21.15.204:6789/0 conn(0x7f0b1014fe80 legacy=0x7f0b10156880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:08.791 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.788+0000 7f0b1553b640 1 -- 172.21.15.196:0/3724628196 >> v1:172.21.15.196:6789/0 conn(0x7f0b1006b2b0 legacy=0x7f0b10160780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-17T23:56:08.791 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.788+0000 7f0b1553b640 1 -- 172.21.15.196:0/3724628196 --> v2:172.21.15.196:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b10159770 con 0x7f0b100727b0 2024-03-17T23:56:08.794 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.792+0000 7f0b1553b640 1 --2- 172.21.15.196:0/3724628196 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0b100727b0 0x7f0b100c5da0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f0b0800ad90 tx=0x7f0b0801e8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=868a6187b3eadd37 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:56:08.804 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.804+0000 7f0b14d3a640 1 -- 172.21.15.196:0/3724628196 <== mon.0 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b080b4070 con 0x7f0b100727b0 2024-03-17T23:56:08.806 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.804+0000 7f0b14d3a640 1 -- 172.21.15.196:0/3724628196 <== mon.0 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b080a7760 con 0x7f0b100727b0 2024-03-17T23:56:08.806 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.804+0000 7f0b14d3a640 1 -- 172.21.15.196:0/3724628196 <== mon.0 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b080a7b30 con 0x7f0b100727b0 2024-03-17T23:56:08.806 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.804+0000 7f0b16d3e640 1 -- 172.21.15.196:0/3724628196 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0b100727b0 msgr2=0x7f0b100c5da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:08.806 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.804+0000 7f0b16d3e640 1 --2- 172.21.15.196:0/3724628196 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0b100727b0 0x7f0b100c5da0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f0b0800ad90 tx=0x7f0b0801e8d0 comp rx=0 tx=0).stop 2024-03-17T23:56:08.806 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.804+0000 7f0b16d3e640 1 -- 172.21.15.196:0/3724628196 shutdown_connections 2024-03-17T23:56:08.806 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.804+0000 7f0b16d3e640 1 --2- 172.21.15.196:0/3724628196 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0b100727b0 0x7f0b100c5da0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:08.806 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.804+0000 7f0b16d3e640 1 -- 172.21.15.196:0/3724628196 >> 172.21.15.196:0/3724628196 conn(0x7f0b100cb3a0 msgr2=0x7f0b100cb7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-17T23:56:08.806 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.804+0000 7f0b16d3e640 1 -- 172.21.15.196:0/3724628196 shutdown_connections 2024-03-17T23:56:08.808 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.804+0000 7f0b16d3e640 1 -- 172.21.15.196:0/3724628196 wait complete. 2024-03-17T23:56:08.808 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.804+0000 7f0b16d3e640 1 Processor -- start 2024-03-17T23:56:08.809 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.804+0000 7f0b16d3e640 1 -- start start 2024-03-17T23:56:08.809 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.808+0000 7f0b16d3e640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0b1006b2b0 0x7f0b101f8510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:08.809 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.808+0000 7f0b16d3e640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0b100727b0 0x7f0b10150950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:08.810 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.808+0000 7f0b16d3e640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0b1014fe80 0x7f0b1014dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:08.810 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.808+0000 7f0b16d3e640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f0b1015a250 con 0x7f0b1006b2b0 2024-03-17T23:56:08.810 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.808+0000 7f0b16d3e640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f0b1006bac0 con 0x7f0b1014fe80 2024-03-17T23:56:08.810 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.808+0000 7f0b16d3e640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f0b10071750 con 0x7f0b100727b0 2024-03-17T23:56:08.810 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.808+0000 7f0b15d3c640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0b1006b2b0 0x7f0b101f8510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:08.810 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.808+0000 7f0b15d3c640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0b1006b2b0 0x7f0b101f8510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.196:34702/0 (socket says 172.21.15.196:34702) 2024-03-17T23:56:08.810 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.808+0000 7f0b15d3c640 1 -- 172.21.15.196:0/1779124508 learned_addr learned my addr 172.21.15.196:0/1779124508 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-03-17T23:56:08.811 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.808+0000 7f0b1553b640 1 --2- 172.21.15.196:0/1779124508 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0b100727b0 0x7f0b10150950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:08.811 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.808+0000 7f0b1653d640 1 --2- 172.21.15.196:0/1779124508 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0b1014fe80 0x7f0b1014dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:08.811 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.808+0000 7f0b15d3c640 1 -- 172.21.15.196:0/1779124508 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0b100727b0 msgr2=0x7f0b10150950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:08.811 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.808+0000 7f0b15d3c640 1 --2- 172.21.15.196:0/1779124508 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0b100727b0 0x7f0b10150950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:08.811 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.808+0000 7f0b15d3c640 1 -- 172.21.15.196:0/1779124508 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0b1014fe80 msgr2=0x7f0b1014dfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:08.811 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.808+0000 7f0b15d3c640 1 --2- 172.21.15.196:0/1779124508 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0b1014fe80 0x7f0b1014dfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:08.811 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.808+0000 7f0b15d3c640 1 -- 172.21.15.196:0/1779124508 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b1014c4c0 con 0x7f0b1006b2b0 2024-03-17T23:56:08.811 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.808+0000 7f0b15d3c640 1 --2- 172.21.15.196:0/1779124508 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0b1006b2b0 0x7f0b101f8510 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f0b0c00b7b0 tx=0x7f0b0c00bc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:56:08.820 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.820+0000 7f0b067fc640 1 -- 172.21.15.196:0/1779124508 <== mon.0 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b0c00c520 con 0x7f0b1006b2b0 2024-03-17T23:56:08.820 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.820+0000 7fd836813640 1 Processor -- start 2024-03-17T23:56:08.821 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.820+0000 7fd836813640 1 -- start start 2024-03-17T23:56:08.821 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.820+0000 7f0b16d3e640 1 -- 172.21.15.196:0/1779124508 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b1014c7a0 con 0x7f0b1006b2b0 2024-03-17T23:56:08.821 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.820+0000 7f0b16d3e640 1 -- 172.21.15.196:0/1779124508 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b1014d7d0 con 0x7f0b1006b2b0 2024-03-17T23:56:08.822 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.820+0000 7fd836813640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fd83014e5e0 0x7fd8300c2a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:08.822 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.820+0000 7fd836813640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd830157a10 0x7fd8300c3be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:08.822 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.820+0000 7fd836813640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd8300c7580 con 0x7fd8300c6010 2024-03-17T23:56:08.822 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.820+0000 7fd836813640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 -- 0x7fd8300c5ad0 con 0x7fd83014e5e0 2024-03-17T23:56:08.822 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.820+0000 7fd836813640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7fd830157f70 con 0x7fd830157a10 2024-03-17T23:56:08.822 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.820+0000 7fd836012640 1 --1- >> v1:172.21.15.196:6789/0 conn(0x7fd8300c6010 0x7fd83015b000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.196:6789/0 says I am v1:172.21.15.196:50498/0 (socket says 172.21.15.196:50498) 2024-03-17T23:56:08.822 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.820+0000 7fd835811640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fd83014e5e0 0x7fd8300c2a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:08.822 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.820+0000 7fd836012640 1 -- 172.21.15.196:0/3447404004 learned_addr learned my addr 172.21.15.196:0/3447404004 (peer_addr_for_me v1:172.21.15.196:0/0) 2024-03-17T23:56:08.823 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.820+0000 7fd835811640 1 -- 172.21.15.196:0/3447404004 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd830157a10 msgr2=0x7fd8300c3be0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-03-17T23:56:08.823 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.820+0000 7fd835811640 1 --2- 172.21.15.196:0/3447404004 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd830157a10 0x7fd8300c3be0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:08.823 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.820+0000 7fd835811640 1 -- 172.21.15.196:0/3447404004 >> v1:172.21.15.196:6789/0 conn(0x7fd8300c6010 legacy=0x7fd83015b000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:08.823 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.820+0000 7fd835811640 1 -- 172.21.15.196:0/3447404004 --> v2:172.21.15.204:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd830158250 con 0x7fd83014e5e0 2024-03-17T23:56:08.824 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.820+0000 7f0b067fc640 1 -- 172.21.15.196:0/1779124508 <== mon.0 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b0c010070 con 0x7f0b1006b2b0 2024-03-17T23:56:08.824 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.820+0000 7f0b067fc640 1 -- 172.21.15.196:0/1779124508 <== mon.0 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b0c00c900 con 0x7f0b1006b2b0 2024-03-17T23:56:08.824 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.820+0000 7f0b067fc640 1 -- 172.21.15.196:0/1779124508 <== mon.0 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 5) ==== 87083+0+0 (secure 0 0 0) 0x7f0b0c00cb60 con 0x7f0b1006b2b0 2024-03-17T23:56:08.824 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.820+0000 7f0b067fc640 1 --2- 172.21.15.196:0/1779124508 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f0afc067870 0x7f0afc069d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:08.824 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.820+0000 7f0b067fc640 1 -- 172.21.15.196:0/1779124508 <== mon.0 v2:172.21.15.196:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f0b0c084fd0 con 0x7f0b1006b2b0 2024-03-17T23:56:08.824 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.820+0000 7f0b1553b640 1 --2- 172.21.15.196:0/1779124508 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f0afc067870 0x7f0afc069d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:08.824 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.824+0000 7f0b16d3e640 1 -- 172.21.15.196:0/1779124508 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0af80052a0 con 0x7f0b1006b2b0 2024-03-17T23:56:08.825 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.824+0000 7f0b1553b640 1 --2- 172.21.15.196:0/1779124508 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f0afc067870 0x7f0afc069d30 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f0b080b1000 tx=0x7f0b080a9070 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:56:08.825 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.824+0000 7fd835811640 1 --2- 172.21.15.196:0/3447404004 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd83014e5e0 0x7fd8300c2a60 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fd82c0097c0 tx=0x7fd82c01ecb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=840c300be81e18d0 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:56:08.832 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.832+0000 7fd83480f640 1 -- 172.21.15.196:0/3447404004 <== mon.1 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd82c0b5070 con 0x7fd83014e5e0 2024-03-17T23:56:08.832 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.832+0000 7fd83480f640 1 -- 172.21.15.196:0/3447404004 <== mon.1 v2:172.21.15.204:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd82c0a89b0 con 0x7fd83014e5e0 2024-03-17T23:56:08.833 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.832+0000 7fd836813640 1 -- 172.21.15.196:0/3447404004 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd83014e5e0 msgr2=0x7fd8300c2a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:08.833 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.832+0000 7fd836813640 1 --2- 172.21.15.196:0/3447404004 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd83014e5e0 0x7fd8300c2a60 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fd82c0097c0 tx=0x7fd82c01ecb0 comp rx=0 tx=0).stop 2024-03-17T23:56:08.834 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.832+0000 7fd836813640 1 -- 172.21.15.196:0/3447404004 shutdown_connections 2024-03-17T23:56:08.834 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.832+0000 7fd836813640 1 --2- 172.21.15.196:0/3447404004 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd830157a10 0x7fd8300c3be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:08.834 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.832+0000 7fd836813640 1 --2- 172.21.15.196:0/3447404004 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd83014e5e0 0x7fd8300c2a60 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:08.834 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.832+0000 7fd836813640 1 -- 172.21.15.196:0/3447404004 >> 172.21.15.196:0/3447404004 conn(0x7fd8300673f0 msgr2=0x7fd83006b2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-17T23:56:08.834 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.832+0000 7fd836813640 1 -- 172.21.15.196:0/3447404004 shutdown_connections 2024-03-17T23:56:08.834 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.832+0000 7fd836813640 1 -- 172.21.15.196:0/3447404004 wait complete. 2024-03-17T23:56:08.834 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.832+0000 7f0b067fc640 1 -- 172.21.15.196:0/1779124508 <== mon.0 v2:172.21.15.196:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177849 (secure 0 0 0) 0x7f0b0c055670 con 0x7f0b1006b2b0 2024-03-17T23:56:08.840 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.832+0000 7fd836813640 1 Processor -- start 2024-03-17T23:56:08.840 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.832+0000 7fd836813640 1 -- start start 2024-03-17T23:56:08.840 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.836+0000 7fd836813640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd8300c6010 0x7fd830153a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:08.840 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.836+0000 7fd836813640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd83014e5e0 0x7fd83013c230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:08.840 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.836+0000 7fd836813640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd830157a10 0x7fd8300ca680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:08.841 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.836+0000 7fd836813640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fd8300c36c0 con 0x7fd83014e5e0 2024-03-17T23:56:08.841 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.836+0000 7fd836813640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7fd830158810 con 0x7fd8300c6010 2024-03-17T23:56:08.841 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.836+0000 7fd836813640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7fd8300c2fa0 con 0x7fd830157a10 2024-03-17T23:56:08.841 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.836+0000 7fd835010640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd83014e5e0 0x7fd83013c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:08.841 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.836+0000 7fd835010640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd83014e5e0 0x7fd83013c230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.196:34714/0 (socket says 172.21.15.196:34714) 2024-03-17T23:56:08.841 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.836+0000 7fd835010640 1 -- 172.21.15.196:0/4057950311 learned_addr learned my addr 172.21.15.196:0/4057950311 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-03-17T23:56:08.841 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.836+0000 7fd835811640 1 --2- 172.21.15.196:0/4057950311 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd8300c6010 0x7fd830153a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:08.841 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.836+0000 7fd835010640 1 -- 172.21.15.196:0/4057950311 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd830157a10 msgr2=0x7fd8300ca680 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-03-17T23:56:08.841 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.836+0000 7fd835010640 1 --2- 172.21.15.196:0/4057950311 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd830157a10 0x7fd8300ca680 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:08.841 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.836+0000 7fd835010640 1 -- 172.21.15.196:0/4057950311 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd8300c6010 msgr2=0x7fd830153a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:08.841 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.836+0000 7fd835010640 1 --2- 172.21.15.196:0/4057950311 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd8300c6010 0x7fd830153a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:08.841 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.836+0000 7fd835010640 1 -- 172.21.15.196:0/4057950311 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd83013e190 con 0x7fd83014e5e0 2024-03-17T23:56:08.841 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.836+0000 7fd835010640 1 --2- 172.21.15.196:0/4057950311 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd83014e5e0 0x7fd83013c230 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fd82000b4d0 tx=0x7fd82000b990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:56:08.845 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.844+0000 7fd8267fc640 1 -- 172.21.15.196:0/4057950311 <== mon.0 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd820014070 con 0x7fd83014e5e0 2024-03-17T23:56:08.845 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.844+0000 7fd836813640 1 -- 172.21.15.196:0/4057950311 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd83013e470 con 0x7fd83014e5e0 2024-03-17T23:56:08.845 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.844+0000 7fd836813640 1 -- 172.21.15.196:0/4057950311 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd83013ea30 con 0x7fd83014e5e0 2024-03-17T23:56:08.845 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.844+0000 7fd8267fc640 1 -- 172.21.15.196:0/4057950311 <== mon.0 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd820010890 con 0x7fd83014e5e0 2024-03-17T23:56:08.846 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.844+0000 7fd8267fc640 1 -- 172.21.15.196:0/4057950311 <== mon.0 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd820010c80 con 0x7fd83014e5e0 2024-03-17T23:56:08.852 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.852+0000 7fd8267fc640 1 -- 172.21.15.196:0/4057950311 <== mon.0 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 5) ==== 87083+0+0 (secure 0 0 0) 0x7fd820017070 con 0x7fd83014e5e0 2024-03-17T23:56:08.852 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.852+0000 7fd8267fc640 1 --2- 172.21.15.196:0/4057950311 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7fd814067730 0x7fd814069bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:08.853 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.852+0000 7fd8267fc640 1 -- 172.21.15.196:0/4057950311 <== mon.0 v2:172.21.15.196:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fd8200849e0 con 0x7fd83014e5e0 2024-03-17T23:56:08.853 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.852+0000 7fd835811640 1 --2- 172.21.15.196:0/4057950311 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7fd814067730 0x7fd814069bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:08.854 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.852+0000 7fd835811640 1 --2- 172.21.15.196:0/4057950311 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7fd814067730 0x7fd814069bf0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fd82c0b2000 tx=0x7fd82c008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:56:08.876 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.876+0000 7fd836813640 1 -- 172.21.15.196:0/4057950311 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd8180052a0 con 0x7fd83014e5e0 2024-03-17T23:56:08.885 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.884+0000 7fd8267fc640 1 -- 172.21.15.196:0/4057950311 <== mon.0 v2:172.21.15.196:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177849 (secure 0 0 0) 0x7fd8200b66d0 con 0x7fd83014e5e0 2024-03-17T23:56:08.911 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.908+0000 7f0ea860e640 1 -- 172.21.15.196:0/802563760 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f0e9804bae0 con 0x7f0e9804af10 2024-03-17T23:56:08.911 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.908+0000 7f0e96ffd640 1 -- 172.21.15.196:0/802563760 <== mon.0 v2:172.21.15.196:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f0e90059430 con 0x7f0e9804af10 2024-03-17T23:56:08.914 INFO:teuthology.orchestra.run.smithi196.stdout:55834574851 2024-03-17T23:56:08.916 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.912+0000 7f0e94ff9640 1 -- 172.21.15.196:0/802563760 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f0e8c067880 msgr2=0x7f0e8c069d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:08.916 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.912+0000 7f0e94ff9640 1 --2- 172.21.15.196:0/802563760 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f0e8c067880 0x7f0e8c069d40 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f0ea0062e50 tx=0x7f0ea008e040 comp rx=0 tx=0).stop 2024-03-17T23:56:08.916 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.912+0000 7f0e94ff9640 1 -- 172.21.15.196:0/802563760 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0e9804af10 msgr2=0x7f0e9817c5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:08.916 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.912+0000 7f0e94ff9640 1 --2- 172.21.15.196:0/802563760 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0e9804af10 0x7f0e9817c5d0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f0e9000c750 tx=0x7f0e9000cc10 comp rx=0 tx=0).stop 2024-03-17T23:56:08.916 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.912+0000 7f0e94ff9640 1 -- 172.21.15.196:0/802563760 shutdown_connections 2024-03-17T23:56:08.917 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.912+0000 7f0e94ff9640 1 --2- 172.21.15.196:0/802563760 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f0e8c067880 0x7f0e8c069d40 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:08.917 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.912+0000 7f0e94ff9640 1 --2- 172.21.15.196:0/802563760 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0e980d6c60 0x7f0e980db980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:08.917 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.912+0000 7f0e94ff9640 1 --2- 172.21.15.196:0/802563760 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0e9804c480 0x7f0e980c9d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:08.917 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.912+0000 7f0e94ff9640 1 --2- 172.21.15.196:0/802563760 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0e9804af10 0x7f0e9817c5d0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:08.917 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.912+0000 7f0e94ff9640 1 -- 172.21.15.196:0/802563760 >> 172.21.15.196:0/802563760 conn(0x7f0e98050190 msgr2=0x7f0e980ccce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-17T23:56:08.917 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.912+0000 7f0e94ff9640 1 -- 172.21.15.196:0/802563760 shutdown_connections 2024-03-17T23:56:08.917 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.912+0000 7f0e94ff9640 1 -- 172.21.15.196:0/802563760 wait complete. 2024-03-17T23:56:08.962 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574851 for osd.5 2024-03-17T23:56:08.971 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.968+0000 7f67ff016640 1 -- 172.21.15.196:0/3488152422 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f67d4005590 con 0x7f67f8073390 2024-03-17T23:56:08.972 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.968+0000 7f67f57fa640 1 -- 172.21.15.196:0/3488152422 <== mon.1 v2:172.21.15.204:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f67f0059bd0 con 0x7f67f8073390 2024-03-17T23:56:08.974 INFO:teuthology.orchestra.run.smithi196.stdout:55834574852 2024-03-17T23:56:08.997 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.996+0000 7f67e6ffd640 1 -- 172.21.15.196:0/3488152422 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f67dc067660 msgr2=0x7f67dc069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:08.997 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.996+0000 7f67e6ffd640 1 --2- 172.21.15.196:0/3488152422 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f67dc067660 0x7f67dc069b20 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f67f80c4fc0 tx=0x7f67e80090e0 comp rx=0 tx=0).stop 2024-03-17T23:56:08.997 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.996+0000 7f67e6ffd640 1 -- 172.21.15.196:0/3488152422 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f67f8073390 msgr2=0x7f67f8159a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:08.997 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.996+0000 7f67e6ffd640 1 --2- 172.21.15.196:0/3488152422 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f67f8073390 0x7f67f8159a20 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f67f000ba50 tx=0x7f67f000bf10 comp rx=0 tx=0).stop 2024-03-17T23:56:08.998 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.996+0000 7f67e6ffd640 1 -- 172.21.15.196:0/3488152422 shutdown_connections 2024-03-17T23:56:08.998 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.996+0000 7f67e6ffd640 1 --2- 172.21.15.196:0/3488152422 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f67dc067660 0x7f67dc069b20 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:08.998 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.996+0000 7f67e6ffd640 1 --2- 172.21.15.196:0/3488152422 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f67f80c2910 0x7f67f81523d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:08.998 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.996+0000 7f67e6ffd640 1 --2- 172.21.15.196:0/3488152422 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f67f8150ce0 0x7f67f8151320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:08.998 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.996+0000 7f67e6ffd640 1 --2- 172.21.15.196:0/3488152422 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f67f8073390 0x7f67f8159a20 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:08.998 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.996+0000 7f67e6ffd640 1 -- 172.21.15.196:0/3488152422 >> 172.21.15.196:0/3488152422 conn(0x7f67f806ec10 msgr2=0x7f67f8071d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-17T23:56:08.998 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.996+0000 7f67e6ffd640 1 -- 172.21.15.196:0/3488152422 shutdown_connections 2024-03-17T23:56:08.998 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:08.996+0000 7f67e6ffd640 1 -- 172.21.15.196:0/3488152422 wait complete. 2024-03-17T23:56:09.017 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:09.016+0000 7f41bc8f9640 1 -- 172.21.15.196:0/1061221614 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f41b815ae90 con 0x7f41b80c36e0 2024-03-17T23:56:09.018 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:09.016+0000 7f419f7fe640 1 -- 172.21.15.196:0/1061221614 <== mon.1 v2:172.21.15.204:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f41b01019b0 con 0x7f41b80c36e0 2024-03-17T23:56:09.018 INFO:teuthology.orchestra.run.smithi196.stdout:55834574851 2024-03-17T23:56:09.022 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.1 2024-03-17T23:56:09.029 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:09.028+0000 7f419d7fa640 1 -- 172.21.15.196:0/1061221614 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f41a4067760 msgr2=0x7f41a4069c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:09.029 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:09.028+0000 7f419d7fa640 1 --2- 172.21.15.196:0/1061221614 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f41a4067760 0x7f41a4069c20 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f41b8166ab0 tx=0x7f41a8008040 comp rx=0 tx=0).stop 2024-03-17T23:56:09.029 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:09.028+0000 7f419d7fa640 1 -- 172.21.15.196:0/1061221614 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f41b80c36e0 msgr2=0x7f41b815b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:09.030 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:09.028+0000 7f419d7fa640 1 --2- 172.21.15.196:0/1061221614 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f41b80c36e0 0x7f41b815b0d0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f41b002a5b0 tx=0x7f41b002a740 comp rx=0 tx=0).stop 2024-03-17T23:56:09.030 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:09.028+0000 7f419d7fa640 1 -- 172.21.15.196:0/1061221614 shutdown_connections 2024-03-17T23:56:09.030 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:09.028+0000 7f419d7fa640 1 --2- 172.21.15.196:0/1061221614 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f41a4067760 0x7f41a4069c20 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:09.030 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:09.028+0000 7f419d7fa640 1 --2- 172.21.15.196:0/1061221614 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f41b80c6980 0x7f41b815bad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:09.030 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:09.028+0000 7f419d7fa640 1 --2- 172.21.15.196:0/1061221614 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f41b81640d0 0x7f41b815c010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:09.030 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:09.028+0000 7f419d7fa640 1 --2- 172.21.15.196:0/1061221614 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f41b80c36e0 0x7f41b815b0d0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:09.030 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:09.028+0000 7f419d7fa640 1 -- 172.21.15.196:0/1061221614 >> 172.21.15.196:0/1061221614 conn(0x7f41b80673f0 msgr2=0x7f41b80c45f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-17T23:56:09.030 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:09.028+0000 7f419d7fa640 1 -- 172.21.15.196:0/1061221614 shutdown_connections 2024-03-17T23:56:09.030 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:09.028+0000 7f419d7fa640 1 -- 172.21.15.196:0/1061221614 wait complete. 2024-03-17T23:56:09.050 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574851 for osd.0 2024-03-17T23:56:09.098 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:09.096+0000 7fcc7e2f7640 1 -- 172.21.15.196:0/4016076219 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7fcc780c5d60 con 0x7fcc781674d0 2024-03-17T23:56:09.098 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:09.096+0000 7fcc6dffb640 1 -- 172.21.15.196:0/4016076219 <== mon.1 v2:172.21.15.204:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fcc680554b0 con 0x7fcc781674d0 2024-03-17T23:56:09.099 INFO:teuthology.orchestra.run.smithi196.stdout:55834574852 2024-03-17T23:56:09.109 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:09.108+0000 7fcc7e2f7640 1 -- 172.21.15.196:0/4016076219 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7fcc5c067730 msgr2=0x7fcc5c069bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:09.109 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:09.108+0000 7fcc7e2f7640 1 --2- 172.21.15.196:0/4016076219 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7fcc5c067730 0x7fcc5c069bf0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fcc740b6000 tx=0x7fcc74023ab0 comp rx=0 tx=0).stop 2024-03-17T23:56:09.109 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:09.108+0000 7fcc7e2f7640 1 -- 172.21.15.196:0/4016076219 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fcc781674d0 msgr2=0x7fcc78158130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:09.109 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:09.108+0000 7fcc7e2f7640 1 --2- 172.21.15.196:0/4016076219 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fcc781674d0 0x7fcc78158130 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fcc6800d890 tx=0x7fcc6800dd50 comp rx=0 tx=0).stop 2024-03-17T23:56:09.109 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:09.108+0000 7fcc7e2f7640 1 -- 172.21.15.196:0/4016076219 shutdown_connections 2024-03-17T23:56:09.109 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:09.108+0000 7fcc7e2f7640 1 --2- 172.21.15.196:0/4016076219 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7fcc5c067730 0x7fcc5c069bf0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:09.110 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:09.108+0000 7fcc7e2f7640 1 --2- 172.21.15.196:0/4016076219 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fcc78158670 0x7fcc78200680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:09.110 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:09.108+0000 7fcc7e2f7640 1 --2- 172.21.15.196:0/4016076219 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fcc781674d0 0x7fcc78158130 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:09.110 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:09.108+0000 7fcc7e2f7640 1 --2- 172.21.15.196:0/4016076219 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcc64003b20 0x7fcc78165a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:09.110 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:09.108+0000 7fcc7e2f7640 1 -- 172.21.15.196:0/4016076219 >> 172.21.15.196:0/4016076219 conn(0x7fcc780673f0 msgr2=0x7fcc780c8370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-17T23:56:09.110 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:09.108+0000 7fcc7e2f7640 1 -- 172.21.15.196:0/4016076219 shutdown_connections 2024-03-17T23:56:09.110 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:09.108+0000 7fcc7e2f7640 1 -- 172.21.15.196:0/4016076219 wait complete. 2024-03-17T23:56:09.129 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.6 2024-03-17T23:56:09.129 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:09.128+0000 7f4c589bc640 1 -- 172.21.15.196:0/3341228506 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f4c38005590 con 0x7f4c540c7630 2024-03-17T23:56:09.129 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:09.128+0000 7f4c42ffd640 1 -- 172.21.15.196:0/3341228506 <== mon.2 v2:172.21.15.204:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f4c4805bca0 con 0x7f4c540c7630 2024-03-17T23:56:09.130 INFO:teuthology.orchestra.run.smithi196.stdout:55834574854 2024-03-17T23:56:09.132 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:09.128+0000 7f4c589bc640 1 -- 172.21.15.196:0/3341228506 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f4c3c0677b0 msgr2=0x7f4c3c069c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:09.132 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:09.128+0000 7f4c589bc640 1 --2- 172.21.15.196:0/3341228506 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f4c3c0677b0 0x7f4c3c069c70 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f4c44006fd0 tx=0x7f4c44009060 comp rx=0 tx=0).stop 2024-03-17T23:56:09.132 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:09.128+0000 7f4c589bc640 1 -- 172.21.15.196:0/3341228506 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4c540c7630 msgr2=0x7f4c541586a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:09.132 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:09.128+0000 7f4c589bc640 1 --2- 172.21.15.196:0/3341228506 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4c540c7630 0x7f4c541586a0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f4c48009f30 tx=0x7f4c4800c4f0 comp rx=0 tx=0).stop 2024-03-17T23:56:09.132 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:09.128+0000 7f4c589bc640 1 -- 172.21.15.196:0/3341228506 shutdown_connections 2024-03-17T23:56:09.132 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:09.128+0000 7f4c589bc640 1 --2- 172.21.15.196:0/3341228506 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f4c3c0677b0 0x7f4c3c069c70 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:09.133 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:09.128+0000 7f4c589bc640 1 --2- 172.21.15.196:0/3341228506 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4c540c7630 0x7f4c541586a0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:09.133 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:09.128+0000 7f4c589bc640 1 --2- 172.21.15.196:0/3341228506 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4c541520b0 0x7f4c54071300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:09.133 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:09.128+0000 7f4c589bc640 1 --2- 172.21.15.196:0/3341228506 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4c540c5ca0 0x7f4c54158160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:09.133 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:09.128+0000 7f4c589bc640 1 -- 172.21.15.196:0/3341228506 >> 172.21.15.196:0/3341228506 conn(0x7f4c540c7da0 msgr2=0x7f4c54147eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-17T23:56:09.133 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:09.128+0000 7f4c589bc640 1 -- 172.21.15.196:0/3341228506 shutdown_connections 2024-03-17T23:56:09.133 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:09.128+0000 7f4c589bc640 1 -- 172.21.15.196:0/3341228506 wait complete. 2024-03-17T23:56:09.153 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.3 2024-03-17T23:56:09.192 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:09.192+0000 7fd31a0cf640 1 -- 172.21.15.196:0/1842794034 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7fd3140c7380 con 0x7fd31414fe00 2024-03-17T23:56:09.192 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:09.192+0000 7fd309ffb640 1 -- 172.21.15.196:0/1842794034 <== mon.0 v2:172.21.15.196:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fd30c056580 con 0x7fd31414fe00 2024-03-17T23:56:09.193 INFO:teuthology.orchestra.run.smithi196.stdout:55834574853 2024-03-17T23:56:09.195 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:09.192+0000 7fd31a0cf640 1 -- 172.21.15.196:0/1842794034 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7fd2f8067730 msgr2=0x7fd2f8069bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:09.195 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:09.192+0000 7fd31a0cf640 1 --2- 172.21.15.196:0/1842794034 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7fd2f8067730 0x7fd2f8069bf0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fd304009fd0 tx=0x7fd304009a80 comp rx=0 tx=0).stop 2024-03-17T23:56:09.195 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:09.192+0000 7fd31a0cf640 1 -- 172.21.15.196:0/1842794034 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd31414fe00 msgr2=0x7fd3140cb190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:09.196 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:09.192+0000 7fd31a0cf640 1 --2- 172.21.15.196:0/1842794034 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd31414fe00 0x7fd3140cb190 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fd30c00e5b0 tx=0x7fd30c00ea70 comp rx=0 tx=0).stop 2024-03-17T23:56:09.196 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:09.192+0000 7fd31a0cf640 1 -- 172.21.15.196:0/1842794034 shutdown_connections 2024-03-17T23:56:09.196 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:09.192+0000 7fd31a0cf640 1 --2- 172.21.15.196:0/1842794034 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7fd2f8067730 0x7fd2f8069bf0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:09.196 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:09.192+0000 7fd31a0cf640 1 --2- 172.21.15.196:0/1842794034 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd3140c6d10 0x7fd3140ca100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:09.196 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:09.192+0000 7fd31a0cf640 1 --2- 172.21.15.196:0/1842794034 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd31414fe00 0x7fd3140cb190 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:09.196 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:09.192+0000 7fd31a0cf640 1 --2- 172.21.15.196:0/1842794034 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd314071ec0 0x7fd31414b230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:09.196 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:09.192+0000 7fd31a0cf640 1 -- 172.21.15.196:0/1842794034 >> 172.21.15.196:0/1842794034 conn(0x7fd3140673f0 msgr2=0x7fd314154c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-17T23:56:09.196 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:09.192+0000 7fd31a0cf640 1 -- 172.21.15.196:0/1842794034 shutdown_connections 2024-03-17T23:56:09.196 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:09.192+0000 7fd31a0cf640 1 -- 172.21.15.196:0/1842794034 wait complete. 2024-03-17T23:56:09.212 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.2 2024-03-17T23:56:09.219 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:09.216+0000 7f0b16d3e640 1 -- 172.21.15.196:0/1779124508 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f0af8005590 con 0x7f0b1006b2b0 2024-03-17T23:56:09.219 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:09.216+0000 7f0b067fc640 1 -- 172.21.15.196:0/1779124508 <== mon.0 v2:172.21.15.196:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f0b0c059710 con 0x7f0b1006b2b0 2024-03-17T23:56:09.219 INFO:teuthology.orchestra.run.smithi196.stdout:55834574853 2024-03-17T23:56:09.220 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:09.216+0000 7fd836813640 1 -- 172.21.15.196:0/4057950311 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7fd818005860 con 0x7fd83014e5e0 2024-03-17T23:56:09.220 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:09.220+0000 7fd8267fc640 1 -- 172.21.15.196:0/4057950311 <== mon.0 v2:172.21.15.196:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fd820010e20 con 0x7fd83014e5e0 2024-03-17T23:56:09.220 INFO:teuthology.orchestra.run.smithi196.stdout:55834574852 2024-03-17T23:56:09.223 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:09.220+0000 7f0b16d3e640 1 -- 172.21.15.196:0/1779124508 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f0afc067870 msgr2=0x7f0afc069d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:09.223 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:09.220+0000 7f0b16d3e640 1 --2- 172.21.15.196:0/1779124508 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f0afc067870 0x7f0afc069d30 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f0b080b1000 tx=0x7f0b080a9070 comp rx=0 tx=0).stop 2024-03-17T23:56:09.223 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:09.220+0000 7f0b16d3e640 1 -- 172.21.15.196:0/1779124508 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0b1006b2b0 msgr2=0x7f0b101f8510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:09.223 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:09.220+0000 7f0b16d3e640 1 --2- 172.21.15.196:0/1779124508 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0b1006b2b0 0x7f0b101f8510 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f0b0c00b7b0 tx=0x7f0b0c00bc70 comp rx=0 tx=0).stop 2024-03-17T23:56:09.223 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:09.220+0000 7f0b16d3e640 1 -- 172.21.15.196:0/1779124508 shutdown_connections 2024-03-17T23:56:09.223 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:09.220+0000 7f0b16d3e640 1 --2- 172.21.15.196:0/1779124508 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f0afc067870 0x7f0afc069d30 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:09.223 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:09.220+0000 7f0b16d3e640 1 --2- 172.21.15.196:0/1779124508 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0b100727b0 0x7f0b10150950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:09.223 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:09.220+0000 7f0b16d3e640 1 --2- 172.21.15.196:0/1779124508 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0b1014fe80 0x7f0b1014dfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:09.223 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:09.220+0000 7f0b16d3e640 1 --2- 172.21.15.196:0/1779124508 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0b1006b2b0 0x7f0b101f8510 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:09.223 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:09.220+0000 7f0b16d3e640 1 -- 172.21.15.196:0/1779124508 >> 172.21.15.196:0/1779124508 conn(0x7f0b100cb3a0 msgr2=0x7f0b100c5ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-17T23:56:09.224 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:09.220+0000 7f0b16d3e640 1 -- 172.21.15.196:0/1779124508 shutdown_connections 2024-03-17T23:56:09.224 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:09.220+0000 7f0b16d3e640 1 -- 172.21.15.196:0/1779124508 wait complete. 2024-03-17T23:56:09.224 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:09.220+0000 7fd836813640 1 -- 172.21.15.196:0/4057950311 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7fd814067730 msgr2=0x7fd814069bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:09.225 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:09.220+0000 7fd836813640 1 --2- 172.21.15.196:0/4057950311 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7fd814067730 0x7fd814069bf0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fd82c0b2000 tx=0x7fd82c008040 comp rx=0 tx=0).stop 2024-03-17T23:56:09.225 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:09.220+0000 7fd836813640 1 -- 172.21.15.196:0/4057950311 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd83014e5e0 msgr2=0x7fd83013c230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:09.225 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:09.220+0000 7fd836813640 1 --2- 172.21.15.196:0/4057950311 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd83014e5e0 0x7fd83013c230 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fd82000b4d0 tx=0x7fd82000b990 comp rx=0 tx=0).stop 2024-03-17T23:56:09.225 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:09.220+0000 7fd836813640 1 -- 172.21.15.196:0/4057950311 shutdown_connections 2024-03-17T23:56:09.225 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:09.220+0000 7fd836813640 1 --2- 172.21.15.196:0/4057950311 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7fd814067730 0x7fd814069bf0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:09.225 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:09.220+0000 7fd836813640 1 --2- 172.21.15.196:0/4057950311 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd830157a10 0x7fd8300ca680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:09.225 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:09.220+0000 7fd836813640 1 --2- 172.21.15.196:0/4057950311 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd83014e5e0 0x7fd83013c230 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:09.225 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:09.220+0000 7fd836813640 1 --2- 172.21.15.196:0/4057950311 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd8300c6010 0x7fd830153a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:09.225 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:09.220+0000 7fd836813640 1 -- 172.21.15.196:0/4057950311 >> 172.21.15.196:0/4057950311 conn(0x7fd8300673f0 msgr2=0x7fd8301486a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-17T23:56:09.225 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:09.220+0000 7fd836813640 1 -- 172.21.15.196:0/4057950311 shutdown_connections 2024-03-17T23:56:09.225 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:09.220+0000 7fd836813640 1 -- 172.21.15.196:0/4057950311 wait complete. 2024-03-17T23:56:09.247 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.7 2024-03-17T23:56:09.247 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.4 2024-03-17T23:56:09.963 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-03-17T23:56:10.023 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-03-17T23:56:10.051 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-03-17T23:56:10.087 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.084+0000 7f34b0f9d640 1 Processor -- start 2024-03-17T23:56:10.087 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.084+0000 7f34b0f9d640 1 -- start start 2024-03-17T23:56:10.089 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.088+0000 7f34b0f9d640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f34ac06f8d0 0x7f34ac06fce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:10.089 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.088+0000 7f34a9d9b640 1 --1- >> v1:172.21.15.196:6789/0 conn(0x7f34ac15a470 0x7f34ac15a8c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.196:6789/0 says I am v1:172.21.15.196:50510/0 (socket says 172.21.15.196:50510) 2024-03-17T23:56:10.089 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.088+0000 7f34aad9d640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f34ac06f8d0 0x7f34ac06fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:10.089 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.088+0000 7f34a9d9b640 1 -- 172.21.15.196:0/3957412726 learned_addr learned my addr 172.21.15.196:0/3957412726 (peer_addr_for_me v1:172.21.15.196:0/0) 2024-03-17T23:56:10.090 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.088+0000 7f34b0f9d640 1 -- 172.21.15.196:0/3957412726 --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f34ac151230 con 0x7f34ac15a470 2024-03-17T23:56:10.090 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.088+0000 7f34b0f9d640 1 -- 172.21.15.196:0/3957412726 --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f34ac0c7620 con 0x7f34ac150e50 2024-03-17T23:56:10.090 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.088+0000 7f34b0f9d640 1 -- 172.21.15.196:0/3957412726 --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7f34ac0c7900 con 0x7f34ac06f8d0 2024-03-17T23:56:10.090 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.088+0000 7f34a959a640 1 -- 172.21.15.196:0/3957412726 <== mon.0 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 732558325 0 0) 0x7f34ac151230 con 0x7f34ac15a470 2024-03-17T23:56:10.090 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.088+0000 7f34a959a640 1 -- 172.21.15.196:0/3957412726 --> v1:172.21.15.196:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3494003530 con 0x7f34ac15a470 2024-03-17T23:56:10.090 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.088+0000 7f34a959a640 1 -- 172.21.15.196:0/3957412726 <== mon.1 v1:172.21.15.204:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4119774235 0 0) 0x7f34ac0c7620 con 0x7f34ac150e50 2024-03-17T23:56:10.090 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.088+0000 7f34a959a640 1 -- 172.21.15.196:0/3957412726 --> v1:172.21.15.204:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f34ac151230 con 0x7f34ac150e50 2024-03-17T23:56:10.090 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.088+0000 7f34aad9d640 1 -- 172.21.15.196:0/3957412726 >> v1:172.21.15.204:6789/0 conn(0x7f34ac150e50 legacy=0x7f34ac0c8600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:10.090 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.088+0000 7f34aad9d640 1 -- 172.21.15.196:0/3957412726 >> v1:172.21.15.196:6789/0 conn(0x7f34ac15a470 legacy=0x7f34ac15a8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:10.090 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.088+0000 7f34aad9d640 1 -- 172.21.15.196:0/3957412726 --> v2:172.21.15.196:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34ac0c7be0 con 0x7f34ac06f8d0 2024-03-17T23:56:10.093 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.092+0000 7f34aad9d640 1 --2- 172.21.15.196:0/3957412726 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f34ac06f8d0 0x7f34ac06fce0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f34a4009d90 tx=0x7f34a40211b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a92e42ee93a21f2b server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:56:10.105 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.104+0000 7f34a959a640 1 -- 172.21.15.196:0/3957412726 <== mon.0 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34a40b6070 con 0x7f34ac06f8d0 2024-03-17T23:56:10.105 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.104+0000 7f34a959a640 1 -- 172.21.15.196:0/3957412726 <== mon.0 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34a40b1400 con 0x7f34ac06f8d0 2024-03-17T23:56:10.105 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.104+0000 7f34a959a640 1 -- 172.21.15.196:0/3957412726 <== mon.0 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34a0001680 con 0x7f34ac06f8d0 2024-03-17T23:56:10.107 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.104+0000 7f34b0f9d640 1 -- 172.21.15.196:0/3957412726 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f34ac06f8d0 msgr2=0x7f34ac06fce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:10.107 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.104+0000 7f34b0f9d640 1 --2- 172.21.15.196:0/3957412726 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f34ac06f8d0 0x7f34ac06fce0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f34a4009d90 tx=0x7f34a40211b0 comp rx=0 tx=0).stop 2024-03-17T23:56:10.107 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.104+0000 7f34b0f9d640 1 -- 172.21.15.196:0/3957412726 shutdown_connections 2024-03-17T23:56:10.107 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.104+0000 7f34b0f9d640 1 --2- 172.21.15.196:0/3957412726 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f34ac06f8d0 0x7f34ac06fce0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:10.107 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.104+0000 7f34b0f9d640 1 -- 172.21.15.196:0/3957412726 >> 172.21.15.196:0/3957412726 conn(0x7f34ac0cc420 msgr2=0x7f34ac0cc830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-17T23:56:10.107 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.104+0000 7f34b0f9d640 1 -- 172.21.15.196:0/3957412726 shutdown_connections 2024-03-17T23:56:10.107 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.104+0000 7f34b0f9d640 1 -- 172.21.15.196:0/3957412726 wait complete. 2024-03-17T23:56:10.109 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.108+0000 7f34b0f9d640 1 Processor -- start 2024-03-17T23:56:10.109 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.108+0000 7f34b0f9d640 1 -- start start 2024-03-17T23:56:10.111 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.108+0000 7f34b0f9d640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f34ac06f8d0 0x7f34ac0caa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:10.111 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.108+0000 7f34b0f9d640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f34ac150e50 0x7f34ac149f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:10.111 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.108+0000 7f34b0f9d640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f34ac15a470 0x7f34ac14a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:10.112 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.108+0000 7f34aa59c640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f34ac06f8d0 0x7f34ac0caa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:10.112 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.108+0000 7f34aa59c640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f34ac06f8d0 0x7f34ac0caa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.196:34730/0 (socket says 172.21.15.196:34730) 2024-03-17T23:56:10.112 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.108+0000 7f34aa59c640 1 -- 172.21.15.196:0/1189437324 learned_addr learned my addr 172.21.15.196:0/1189437324 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-03-17T23:56:10.112 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.108+0000 7f34a9d9b640 1 --2- 172.21.15.196:0/1189437324 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f34ac150e50 0x7f34ac149f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:10.112 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.108+0000 7f34b0f9d640 1 -- 172.21.15.196:0/1189437324 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f34ac070db0 con 0x7f34ac06f8d0 2024-03-17T23:56:10.112 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.108+0000 7f34aad9d640 1 --2- 172.21.15.196:0/1189437324 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f34ac15a470 0x7f34ac14a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:10.112 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.108+0000 7f34b0f9d640 1 -- 172.21.15.196:0/1189437324 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f34ac0c81a0 con 0x7f34ac150e50 2024-03-17T23:56:10.112 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.108+0000 7f34b0f9d640 1 -- 172.21.15.196:0/1189437324 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f34ac070220 con 0x7f34ac15a470 2024-03-17T23:56:10.112 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.112+0000 7f34aa59c640 1 -- 172.21.15.196:0/1189437324 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f34ac15a470 msgr2=0x7f34ac14a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:10.113 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.112+0000 7f34aa59c640 1 --2- 172.21.15.196:0/1189437324 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f34ac15a470 0x7f34ac14a4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:10.113 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.112+0000 7f34aa59c640 1 -- 172.21.15.196:0/1189437324 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f34ac150e50 msgr2=0x7f34ac149f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:10.113 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.112+0000 7f34aa59c640 1 --2- 172.21.15.196:0/1189437324 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f34ac150e50 0x7f34ac149f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:10.113 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.112+0000 7f34aa59c640 1 -- 172.21.15.196:0/1189437324 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34ac159d80 con 0x7f34ac06f8d0 2024-03-17T23:56:10.113 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.112+0000 7f34aa59c640 1 --2- 172.21.15.196:0/1189437324 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f34ac06f8d0 0x7f34ac0caa70 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f349c00c490 tx=0x7f349c00c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:56:10.125 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.124+0000 7f349affd640 1 -- 172.21.15.196:0/1189437324 <== mon.0 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f349c0052d0 con 0x7f34ac06f8d0 2024-03-17T23:56:10.126 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.124+0000 7f349affd640 1 -- 172.21.15.196:0/1189437324 <== mon.0 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f349c005470 con 0x7f34ac06f8d0 2024-03-17T23:56:10.126 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.124+0000 7f349affd640 1 -- 172.21.15.196:0/1189437324 <== mon.0 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f349c012870 con 0x7f34ac06f8d0 2024-03-17T23:56:10.126 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.124+0000 7f34b0f9d640 1 -- 172.21.15.196:0/1189437324 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f34ac144d10 con 0x7f34ac06f8d0 2024-03-17T23:56:10.127 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.124+0000 7f34b0f9d640 1 -- 172.21.15.196:0/1189437324 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34ac1452d0 con 0x7f34ac06f8d0 2024-03-17T23:56:10.128 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.124+0000 7f349affd640 1 -- 172.21.15.196:0/1189437324 <== mon.0 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 5) ==== 87083+0+0 (secure 0 0 0) 0x7f349c012a10 con 0x7f34ac06f8d0 2024-03-17T23:56:10.128 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.124+0000 7f34b0f9d640 1 -- 172.21.15.196:0/1189437324 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f34ac1454d0 con 0x7f34ac06f8d0 2024-03-17T23:56:10.128 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.128+0000 7f349affd640 1 --2- 172.21.15.196:0/1189437324 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f348c0676b0 0x7f348c069b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:10.129 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.128+0000 7f349affd640 1 -- 172.21.15.196:0/1189437324 <== mon.0 v2:172.21.15.196:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f349c086dc0 con 0x7f34ac06f8d0 2024-03-17T23:56:10.130 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-03-17T23:56:10.137 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.136+0000 7f349affd640 1 -- 172.21.15.196:0/1189437324 <== mon.0 v2:172.21.15.196:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177849 (secure 0 0 0) 0x7f34ac1454d0 con 0x7f34ac06f8d0 2024-03-17T23:56:10.137 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.136+0000 7f34a9d9b640 1 --2- 172.21.15.196:0/1189437324 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f348c0676b0 0x7f348c069b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:10.141 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.136+0000 7f34a9d9b640 1 --2- 172.21.15.196:0/1189437324 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f348c0676b0 0x7f348c069b70 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f34ac0cc380 tx=0x7f34a00018e0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:56:10.144 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.144+0000 7f9109d22640 1 Processor -- start 2024-03-17T23:56:10.145 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.144+0000 7f9109d22640 1 -- start start 2024-03-17T23:56:10.146 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.144+0000 7f9109d22640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f9104150e80 0x7f910415a120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:10.146 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.144+0000 7f9109d22640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f91040c8310 0x7f91041614b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:10.146 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.144+0000 7f9109d22640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f91040c44c0 con 0x7f91040c6fe0 2024-03-17T23:56:10.146 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.144+0000 7f9109d22640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7f91041573b0 con 0x7f9104150e80 2024-03-17T23:56:10.146 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.144+0000 7f9109d22640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f91040c3f00 con 0x7f91040c8310 2024-03-17T23:56:10.146 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.144+0000 7f91037fe640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f9104150e80 0x7f910415a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:10.147 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.144+0000 7f91037fe640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f9104150e80 0x7f910415a120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.196:34742/0 (socket says 172.21.15.196:34742) 2024-03-17T23:56:10.147 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.144+0000 7f91037fe640 1 -- 172.21.15.196:0/3901303652 learned_addr learned my addr 172.21.15.196:0/3901303652 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-03-17T23:56:10.147 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.144+0000 7f9103fff640 1 --2- 172.21.15.196:0/3901303652 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f91040c8310 0x7f91041614b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:10.147 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.144+0000 7f9103fff640 1 -- 172.21.15.196:0/3901303652 >> v2:172.21.15.196:3300/0 conn(0x7f9104150e80 msgr2=0x7f910415a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-17T23:56:10.147 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.144+0000 7f9103fff640 1 --2- 172.21.15.196:0/3901303652 >> v2:172.21.15.196:3300/0 conn(0x7f9104150e80 0x7f910415a120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:10.147 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.144+0000 7f9103fff640 1 -- 172.21.15.196:0/3901303652 >> v1:172.21.15.204:6789/0 conn(0x7f91040c6fe0 legacy=0x7f9104072b30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-17T23:56:10.147 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.144+0000 7f9103fff640 1 -- 172.21.15.196:0/3901303652 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91040c41e0 con 0x7f91040c8310 2024-03-17T23:56:10.150 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.148+0000 7f9103fff640 1 --2- 172.21.15.196:0/3901303652 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f91040c8310 0x7f91041614b0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f90fc009d90 tx=0x7f90fc01f140 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e8e4a4e4527c16ee server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:56:10.154 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-03-17T23:56:10.160 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.156+0000 7f91027fc640 1 -- 172.21.15.196:0/3901303652 <== mon.2 v2:172.21.15.204:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90fc0b4070 con 0x7f91040c8310 2024-03-17T23:56:10.160 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.156+0000 7f91027fc640 1 -- 172.21.15.196:0/3901303652 <== mon.2 v2:172.21.15.204:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f90fc0af600 con 0x7f91040c8310 2024-03-17T23:56:10.161 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.160+0000 7f9109d22640 1 -- 172.21.15.196:0/3901303652 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f91040c8310 msgr2=0x7f91041614b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:10.161 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.160+0000 7f9109d22640 1 --2- 172.21.15.196:0/3901303652 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f91040c8310 0x7f91041614b0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f90fc009d90 tx=0x7f90fc01f140 comp rx=0 tx=0).stop 2024-03-17T23:56:10.161 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.160+0000 7f9109d22640 1 -- 172.21.15.196:0/3901303652 shutdown_connections 2024-03-17T23:56:10.161 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.160+0000 7f9109d22640 1 --2- 172.21.15.196:0/3901303652 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f91040c8310 0x7f91041614b0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:10.161 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.160+0000 7f9109d22640 1 --2- 172.21.15.196:0/3901303652 >> v2:172.21.15.196:3300/0 conn(0x7f9104150e80 0x7f910415a120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:10.161 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.160+0000 7f9109d22640 1 -- 172.21.15.196:0/3901303652 >> 172.21.15.196:0/3901303652 conn(0x7f910406c3c0 msgr2=0x7f910406c7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-17T23:56:10.161 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.160+0000 7f9109d22640 1 -- 172.21.15.196:0/3901303652 shutdown_connections 2024-03-17T23:56:10.162 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.160+0000 7f9109d22640 1 -- 172.21.15.196:0/3901303652 wait complete. 2024-03-17T23:56:10.163 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.160+0000 7f9109d22640 1 Processor -- start 2024-03-17T23:56:10.164 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.160+0000 7f9109d22640 1 -- start start 2024-03-17T23:56:10.165 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.164+0000 7f9109d22640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f91040c6fe0 0x7f91040c2780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:10.165 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.164+0000 7f9109d22640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f91040c8310 0x7f9104155c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:10.165 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.164+0000 7f9109d22640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9104150e80 0x7f91040c1040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:10.165 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.164+0000 7f9109d22640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f9104151260 con 0x7f91040c6fe0 2024-03-17T23:56:10.165 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.164+0000 7f9109d22640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f9104157040 con 0x7f91040c8310 2024-03-17T23:56:10.165 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.164+0000 7f9109d22640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f910415a660 con 0x7f9104150e80 2024-03-17T23:56:10.165 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.164+0000 7f91037fe640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f91040c6fe0 0x7f91040c2780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:10.165 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.164+0000 7f91037fe640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f91040c6fe0 0x7f91040c2780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.196:34756/0 (socket says 172.21.15.196:34756) 2024-03-17T23:56:10.165 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.164+0000 7f91037fe640 1 -- 172.21.15.196:0/3566718089 learned_addr learned my addr 172.21.15.196:0/3566718089 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-03-17T23:56:10.165 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.164+0000 7f9103fff640 1 --2- 172.21.15.196:0/3566718089 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9104150e80 0x7f91040c1040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:10.166 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.164+0000 7f91037fe640 1 -- 172.21.15.196:0/3566718089 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9104150e80 msgr2=0x7f91040c1040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:10.166 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.164+0000 7f91037fe640 1 --2- 172.21.15.196:0/3566718089 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9104150e80 0x7f91040c1040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:10.166 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.164+0000 7f91037fe640 1 -- 172.21.15.196:0/3566718089 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f91040c8310 msgr2=0x7f9104155c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:10.166 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.164+0000 7f9102ffd640 1 --2- 172.21.15.196:0/3566718089 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f91040c8310 0x7f9104155c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:10.166 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.164+0000 7f91037fe640 1 --2- 172.21.15.196:0/3566718089 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f91040c8310 0x7f9104155c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:10.166 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.164+0000 7f91037fe640 1 -- 172.21.15.196:0/3566718089 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f910406ca50 con 0x7f91040c6fe0 2024-03-17T23:56:10.166 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.164+0000 7f91037fe640 1 --2- 172.21.15.196:0/3566718089 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f91040c6fe0 0x7f91040c2780 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f90f800d800 tx=0x7f90f800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:56:10.168 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.168+0000 7f90ebfff640 1 -- 172.21.15.196:0/3566718089 <== mon.0 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90f80096a0 con 0x7f91040c6fe0 2024-03-17T23:56:10.168 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.168+0000 7f90ebfff640 1 -- 172.21.15.196:0/3566718089 <== mon.0 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f90f8019070 con 0x7f91040c6fe0 2024-03-17T23:56:10.168 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.168+0000 7f90ebfff640 1 -- 172.21.15.196:0/3566718089 <== mon.0 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90f8009a60 con 0x7f91040c6fe0 2024-03-17T23:56:10.168 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.168+0000 7f9109d22640 1 -- 172.21.15.196:0/3566718089 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9104156970 con 0x7f91040c6fe0 2024-03-17T23:56:10.168 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.168+0000 7f9109d22640 1 -- 172.21.15.196:0/3566718089 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91041566d0 con 0x7f91040c6fe0 2024-03-17T23:56:10.169 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.168+0000 7f9109d22640 1 -- 172.21.15.196:0/3566718089 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f91040c6c50 con 0x7f91040c6fe0 2024-03-17T23:56:10.171 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.168+0000 7f90ebfff640 1 -- 172.21.15.196:0/3566718089 <== mon.0 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 5) ==== 87083+0+0 (secure 0 0 0) 0x7f90f8009c00 con 0x7f91040c6fe0 2024-03-17T23:56:10.171 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.168+0000 7f90ebfff640 1 --2- 172.21.15.196:0/3566718089 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f90f00676b0 0x7f90f0069b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:10.179 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.176+0000 7f90ebfff640 1 -- 172.21.15.196:0/3566718089 <== mon.0 v2:172.21.15.196:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f90f808a060 con 0x7f91040c6fe0 2024-03-17T23:56:10.179 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.176+0000 7f90ebfff640 1 -- 172.21.15.196:0/3566718089 <== mon.0 v2:172.21.15.196:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177849 (secure 0 0 0) 0x7f90f8056110 con 0x7f91040c6fe0 2024-03-17T23:56:10.180 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.176+0000 7f9102ffd640 1 --2- 172.21.15.196:0/3566718089 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f90f00676b0 0x7f90f0069b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:10.181 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.180+0000 7f9102ffd640 1 --2- 172.21.15.196:0/3566718089 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f90f00676b0 0x7f90f0069b70 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f91040c7d80 tx=0x7f90f4008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:56:10.212 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-03-17T23:56:10.236 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.236+0000 7f832a9a9640 1 Processor -- start 2024-03-17T23:56:10.237 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.236+0000 7f832a9a9640 1 -- start start 2024-03-17T23:56:10.238 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.236+0000 7f832a9a9640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f8324151c40 0x7f83240c80d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:10.238 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.236+0000 7f832a9a9640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f8324152020 0x7f832415b810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:10.238 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.236+0000 7f832a9a9640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8324157b60 0x7f832415bd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:10.238 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.236+0000 7f832a9a9640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7f83241580a0 con 0x7f8324152020 2024-03-17T23:56:10.238 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.236+0000 7f832a9a9640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 -- 0x7f8324158360 con 0x7f8324151c40 2024-03-17T23:56:10.238 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.236+0000 7f832a9a9640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f8324158640 con 0x7f8324157b60 2024-03-17T23:56:10.238 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.236+0000 7f8323fff640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f8324151c40 0x7f83240c80d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:10.239 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.236+0000 7f8323fff640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f8324151c40 0x7f83240c80d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3300/0 says I am v2:172.21.15.196:50350/0 (socket says 172.21.15.196:50350) 2024-03-17T23:56:10.239 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.236+0000 7f8323fff640 1 -- 172.21.15.196:0/1496907612 learned_addr learned my addr 172.21.15.196:0/1496907612 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-03-17T23:56:10.239 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.236+0000 7f8328f46640 1 --2- 172.21.15.196:0/1496907612 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8324157b60 0x7f832415bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:10.240 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.236+0000 7f8323fff640 1 -- 172.21.15.196:0/1496907612 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8324157b60 msgr2=0x7f832415bd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-17T23:56:10.240 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.236+0000 7f8323fff640 1 --2- 172.21.15.196:0/1496907612 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8324157b60 0x7f832415bd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:10.240 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.236+0000 7f8323fff640 1 -- 172.21.15.196:0/1496907612 >> v2:172.21.15.196:3300/0 conn(0x7f8324152020 msgr2=0x7f832415b810 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-17T23:56:10.240 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.236+0000 7f8323fff640 1 --2- 172.21.15.196:0/1496907612 >> v2:172.21.15.196:3300/0 conn(0x7f8324152020 0x7f832415b810 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:10.240 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.236+0000 7f8323fff640 1 -- 172.21.15.196:0/1496907612 --> v2:172.21.15.204:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8324158920 con 0x7f8324151c40 2024-03-17T23:56:10.241 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.240+0000 7f8323fff640 1 --2- 172.21.15.196:0/1496907612 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8324151c40 0x7f83240c80d0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f8324071ff0 tx=0x7f831c01ca30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=631928bf0521321b server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:56:10.242 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.240+0000 7f8322ffd640 1 -- 172.21.15.196:0/1496907612 <== mon.1 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83240c2ac0 con 0x7f8324151c40 2024-03-17T23:56:10.242 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.240+0000 7f8322ffd640 1 -- 172.21.15.196:0/1496907612 <== mon.1 v2:172.21.15.204:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f831c0a57d0 con 0x7f8324151c40 2024-03-17T23:56:10.243 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.240+0000 7f832a9a9640 1 -- 172.21.15.196:0/1496907612 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8324151c40 msgr2=0x7f83240c80d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:10.243 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.240+0000 7f832a9a9640 1 --2- 172.21.15.196:0/1496907612 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8324151c40 0x7f83240c80d0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f8324071ff0 tx=0x7f831c01ca30 comp rx=0 tx=0).stop 2024-03-17T23:56:10.247 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-03-17T23:56:10.247 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-03-17T23:56:10.248 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.244+0000 7f832a9a9640 1 -- 172.21.15.196:0/1496907612 shutdown_connections 2024-03-17T23:56:10.248 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.244+0000 7f832a9a9640 1 --2- 172.21.15.196:0/1496907612 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8324157b60 0x7f832415bd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:10.248 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.244+0000 7f832a9a9640 1 --2- 172.21.15.196:0/1496907612 >> v2:172.21.15.196:3300/0 conn(0x7f8324152020 0x7f832415b810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:10.248 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.244+0000 7f832a9a9640 1 --2- 172.21.15.196:0/1496907612 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8324151c40 0x7f83240c80d0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:10.249 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.244+0000 7f832a9a9640 1 -- 172.21.15.196:0/1496907612 >> 172.21.15.196:0/1496907612 conn(0x7f8324071020 msgr2=0x7f8324071430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-17T23:56:10.249 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.244+0000 7f832a9a9640 1 -- 172.21.15.196:0/1496907612 shutdown_connections 2024-03-17T23:56:10.249 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.244+0000 7f832a9a9640 1 -- 172.21.15.196:0/1496907612 wait complete. 2024-03-17T23:56:10.249 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.248+0000 7f832a9a9640 1 Processor -- start 2024-03-17T23:56:10.249 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.248+0000 7f832a9a9640 1 -- start start 2024-03-17T23:56:10.252 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.248+0000 7f832a9a9640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8324151c40 0x7f83240b2440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:10.252 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.248+0000 7f832a9a9640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8324152020 0x7f83241597b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:10.252 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.248+0000 7f832a9a9640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8324157b60 0x7f8324159cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:10.252 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.248+0000 7f832a9a9640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f83240c9f30 con 0x7f8324152020 2024-03-17T23:56:10.252 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.248+0000 7f832a9a9640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f83240c9db0 con 0x7f8324151c40 2024-03-17T23:56:10.252 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.248+0000 7f832a9a9640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f83240ca0b0 con 0x7f8324157b60 2024-03-17T23:56:10.252 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.248+0000 7f83237fe640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8324152020 0x7f83241597b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:10.252 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.248+0000 7f83237fe640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8324152020 0x7f83241597b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.196:34766/0 (socket says 172.21.15.196:34766) 2024-03-17T23:56:10.252 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.248+0000 7f83237fe640 1 -- 172.21.15.196:0/3819975945 learned_addr learned my addr 172.21.15.196:0/3819975945 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-03-17T23:56:10.252 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.248+0000 7f8323fff640 1 --2- 172.21.15.196:0/3819975945 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8324151c40 0x7f83240b2440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:10.252 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.248+0000 7f8328f46640 1 --2- 172.21.15.196:0/3819975945 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8324157b60 0x7f8324159cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:10.252 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.248+0000 7f8323fff640 1 -- 172.21.15.196:0/3819975945 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8324157b60 msgr2=0x7f8324159cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:10.252 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.248+0000 7f8323fff640 1 --2- 172.21.15.196:0/3819975945 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8324157b60 0x7f8324159cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:10.253 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.248+0000 7f8323fff640 1 -- 172.21.15.196:0/3819975945 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8324152020 msgr2=0x7f83241597b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:10.253 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.248+0000 7f8323fff640 1 --2- 172.21.15.196:0/3819975945 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8324152020 0x7f83241597b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:10.253 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.248+0000 7f8323fff640 1 -- 172.21.15.196:0/3819975945 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83240b2e90 con 0x7f8324151c40 2024-03-17T23:56:10.253 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.248+0000 7f8323fff640 1 --2- 172.21.15.196:0/3819975945 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8324151c40 0x7f83240b2440 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f831c0ab000 tx=0x7f831c0197d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:56:10.260 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.260+0000 7f8320ff9640 1 -- 172.21.15.196:0/3819975945 <== mon.1 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f831c0bc030 con 0x7f8324151c40 2024-03-17T23:56:10.260 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.260+0000 7f8320ff9640 1 -- 172.21.15.196:0/3819975945 <== mon.1 v2:172.21.15.204:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f831c007cc0 con 0x7f8324151c40 2024-03-17T23:56:10.260 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.260+0000 7f832a9a9640 1 -- 172.21.15.196:0/3819975945 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83241f08c0 con 0x7f8324151c40 2024-03-17T23:56:10.260 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.260+0000 7f8320ff9640 1 -- 172.21.15.196:0/3819975945 <== mon.1 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f831c0b8470 con 0x7f8324151c40 2024-03-17T23:56:10.261 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.260+0000 7f832a9a9640 1 -- 172.21.15.196:0/3819975945 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83241f0e80 con 0x7f8324151c40 2024-03-17T23:56:10.263 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.260+0000 7f8320ff9640 1 -- 172.21.15.196:0/3819975945 <== mon.1 v2:172.21.15.204:3300/0 4 ==== mgrmap(e 5) ==== 87083+0+0 (secure 0 0 0) 0x7f831c0bf070 con 0x7f8324151c40 2024-03-17T23:56:10.263 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.260+0000 7f8320ff9640 1 --2- 172.21.15.196:0/3819975945 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f830c0677f0 0x7f830c069cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:10.263 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.260+0000 7f8320ff9640 1 -- 172.21.15.196:0/3819975945 <== mon.1 v2:172.21.15.204:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f831c120170 con 0x7f8324151c40 2024-03-17T23:56:10.264 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.260+0000 7f83237fe640 1 --2- 172.21.15.196:0/3819975945 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f830c0677f0 0x7f830c069cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:10.264 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.264+0000 7f83237fe640 1 --2- 172.21.15.196:0/3819975945 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f830c0677f0 0x7f830c069cb0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f8324157340 tx=0x7f8318009190 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:56:10.272 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.272+0000 7f832a9a9640 1 -- 172.21.15.196:0/3819975945 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f83000052a0 con 0x7f8324151c40 2024-03-17T23:56:10.281 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.280+0000 7f8320ff9640 1 -- 172.21.15.196:0/3819975945 <== mon.1 v2:172.21.15.204:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177849 (secure 0 0 0) 0x7f831c0c7020 con 0x7f8324151c40 2024-03-17T23:56:10.388 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.384+0000 7f99b90be640 1 Processor -- start 2024-03-17T23:56:10.388 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.384+0000 7f99b90be640 1 -- start start 2024-03-17T23:56:10.389 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.388+0000 7f99b90be640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f99b414fe60 0x7f99b4156710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:10.389 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.388+0000 7f99b90be640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f99b40734b0 0x7f99b4071630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:10.389 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.388+0000 7f99b90be640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f99b40c5d40 con 0x7f99b40c70c0 2024-03-17T23:56:10.389 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.388+0000 7f99b90be640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7f99b40c6020 con 0x7f99b414fe60 2024-03-17T23:56:10.389 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.388+0000 7f99b90be640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 -- 0x7f99b40c6300 con 0x7f99b40734b0 2024-03-17T23:56:10.390 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.388+0000 7f99b2d9d640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f99b414fe60 0x7f99b4156710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:10.390 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.388+0000 7f99b2d9d640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f99b414fe60 0x7f99b4156710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.196:34772/0 (socket says 172.21.15.196:34772) 2024-03-17T23:56:10.390 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.388+0000 7f99b2d9d640 1 -- 172.21.15.196:0/463599751 learned_addr learned my addr 172.21.15.196:0/463599751 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-03-17T23:56:10.390 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.388+0000 7f99b259c640 1 --2- 172.21.15.196:0/463599751 >> v2:172.21.15.204:3300/0 conn(0x7f99b40734b0 0x7f99b4071630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:10.390 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.388+0000 7f99b259c640 1 -- 172.21.15.196:0/463599751 >> v2:172.21.15.196:3300/0 conn(0x7f99b414fe60 msgr2=0x7f99b4156710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-17T23:56:10.391 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.388+0000 7f99b259c640 1 --2- 172.21.15.196:0/463599751 >> v2:172.21.15.196:3300/0 conn(0x7f99b414fe60 0x7f99b4156710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:10.391 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.388+0000 7f99b259c640 1 -- 172.21.15.196:0/463599751 >> v1:172.21.15.204:6789/0 conn(0x7f99b40c70c0 legacy=0x7f99b406c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:10.391 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.388+0000 7f99b259c640 1 -- 172.21.15.196:0/463599751 --> v2:172.21.15.204:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99b40c65e0 con 0x7f99b40734b0 2024-03-17T23:56:10.391 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.388+0000 7f99b2d9d640 1 --2- 172.21.15.196:0/463599751 >> v2:172.21.15.196:3300/0 conn(0x7f99b414fe60 0x7f99b4156710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-17T23:56:10.393 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.392+0000 7f99b259c640 1 --2- 172.21.15.196:0/463599751 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f99b40734b0 0x7f99b4071630 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f99b4070c40 tx=0x7f99ac01c850 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3b49e59673d9211e server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:56:10.404 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.404+0000 7f99b1d9b640 1 -- 172.21.15.196:0/463599751 <== mon.1 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99ac0b2070 con 0x7f99b40734b0 2024-03-17T23:56:10.404 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.404+0000 7f99b1d9b640 1 -- 172.21.15.196:0/463599751 <== mon.1 v2:172.21.15.204:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f99ac0a58b0 con 0x7f99b40734b0 2024-03-17T23:56:10.404 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.404+0000 7f99b1d9b640 1 -- 172.21.15.196:0/463599751 <== mon.1 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99ac0a5c80 con 0x7f99b40734b0 2024-03-17T23:56:10.405 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.404+0000 7f99b90be640 1 -- 172.21.15.196:0/463599751 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f99b40734b0 msgr2=0x7f99b4071630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:10.405 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.404+0000 7f99b90be640 1 --2- 172.21.15.196:0/463599751 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f99b40734b0 0x7f99b4071630 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f99b4070c40 tx=0x7f99ac01c850 comp rx=0 tx=0).stop 2024-03-17T23:56:10.405 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.404+0000 7f99b90be640 1 -- 172.21.15.196:0/463599751 shutdown_connections 2024-03-17T23:56:10.405 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.404+0000 7f99b90be640 1 --2- 172.21.15.196:0/463599751 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f99b40734b0 0x7f99b4071630 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:10.406 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.404+0000 7f99b90be640 1 --2- 172.21.15.196:0/463599751 >> v2:172.21.15.196:3300/0 conn(0x7f99b414fe60 0x7f99b4156710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:10.406 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.404+0000 7f99b90be640 1 -- 172.21.15.196:0/463599751 >> 172.21.15.196:0/463599751 conn(0x7f99b40c7da0 msgr2=0x7f99b40c81b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-17T23:56:10.406 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.404+0000 7f99b90be640 1 -- 172.21.15.196:0/463599751 shutdown_connections 2024-03-17T23:56:10.406 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.404+0000 7f99b90be640 1 -- 172.21.15.196:0/463599751 wait complete. 2024-03-17T23:56:10.407 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.404+0000 7f99b90be640 1 Processor -- start 2024-03-17T23:56:10.407 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.404+0000 7f99b90be640 1 -- start start 2024-03-17T23:56:10.408 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.408+0000 7f99b90be640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f99b40c70c0 0x7f99b4153110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:10.409 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.408+0000 7f99b90be640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f99b414fe60 0x7f99b4152870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:10.409 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.408+0000 7f99b90be640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f99b41f0570 0x7f99b4149570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:10.409 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.408+0000 7f99b90be640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f99b4071b70 con 0x7f99b414fe60 2024-03-17T23:56:10.409 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.408+0000 7f99b90be640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f99b40c6ba0 con 0x7f99b40c70c0 2024-03-17T23:56:10.409 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.408+0000 7f99b90be640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f99b406cdd0 con 0x7f99b41f0570 2024-03-17T23:56:10.409 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.408+0000 7f99b259c640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f99b414fe60 0x7f99b4152870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:10.409 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.408+0000 7f99b259c640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f99b414fe60 0x7f99b4152870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.196:34776/0 (socket says 172.21.15.196:34776) 2024-03-17T23:56:10.409 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.408+0000 7f99b259c640 1 -- 172.21.15.196:0/3025023023 learned_addr learned my addr 172.21.15.196:0/3025023023 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-03-17T23:56:10.409 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.408+0000 7f99b359e640 1 --2- 172.21.15.196:0/3025023023 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f99b41f0570 0x7f99b4149570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:10.409 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.408+0000 7f99b2d9d640 1 --2- 172.21.15.196:0/3025023023 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f99b40c70c0 0x7f99b4153110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:10.410 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.408+0000 7f99b2d9d640 1 -- 172.21.15.196:0/3025023023 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f99b41f0570 msgr2=0x7f99b4149570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:10.410 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.408+0000 7f99b2d9d640 1 --2- 172.21.15.196:0/3025023023 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f99b41f0570 0x7f99b4149570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:10.410 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.408+0000 7f99b2d9d640 1 -- 172.21.15.196:0/3025023023 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f99b414fe60 msgr2=0x7f99b4152870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:10.410 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.408+0000 7f99b2d9d640 1 --2- 172.21.15.196:0/3025023023 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f99b414fe60 0x7f99b4152870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:10.410 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.408+0000 7f99b2d9d640 1 -- 172.21.15.196:0/3025023023 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99b41517d0 con 0x7f99b40c70c0 2024-03-17T23:56:10.410 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.408+0000 7f99b359e640 1 --2- 172.21.15.196:0/3025023023 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f99b41f0570 0x7f99b4149570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-17T23:56:10.410 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.408+0000 7f99b2d9d640 1 --2- 172.21.15.196:0/3025023023 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f99b40c70c0 0x7f99b4153110 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f999c00e8b0 tx=0x7f999c00ed70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:56:10.416 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.416+0000 7f99ab7fe640 1 -- 172.21.15.196:0/3025023023 <== mon.1 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f999c004030 con 0x7f99b40c70c0 2024-03-17T23:56:10.416 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.416+0000 7f99b90be640 1 -- 172.21.15.196:0/3025023023 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99b4151ab0 con 0x7f99b40c70c0 2024-03-17T23:56:10.416 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.416+0000 7f99b90be640 1 -- 172.21.15.196:0/3025023023 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99b4152070 con 0x7f99b40c70c0 2024-03-17T23:56:10.424 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.416+0000 7f99ab7fe640 1 -- 172.21.15.196:0/3025023023 <== mon.1 v2:172.21.15.204:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f999c0041d0 con 0x7f99b40c70c0 2024-03-17T23:56:10.424 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.424+0000 7f99ab7fe640 1 -- 172.21.15.196:0/3025023023 <== mon.1 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f999c00c940 con 0x7f99b40c70c0 2024-03-17T23:56:10.424 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.424+0000 7f99ab7fe640 1 -- 172.21.15.196:0/3025023023 <== mon.1 v2:172.21.15.204:3300/0 4 ==== mgrmap(e 5) ==== 87083+0+0 (secure 0 0 0) 0x7f999c00cb20 con 0x7f99b40c70c0 2024-03-17T23:56:10.425 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.424+0000 7f99ab7fe640 1 --2- 172.21.15.196:0/3025023023 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f99a00678d0 0x7f99a0069d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:10.425 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.424+0000 7f99ab7fe640 1 -- 172.21.15.196:0/3025023023 <== mon.1 v2:172.21.15.204:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f999c085810 con 0x7f99b40c70c0 2024-03-17T23:56:10.425 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.424+0000 7f99b259c640 1 --2- 172.21.15.196:0/3025023023 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f99a00678d0 0x7f99a0069d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:10.425 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.424+0000 7f99b90be640 1 -- 172.21.15.196:0/3025023023 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f99980052a0 con 0x7f99b40c70c0 2024-03-17T23:56:10.426 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.424+0000 7f99b259c640 1 --2- 172.21.15.196:0/3025023023 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f99a00678d0 0x7f99a0069d90 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f99ac000f90 tx=0x7f99ac0a7070 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:56:10.434 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.432+0000 7f99ab7fe640 1 -- 172.21.15.196:0/3025023023 <== mon.1 v2:172.21.15.204:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177849 (secure 0 0 0) 0x7f999c017020 con 0x7f99b40c70c0 2024-03-17T23:56:10.444 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.444+0000 7f70d6414640 1 Processor -- start 2024-03-17T23:56:10.446 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.444+0000 7f70d6414640 1 -- start start 2024-03-17T23:56:10.446 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.444+0000 7f70d6414640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f70d014fe80 0x7f70d0156880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:10.447 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.444+0000 7f70d6414640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f70d006b2b0 0x7f70d006b6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:10.447 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.444+0000 7f70d6414640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f70d0156dc0 con 0x7f70d00727b0 2024-03-17T23:56:10.447 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.444+0000 7f70d6414640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7f70d0071240 con 0x7f70d006b2b0 2024-03-17T23:56:10.447 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.444+0000 7f70d6414640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 -- 0x7f70d00c64b0 con 0x7f70d014fe80 2024-03-17T23:56:10.447 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.444+0000 7f70d5c13640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f70d006b2b0 0x7f70d006b6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:10.447 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.444+0000 7f70d5c13640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f70d006b2b0 0x7f70d006b6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.196:34782/0 (socket says 172.21.15.196:34782) 2024-03-17T23:56:10.447 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.444+0000 7f70d5c13640 1 -- 172.21.15.196:0/648946719 learned_addr learned my addr 172.21.15.196:0/648946719 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-03-17T23:56:10.447 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.444+0000 7f70d5412640 1 --2- 172.21.15.196:0/648946719 >> v2:172.21.15.204:3300/0 conn(0x7f70d014fe80 0x7f70d0156880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:10.447 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.444+0000 7f70d5c13640 1 -- 172.21.15.196:0/648946719 >> v2:172.21.15.204:3300/0 conn(0x7f70d014fe80 msgr2=0x7f70d0156880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-17T23:56:10.447 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.444+0000 7f70d5c13640 1 --2- 172.21.15.196:0/648946719 >> v2:172.21.15.204:3300/0 conn(0x7f70d014fe80 0x7f70d0156880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:10.447 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.444+0000 7f70d5c13640 1 -- 172.21.15.196:0/648946719 >> v1:172.21.15.196:6789/0 conn(0x7f70d00727b0 legacy=0x7f70d00c5da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:10.447 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.444+0000 7f70d5c13640 1 -- 172.21.15.196:0/648946719 --> v2:172.21.15.196:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70d0071470 con 0x7f70d006b2b0 2024-03-17T23:56:10.449 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.448+0000 7f70d5c13640 1 --2- 172.21.15.196:0/648946719 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f70d006b2b0 0x7f70d006b6b0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f70d006c3b0 tx=0x7f70c401e950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=562c7bd2ac3a22fc server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:56:10.456 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.456+0000 7f70cffff640 1 -- 172.21.15.196:0/648946719 <== mon.0 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70c40b4070 con 0x7f70d006b2b0 2024-03-17T23:56:10.457 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.456+0000 7f70cffff640 1 -- 172.21.15.196:0/648946719 <== mon.0 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f70c40a7820 con 0x7f70d006b2b0 2024-03-17T23:56:10.457 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.456+0000 7f70cffff640 1 -- 172.21.15.196:0/648946719 <== mon.0 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70c40a7bf0 con 0x7f70d006b2b0 2024-03-17T23:56:10.457 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.456+0000 7f70d6414640 1 -- 172.21.15.196:0/648946719 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f70d006b2b0 msgr2=0x7f70d006b6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:10.457 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.456+0000 7f70d6414640 1 --2- 172.21.15.196:0/648946719 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f70d006b2b0 0x7f70d006b6b0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f70d006c3b0 tx=0x7f70c401e950 comp rx=0 tx=0).stop 2024-03-17T23:56:10.460 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.460+0000 7f70d6414640 1 -- 172.21.15.196:0/648946719 shutdown_connections 2024-03-17T23:56:10.460 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.460+0000 7f70d6414640 1 --2- 172.21.15.196:0/648946719 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f70d006b2b0 0x7f70d006b6b0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:10.460 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.460+0000 7f70d6414640 1 --2- 172.21.15.196:0/648946719 >> v2:172.21.15.204:3300/0 conn(0x7f70d014fe80 0x7f70d0156880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:10.460 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.460+0000 7f70d6414640 1 -- 172.21.15.196:0/648946719 >> 172.21.15.196:0/648946719 conn(0x7f70d00cb3a0 msgr2=0x7f70d00cb7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-17T23:56:10.461 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.460+0000 7f70d6414640 1 -- 172.21.15.196:0/648946719 shutdown_connections 2024-03-17T23:56:10.461 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.460+0000 7f70d6414640 1 -- 172.21.15.196:0/648946719 wait complete. 2024-03-17T23:56:10.462 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.460+0000 7f70d6414640 1 Processor -- start 2024-03-17T23:56:10.462 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.460+0000 7f70d6414640 1 -- start start 2024-03-17T23:56:10.464 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.460+0000 7f70d6414640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f70d006b2b0 0x7f70d014e360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:10.464 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.460+0000 7f70d6414640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f70d00727b0 0x7f70d014e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:10.464 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.460+0000 7f70d6414640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f70d014fe80 0x7f70d0157580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:10.464 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.460+0000 7f70d6414640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f70d0071b00 con 0x7f70d014fe80 2024-03-17T23:56:10.464 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.460+0000 7f70d6414640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f70d0150260 con 0x7f70d006b2b0 2024-03-17T23:56:10.464 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.460+0000 7f70d6414640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f70d015a250 con 0x7f70d00727b0 2024-03-17T23:56:10.464 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.460+0000 7f70d5c13640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f70d014fe80 0x7f70d0157580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:10.464 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.460+0000 7f70d5c13640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f70d014fe80 0x7f70d0157580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.196:34798/0 (socket says 172.21.15.196:34798) 2024-03-17T23:56:10.464 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.460+0000 7f70d5412640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f70d006b2b0 0x7f70d014e360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:10.464 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.460+0000 7f70d5c13640 1 -- 172.21.15.196:0/255400618 learned_addr learned my addr 172.21.15.196:0/255400618 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-03-17T23:56:10.464 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.460+0000 7f70d4c11640 1 --2- 172.21.15.196:0/255400618 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f70d00727b0 0x7f70d014e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:10.465 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.464+0000 7f70d4c11640 1 -- 172.21.15.196:0/255400618 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f70d006b2b0 msgr2=0x7f70d014e360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:10.465 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.464+0000 7f70d4c11640 1 --2- 172.21.15.196:0/255400618 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f70d006b2b0 0x7f70d014e360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:10.465 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.464+0000 7f70d4c11640 1 -- 172.21.15.196:0/255400618 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f70d014fe80 msgr2=0x7f70d0157580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:10.465 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.464+0000 7f70d4c11640 1 --2- 172.21.15.196:0/255400618 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f70d014fe80 0x7f70d0157580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:10.465 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.464+0000 7f70d4c11640 1 -- 172.21.15.196:0/255400618 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70d0158360 con 0x7f70d00727b0 2024-03-17T23:56:10.465 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.464+0000 7f70d4c11640 1 --2- 172.21.15.196:0/255400618 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f70d00727b0 0x7f70d014e8a0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f70c800c3f0 tx=0x7f70c800c8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:56:10.473 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.472+0000 7f70cdffb640 1 -- 172.21.15.196:0/255400618 <== mon.2 v2:172.21.15.204:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70c80052d0 con 0x7f70d00727b0 2024-03-17T23:56:10.475 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.472+0000 7f70d6414640 1 -- 172.21.15.196:0/255400618 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70d0150790 con 0x7f70d00727b0 2024-03-17T23:56:10.475 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.472+0000 7f70d6414640 1 -- 172.21.15.196:0/255400618 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f70d0150a30 con 0x7f70d00727b0 2024-03-17T23:56:10.475 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.472+0000 7f70cdffb640 1 -- 172.21.15.196:0/255400618 <== mon.2 v2:172.21.15.204:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f70c8005470 con 0x7f70d00727b0 2024-03-17T23:56:10.475 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.472+0000 7f70cdffb640 1 -- 172.21.15.196:0/255400618 <== mon.2 v2:172.21.15.204:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70c8007260 con 0x7f70d00727b0 2024-03-17T23:56:10.476 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.472+0000 7f70cdffb640 1 -- 172.21.15.196:0/255400618 <== mon.2 v2:172.21.15.204:3301/0 4 ==== mgrmap(e 5) ==== 87083+0+0 (secure 0 0 0) 0x7f70c8007400 con 0x7f70d00727b0 2024-03-17T23:56:10.476 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.476+0000 7f70cdffb640 1 --2- 172.21.15.196:0/255400618 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f70bc067730 0x7f70bc069bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:10.477 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.476+0000 7f70cdffb640 1 -- 172.21.15.196:0/255400618 <== mon.2 v2:172.21.15.204:3301/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f70c8084c10 con 0x7f70d00727b0 2024-03-17T23:56:10.477 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.476+0000 7f70d5412640 1 --2- 172.21.15.196:0/255400618 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f70bc067730 0x7f70bc069bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:10.478 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.476+0000 7f70d5412640 1 --2- 172.21.15.196:0/255400618 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f70bc067730 0x7f70bc069bf0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f70c00039a0 tx=0x7f70c000c040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:56:10.480 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.476+0000 7f34b0f9d640 1 -- 172.21.15.196:0/1189437324 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f34ac0689a0 con 0x7f34ac06f8d0 2024-03-17T23:56:10.480 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.480+0000 7f349affd640 1 -- 172.21.15.196:0/1189437324 <== mon.0 v2:172.21.15.196:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f349c0558e0 con 0x7f34ac06f8d0 2024-03-17T23:56:10.483 INFO:teuthology.orchestra.run.smithi196.stdout:55834574851 2024-03-17T23:56:10.483 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.480+0000 7f70d6414640 1 -- 172.21.15.196:0/255400618 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f70b00052a0 con 0x7f70d00727b0 2024-03-17T23:56:10.488 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.488+0000 7f3498ff9640 1 -- 172.21.15.196:0/1189437324 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f348c0676b0 msgr2=0x7f348c069b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:10.488 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.488+0000 7f71d1ee6640 1 Processor -- start 2024-03-17T23:56:10.489 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.488+0000 7f3498ff9640 1 --2- 172.21.15.196:0/1189437324 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f348c0676b0 0x7f348c069b70 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f34ac0cc380 tx=0x7f34a00018e0 comp rx=0 tx=0).stop 2024-03-17T23:56:10.489 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.488+0000 7f3498ff9640 1 -- 172.21.15.196:0/1189437324 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f34ac06f8d0 msgr2=0x7f34ac0caa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:10.489 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.488+0000 7f3498ff9640 1 --2- 172.21.15.196:0/1189437324 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f34ac06f8d0 0x7f34ac0caa70 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f349c00c490 tx=0x7f349c00c950 comp rx=0 tx=0).stop 2024-03-17T23:56:10.490 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.488+0000 7f3498ff9640 1 -- 172.21.15.196:0/1189437324 shutdown_connections 2024-03-17T23:56:10.490 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.488+0000 7f3498ff9640 1 --2- 172.21.15.196:0/1189437324 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f348c0676b0 0x7f348c069b70 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:10.490 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.488+0000 7f3498ff9640 1 --2- 172.21.15.196:0/1189437324 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f34ac15a470 0x7f34ac14a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:10.490 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.488+0000 7f3498ff9640 1 --2- 172.21.15.196:0/1189437324 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f34ac150e50 0x7f34ac149f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:10.490 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.488+0000 7f3498ff9640 1 --2- 172.21.15.196:0/1189437324 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f34ac06f8d0 0x7f34ac0caa70 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:10.490 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.488+0000 7f3498ff9640 1 -- 172.21.15.196:0/1189437324 >> 172.21.15.196:0/1189437324 conn(0x7f34ac0cc420 msgr2=0x7f34ac0c5870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-17T23:56:10.490 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.488+0000 7f3498ff9640 1 -- 172.21.15.196:0/1189437324 shutdown_connections 2024-03-17T23:56:10.490 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.488+0000 7f3498ff9640 1 -- 172.21.15.196:0/1189437324 wait complete. 2024-03-17T23:56:10.491 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.488+0000 7f71d1ee6640 1 -- start start 2024-03-17T23:56:10.491 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.488+0000 7f71d1ee6640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f71cc14fe00 0x7f71cc0cb4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:10.491 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.488+0000 7f71d1ee6640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f71cc071ec0 0x7f71cc0cb9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:10.491 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.488+0000 7f71d1ee6640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f71cc0c67d0 0x7f71cc0c6c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:10.491 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.488+0000 7f71d1ee6640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7f71cc155f40 con 0x7f71cc14fe00 2024-03-17T23:56:10.491 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.488+0000 7f71d1ee6640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 -- 0x7f71cc156220 con 0x7f71cc071ec0 2024-03-17T23:56:10.491 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.488+0000 7f71d1ee6640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f71cc156500 con 0x7f71cc0c67d0 2024-03-17T23:56:10.491 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.488+0000 7f71d0ee4640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f71cc14fe00 0x7f71cc0cb4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:10.491 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.488+0000 7f71d0ee4640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f71cc14fe00 0x7f71cc0cb4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.196:34808/0 (socket says 172.21.15.196:34808) 2024-03-17T23:56:10.491 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.488+0000 7f71d0ee4640 1 -- 172.21.15.196:0/3452800895 learned_addr learned my addr 172.21.15.196:0/3452800895 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-03-17T23:56:10.491 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.488+0000 7f71cbfff640 1 --2- 172.21.15.196:0/3452800895 >> v2:172.21.15.204:3300/0 conn(0x7f71cc071ec0 0x7f71cc0cb9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:10.492 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.488+0000 7f71d16e5640 1 --2- 172.21.15.196:0/3452800895 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f71cc0c67d0 0x7f71cc0c6c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:10.492 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.488+0000 7f71d0ee4640 1 -- 172.21.15.196:0/3452800895 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f71cc0c67d0 msgr2=0x7f71cc0c6c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-17T23:56:10.493 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.488+0000 7f71d0ee4640 1 --2- 172.21.15.196:0/3452800895 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f71cc0c67d0 0x7f71cc0c6c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:10.494 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.488+0000 7f71d0ee4640 1 -- 172.21.15.196:0/3452800895 >> v2:172.21.15.204:3300/0 conn(0x7f71cc071ec0 msgr2=0x7f71cc0cb9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-17T23:56:10.494 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.488+0000 7f71d0ee4640 1 --2- 172.21.15.196:0/3452800895 >> v2:172.21.15.204:3300/0 conn(0x7f71cc071ec0 0x7f71cc0cb9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:10.494 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.488+0000 7f71d0ee4640 1 -- 172.21.15.196:0/3452800895 --> v2:172.21.15.196:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71cc1567e0 con 0x7f71cc14fe00 2024-03-17T23:56:10.494 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.488+0000 7f71cbfff640 1 --2- 172.21.15.196:0/3452800895 >> v2:172.21.15.204:3300/0 conn(0x7f71cc071ec0 0x7f71cc0cb9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-17T23:56:10.494 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.488+0000 7f71d16e5640 1 --2- 172.21.15.196:0/3452800895 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f71cc0c67d0 0x7f71cc0c6c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-17T23:56:10.496 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.492+0000 7f70cdffb640 1 -- 172.21.15.196:0/255400618 <== mon.2 v2:172.21.15.204:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177849 (secure 0 0 0) 0x7f70d0156dc0 con 0x7f70d00727b0 2024-03-17T23:56:10.501 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.500+0000 7f71d0ee4640 1 --2- 172.21.15.196:0/3452800895 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f71cc14fe00 0x7f71cc0cb4b0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f71cc0c3210 tx=0x7f71c0021210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6bf03f8f2434fcd server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:56:10.507 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.504+0000 7f71cb7fe640 1 -- 172.21.15.196:0/3452800895 <== mon.0 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71c00b8070 con 0x7f71cc14fe00 2024-03-17T23:56:10.507 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.504+0000 7f71cb7fe640 1 -- 172.21.15.196:0/3452800895 <== mon.0 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f71c00b3410 con 0x7f71cc14fe00 2024-03-17T23:56:10.509 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.508+0000 7f71d1ee6640 1 -- 172.21.15.196:0/3452800895 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f71cc14fe00 msgr2=0x7f71cc0cb4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:10.509 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.508+0000 7f71d1ee6640 1 --2- 172.21.15.196:0/3452800895 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f71cc14fe00 0x7f71cc0cb4b0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f71cc0c3210 tx=0x7f71c0021210 comp rx=0 tx=0).stop 2024-03-17T23:56:10.509 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.508+0000 7f71d1ee6640 1 -- 172.21.15.196:0/3452800895 shutdown_connections 2024-03-17T23:56:10.509 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.508+0000 7f71d1ee6640 1 --2- 172.21.15.196:0/3452800895 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f71cc0c67d0 0x7f71cc0c6c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:10.509 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.508+0000 7f71d1ee6640 1 --2- 172.21.15.196:0/3452800895 >> v2:172.21.15.204:3300/0 conn(0x7f71cc071ec0 0x7f71cc0cb9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:10.509 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.508+0000 7f71d1ee6640 1 --2- 172.21.15.196:0/3452800895 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f71cc14fe00 0x7f71cc0cb4b0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:10.509 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.508+0000 7f71d1ee6640 1 -- 172.21.15.196:0/3452800895 >> 172.21.15.196:0/3452800895 conn(0x7f71cc0673f0 msgr2=0x7f71cc06b2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-17T23:56:10.509 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.508+0000 7f71d1ee6640 1 -- 172.21.15.196:0/3452800895 shutdown_connections 2024-03-17T23:56:10.509 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.508+0000 7f71d1ee6640 1 -- 172.21.15.196:0/3452800895 wait complete. 2024-03-17T23:56:10.511 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.508+0000 7f71d1ee6640 1 Processor -- start 2024-03-17T23:56:10.511 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.508+0000 7f71d1ee6640 1 -- start start 2024-03-17T23:56:10.513 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.512+0000 7f71d1ee6640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f71cc071ec0 0x7f71cc1ec180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:10.513 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.512+0000 7f71d1ee6640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f71cc0c67d0 0x7f71cc143eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:10.513 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.512+0000 7f71d1ee6640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f71cc14fe00 0x7f71cc1580a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:10.513 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.512+0000 7f71d1ee6640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f71cc1501e0 con 0x7f71cc071ec0 2024-03-17T23:56:10.513 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.512+0000 7f71cbfff640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f71cc0c67d0 0x7f71cc143eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:10.513 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.512+0000 7f71d0ee4640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f71cc071ec0 0x7f71cc1ec180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:10.513 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.512+0000 7f71cbfff640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f71cc0c67d0 0x7f71cc143eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3301/0 says I am v2:172.21.15.196:48534/0 (socket says 172.21.15.196:48534) 2024-03-17T23:56:10.513 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.512+0000 7f71cbfff640 1 -- 172.21.15.196:0/1544798394 learned_addr learned my addr 172.21.15.196:0/1544798394 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-03-17T23:56:10.513 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.512+0000 7f71d1ee6640 1 -- 172.21.15.196:0/1544798394 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f71cc155bf0 con 0x7f71cc14fe00 2024-03-17T23:56:10.513 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.512+0000 7f71d1ee6640 1 -- 172.21.15.196:0/1544798394 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f71cc150360 con 0x7f71cc0c67d0 2024-03-17T23:56:10.513 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.512+0000 7f71d16e5640 1 --2- 172.21.15.196:0/1544798394 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f71cc14fe00 0x7f71cc1580a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:10.514 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.512+0000 7f71cbfff640 1 -- 172.21.15.196:0/1544798394 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f71cc14fe00 msgr2=0x7f71cc1580a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:10.514 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.512+0000 7f71cbfff640 1 --2- 172.21.15.196:0/1544798394 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f71cc14fe00 0x7f71cc1580a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:10.514 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.512+0000 7f71cbfff640 1 -- 172.21.15.196:0/1544798394 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f71cc071ec0 msgr2=0x7f71cc1ec180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:10.514 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.512+0000 7f71cbfff640 1 --2- 172.21.15.196:0/1544798394 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f71cc071ec0 0x7f71cc1ec180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:10.514 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.512+0000 7f71cbfff640 1 -- 172.21.15.196:0/1544798394 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71cc0c3c70 con 0x7f71cc0c67d0 2024-03-17T23:56:10.514 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.512+0000 7f71cbfff640 1 --2- 172.21.15.196:0/1544798394 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f71cc0c67d0 0x7f71cc143eb0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f71bc00e930 tx=0x7f71bc00ed30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:56:10.516 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574851 for osd.5 2024-03-17T23:56:10.520 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.516+0000 7f71c97fa640 1 -- 172.21.15.196:0/1544798394 <== mon.2 v2:172.21.15.204:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71bc017070 con 0x7f71cc0c67d0 2024-03-17T23:56:10.520 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.516+0000 7f71c97fa640 1 -- 172.21.15.196:0/1544798394 <== mon.2 v2:172.21.15.204:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f71bc00c940 con 0x7f71cc0c67d0 2024-03-17T23:56:10.520 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.516+0000 7f71d1ee6640 1 -- 172.21.15.196:0/1544798394 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71cc0c49f0 con 0x7f71cc0c67d0 2024-03-17T23:56:10.520 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.516+0000 7f71c97fa640 1 -- 172.21.15.196:0/1544798394 <== mon.2 v2:172.21.15.204:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71bc00cd10 con 0x7f71cc0c67d0 2024-03-17T23:56:10.520 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.516+0000 7f71d1ee6640 1 -- 172.21.15.196:0/1544798394 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f71cc0c3f10 con 0x7f71cc0c67d0 2024-03-17T23:56:10.520 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.516+0000 7f9109d22640 1 -- 172.21.15.196:0/3566718089 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f91040689a0 con 0x7f91040c6fe0 2024-03-17T23:56:10.521 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.520+0000 7fcb51b82640 1 Processor -- start 2024-03-17T23:56:10.521 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.520+0000 7f90ebfff640 1 -- 172.21.15.196:0/3566718089 <== mon.0 v2:172.21.15.196:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f90f8055a10 con 0x7f91040c6fe0 2024-03-17T23:56:10.521 INFO:teuthology.orchestra.run.smithi196.stdout:55834574852 2024-03-17T23:56:10.522 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.520+0000 7fcb51b82640 1 -- start start 2024-03-17T23:56:10.522 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.520+0000 7fcb51b82640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fcb4c1569a0 0x7fcb4c0c8210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:10.522 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.520+0000 7fcb51b82640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fcb4c0c8750 0x7fcb4c157330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:10.523 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.520+0000 7fcb51b82640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcb4c150140 con 0x7fcb4c14fd60 2024-03-17T23:56:10.523 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.520+0000 7fcb51b82640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 -- 0x7fcb4c0c8b80 con 0x7fcb4c0c8750 2024-03-17T23:56:10.523 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.520+0000 7fcb51b82640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7fcb4c159490 con 0x7fcb4c1569a0 2024-03-17T23:56:10.523 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.520+0000 7fcb4b7fe640 1 --1- >> v1:172.21.15.196:6789/0 conn(0x7fcb4c14fd60 0x7fcb4c0c66f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.196:6789/0 says I am v1:172.21.15.196:50520/0 (socket says 172.21.15.196:50520) 2024-03-17T23:56:10.523 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.520+0000 7fcb4b7fe640 1 -- 172.21.15.196:0/829931826 learned_addr learned my addr 172.21.15.196:0/829931826 (peer_addr_for_me v1:172.21.15.196:0/0) 2024-03-17T23:56:10.524 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.520+0000 7fcb4affd640 1 --2- 172.21.15.196:0/829931826 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fcb4c1569a0 0x7fcb4c0c8210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:10.524 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.520+0000 7fcb4a7fc640 1 -- 172.21.15.196:0/829931826 <== mon.0 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2108783820 0 0) 0x7fcb4c150140 con 0x7fcb4c14fd60 2024-03-17T23:56:10.524 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.520+0000 7fcb4a7fc640 1 -- 172.21.15.196:0/829931826 --> v1:172.21.15.196:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcb34003530 con 0x7fcb4c14fd60 2024-03-17T23:56:10.524 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.520+0000 7fcb4a7fc640 1 -- 172.21.15.196:0/829931826 <== mon.0 v1:172.21.15.196:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2531431976 0 0) 0x7fcb34003530 con 0x7fcb4c14fd60 2024-03-17T23:56:10.524 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.520+0000 7fcb4affd640 1 -- 172.21.15.196:0/829931826 >> v2:172.21.15.204:3300/0 conn(0x7fcb4c0c8750 msgr2=0x7fcb4c157330 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-17T23:56:10.524 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.520+0000 7fcb4affd640 1 --2- 172.21.15.196:0/829931826 >> v2:172.21.15.204:3300/0 conn(0x7fcb4c0c8750 0x7fcb4c157330 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:10.524 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.520+0000 7fcb4affd640 1 -- 172.21.15.196:0/829931826 >> v1:172.21.15.196:6789/0 conn(0x7fcb4c14fd60 legacy=0x7fcb4c0c66f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:10.524 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.520+0000 7fcb4affd640 1 -- 172.21.15.196:0/829931826 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb4c159770 con 0x7fcb4c1569a0 2024-03-17T23:56:10.525 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.520+0000 7f71c97fa640 1 -- 172.21.15.196:0/1544798394 <== mon.2 v2:172.21.15.204:3301/0 4 ==== mgrmap(e 5) ==== 87083+0+0 (secure 0 0 0) 0x7f71bc01a070 con 0x7f71cc0c67d0 2024-03-17T23:56:10.525 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.524+0000 7f71c97fa640 1 --2- 172.21.15.196:0/1544798394 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f71b8067730 0x7f71b8069bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:10.525 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.524+0000 7f71c97fa640 1 -- 172.21.15.196:0/1544798394 <== mon.2 v2:172.21.15.204:3301/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f71bc085a20 con 0x7f71cc0c67d0 2024-03-17T23:56:10.525 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.524+0000 7f71d0ee4640 1 --2- 172.21.15.196:0/1544798394 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f71b8067730 0x7f71b8069bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:10.527 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.524+0000 7fcb4affd640 1 --2- 172.21.15.196:0/829931826 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fcb4c1569a0 0x7fcb4c0c8210 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fcb3c0097c0 tx=0x7fcb3c01ebd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f1d8bf2ad27e0da4 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:56:10.527 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.524+0000 7fcb4a7fc640 1 -- 172.21.15.196:0/829931826 <== mon.2 v2:172.21.15.204:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb3c0b5070 con 0x7fcb4c1569a0 2024-03-17T23:56:10.528 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.524+0000 7fcb4a7fc640 1 -- 172.21.15.196:0/829931826 <== mon.2 v2:172.21.15.204:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb3c0a8610 con 0x7fcb4c1569a0 2024-03-17T23:56:10.528 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.524+0000 7fcb4a7fc640 1 -- 172.21.15.196:0/829931826 <== mon.2 v2:172.21.15.204:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb44001a00 con 0x7fcb4c1569a0 2024-03-17T23:56:10.528 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.524+0000 7fcb51b82640 1 -- 172.21.15.196:0/829931826 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fcb4c1569a0 msgr2=0x7fcb4c0c8210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:10.528 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.524+0000 7fcb51b82640 1 --2- 172.21.15.196:0/829931826 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fcb4c1569a0 0x7fcb4c0c8210 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fcb3c0097c0 tx=0x7fcb3c01ebd0 comp rx=0 tx=0).stop 2024-03-17T23:56:10.528 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.524+0000 7fcb51b82640 1 -- 172.21.15.196:0/829931826 shutdown_connections 2024-03-17T23:56:10.528 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.524+0000 7fcb51b82640 1 --2- 172.21.15.196:0/829931826 >> v2:172.21.15.204:3300/0 conn(0x7fcb4c0c8750 0x7fcb4c157330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:10.528 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.528+0000 7fcb51b82640 1 --2- 172.21.15.196:0/829931826 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fcb4c1569a0 0x7fcb4c0c8210 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:10.528 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.528+0000 7fcb51b82640 1 -- 172.21.15.196:0/829931826 >> 172.21.15.196:0/829931826 conn(0x7fcb4c06ec10 msgr2=0x7fcb4c06f020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-17T23:56:10.529 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.528+0000 7f71d1ee6640 1 -- 172.21.15.196:0/1544798394 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f71cc04f550 con 0x7f71cc0c67d0 2024-03-17T23:56:10.529 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.528+0000 7f71d0ee4640 1 --2- 172.21.15.196:0/1544798394 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f71b8067730 0x7f71b8069bf0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f71c00b5000 tx=0x7f71c00ac000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:56:10.531 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.528+0000 7fcb51b82640 1 -- 172.21.15.196:0/829931826 shutdown_connections 2024-03-17T23:56:10.532 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.528+0000 7f9109d22640 1 -- 172.21.15.196:0/3566718089 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f90f00676b0 msgr2=0x7f90f0069b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:10.532 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.528+0000 7f9109d22640 1 --2- 172.21.15.196:0/3566718089 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f90f00676b0 0x7f90f0069b70 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f91040c7d80 tx=0x7f90f4008040 comp rx=0 tx=0).stop 2024-03-17T23:56:10.533 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.528+0000 7f9109d22640 1 -- 172.21.15.196:0/3566718089 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f91040c6fe0 msgr2=0x7f91040c2780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:10.533 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.528+0000 7f9109d22640 1 --2- 172.21.15.196:0/3566718089 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f91040c6fe0 0x7f91040c2780 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f90f800d800 tx=0x7f90f800dcc0 comp rx=0 tx=0).stop 2024-03-17T23:56:10.533 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.528+0000 7f9109d22640 1 -- 172.21.15.196:0/3566718089 shutdown_connections 2024-03-17T23:56:10.533 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.528+0000 7f9109d22640 1 --2- 172.21.15.196:0/3566718089 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f90f00676b0 0x7f90f0069b70 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:10.533 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.532+0000 7f9109d22640 1 --2- 172.21.15.196:0/3566718089 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9104150e80 0x7f91040c1040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:10.533 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.532+0000 7f9109d22640 1 --2- 172.21.15.196:0/3566718089 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f91040c8310 0x7f9104155c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:10.533 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.532+0000 7f9109d22640 1 --2- 172.21.15.196:0/3566718089 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f91040c6fe0 0x7f91040c2780 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:10.533 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.532+0000 7f9109d22640 1 -- 172.21.15.196:0/3566718089 >> 172.21.15.196:0/3566718089 conn(0x7f910406c3c0 msgr2=0x7f9104072af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-17T23:56:10.533 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.528+0000 7fcb51b82640 1 -- 172.21.15.196:0/829931826 wait complete. 2024-03-17T23:56:10.534 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.532+0000 7f9109d22640 1 -- 172.21.15.196:0/3566718089 shutdown_connections 2024-03-17T23:56:10.534 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.532+0000 7f9109d22640 1 -- 172.21.15.196:0/3566718089 wait complete. 2024-03-17T23:56:10.534 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.532+0000 7fcb51b82640 1 Processor -- start 2024-03-17T23:56:10.535 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.532+0000 7fcb51b82640 1 -- start start 2024-03-17T23:56:10.535 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.532+0000 7fcb51b82640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcb4c0c8750 0x7fcb4c1f4d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:10.535 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.532+0000 7fcb51b82640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fcb4c14fd60 0x7fcb4c157a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:10.535 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.532+0000 7fcb51b82640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fcb4c1569a0 0x7fcb4c0c40e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:10.535 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.532+0000 7fcb51b82640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fcb4c15a010 con 0x7fcb4c0c8750 2024-03-17T23:56:10.535 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.532+0000 7fcb51b82640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7fcb4c159d30 con 0x7fcb4c14fd60 2024-03-17T23:56:10.535 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.532+0000 7fcb51b82640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7fcb4c0c6e00 con 0x7fcb4c1569a0 2024-03-17T23:56:10.535 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.532+0000 7fcb4affd640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fcb4c14fd60 0x7fcb4c157a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:10.535 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.532+0000 7fcb4affd640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fcb4c14fd60 0x7fcb4c157a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3300/0 says I am v2:172.21.15.196:50396/0 (socket says 172.21.15.196:50396) 2024-03-17T23:56:10.536 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.532+0000 7fcb4affd640 1 -- 172.21.15.196:0/587189913 learned_addr learned my addr 172.21.15.196:0/587189913 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-03-17T23:56:10.536 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.532+0000 7fcb4bfff640 1 --2- 172.21.15.196:0/587189913 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fcb4c1569a0 0x7fcb4c0c40e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:10.536 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.532+0000 7fcb4b7fe640 1 --2- 172.21.15.196:0/587189913 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcb4c0c8750 0x7fcb4c1f4d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:10.536 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.532+0000 7fcb4affd640 1 -- 172.21.15.196:0/587189913 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fcb4c1569a0 msgr2=0x7fcb4c0c40e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:10.536 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.532+0000 7fcb4affd640 1 --2- 172.21.15.196:0/587189913 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fcb4c1569a0 0x7fcb4c0c40e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:10.536 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.532+0000 7fcb4affd640 1 -- 172.21.15.196:0/587189913 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcb4c0c8750 msgr2=0x7fcb4c1f4d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:10.536 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.532+0000 7fcb4affd640 1 --2- 172.21.15.196:0/587189913 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcb4c0c8750 0x7fcb4c1f4d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:10.536 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.532+0000 7fcb4affd640 1 -- 172.21.15.196:0/587189913 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb4c151980 con 0x7fcb4c14fd60 2024-03-17T23:56:10.536 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.532+0000 7fcb4affd640 1 --2- 172.21.15.196:0/587189913 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fcb4c14fd60 0x7fcb4c157a10 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fcb3c0b3040 tx=0x7fcb3c01b970 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:56:10.538 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.536+0000 7fb95d815640 1 Processor -- start 2024-03-17T23:56:10.538 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.536+0000 7fb95d815640 1 -- start start 2024-03-17T23:56:10.538 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.536+0000 7fb95d815640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb9500347a0 0x7fb9500dad30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:10.538 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.536+0000 7fb95d815640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fb9500db270 0x7fb9500db6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:10.538 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.536+0000 7fb95d815640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb95004b990 con 0x7fb9500d5000 2024-03-17T23:56:10.538 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.536+0000 7fb95d815640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 -- 0x7fb95004bc70 con 0x7fb9500db270 2024-03-17T23:56:10.538 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.536+0000 7fb95d815640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7fb950006a50 con 0x7fb9500347a0 2024-03-17T23:56:10.538 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.536+0000 7fb9567fc640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb9500347a0 0x7fb9500dad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:10.539 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.536+0000 7fb9567fc640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb9500347a0 0x7fb9500dad30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3301/0 says I am v2:172.21.15.196:48564/0 (socket says 172.21.15.196:48564) 2024-03-17T23:56:10.539 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.536+0000 7fb9567fc640 1 -- 172.21.15.196:0/1810314476 learned_addr learned my addr 172.21.15.196:0/1810314476 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-03-17T23:56:10.539 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.536+0000 7fb9577fe640 1 --2- 172.21.15.196:0/1810314476 >> v2:172.21.15.204:3300/0 conn(0x7fb9500db270 0x7fb9500db6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:10.539 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.536+0000 7fb9577fe640 1 -- 172.21.15.196:0/1810314476 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb9500347a0 msgr2=0x7fb9500dad30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-17T23:56:10.539 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.536+0000 7fb9577fe640 1 --2- 172.21.15.196:0/1810314476 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb9500347a0 0x7fb9500dad30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:10.539 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.536+0000 7fb9577fe640 1 -- 172.21.15.196:0/1810314476 >> v1:172.21.15.196:6789/0 conn(0x7fb9500d5000 legacy=0x7fb95004c2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:10.539 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.536+0000 7fcb33fff640 1 -- 172.21.15.196:0/587189913 <== mon.1 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb3c0b5040 con 0x7fcb4c14fd60 2024-03-17T23:56:10.540 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.536+0000 7fcb33fff640 1 -- 172.21.15.196:0/587189913 <== mon.1 v2:172.21.15.204:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb3c0bf070 con 0x7fcb4c14fd60 2024-03-17T23:56:10.540 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.536+0000 7fcb51b82640 1 -- 172.21.15.196:0/587189913 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb4c0c58b0 con 0x7fcb4c14fd60 2024-03-17T23:56:10.540 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.540+0000 7fcb51b82640 1 -- 172.21.15.196:0/587189913 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb4c0c51c0 con 0x7fcb4c14fd60 2024-03-17T23:56:10.540 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.540+0000 7fcb33fff640 1 -- 172.21.15.196:0/587189913 <== mon.1 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb3c0a9cd0 con 0x7fcb4c14fd60 2024-03-17T23:56:10.542 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.536+0000 7fb9577fe640 1 -- 172.21.15.196:0/1810314476 --> v2:172.21.15.204:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb950006d30 con 0x7fb9500db270 2024-03-17T23:56:10.542 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.540+0000 7f71c97fa640 1 -- 172.21.15.196:0/1544798394 <== mon.2 v2:172.21.15.204:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177849 (secure 0 0 0) 0x7f71bc056060 con 0x7f71cc0c67d0 2024-03-17T23:56:10.542 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.540+0000 7fb9577fe640 1 --2- 172.21.15.196:0/1810314476 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb9500db270 0x7fb9500db6e0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fb94800dbe0 tx=0x7fb948022fc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b30e5080155789db server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:56:10.542 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.540+0000 7fcb33fff640 1 -- 172.21.15.196:0/587189913 <== mon.1 v2:172.21.15.204:3300/0 4 ==== mgrmap(e 5) ==== 87083+0+0 (secure 0 0 0) 0x7fcb3c003620 con 0x7fcb4c14fd60 2024-03-17T23:56:10.543 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.540+0000 7fcb33fff640 1 --2- 172.21.15.196:0/587189913 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7fcb38067730 0x7fcb38069bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:10.543 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.540+0000 7fcb33fff640 1 -- 172.21.15.196:0/587189913 <== mon.1 v2:172.21.15.204:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fcb3c122de0 con 0x7fcb4c14fd60 2024-03-17T23:56:10.544 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.544+0000 7fcb51b82640 1 -- 172.21.15.196:0/587189913 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcb2c0052a0 con 0x7fcb4c14fd60 2024-03-17T23:56:10.544 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.544+0000 7fcb4b7fe640 1 --2- 172.21.15.196:0/587189913 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7fcb38067730 0x7fcb38069bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:10.545 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.544+0000 7fcb4b7fe640 1 --2- 172.21.15.196:0/587189913 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7fcb38067730 0x7fcb38069bf0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fcb44001380 tx=0x7fcb4400a040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:56:10.549 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.548+0000 7fb955ffb640 1 -- 172.21.15.196:0/1810314476 <== mon.1 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb94800d2d0 con 0x7fb9500db270 2024-03-17T23:56:10.549 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.548+0000 7fb955ffb640 1 -- 172.21.15.196:0/1810314476 <== mon.1 v2:172.21.15.204:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb9480acbb0 con 0x7fb9500db270 2024-03-17T23:56:10.551 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.548+0000 7fb95d815640 1 -- 172.21.15.196:0/1810314476 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb9500db270 msgr2=0x7fb9500db6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:10.551 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.548+0000 7fb95d815640 1 --2- 172.21.15.196:0/1810314476 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb9500db270 0x7fb9500db6e0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fb94800dbe0 tx=0x7fb948022fc0 comp rx=0 tx=0).stop 2024-03-17T23:56:10.551 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.548+0000 7fb95d815640 1 -- 172.21.15.196:0/1810314476 shutdown_connections 2024-03-17T23:56:10.551 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.548+0000 7fb95d815640 1 --2- 172.21.15.196:0/1810314476 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb9500db270 0x7fb9500db6e0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:10.551 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.548+0000 7fb95d815640 1 --2- 172.21.15.196:0/1810314476 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb9500347a0 0x7fb9500dad30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:10.551 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.548+0000 7fb95d815640 1 -- 172.21.15.196:0/1810314476 >> 172.21.15.196:0/1810314476 conn(0x7fb950050190 msgr2=0x7fb9500505a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-17T23:56:10.557 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.556+0000 7fcb33fff640 1 -- 172.21.15.196:0/587189913 <== mon.1 v2:172.21.15.204:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177849 (secure 0 0 0) 0x7fcb3c018730 con 0x7fcb4c14fd60 2024-03-17T23:56:10.564 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.564+0000 7fb95d815640 1 -- 172.21.15.196:0/1810314476 shutdown_connections 2024-03-17T23:56:10.564 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.564+0000 7fb95d815640 1 -- 172.21.15.196:0/1810314476 wait complete. 2024-03-17T23:56:10.566 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.564+0000 7fb95d815640 1 Processor -- start 2024-03-17T23:56:10.566 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.564+0000 7fb95d815640 1 -- start start 2024-03-17T23:56:10.567 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.564+0000 7fb95d815640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb9500347a0 0x7fb9500cdf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:10.567 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.564+0000 7fb95d815640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb9500d5000 0x7fb950170650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:10.568 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.564+0000 7fb95d815640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb9500db270 0x7fb9500490e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:10.568 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.564+0000 7fb95d815640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fb9500d53e0 con 0x7fb9500347a0 2024-03-17T23:56:10.568 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.564+0000 7fb95d815640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7fb950045130 con 0x7fb9500db270 2024-03-17T23:56:10.568 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.564+0000 7fb95d815640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7fb950034c10 con 0x7fb9500d5000 2024-03-17T23:56:10.568 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.564+0000 7fb956ffd640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb9500347a0 0x7fb9500cdf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:10.568 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.564+0000 7fb956ffd640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb9500347a0 0x7fb9500cdf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.196:34834/0 (socket says 172.21.15.196:34834) 2024-03-17T23:56:10.568 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.564+0000 7fb9567fc640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb9500d5000 0x7fb950170650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:10.568 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.564+0000 7fb956ffd640 1 -- 172.21.15.196:0/813210868 learned_addr learned my addr 172.21.15.196:0/813210868 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-03-17T23:56:10.569 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.564+0000 7fb9577fe640 1 --2- 172.21.15.196:0/813210868 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb9500db270 0x7fb9500490e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:10.569 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.568+0000 7fb9567fc640 1 -- 172.21.15.196:0/813210868 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb9500db270 msgr2=0x7fb9500490e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:10.569 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.568+0000 7fb9567fc640 1 --2- 172.21.15.196:0/813210868 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb9500db270 0x7fb9500490e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:10.569 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.568+0000 7fb9567fc640 1 -- 172.21.15.196:0/813210868 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb9500347a0 msgr2=0x7fb9500cdf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:10.569 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.568+0000 7fb9567fc640 1 --2- 172.21.15.196:0/813210868 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb9500347a0 0x7fb9500cdf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:10.569 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.568+0000 7fb9567fc640 1 -- 172.21.15.196:0/813210868 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9500d5b00 con 0x7fb9500d5000 2024-03-17T23:56:10.569 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.568+0000 7fb9567fc640 1 --2- 172.21.15.196:0/813210868 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb9500d5000 0x7fb950170650 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fb958050ef0 tx=0x7fb9580696b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:56:10.574 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.1 2024-03-17T23:56:10.588 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.588+0000 7fb947fff640 1 -- 172.21.15.196:0/813210868 <== mon.2 v2:172.21.15.204:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb958099070 con 0x7fb9500d5000 2024-03-17T23:56:10.588 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.588+0000 7fb947fff640 1 -- 172.21.15.196:0/813210868 <== mon.2 v2:172.21.15.204:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb958073830 con 0x7fb9500d5000 2024-03-17T23:56:10.588 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.588+0000 7fb95d815640 1 -- 172.21.15.196:0/813210868 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb950047640 con 0x7fb9500d5000 2024-03-17T23:56:10.589 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.588+0000 7fb947fff640 1 -- 172.21.15.196:0/813210868 <== mon.2 v2:172.21.15.204:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb958070630 con 0x7fb9500d5000 2024-03-17T23:56:10.589 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.588+0000 7fb95d815640 1 -- 172.21.15.196:0/813210868 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9500d8100 con 0x7fb9500d5000 2024-03-17T23:56:10.591 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.588+0000 7fb947fff640 1 -- 172.21.15.196:0/813210868 <== mon.2 v2:172.21.15.204:3301/0 4 ==== mgrmap(e 5) ==== 87083+0+0 (secure 0 0 0) 0x7fb95809c070 con 0x7fb9500d5000 2024-03-17T23:56:10.591 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.588+0000 7fb947fff640 1 --2- 172.21.15.196:0/813210868 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7fb93c0676e0 0x7fb93c069ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:10.592 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.588+0000 7fb947fff640 1 -- 172.21.15.196:0/813210868 <== mon.2 v2:172.21.15.204:3301/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fb958101000 con 0x7fb9500d5000 2024-03-17T23:56:10.592 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.588+0000 7fb956ffd640 1 --2- 172.21.15.196:0/813210868 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7fb93c0676e0 0x7fb93c069ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:10.593 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.592+0000 7fb956ffd640 1 --2- 172.21.15.196:0/813210868 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7fb93c0676e0 0x7fb93c069ba0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fb94c0018b0 tx=0x7fb94c009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:56:10.594 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.592+0000 7fb95d815640 1 -- 172.21.15.196:0/813210868 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb9500053a0 con 0x7fb9500d5000 2024-03-17T23:56:10.607 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.604+0000 7fb947fff640 1 -- 172.21.15.196:0/813210868 <== mon.2 v2:172.21.15.204:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177849 (secure 0 0 0) 0x7fb958091070 con 0x7fb9500d5000 2024-03-17T23:56:10.617 INFO:tasks.ceph.mds.c.smithi196.stderr:2024-03-17T23:56:10.616+0000 7f7037ba5640 -1 mds.pinger is_rank_lagging: rank=4 was never sent ping request. 2024-03-17T23:56:10.635 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.632+0000 7f832a9a9640 1 -- 172.21.15.196:0/3819975945 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f8300005590 con 0x7f8324151c40 2024-03-17T23:56:10.635 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.632+0000 7f8320ff9640 1 -- 172.21.15.196:0/3819975945 <== mon.1 v2:172.21.15.204:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f831c016620 con 0x7f8324151c40 2024-03-17T23:56:10.644 INFO:teuthology.orchestra.run.smithi196.stdout:55834574851 2024-03-17T23:56:10.668 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.668+0000 7f832a9a9640 1 -- 172.21.15.196:0/3819975945 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f830c0677f0 msgr2=0x7f830c069cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:10.669 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.668+0000 7f832a9a9640 1 --2- 172.21.15.196:0/3819975945 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f830c0677f0 0x7f830c069cb0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f8324157340 tx=0x7f8318009190 comp rx=0 tx=0).stop 2024-03-17T23:56:10.669 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.668+0000 7f832a9a9640 1 -- 172.21.15.196:0/3819975945 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8324151c40 msgr2=0x7f83240b2440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:10.669 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.668+0000 7f832a9a9640 1 --2- 172.21.15.196:0/3819975945 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8324151c40 0x7f83240b2440 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f831c0ab000 tx=0x7f831c0197d0 comp rx=0 tx=0).stop 2024-03-17T23:56:10.669 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.668+0000 7f832a9a9640 1 -- 172.21.15.196:0/3819975945 shutdown_connections 2024-03-17T23:56:10.669 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.668+0000 7f832a9a9640 1 --2- 172.21.15.196:0/3819975945 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f830c0677f0 0x7f830c069cb0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:10.669 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.668+0000 7f832a9a9640 1 --2- 172.21.15.196:0/3819975945 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8324157b60 0x7f8324159cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:10.669 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.668+0000 7f832a9a9640 1 --2- 172.21.15.196:0/3819975945 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8324152020 0x7f83241597b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:10.669 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.668+0000 7f832a9a9640 1 --2- 172.21.15.196:0/3819975945 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8324151c40 0x7f83240b2440 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:10.669 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.668+0000 7f832a9a9640 1 -- 172.21.15.196:0/3819975945 >> 172.21.15.196:0/3819975945 conn(0x7f8324071020 msgr2=0x7f8324156950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-17T23:56:10.669 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.668+0000 7f832a9a9640 1 -- 172.21.15.196:0/3819975945 shutdown_connections 2024-03-17T23:56:10.669 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.668+0000 7f832a9a9640 1 -- 172.21.15.196:0/3819975945 wait complete. 2024-03-17T23:56:10.693 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574851 for osd.0 2024-03-17T23:56:10.804 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.804+0000 7f99b90be640 1 -- 172.21.15.196:0/3025023023 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f9998005590 con 0x7f99b40c70c0 2024-03-17T23:56:10.805 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.804+0000 7f99ab7fe640 1 -- 172.21.15.196:0/3025023023 <== mon.1 v2:172.21.15.204:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f999c055d90 con 0x7f99b40c70c0 2024-03-17T23:56:10.805 INFO:teuthology.orchestra.run.smithi196.stdout:55834574853 2024-03-17T23:56:10.828 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.824+0000 7f99b90be640 1 -- 172.21.15.196:0/3025023023 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f99a00678d0 msgr2=0x7f99a0069d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:10.828 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.824+0000 7f99b90be640 1 --2- 172.21.15.196:0/3025023023 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f99a00678d0 0x7f99a0069d90 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f99ac000f90 tx=0x7f99ac0a7070 comp rx=0 tx=0).stop 2024-03-17T23:56:10.828 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.824+0000 7f99b90be640 1 -- 172.21.15.196:0/3025023023 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f99b40c70c0 msgr2=0x7f99b4153110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:10.828 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.824+0000 7f99b90be640 1 --2- 172.21.15.196:0/3025023023 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f99b40c70c0 0x7f99b4153110 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f999c00e8b0 tx=0x7f999c00ed70 comp rx=0 tx=0).stop 2024-03-17T23:56:10.829 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.824+0000 7f99b90be640 1 -- 172.21.15.196:0/3025023023 shutdown_connections 2024-03-17T23:56:10.829 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.824+0000 7f99b90be640 1 --2- 172.21.15.196:0/3025023023 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f99a00678d0 0x7f99a0069d90 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:10.829 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.824+0000 7f99b90be640 1 --2- 172.21.15.196:0/3025023023 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f99b41f0570 0x7f99b4149570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:10.829 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.824+0000 7f99b90be640 1 --2- 172.21.15.196:0/3025023023 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f99b414fe60 0x7f99b4152870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:10.829 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.824+0000 7f99b90be640 1 --2- 172.21.15.196:0/3025023023 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f99b40c70c0 0x7f99b4153110 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:10.829 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.824+0000 7f99b90be640 1 -- 172.21.15.196:0/3025023023 >> 172.21.15.196:0/3025023023 conn(0x7f99b40c7da0 msgr2=0x7f99b406d150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-17T23:56:10.829 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.828+0000 7f99b90be640 1 -- 172.21.15.196:0/3025023023 shutdown_connections 2024-03-17T23:56:10.829 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.828+0000 7f99b90be640 1 -- 172.21.15.196:0/3025023023 wait complete. 2024-03-17T23:56:10.830 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.828+0000 7f71d1ee6640 1 -- 172.21.15.196:0/1544798394 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f71cc0c7380 con 0x7f71cc0c67d0 2024-03-17T23:56:10.831 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.828+0000 7f71c97fa640 1 -- 172.21.15.196:0/1544798394 <== mon.2 v2:172.21.15.204:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f71bc05a100 con 0x7f71cc0c67d0 2024-03-17T23:56:10.831 INFO:teuthology.orchestra.run.smithi196.stdout:55834574853 2024-03-17T23:56:10.831 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.828+0000 7f70d6414640 1 -- 172.21.15.196:0/255400618 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f70b0005590 con 0x7f70d00727b0 2024-03-17T23:56:10.832 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.828+0000 7f70cdffb640 1 -- 172.21.15.196:0/255400618 <== mon.2 v2:172.21.15.204:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f70c80552b0 con 0x7f70d00727b0 2024-03-17T23:56:10.834 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.832+0000 7f71d1ee6640 1 -- 172.21.15.196:0/1544798394 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f71b8067730 msgr2=0x7f71b8069bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:10.834 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.832+0000 7f71d1ee6640 1 --2- 172.21.15.196:0/1544798394 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f71b8067730 0x7f71b8069bf0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f71c00b5000 tx=0x7f71c00ac000 comp rx=0 tx=0).stop 2024-03-17T23:56:10.834 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.832+0000 7f71d1ee6640 1 -- 172.21.15.196:0/1544798394 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f71cc0c67d0 msgr2=0x7f71cc143eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:10.834 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.832+0000 7f71d1ee6640 1 --2- 172.21.15.196:0/1544798394 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f71cc0c67d0 0x7f71cc143eb0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f71bc00e930 tx=0x7f71bc00ed30 comp rx=0 tx=0).stop 2024-03-17T23:56:10.837 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.836+0000 7f71d1ee6640 1 -- 172.21.15.196:0/1544798394 shutdown_connections 2024-03-17T23:56:10.837 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.836+0000 7f71d1ee6640 1 --2- 172.21.15.196:0/1544798394 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f71b8067730 0x7f71b8069bf0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:10.837 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.836+0000 7f71d1ee6640 1 --2- 172.21.15.196:0/1544798394 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f71cc0c67d0 0x7f71cc143eb0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:10.837 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.836+0000 7f71d1ee6640 1 --2- 172.21.15.196:0/1544798394 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f71cc14fe00 0x7f71cc1580a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:10.837 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.836+0000 7f71d1ee6640 1 --2- 172.21.15.196:0/1544798394 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f71cc071ec0 0x7f71cc1ec180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:10.837 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.836+0000 7f71d1ee6640 1 -- 172.21.15.196:0/1544798394 >> 172.21.15.196:0/1544798394 conn(0x7f71cc0673f0 msgr2=0x7f71cc071390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-17T23:56:10.837 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.836+0000 7f71d1ee6640 1 -- 172.21.15.196:0/1544798394 shutdown_connections 2024-03-17T23:56:10.837 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.836+0000 7f71d1ee6640 1 -- 172.21.15.196:0/1544798394 wait complete. 2024-03-17T23:56:10.844 INFO:teuthology.orchestra.run.smithi196.stdout:55834574855 2024-03-17T23:56:10.848 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.844+0000 7f70d6414640 1 -- 172.21.15.196:0/255400618 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f70bc067730 msgr2=0x7f70bc069bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:10.848 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.844+0000 7f70d6414640 1 --2- 172.21.15.196:0/255400618 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f70bc067730 0x7f70bc069bf0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f70c00039a0 tx=0x7f70c000c040 comp rx=0 tx=0).stop 2024-03-17T23:56:10.848 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.844+0000 7f70d6414640 1 -- 172.21.15.196:0/255400618 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f70d00727b0 msgr2=0x7f70d014e8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:10.848 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.844+0000 7f70d6414640 1 --2- 172.21.15.196:0/255400618 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f70d00727b0 0x7f70d014e8a0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f70c800c3f0 tx=0x7f70c800c8b0 comp rx=0 tx=0).stop 2024-03-17T23:56:10.849 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.844+0000 7f70d6414640 1 -- 172.21.15.196:0/255400618 shutdown_connections 2024-03-17T23:56:10.849 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.844+0000 7f70d6414640 1 --2- 172.21.15.196:0/255400618 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f70bc067730 0x7f70bc069bf0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:10.849 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.844+0000 7f70d6414640 1 --2- 172.21.15.196:0/255400618 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f70d00727b0 0x7f70d014e8a0 secure :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f70c800c3f0 tx=0x7f70c800c8b0 comp rx=0 tx=0).stop 2024-03-17T23:56:10.849 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.844+0000 7f70d6414640 1 --2- 172.21.15.196:0/255400618 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f70d014fe80 0x7f70d0157580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:10.849 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.844+0000 7f70d6414640 1 --2- 172.21.15.196:0/255400618 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f70d006b2b0 0x7f70d014e360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:10.849 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.844+0000 7f70d6414640 1 -- 172.21.15.196:0/255400618 >> 172.21.15.196:0/255400618 conn(0x7f70d00cb3a0 msgr2=0x7f70d01546a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-17T23:56:10.849 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.848+0000 7f70d6414640 1 -- 172.21.15.196:0/255400618 shutdown_connections 2024-03-17T23:56:10.849 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.848+0000 7f70d6414640 1 -- 172.21.15.196:0/255400618 wait complete. 2024-03-17T23:56:10.853 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.6 2024-03-17T23:56:10.853 DEBUG:teuthology.parallel:result is None 2024-03-17T23:56:10.858 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.856+0000 7fcb51b82640 1 -- 172.21.15.196:0/587189913 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7fcb2c005590 con 0x7fcb4c14fd60 2024-03-17T23:56:10.859 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.7 2024-03-17T23:56:10.859 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.856+0000 7fcb33fff640 1 -- 172.21.15.196:0/587189913 <== mon.1 v2:172.21.15.204:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fcb3c0f3b60 con 0x7fcb4c14fd60 2024-03-17T23:56:10.859 INFO:teuthology.orchestra.run.smithi196.stdout:55834574854 2024-03-17T23:56:10.859 DEBUG:teuthology.parallel:result is None 2024-03-17T23:56:10.861 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.860+0000 7fcb51b82640 1 -- 172.21.15.196:0/587189913 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7fcb38067730 msgr2=0x7fcb38069bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:10.862 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.860+0000 7fcb51b82640 1 --2- 172.21.15.196:0/587189913 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7fcb38067730 0x7fcb38069bf0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fcb44001380 tx=0x7fcb4400a040 comp rx=0 tx=0).stop 2024-03-17T23:56:10.862 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.860+0000 7fcb51b82640 1 -- 172.21.15.196:0/587189913 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fcb4c14fd60 msgr2=0x7fcb4c157a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:10.862 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.860+0000 7fcb51b82640 1 --2- 172.21.15.196:0/587189913 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fcb4c14fd60 0x7fcb4c157a10 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fcb3c0b3040 tx=0x7fcb3c01b970 comp rx=0 tx=0).stop 2024-03-17T23:56:10.862 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.860+0000 7fcb51b82640 1 -- 172.21.15.196:0/587189913 shutdown_connections 2024-03-17T23:56:10.862 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.860+0000 7fcb51b82640 1 --2- 172.21.15.196:0/587189913 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7fcb38067730 0x7fcb38069bf0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:10.862 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.860+0000 7fcb51b82640 1 --2- 172.21.15.196:0/587189913 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fcb4c1569a0 0x7fcb4c0c40e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:10.862 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.860+0000 7fcb51b82640 1 --2- 172.21.15.196:0/587189913 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fcb4c14fd60 0x7fcb4c157a10 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:10.862 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.860+0000 7fcb51b82640 1 --2- 172.21.15.196:0/587189913 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcb4c0c8750 0x7fcb4c1f4d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:10.862 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.860+0000 7fcb51b82640 1 -- 172.21.15.196:0/587189913 >> 172.21.15.196:0/587189913 conn(0x7fcb4c06ec10 msgr2=0x7fcb4c14c0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-17T23:56:10.862 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.860+0000 7fcb51b82640 1 -- 172.21.15.196:0/587189913 shutdown_connections 2024-03-17T23:56:10.862 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.860+0000 7fcb51b82640 1 -- 172.21.15.196:0/587189913 wait complete. 2024-03-17T23:56:10.876 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.3 2024-03-17T23:56:10.876 DEBUG:teuthology.parallel:result is None 2024-03-17T23:56:10.886 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.4 2024-03-17T23:56:10.887 DEBUG:teuthology.parallel:result is None 2024-03-17T23:56:10.909 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.908+0000 7fb95d815640 1 -- 172.21.15.196:0/813210868 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7fb9500dabc0 con 0x7fb9500d5000 2024-03-17T23:56:10.910 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.908+0000 7fb947fff640 1 -- 172.21.15.196:0/813210868 <== mon.2 v2:172.21.15.204:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fb9580d17a0 con 0x7fb9500d5000 2024-03-17T23:56:10.910 INFO:teuthology.orchestra.run.smithi196.stdout:55834574854 2024-03-17T23:56:10.913 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.912+0000 7fb95d815640 1 -- 172.21.15.196:0/813210868 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7fb93c0676e0 msgr2=0x7fb93c069ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:10.913 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.912+0000 7fb95d815640 1 --2- 172.21.15.196:0/813210868 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7fb93c0676e0 0x7fb93c069ba0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fb94c0018b0 tx=0x7fb94c009040 comp rx=0 tx=0).stop 2024-03-17T23:56:10.913 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.912+0000 7fb95d815640 1 -- 172.21.15.196:0/813210868 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb9500d5000 msgr2=0x7fb950170650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:10.913 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.912+0000 7fb95d815640 1 --2- 172.21.15.196:0/813210868 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb9500d5000 0x7fb950170650 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fb958050ef0 tx=0x7fb9580696b0 comp rx=0 tx=0).stop 2024-03-17T23:56:10.913 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.912+0000 7fb95d815640 1 -- 172.21.15.196:0/813210868 shutdown_connections 2024-03-17T23:56:10.913 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.912+0000 7fb95d815640 1 --2- 172.21.15.196:0/813210868 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7fb93c0676e0 0x7fb93c069ba0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:10.913 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.912+0000 7fb95d815640 1 --2- 172.21.15.196:0/813210868 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb9500d5000 0x7fb950170650 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:10.914 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.912+0000 7fb95d815640 1 --2- 172.21.15.196:0/813210868 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb9500db270 0x7fb9500490e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:10.914 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.912+0000 7fb95d815640 1 --2- 172.21.15.196:0/813210868 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb9500347a0 0x7fb9500cdf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:10.914 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.912+0000 7fb95d815640 1 -- 172.21.15.196:0/813210868 >> 172.21.15.196:0/813210868 conn(0x7fb950050190 msgr2=0x7fb9500d33a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-17T23:56:10.914 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.912+0000 7fb95d815640 1 -- 172.21.15.196:0/813210868 shutdown_connections 2024-03-17T23:56:10.914 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:10.912+0000 7fb95d815640 1 -- 172.21.15.196:0/813210868 wait complete. 2024-03-17T23:56:10.927 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.2 2024-03-17T23:56:10.927 DEBUG:teuthology.parallel:result is None 2024-03-17T23:56:11.517 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-03-17T23:56:11.574 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-03-17T23:56:11.638 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:11.636+0000 7faf710bb640 1 Processor -- start 2024-03-17T23:56:11.638 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:11.636+0000 7faf710bb640 1 -- start start 2024-03-17T23:56:11.639 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:11.636+0000 7faf710bb640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7faf6c154240 0x7faf6c06fca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:11.639 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:11.636+0000 7faf710bb640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7faf6c15a260 0x7faf6c15a680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:11.639 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:11.636+0000 7faf710bb640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faf6c154620 con 0x7faf6c072430 2024-03-17T23:56:11.639 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:11.636+0000 7faf710bb640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7faf6c0701e0 con 0x7faf6c15a260 2024-03-17T23:56:11.639 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:11.636+0000 7faf710bb640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7faf6c0c7830 con 0x7faf6c154240 2024-03-17T23:56:11.639 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:11.636+0000 7faf6a59c640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7faf6c15a260 0x7faf6c15a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:11.639 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:11.636+0000 7faf6a59c640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7faf6c15a260 0x7faf6c15a680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.196:34848/0 (socket says 172.21.15.196:34848) 2024-03-17T23:56:11.640 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:11.636+0000 7faf6a59c640 1 -- 172.21.15.196:0/1291577333 learned_addr learned my addr 172.21.15.196:0/1291577333 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-03-17T23:56:11.640 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:11.636+0000 7faf6ad9d640 1 --2- 172.21.15.196:0/1291577333 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7faf6c154240 0x7faf6c06fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:11.640 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:11.636+0000 7faf6a59c640 1 -- 172.21.15.196:0/1291577333 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7faf6c154240 msgr2=0x7faf6c06fca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-17T23:56:11.640 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:11.636+0000 7faf6a59c640 1 --2- 172.21.15.196:0/1291577333 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7faf6c154240 0x7faf6c06fca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:11.640 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:11.636+0000 7faf6a59c640 1 -- 172.21.15.196:0/1291577333 >> v1:172.21.15.204:6789/0 conn(0x7faf6c072430 legacy=0x7faf6c0728c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:11.640 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:11.636+0000 7faf6a59c640 1 -- 172.21.15.196:0/1291577333 --> v2:172.21.15.196:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf6c0c7b10 con 0x7faf6c15a260 2024-03-17T23:56:11.641 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:11.640+0000 7faf6a59c640 1 --2- 172.21.15.196:0/1291577333 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7faf6c15a260 0x7faf6c15a680 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7faf60009870 tx=0x7faf6001ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86e60d18b735a87f server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:56:11.641 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:11.640+0000 7faf69d9b640 1 -- 172.21.15.196:0/1291577333 <== mon.0 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf600b5070 con 0x7faf6c15a260 2024-03-17T23:56:11.641 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:11.640+0000 7faf69d9b640 1 -- 172.21.15.196:0/1291577333 <== mon.0 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf600a8a50 con 0x7faf6c15a260 2024-03-17T23:56:11.641 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:11.640+0000 7faf69d9b640 1 -- 172.21.15.196:0/1291577333 <== mon.0 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf600a8e20 con 0x7faf6c15a260 2024-03-17T23:56:11.642 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:11.640+0000 7faf710bb640 1 -- 172.21.15.196:0/1291577333 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7faf6c15a260 msgr2=0x7faf6c15a680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:11.642 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:11.640+0000 7faf710bb640 1 --2- 172.21.15.196:0/1291577333 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7faf6c15a260 0x7faf6c15a680 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7faf60009870 tx=0x7faf6001ed50 comp rx=0 tx=0).stop 2024-03-17T23:56:11.642 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:11.640+0000 7faf710bb640 1 -- 172.21.15.196:0/1291577333 shutdown_connections 2024-03-17T23:56:11.643 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:11.640+0000 7faf710bb640 1 --2- 172.21.15.196:0/1291577333 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7faf6c15a260 0x7faf6c15a680 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:11.643 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:11.640+0000 7faf710bb640 1 --2- 172.21.15.196:0/1291577333 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7faf6c154240 0x7faf6c06fca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:11.643 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:11.640+0000 7faf710bb640 1 -- 172.21.15.196:0/1291577333 >> 172.21.15.196:0/1291577333 conn(0x7faf6c0cc420 msgr2=0x7faf6c0cc830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-17T23:56:11.643 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:11.640+0000 7faf710bb640 1 -- 172.21.15.196:0/1291577333 shutdown_connections 2024-03-17T23:56:11.643 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:11.640+0000 7faf710bb640 1 -- 172.21.15.196:0/1291577333 wait complete. 2024-03-17T23:56:11.644 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:11.640+0000 7faf710bb640 1 Processor -- start 2024-03-17T23:56:11.644 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:11.640+0000 7faf710bb640 1 -- start start 2024-03-17T23:56:11.646 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:11.644+0000 7faf710bb640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7faf6c072430 0x7faf6c1589a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:11.646 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:11.644+0000 7faf710bb640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7faf6c154240 0x7faf6c149860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:11.646 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:11.644+0000 7faf710bb640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7faf6c15a260 0x7faf6c157d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:11.647 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:11.644+0000 7faf710bb640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7faf6c0c83b0 con 0x7faf6c072430 2024-03-17T23:56:11.647 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:11.644+0000 7faf710bb640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7faf6c0c80d0 con 0x7faf6c154240 2024-03-17T23:56:11.647 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:11.644+0000 7faf710bb640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7faf6c0c8720 con 0x7faf6c15a260 2024-03-17T23:56:11.647 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:11.644+0000 7faf6ad9d640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7faf6c072430 0x7faf6c1589a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:11.647 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:11.644+0000 7faf6ad9d640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7faf6c072430 0x7faf6c1589a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.196:34850/0 (socket says 172.21.15.196:34850) 2024-03-17T23:56:11.647 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:11.644+0000 7faf6ad9d640 1 -- 172.21.15.196:0/17793259 learned_addr learned my addr 172.21.15.196:0/17793259 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-03-17T23:56:11.647 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:11.644+0000 7faf6a59c640 1 --2- 172.21.15.196:0/17793259 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7faf6c154240 0x7faf6c149860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:11.647 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:11.644+0000 7faf6b59e640 1 --2- 172.21.15.196:0/17793259 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7faf6c15a260 0x7faf6c157d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:11.647 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:11.644+0000 7faf6ad9d640 1 -- 172.21.15.196:0/17793259 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7faf6c15a260 msgr2=0x7faf6c157d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:11.647 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:11.644+0000 7faf6ad9d640 1 --2- 172.21.15.196:0/17793259 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7faf6c15a260 0x7faf6c157d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:11.647 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:11.644+0000 7faf6ad9d640 1 -- 172.21.15.196:0/17793259 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7faf6c154240 msgr2=0x7faf6c149860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:11.647 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:11.644+0000 7faf6ad9d640 1 --2- 172.21.15.196:0/17793259 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7faf6c154240 0x7faf6c149860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:11.647 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:11.644+0000 7faf6ad9d640 1 -- 172.21.15.196:0/17793259 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf6c144b60 con 0x7faf6c072430 2024-03-17T23:56:11.647 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:11.644+0000 7faf6ad9d640 1 --2- 172.21.15.196:0/17793259 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7faf6c072430 0x7faf6c1589a0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7faf5c00d920 tx=0x7faf5c00dde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:56:11.648 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:11.644+0000 7faf537fe640 1 -- 172.21.15.196:0/17793259 <== mon.0 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf5c00b780 con 0x7faf6c072430 2024-03-17T23:56:11.648 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:11.644+0000 7faf537fe640 1 -- 172.21.15.196:0/17793259 <== mon.0 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf5c019070 con 0x7faf6c072430 2024-03-17T23:56:11.648 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:11.644+0000 7faf710bb640 1 -- 172.21.15.196:0/17793259 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf6c144e00 con 0x7faf6c072430 2024-03-17T23:56:11.648 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:11.644+0000 7faf710bb640 1 -- 172.21.15.196:0/17793259 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf6c159570 con 0x7faf6c072430 2024-03-17T23:56:11.648 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:11.644+0000 7faf537fe640 1 -- 172.21.15.196:0/17793259 <== mon.0 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf5c00bb20 con 0x7faf6c072430 2024-03-17T23:56:11.649 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:11.648+0000 7faf517fa640 1 -- 172.21.15.196:0/17793259 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faf440052a0 con 0x7faf6c072430 2024-03-17T23:56:11.649 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:11.648+0000 7faf537fe640 1 -- 172.21.15.196:0/17793259 <== mon.0 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 5) ==== 87083+0+0 (secure 0 0 0) 0x7faf5c00bcc0 con 0x7faf6c072430 2024-03-17T23:56:11.649 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:11.648+0000 7faf537fe640 1 --2- 172.21.15.196:0/17793259 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7faf58067690 0x7faf58069b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:11.649 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:11.648+0000 7faf537fe640 1 -- 172.21.15.196:0/17793259 <== mon.0 v2:172.21.15.196:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7faf5c08a060 con 0x7faf6c072430 2024-03-17T23:56:11.650 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:11.648+0000 7faf6a59c640 1 --2- 172.21.15.196:0/17793259 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7faf58067690 0x7faf58069b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:11.650 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:11.648+0000 7faf6a59c640 1 --2- 172.21.15.196:0/17793259 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7faf58067690 0x7faf58069b50 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7faf600b2000 tx=0x7faf60009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:56:11.658 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:11.656+0000 7faf537fe640 1 -- 172.21.15.196:0/17793259 <== mon.0 v2:172.21.15.196:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177849 (secure 0 0 0) 0x7faf5c055a30 con 0x7faf6c072430 2024-03-17T23:56:11.681 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:11.680+0000 7ff12371d640 1 Processor -- start 2024-03-17T23:56:11.682 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:11.680+0000 7ff12371d640 1 -- start start 2024-03-17T23:56:11.683 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:11.680+0000 7ff12371d640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7ff11c06f3e0 0x7ff11c06f870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:11.683 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:11.680+0000 7ff12371d640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff11c15a140 con 0x7ff11c1541f0 2024-03-17T23:56:11.683 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:11.680+0000 7ff12371d640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff11c15a420 con 0x7ff11c15b8b0 2024-03-17T23:56:11.683 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:11.680+0000 7ff12371d640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7ff11c06d070 con 0x7ff11c06f3e0 2024-03-17T23:56:11.683 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:11.680+0000 7ff121cba640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7ff11c06f3e0 0x7ff11c06f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:11.683 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:11.680+0000 7ff1214b9640 1 --1- >> v1:172.21.15.196:6789/0 conn(0x7ff11c1541f0 0x7ff11c0cd450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.196:6789/0 says I am v1:172.21.15.196:50540/0 (socket says 172.21.15.196:50540) 2024-03-17T23:56:11.683 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:11.680+0000 7ff1214b9640 1 -- 172.21.15.196:0/1232158433 learned_addr learned my addr 172.21.15.196:0/1232158433 (peer_addr_for_me v1:172.21.15.196:0/0) 2024-03-17T23:56:11.684 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:11.680+0000 7ff120cb8640 1 --1- 172.21.15.196:0/1232158433 >> v1:172.21.15.204:6789/0 conn(0x7ff11c15b8b0 0x7ff11c15bd20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.204:6789/0 says I am v1:172.21.15.196:60156/0 (socket says 172.21.15.196:60156) 2024-03-17T23:56:11.684 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:11.680+0000 7ff121cba640 1 -- 172.21.15.196:0/1232158433 >> v1:172.21.15.204:6789/0 conn(0x7ff11c15b8b0 legacy=0x7ff11c15bd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:11.684 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:11.680+0000 7ff121cba640 1 -- 172.21.15.196:0/1232158433 >> v1:172.21.15.196:6789/0 conn(0x7ff11c1541f0 legacy=0x7ff11c0cd450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:11.684 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:11.680+0000 7ff121cba640 1 -- 172.21.15.196:0/1232158433 --> v2:172.21.15.196:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff11c15a700 con 0x7ff11c06f3e0 2024-03-17T23:56:11.685 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:11.684+0000 7ff121cba640 1 --2- 172.21.15.196:0/1232158433 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff11c06f3e0 0x7ff11c06f870 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7ff114009d90 tx=0x7ff11401f170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2571c77b0bf84443 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:56:11.686 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:11.684+0000 7ff113fff640 1 -- 172.21.15.196:0/1232158433 <== mon.0 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1140b4070 con 0x7ff11c06f3e0 2024-03-17T23:56:11.686 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:11.684+0000 7ff113fff640 1 -- 172.21.15.196:0/1232158433 <== mon.0 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff1140af600 con 0x7ff11c06f3e0 2024-03-17T23:56:11.686 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:11.684+0000 7ff113fff640 1 -- 172.21.15.196:0/1232158433 <== mon.0 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1140af9d0 con 0x7ff11c06f3e0 2024-03-17T23:56:11.686 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:11.684+0000 7ff12371d640 1 -- 172.21.15.196:0/1232158433 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff11c06f3e0 msgr2=0x7ff11c06f870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:11.686 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:11.684+0000 7ff12371d640 1 --2- 172.21.15.196:0/1232158433 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff11c06f3e0 0x7ff11c06f870 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7ff114009d90 tx=0x7ff11401f170 comp rx=0 tx=0).stop 2024-03-17T23:56:11.686 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:11.684+0000 7ff12371d640 1 -- 172.21.15.196:0/1232158433 shutdown_connections 2024-03-17T23:56:11.687 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:11.684+0000 7ff12371d640 1 --2- 172.21.15.196:0/1232158433 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff11c06f3e0 0x7ff11c06f870 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:11.687 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:11.684+0000 7ff12371d640 1 -- 172.21.15.196:0/1232158433 >> 172.21.15.196:0/1232158433 conn(0x7ff11c06b2b0 msgr2=0x7ff11c06b6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-17T23:56:11.687 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:11.684+0000 7ff12371d640 1 -- 172.21.15.196:0/1232158433 shutdown_connections 2024-03-17T23:56:11.687 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:11.684+0000 7ff12371d640 1 -- 172.21.15.196:0/1232158433 wait complete. 2024-03-17T23:56:11.687 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:11.684+0000 7ff12371d640 1 Processor -- start 2024-03-17T23:56:11.687 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:11.684+0000 7ff12371d640 1 -- start start 2024-03-17T23:56:11.689 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:11.688+0000 7ff12371d640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff11c06f3e0 0x7ff11c0ca580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:11.689 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:11.688+0000 7ff12371d640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff11c1541f0 0x7ff11c158510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:11.690 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:11.688+0000 7ff12371d640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff11c15b8b0 0x7ff11c158a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:11.690 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:11.688+0000 7ff12371d640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7ff11c06fdb0 con 0x7ff11c06f3e0 2024-03-17T23:56:11.690 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:11.688+0000 7ff12371d640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7ff11c15b390 con 0x7ff11c15b8b0 2024-03-17T23:56:11.690 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:11.688+0000 7ff12371d640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7ff11c0cdb60 con 0x7ff11c1541f0 2024-03-17T23:56:11.690 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:11.688+0000 7ff1214b9640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff11c06f3e0 0x7ff11c0ca580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:11.690 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:11.688+0000 7ff1214b9640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff11c06f3e0 0x7ff11c0ca580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.196:34856/0 (socket says 172.21.15.196:34856) 2024-03-17T23:56:11.690 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:11.688+0000 7ff1214b9640 1 -- 172.21.15.196:0/3163361552 learned_addr learned my addr 172.21.15.196:0/3163361552 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-03-17T23:56:11.690 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:11.688+0000 7ff121cba640 1 --2- 172.21.15.196:0/3163361552 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff11c15b8b0 0x7ff11c158a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:11.690 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:11.688+0000 7ff120cb8640 1 --2- 172.21.15.196:0/3163361552 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff11c1541f0 0x7ff11c158510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:11.690 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:11.688+0000 7ff1214b9640 1 -- 172.21.15.196:0/3163361552 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff11c1541f0 msgr2=0x7ff11c158510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:11.690 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:11.688+0000 7ff1214b9640 1 --2- 172.21.15.196:0/3163361552 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff11c1541f0 0x7ff11c158510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:11.690 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:11.688+0000 7ff1214b9640 1 -- 172.21.15.196:0/3163361552 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff11c15b8b0 msgr2=0x7ff11c158a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:11.690 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:11.688+0000 7ff1214b9640 1 --2- 172.21.15.196:0/3163361552 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff11c15b8b0 0x7ff11c158a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:11.690 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:11.688+0000 7ff1214b9640 1 -- 172.21.15.196:0/3163361552 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff11c1e3b90 con 0x7ff11c06f3e0 2024-03-17T23:56:11.691 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:11.688+0000 7ff1214b9640 1 --2- 172.21.15.196:0/3163361552 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff11c06f3e0 0x7ff11c0ca580 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7ff11800c500 tx=0x7ff11800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:56:11.691 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:11.688+0000 7ff111ffb640 1 -- 172.21.15.196:0/3163361552 <== mon.0 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff118017070 con 0x7ff11c06f3e0 2024-03-17T23:56:11.691 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:11.688+0000 7ff111ffb640 1 -- 172.21.15.196:0/3163361552 <== mon.0 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff118005cf0 con 0x7ff11c06f3e0 2024-03-17T23:56:11.691 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:11.688+0000 7ff12371d640 1 -- 172.21.15.196:0/3163361552 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff11c0cc710 con 0x7ff11c06f3e0 2024-03-17T23:56:11.691 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:11.688+0000 7ff12371d640 1 -- 172.21.15.196:0/3163361552 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff11c159560 con 0x7ff11c06f3e0 2024-03-17T23:56:11.692 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:11.688+0000 7ff111ffb640 1 -- 172.21.15.196:0/3163361552 <== mon.0 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1180072f0 con 0x7ff11c06f3e0 2024-03-17T23:56:11.692 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:11.688+0000 7ff1077fe640 1 -- 172.21.15.196:0/3163361552 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff0f40052a0 con 0x7ff11c06f3e0 2024-03-17T23:56:11.692 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:11.688+0000 7ff111ffb640 1 -- 172.21.15.196:0/3163361552 <== mon.0 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 5) ==== 87083+0+0 (secure 0 0 0) 0x7ff11801a070 con 0x7ff11c06f3e0 2024-03-17T23:56:11.692 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:11.688+0000 7ff111ffb640 1 --2- 172.21.15.196:0/3163361552 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7ff100067690 0x7ff100069b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:11.692 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:11.688+0000 7ff111ffb640 1 -- 172.21.15.196:0/3163361552 <== mon.0 v2:172.21.15.196:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7ff118084a80 con 0x7ff11c06f3e0 2024-03-17T23:56:11.692 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:11.688+0000 7ff120cb8640 1 --2- 172.21.15.196:0/3163361552 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7ff100067690 0x7ff100069b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:11.692 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:11.692+0000 7ff120cb8640 1 --2- 172.21.15.196:0/3163361552 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7ff100067690 0x7ff100069b50 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7ff11c1e41d0 tx=0x7ff10c007cf0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:56:11.694 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-03-17T23:56:11.696 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:11.692+0000 7ff111ffb640 1 -- 172.21.15.196:0/3163361552 <== mon.0 v2:172.21.15.196:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177849 (secure 0 0 0) 0x7ff118055140 con 0x7ff11c06f3e0 2024-03-17T23:56:11.802 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:11.800+0000 7fa9f63a5640 1 Processor -- start 2024-03-17T23:56:11.802 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:11.800+0000 7fa9f63a5640 1 -- start start 2024-03-17T23:56:11.803 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:11.800+0000 7fa9f63a5640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fa9f006e270 0x7fa9f0157e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:11.803 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:11.800+0000 7fa9f63a5640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa9f0152310 con 0x7fa9f0151f30 2024-03-17T23:56:11.804 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:11.800+0000 7fa9f63a5640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa9f01584d0 con 0x7fa9f006d240 2024-03-17T23:56:11.804 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:11.800+0000 7fa9f63a5640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 -- 0x7fa9f015c3e0 con 0x7fa9f006e270 2024-03-17T23:56:11.804 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:11.800+0000 7fa9effff640 1 --1- >> v1:172.21.15.196:6789/0 conn(0x7fa9f0151f30 0x7fa9f015bcd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.196:6789/0 says I am v1:172.21.15.196:50542/0 (socket says 172.21.15.196:50542) 2024-03-17T23:56:11.804 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:11.800+0000 7fa9effff640 1 -- 172.21.15.196:0/1616611704 learned_addr learned my addr 172.21.15.196:0/1616611704 (peer_addr_for_me v1:172.21.15.196:0/0) 2024-03-17T23:56:11.804 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:11.800+0000 7fa9e7fff640 1 --2- 172.21.15.196:0/1616611704 >> v2:172.21.15.204:3300/0 conn(0x7fa9f006e270 0x7fa9f0157e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:11.808 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:11.800+0000 7fa9ef7fe640 1 -- 172.21.15.196:0/1616611704 <== mon.1 v1:172.21.15.204:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 620194679 0 0) 0x7fa9f01584d0 con 0x7fa9f006d240 2024-03-17T23:56:11.809 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:11.800+0000 7fa9ef7fe640 1 -- 172.21.15.196:0/1616611704 --> v1:172.21.15.204:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa9dc003530 con 0x7fa9f006d240 2024-03-17T23:56:11.809 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:11.800+0000 7fa9ef7fe640 1 -- 172.21.15.196:0/1616611704 <== mon.0 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1063246330 0 0) 0x7fa9f0152310 con 0x7fa9f0151f30 2024-03-17T23:56:11.809 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:11.800+0000 7fa9ef7fe640 1 -- 172.21.15.196:0/1616611704 --> v1:172.21.15.196:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa9f01584d0 con 0x7fa9f0151f30 2024-03-17T23:56:11.809 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:11.800+0000 7fa9ef7fe640 1 -- 172.21.15.196:0/1616611704 <== mon.0 v1:172.21.15.196:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3290970114 0 0) 0x7fa9f01584d0 con 0x7fa9f0151f30 2024-03-17T23:56:11.809 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:11.800+0000 7fa9e7fff640 1 -- 172.21.15.196:0/1616611704 >> v1:172.21.15.204:6789/0 conn(0x7fa9f006d240 legacy=0x7fa9f00c68a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:11.809 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:11.800+0000 7fa9e7fff640 1 -- 172.21.15.196:0/1616611704 >> v1:172.21.15.196:6789/0 conn(0x7fa9f0151f30 legacy=0x7fa9f015bcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:11.809 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:11.804+0000 7fa9e7fff640 1 -- 172.21.15.196:0/1616611704 --> v2:172.21.15.204:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9f01587b0 con 0x7fa9f006e270 2024-03-17T23:56:11.809 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:11.804+0000 7fa9e7fff640 1 --2- 172.21.15.196:0/1616611704 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa9f006e270 0x7fa9f0157e40 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fa9d8009740 tx=0x7fa9d801c300 comp rx=0 tx=0).ready entity=mon.1 client_cookie=87c1ba53e05aed6e server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:56:11.809 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:11.804+0000 7fa9ef7fe640 1 -- 172.21.15.196:0/1616611704 <== mon.1 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9d80b0070 con 0x7fa9f006e270 2024-03-17T23:56:11.809 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:11.804+0000 7fa9ef7fe640 1 -- 172.21.15.196:0/1616611704 <== mon.1 v2:172.21.15.204:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa9d80ab400 con 0x7fa9f006e270 2024-03-17T23:56:11.809 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:11.804+0000 7fa9ef7fe640 1 -- 172.21.15.196:0/1616611704 <== mon.1 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9e0001680 con 0x7fa9f006e270 2024-03-17T23:56:11.809 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:11.808+0000 7fa9f63a5640 1 -- 172.21.15.196:0/1616611704 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa9f006e270 msgr2=0x7fa9f0157e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:11.809 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:11.808+0000 7fa9f63a5640 1 --2- 172.21.15.196:0/1616611704 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa9f006e270 0x7fa9f0157e40 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fa9d8009740 tx=0x7fa9d801c300 comp rx=0 tx=0).stop 2024-03-17T23:56:11.809 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:11.808+0000 7fa9f63a5640 1 -- 172.21.15.196:0/1616611704 shutdown_connections 2024-03-17T23:56:11.810 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:11.808+0000 7fa9f63a5640 1 --2- 172.21.15.196:0/1616611704 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa9f006e270 0x7fa9f0157e40 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:11.810 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:11.808+0000 7fa9f63a5640 1 -- 172.21.15.196:0/1616611704 >> 172.21.15.196:0/1616611704 conn(0x7fa9f00c89a0 msgr2=0x7fa9f00c8db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-17T23:56:11.812 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:11.812+0000 7fa9f63a5640 1 -- 172.21.15.196:0/1616611704 shutdown_connections 2024-03-17T23:56:11.812 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:11.812+0000 7fa9f63a5640 1 -- 172.21.15.196:0/1616611704 wait complete. 2024-03-17T23:56:11.814 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:11.812+0000 7fa9f63a5640 1 Processor -- start 2024-03-17T23:56:11.814 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:11.812+0000 7fa9f63a5640 1 -- start start 2024-03-17T23:56:11.816 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:11.812+0000 7fa9f63a5640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa9f006d240 0x7fa9f01471c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:11.816 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:11.812+0000 7fa9f63a5640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa9f006e270 0x7fa9f01f4060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:11.816 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:11.812+0000 7fa9f63a5640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa9f0151f30 0x7fa9f013c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:11.816 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:11.812+0000 7fa9effff640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa9f006d240 0x7fa9f01471c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:11.817 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:11.812+0000 7fa9effff640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa9f006d240 0x7fa9f01471c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.196:34868/0 (socket says 172.21.15.196:34868) 2024-03-17T23:56:11.817 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:11.812+0000 7fa9effff640 1 -- 172.21.15.196:0/4051672813 learned_addr learned my addr 172.21.15.196:0/4051672813 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-03-17T23:56:11.817 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:11.812+0000 7fa9e7fff640 1 --2- 172.21.15.196:0/4051672813 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa9f006e270 0x7fa9f01f4060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:11.817 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:11.812+0000 7fa9f4942640 1 --2- 172.21.15.196:0/4051672813 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa9f0151f30 0x7fa9f013c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:11.817 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:11.812+0000 7fa9f63a5640 1 -- 172.21.15.196:0/4051672813 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fa9f00c6fb0 con 0x7fa9f006d240 2024-03-17T23:56:11.817 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:11.812+0000 7fa9f63a5640 1 -- 172.21.15.196:0/4051672813 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7fa9f006b2b0 con 0x7fa9f0151f30 2024-03-17T23:56:11.817 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:11.812+0000 7fa9f63a5640 1 -- 172.21.15.196:0/4051672813 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7fa9f00c7130 con 0x7fa9f006e270 2024-03-17T23:56:11.817 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:11.816+0000 7fa9effff640 1 -- 172.21.15.196:0/4051672813 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa9f006e270 msgr2=0x7fa9f01f4060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:11.817 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:11.816+0000 7fa9effff640 1 --2- 172.21.15.196:0/4051672813 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa9f006e270 0x7fa9f01f4060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:11.817 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:11.816+0000 7fa9effff640 1 -- 172.21.15.196:0/4051672813 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa9f0151f30 msgr2=0x7fa9f013c6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:11.817 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:11.816+0000 7fa9effff640 1 --2- 172.21.15.196:0/4051672813 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa9f0151f30 0x7fa9f013c6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:11.817 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:11.816+0000 7fa9effff640 1 -- 172.21.15.196:0/4051672813 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9f0147700 con 0x7fa9f006d240 2024-03-17T23:56:11.817 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:11.816+0000 7fa9effff640 1 --2- 172.21.15.196:0/4051672813 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa9f006d240 0x7fa9f01471c0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fa9e0007fd0 tx=0x7fa9e000cbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:56:11.818 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:11.816+0000 7fa9ed7fa640 1 -- 172.21.15.196:0/4051672813 <== mon.0 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9e0018070 con 0x7fa9f006d240 2024-03-17T23:56:11.818 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:11.816+0000 7fa9ed7fa640 1 -- 172.21.15.196:0/4051672813 <== mon.0 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa9e00072d0 con 0x7fa9f006d240 2024-03-17T23:56:11.818 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:11.816+0000 7fa9f63a5640 1 -- 172.21.15.196:0/4051672813 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa9f01f4a30 con 0x7fa9f006d240 2024-03-17T23:56:11.818 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:11.816+0000 7fa9ed7fa640 1 -- 172.21.15.196:0/4051672813 <== mon.0 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9e00047f0 con 0x7fa9f006d240 2024-03-17T23:56:11.818 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:11.816+0000 7fa9f63a5640 1 -- 172.21.15.196:0/4051672813 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa9f015b050 con 0x7fa9f006d240 2024-03-17T23:56:11.818 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:11.816+0000 7fa9f63a5640 1 -- 172.21.15.196:0/4051672813 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa9f015b290 con 0x7fa9f006d240 2024-03-17T23:56:11.819 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:11.816+0000 7fa9ed7fa640 1 -- 172.21.15.196:0/4051672813 <== mon.0 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 5) ==== 87083+0+0 (secure 0 0 0) 0x7fa9e0004990 con 0x7fa9f006d240 2024-03-17T23:56:11.820 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:11.816+0000 7fa9ed7fa640 1 --2- 172.21.15.196:0/4051672813 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7fa9d006ba70 0x7fa9d006df30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:11.820 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:11.816+0000 7fa9ed7fa640 1 -- 172.21.15.196:0/4051672813 <== mon.0 v2:172.21.15.196:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fa9e0084be0 con 0x7fa9f006d240 2024-03-17T23:56:11.820 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:11.816+0000 7fa9e7fff640 1 --2- 172.21.15.196:0/4051672813 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7fa9d006ba70 0x7fa9d006df30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:11.820 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:11.820+0000 7fa9e7fff640 1 --2- 172.21.15.196:0/4051672813 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7fa9d006ba70 0x7fa9d006df30 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fa9d80ad000 tx=0x7fa9d80a6000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:56:11.824 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:11.820+0000 7fa9ed7fa640 1 -- 172.21.15.196:0/4051672813 <== mon.0 v2:172.21.15.196:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177849 (secure 0 0 0) 0x7fa9f015b290 con 0x7fa9f006d240 2024-03-17T23:56:11.957 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:11.956+0000 7faf517fa640 1 -- 172.21.15.196:0/17793259 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7faf44005860 con 0x7faf6c072430 2024-03-17T23:56:11.958 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:11.956+0000 7faf537fe640 1 -- 172.21.15.196:0/17793259 <== mon.0 v2:172.21.15.196:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7faf5c059ad0 con 0x7faf6c072430 2024-03-17T23:56:11.958 INFO:teuthology.orchestra.run.smithi196.stdout:55834574852 2024-03-17T23:56:11.962 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:11.960+0000 7faf517fa640 1 -- 172.21.15.196:0/17793259 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7faf58067690 msgr2=0x7faf58069b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:11.962 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:11.960+0000 7faf517fa640 1 --2- 172.21.15.196:0/17793259 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7faf58067690 0x7faf58069b50 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7faf600b2000 tx=0x7faf60009040 comp rx=0 tx=0).stop 2024-03-17T23:56:11.962 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:11.960+0000 7faf517fa640 1 -- 172.21.15.196:0/17793259 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7faf6c072430 msgr2=0x7faf6c1589a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:11.962 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:11.960+0000 7faf517fa640 1 --2- 172.21.15.196:0/17793259 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7faf6c072430 0x7faf6c1589a0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7faf5c00d920 tx=0x7faf5c00dde0 comp rx=0 tx=0).stop 2024-03-17T23:56:11.962 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:11.960+0000 7faf517fa640 1 -- 172.21.15.196:0/17793259 shutdown_connections 2024-03-17T23:56:11.962 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:11.960+0000 7faf517fa640 1 --2- 172.21.15.196:0/17793259 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7faf58067690 0x7faf58069b50 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:11.962 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:11.960+0000 7faf517fa640 1 --2- 172.21.15.196:0/17793259 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7faf6c15a260 0x7faf6c157d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:11.962 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:11.960+0000 7faf517fa640 1 --2- 172.21.15.196:0/17793259 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7faf6c154240 0x7faf6c149860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:11.962 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:11.960+0000 7faf517fa640 1 --2- 172.21.15.196:0/17793259 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7faf6c072430 0x7faf6c1589a0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:11.963 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:11.960+0000 7faf517fa640 1 -- 172.21.15.196:0/17793259 >> 172.21.15.196:0/17793259 conn(0x7faf6c0cc420 msgr2=0x7faf6c151e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-17T23:56:11.963 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:11.960+0000 7faf517fa640 1 -- 172.21.15.196:0/17793259 shutdown_connections 2024-03-17T23:56:11.963 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:11.960+0000 7faf517fa640 1 -- 172.21.15.196:0/17793259 wait complete. 2024-03-17T23:56:11.981 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574852 for osd.5 2024-03-17T23:56:11.981 DEBUG:teuthology.parallel:result is None 2024-03-17T23:56:11.981 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:11.980+0000 7fa9f63a5640 1 -- 172.21.15.196:0/4051672813 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7fa9f00689a0 con 0x7fa9f006d240 2024-03-17T23:56:11.981 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:11.980+0000 7fa9ed7fa640 1 -- 172.21.15.196:0/4051672813 <== mon.0 v2:172.21.15.196:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fa9e0073030 con 0x7fa9f006d240 2024-03-17T23:56:11.982 INFO:teuthology.orchestra.run.smithi196.stdout:55834574852 2024-03-17T23:56:11.984 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:11.980+0000 7fa9f63a5640 1 -- 172.21.15.196:0/4051672813 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7fa9d006ba70 msgr2=0x7fa9d006df30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:11.984 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:11.980+0000 7fa9f63a5640 1 --2- 172.21.15.196:0/4051672813 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7fa9d006ba70 0x7fa9d006df30 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fa9d80ad000 tx=0x7fa9d80a6000 comp rx=0 tx=0).stop 2024-03-17T23:56:11.984 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:11.980+0000 7fa9f63a5640 1 -- 172.21.15.196:0/4051672813 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa9f006d240 msgr2=0x7fa9f01471c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:11.984 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:11.980+0000 7fa9f63a5640 1 --2- 172.21.15.196:0/4051672813 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa9f006d240 0x7fa9f01471c0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fa9e0007fd0 tx=0x7fa9e000cbe0 comp rx=0 tx=0).stop 2024-03-17T23:56:11.984 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:11.980+0000 7fa9f63a5640 1 -- 172.21.15.196:0/4051672813 shutdown_connections 2024-03-17T23:56:11.984 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:11.980+0000 7fa9f63a5640 1 --2- 172.21.15.196:0/4051672813 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7fa9d006ba70 0x7fa9d006df30 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:11.984 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:11.980+0000 7fa9f63a5640 1 --2- 172.21.15.196:0/4051672813 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa9f006e270 0x7fa9f01f4060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:11.984 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:11.980+0000 7fa9f63a5640 1 --2- 172.21.15.196:0/4051672813 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa9f0151f30 0x7fa9f013c6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:11.984 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:11.980+0000 7fa9f63a5640 1 --2- 172.21.15.196:0/4051672813 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa9f006d240 0x7fa9f01471c0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:11.985 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:11.980+0000 7fa9f63a5640 1 -- 172.21.15.196:0/4051672813 >> 172.21.15.196:0/4051672813 conn(0x7fa9f00c89a0 msgr2=0x7fa9f0156ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-17T23:56:11.985 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:11.980+0000 7fa9f63a5640 1 -- 172.21.15.196:0/4051672813 shutdown_connections 2024-03-17T23:56:11.985 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:11.980+0000 7fa9f63a5640 1 -- 172.21.15.196:0/4051672813 wait complete. 2024-03-17T23:56:11.993 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:11.992+0000 7ff1077fe640 1 -- 172.21.15.196:0/3163361552 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7ff0f4005860 con 0x7ff11c06f3e0 2024-03-17T23:56:11.993 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:11.992+0000 7ff111ffb640 1 -- 172.21.15.196:0/3163361552 <== mon.0 v2:172.21.15.196:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7ff1180591e0 con 0x7ff11c06f3e0 2024-03-17T23:56:11.994 INFO:teuthology.orchestra.run.smithi196.stdout:55834574853 2024-03-17T23:56:11.996 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:11.996+0000 7ff1077fe640 1 -- 172.21.15.196:0/3163361552 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7ff100067690 msgr2=0x7ff100069b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:11.997 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:11.996+0000 7ff1077fe640 1 --2- 172.21.15.196:0/3163361552 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7ff100067690 0x7ff100069b50 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7ff11c1e41d0 tx=0x7ff10c007cf0 comp rx=0 tx=0).stop 2024-03-17T23:56:11.997 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:11.996+0000 7ff1077fe640 1 -- 172.21.15.196:0/3163361552 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff11c06f3e0 msgr2=0x7ff11c0ca580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:11.997 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:11.996+0000 7ff1077fe640 1 --2- 172.21.15.196:0/3163361552 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff11c06f3e0 0x7ff11c0ca580 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7ff11800c500 tx=0x7ff11800c9c0 comp rx=0 tx=0).stop 2024-03-17T23:56:11.997 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:11.996+0000 7ff1077fe640 1 -- 172.21.15.196:0/3163361552 shutdown_connections 2024-03-17T23:56:11.997 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:11.996+0000 7ff1077fe640 1 --2- 172.21.15.196:0/3163361552 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7ff100067690 0x7ff100069b50 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:11.997 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:11.996+0000 7ff1077fe640 1 --2- 172.21.15.196:0/3163361552 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff11c1541f0 0x7ff11c158510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:11.997 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:11.996+0000 7ff1077fe640 1 --2- 172.21.15.196:0/3163361552 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff11c15b8b0 0x7ff11c158a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:11.997 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:11.996+0000 7ff1077fe640 1 --2- 172.21.15.196:0/3163361552 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff11c06f3e0 0x7ff11c0ca580 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:11.997 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:11.996+0000 7ff1077fe640 1 -- 172.21.15.196:0/3163361552 >> 172.21.15.196:0/3163361552 conn(0x7ff11c06b2b0 msgr2=0x7ff11c15bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-17T23:56:11.997 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:11.996+0000 7ff1077fe640 1 -- 172.21.15.196:0/3163361552 shutdown_connections 2024-03-17T23:56:11.997 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:11.996+0000 7ff1077fe640 1 -- 172.21.15.196:0/3163361552 wait complete. 2024-03-17T23:56:11.999 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574852 for osd.0 2024-03-17T23:56:11.999 DEBUG:teuthology.parallel:result is None 2024-03-17T23:56:12.016 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.1 2024-03-17T23:56:12.016 DEBUG:teuthology.parallel:result is None 2024-03-17T23:56:12.016 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-03-17T23:56:12.016 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-17T23:56:12.167 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:12.164+0000 7f5c8ee66640 1 Processor -- start 2024-03-17T23:56:12.168 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:12.164+0000 7f5c8ee66640 1 -- start start 2024-03-17T23:56:12.168 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:12.164+0000 7f5c8ee66640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5c881543e0 0x7f5c8806d240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:12.168 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:12.164+0000 7f5c8ee66640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5c8806d910 con 0x7f5c8815d660 2024-03-17T23:56:12.168 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:12.164+0000 7f5c8ee66640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5c8806dbb0 con 0x7f5c880b0e70 2024-03-17T23:56:12.168 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:12.164+0000 7f5c8ee66640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f5c880c6ab0 con 0x7f5c881543e0 2024-03-17T23:56:12.168 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:12.164+0000 7f5c8d403640 1 --1- >> v1:172.21.15.196:6789/0 conn(0x7f5c8815d660 0x7f5c881649d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.196:6789/0 says I am v1:172.21.15.196:50554/0 (socket says 172.21.15.196:50554) 2024-03-17T23:56:12.168 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:12.164+0000 7f5c8d403640 1 -- 172.21.15.196:0/840117860 learned_addr learned my addr 172.21.15.196:0/840117860 (peer_addr_for_me v1:172.21.15.196:0/0) 2024-03-17T23:56:12.168 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:12.164+0000 7f5c8cc02640 1 --2- 172.21.15.196:0/840117860 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5c881543e0 0x7f5c8806d240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:12.168 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:12.164+0000 7f5c877fe640 1 -- 172.21.15.196:0/840117860 <== mon.0 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2534054298 0 0) 0x7f5c8806d910 con 0x7f5c8815d660 2024-03-17T23:56:12.168 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:12.164+0000 7f5c877fe640 1 -- 172.21.15.196:0/840117860 --> v1:172.21.15.196:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5c78003530 con 0x7f5c8815d660 2024-03-17T23:56:12.168 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:12.164+0000 7f5c877fe640 1 -- 172.21.15.196:0/840117860 <== mon.1 v1:172.21.15.204:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 764700651 0 0) 0x7f5c8806dbb0 con 0x7f5c880b0e70 2024-03-17T23:56:12.168 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:12.164+0000 7f5c877fe640 1 -- 172.21.15.196:0/840117860 --> v1:172.21.15.204:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5c8806d910 con 0x7f5c880b0e70 2024-03-17T23:56:12.169 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:12.164+0000 7f5c8cc02640 1 -- 172.21.15.196:0/840117860 >> v1:172.21.15.204:6789/0 conn(0x7f5c880b0e70 legacy=0x7f5c88072f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:12.169 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:12.164+0000 7f5c877fe640 1 -- 172.21.15.196:0/840117860 <== mon.0 v1:172.21.15.196:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2523491954 0 0) 0x7f5c78003530 con 0x7f5c8815d660 2024-03-17T23:56:12.169 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:12.164+0000 7f5c8cc02640 1 -- 172.21.15.196:0/840117860 >> v1:172.21.15.196:6789/0 conn(0x7f5c8815d660 legacy=0x7f5c881649d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:12.169 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:12.164+0000 7f5c8cc02640 1 -- 172.21.15.196:0/840117860 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c880c6d90 con 0x7f5c881543e0 2024-03-17T23:56:12.170 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:12.168+0000 7f5c8cc02640 1 --2- 172.21.15.196:0/840117860 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5c881543e0 0x7f5c8806d240 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f5c7c0097f0 tx=0x7f5c7c01ebf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f0abc4f6f7751d67 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:56:12.170 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:12.168+0000 7f5c877fe640 1 -- 172.21.15.196:0/840117860 <== mon.2 v2:172.21.15.204:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c7c0b5070 con 0x7f5c881543e0 2024-03-17T23:56:12.170 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:12.168+0000 7f5c877fe640 1 -- 172.21.15.196:0/840117860 <== mon.2 v2:172.21.15.204:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c7c0a8670 con 0x7f5c881543e0 2024-03-17T23:56:12.170 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:12.168+0000 7f5c877fe640 1 -- 172.21.15.196:0/840117860 <== mon.2 v2:172.21.15.204:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c80001a00 con 0x7f5c881543e0 2024-03-17T23:56:12.171 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:12.168+0000 7f5c8ee66640 1 -- 172.21.15.196:0/840117860 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5c881543e0 msgr2=0x7f5c8806d240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:12.171 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:12.168+0000 7f5c8ee66640 1 --2- 172.21.15.196:0/840117860 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5c881543e0 0x7f5c8806d240 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f5c7c0097f0 tx=0x7f5c7c01ebf0 comp rx=0 tx=0).stop 2024-03-17T23:56:12.171 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:12.168+0000 7f5c8ee66640 1 -- 172.21.15.196:0/840117860 shutdown_connections 2024-03-17T23:56:12.171 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:12.168+0000 7f5c8ee66640 1 --2- 172.21.15.196:0/840117860 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5c881543e0 0x7f5c8806d240 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:12.171 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:12.168+0000 7f5c8ee66640 1 -- 172.21.15.196:0/840117860 >> 172.21.15.196:0/840117860 conn(0x7f5c880c89a0 msgr2=0x7f5c880c8db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-17T23:56:12.171 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:12.168+0000 7f5c8ee66640 1 -- 172.21.15.196:0/840117860 shutdown_connections 2024-03-17T23:56:12.171 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:12.168+0000 7f5c8ee66640 1 -- 172.21.15.196:0/840117860 wait complete. 2024-03-17T23:56:12.172 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:12.172+0000 7f5c8ee66640 1 Processor -- start 2024-03-17T23:56:12.172 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:12.172+0000 7f5c8ee66640 1 -- start start 2024-03-17T23:56:12.175 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:12.172+0000 7f5c8ee66640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5c880b0e70 0x7f5c8815c710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:12.175 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:12.172+0000 7f5c8ee66640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5c881543e0 0x7f5c881f15c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:12.175 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:12.172+0000 7f5c8ee66640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5c8815d660 0x7f5c88148940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:12.175 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:12.172+0000 7f5c8ee66640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f5c881547c0 con 0x7f5c880b0e70 2024-03-17T23:56:12.175 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:12.172+0000 7f5c8ee66640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f5c88071e60 con 0x7f5c881543e0 2024-03-17T23:56:12.175 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:12.172+0000 7f5c8ee66640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f5c88073630 con 0x7f5c8815d660 2024-03-17T23:56:12.175 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:12.172+0000 7f5c8cc02640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5c880b0e70 0x7f5c8815c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:12.175 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:12.172+0000 7f5c8cc02640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5c880b0e70 0x7f5c8815c710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.196:34882/0 (socket says 172.21.15.196:34882) 2024-03-17T23:56:12.175 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:12.172+0000 7f5c8cc02640 1 -- 172.21.15.196:0/1569914910 learned_addr learned my addr 172.21.15.196:0/1569914910 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-03-17T23:56:12.175 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:12.172+0000 7f5c8d403640 1 --2- 172.21.15.196:0/1569914910 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5c8815d660 0x7f5c88148940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:12.176 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:12.172+0000 7f5c87fff640 1 --2- 172.21.15.196:0/1569914910 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5c881543e0 0x7f5c881f15c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:12.176 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:12.172+0000 7f5c8cc02640 1 -- 172.21.15.196:0/1569914910 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5c8815d660 msgr2=0x7f5c88148940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:12.176 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:12.172+0000 7f5c8cc02640 1 --2- 172.21.15.196:0/1569914910 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5c8815d660 0x7f5c88148940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:12.176 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:12.172+0000 7f5c8cc02640 1 -- 172.21.15.196:0/1569914910 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5c881543e0 msgr2=0x7f5c881f15c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:12.176 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:12.172+0000 7f5c8cc02640 1 --2- 172.21.15.196:0/1569914910 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5c881543e0 0x7f5c881f15c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:12.176 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:12.172+0000 7f5c8cc02640 1 -- 172.21.15.196:0/1569914910 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c88158510 con 0x7f5c880b0e70 2024-03-17T23:56:12.176 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:12.172+0000 7f5c8cc02640 1 --2- 172.21.15.196:0/1569914910 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5c880b0e70 0x7f5c8815c710 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f5c7c0097f0 tx=0x7f5c7c01b990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:56:12.176 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:12.172+0000 7f5c857fa640 1 -- 172.21.15.196:0/1569914910 <== mon.0 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c7c0b5040 con 0x7f5c880b0e70 2024-03-17T23:56:12.176 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:12.172+0000 7f5c857fa640 1 -- 172.21.15.196:0/1569914910 <== mon.0 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c7c0b0440 con 0x7f5c880b0e70 2024-03-17T23:56:12.176 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:12.172+0000 7f5c8ee66640 1 -- 172.21.15.196:0/1569914910 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5c881587d0 con 0x7f5c880b0e70 2024-03-17T23:56:12.176 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:12.172+0000 7f5c857fa640 1 -- 172.21.15.196:0/1569914910 <== mon.0 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c7c006e20 con 0x7f5c880b0e70 2024-03-17T23:56:12.176 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:12.172+0000 7f5c8ee66640 1 -- 172.21.15.196:0/1569914910 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5c88158d90 con 0x7f5c880b0e70 2024-03-17T23:56:12.177 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:12.172+0000 7f5c8ee66640 1 -- 172.21.15.196:0/1569914910 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5c880689a0 con 0x7f5c880b0e70 2024-03-17T23:56:12.177 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:12.172+0000 7f5c857fa640 1 -- 172.21.15.196:0/1569914910 <== mon.0 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 5) ==== 87083+0+0 (secure 0 0 0) 0x7f5c7c0c1020 con 0x7f5c880b0e70 2024-03-17T23:56:12.178 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:12.176+0000 7f5c857fa640 1 --2- 172.21.15.196:0/1569914910 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f5c6c067660 0x7f5c6c069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:12.178 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:12.176+0000 7f5c857fa640 1 -- 172.21.15.196:0/1569914910 <== mon.0 v2:172.21.15.196:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f5c7c122450 con 0x7f5c880b0e70 2024-03-17T23:56:12.178 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:12.176+0000 7f5c87fff640 1 --2- 172.21.15.196:0/1569914910 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f5c6c067660 0x7f5c6c069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:12.178 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:12.176+0000 7f5c87fff640 1 --2- 172.21.15.196:0/1569914910 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f5c6c067660 0x7f5c6c069b20 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f5c881f1280 tx=0x7f5c74009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:56:12.182 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:12.180+0000 7f5c857fa640 1 -- 172.21.15.196:0/1569914910 <== mon.0 v2:172.21.15.196:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177849 (secure 0 0 0) 0x7f5c7c018750 con 0x7f5c880b0e70 2024-03-17T23:56:12.355 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:12.352+0000 7f5c8ee66640 1 -- 172.21.15.196:0/1569914910 --> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f5c8806d240 con 0x7f5c6c067660 2024-03-17T23:56:12.370 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:12.364+0000 7f5c857fa640 1 -- 172.21.15.196:0/1569914910 <== mgr.4099 v2:172.21.15.204:6832/2505201055 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252007 (secure 0 0 0) 0x7f5c8806d240 con 0x7f5c6c067660 2024-03-17T23:56:12.372 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-03-17T23:56:12.373 INFO:teuthology.orchestra.run.smithi196.stderr:dumped all 2024-03-17T23:56:12.374 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:12.368+0000 7f5c8ee66640 1 -- 172.21.15.196:0/1569914910 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f5c6c067660 msgr2=0x7f5c6c069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:12.374 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:12.368+0000 7f5c8ee66640 1 --2- 172.21.15.196:0/1569914910 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f5c6c067660 0x7f5c6c069b20 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f5c881f1280 tx=0x7f5c74009040 comp rx=0 tx=0).stop 2024-03-17T23:56:12.374 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:12.368+0000 7f5c8ee66640 1 -- 172.21.15.196:0/1569914910 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5c880b0e70 msgr2=0x7f5c8815c710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:12.375 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:12.368+0000 7f5c8ee66640 1 --2- 172.21.15.196:0/1569914910 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5c880b0e70 0x7f5c8815c710 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f5c7c0097f0 tx=0x7f5c7c01b990 comp rx=0 tx=0).stop 2024-03-17T23:56:12.375 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:12.368+0000 7f5c8ee66640 1 -- 172.21.15.196:0/1569914910 shutdown_connections 2024-03-17T23:56:12.375 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:12.368+0000 7f5c8ee66640 1 --2- 172.21.15.196:0/1569914910 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f5c6c067660 0x7f5c6c069b20 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:12.375 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:12.368+0000 7f5c8ee66640 1 --2- 172.21.15.196:0/1569914910 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5c8815d660 0x7f5c88148940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:12.375 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:12.368+0000 7f5c8ee66640 1 --2- 172.21.15.196:0/1569914910 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5c881543e0 0x7f5c881f15c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:12.375 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:12.368+0000 7f5c8ee66640 1 --2- 172.21.15.196:0/1569914910 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5c880b0e70 0x7f5c8815c710 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:12.375 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:12.368+0000 7f5c8ee66640 1 -- 172.21.15.196:0/1569914910 >> 172.21.15.196:0/1569914910 conn(0x7f5c880c89a0 msgr2=0x7f5c8806b2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-17T23:56:12.375 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:12.372+0000 7f5c8ee66640 1 -- 172.21.15.196:0/1569914910 shutdown_connections 2024-03-17T23:56:12.375 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:12.372+0000 7f5c8ee66640 1 -- 172.21.15.196:0/1569914910 wait complete. 2024-03-17T23:56:12.387 INFO:teuthology.orchestra.run.smithi196.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2024-03-17T23:56:11.958638+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":598402,"num_objects":100,"num_object_clones":0,"num_object_copies":200,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":100,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":364,"num_write_kb":2478,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":296,"ondisk_log_size":296,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218208,"kb_used_data":2080,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754756512,"statfs":{"total":773094113280,"available":772870668288,"internally_reserved":0,"allocated":2129920,"data_stored":1801644,"data_compressed":66348,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12748,"internal_metadata":221236788},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":8034,"num_objects":98,"num_object_clones":0,"num_object_copies":196,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":205,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.003588"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:02.164060+0000","last_change":"2024-03-17T23:56:01.208245+0000","last_active":"2024-03-17T23:56:02.164060+0000","last_peered":"2024-03-17T23:56:02.164060+0000","last_clean":"2024-03-17T23:56:02.164060+0000","last_became_active":"2024-03-17T23:56:01.207533+0000","last_became_peered":"2024-03-17T23:56:01.207533+0000","last_unstale":"2024-03-17T23:56:02.164060+0000","last_undegraded":"2024-03-17T23:56:02.164060+0000","last_fullsized":"2024-03-17T23:56:02.164060+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T09:33:28.935701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:02.756375+0000","last_change":"2024-03-17T23:56:01.193546+0000","last_active":"2024-03-17T23:56:02.756375+0000","last_peered":"2024-03-17T23:56:02.756375+0000","last_clean":"2024-03-17T23:56:02.756375+0000","last_became_active":"2024-03-17T23:56:01.192736+0000","last_became_peered":"2024-03-17T23:56:01.192736+0000","last_unstale":"2024-03-17T23:56:02.756375+0000","last_undegraded":"2024-03-17T23:56:02.756375+0000","last_fullsized":"2024-03-17T23:56:02.756375+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T07:03:18.208772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:02.858181+0000","last_change":"2024-03-17T23:56:01.188859+0000","last_active":"2024-03-17T23:56:02.858181+0000","last_peered":"2024-03-17T23:56:02.858181+0000","last_clean":"2024-03-17T23:56:02.858181+0000","last_became_active":"2024-03-17T23:56:01.188339+0000","last_became_peered":"2024-03-17T23:56:01.188339+0000","last_unstale":"2024-03-17T23:56:02.858181+0000","last_undegraded":"2024-03-17T23:56:02.858181+0000","last_fullsized":"2024-03-17T23:56:02.858181+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T05:26:03.654839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:02.169804+0000","last_change":"2024-03-17T23:56:01.204810+0000","last_active":"2024-03-17T23:56:02.169804+0000","last_peered":"2024-03-17T23:56:02.169804+0000","last_clean":"2024-03-17T23:56:02.169804+0000","last_became_active":"2024-03-17T23:56:01.196978+0000","last_became_peered":"2024-03-17T23:56:01.196978+0000","last_unstale":"2024-03-17T23:56:02.169804+0000","last_undegraded":"2024-03-17T23:56:02.169804+0000","last_fullsized":"2024-03-17T23:56:02.169804+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T06:25:58.489959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:02.162704+0000","last_change":"2024-03-17T23:56:01.195423+0000","last_active":"2024-03-17T23:56:02.162704+0000","last_peered":"2024-03-17T23:56:02.162704+0000","last_clean":"2024-03-17T23:56:02.162704+0000","last_became_active":"2024-03-17T23:56:01.194710+0000","last_became_peered":"2024-03-17T23:56:01.194710+0000","last_unstale":"2024-03-17T23:56:02.162704+0000","last_undegraded":"2024-03-17T23:56:02.162704+0000","last_fullsized":"2024-03-17T23:56:02.162704+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T06:25:58.489959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:02.169622+0000","last_change":"2024-03-17T23:56:01.204633+0000","last_active":"2024-03-17T23:56:02.169622+0000","last_peered":"2024-03-17T23:56:02.169622+0000","last_clean":"2024-03-17T23:56:02.169622+0000","last_became_active":"2024-03-17T23:56:01.192908+0000","last_became_peered":"2024-03-17T23:56:01.192908+0000","last_unstale":"2024-03-17T23:56:02.169622+0000","last_undegraded":"2024-03-17T23:56:02.169622+0000","last_fullsized":"2024-03-17T23:56:02.169622+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T03:49:46.522282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:02.163588+0000","last_change":"2024-03-17T23:56:01.208861+0000","last_active":"2024-03-17T23:56:02.163588+0000","last_peered":"2024-03-17T23:56:02.163588+0000","last_clean":"2024-03-17T23:56:02.163588+0000","last_became_active":"2024-03-17T23:56:01.199550+0000","last_became_peered":"2024-03-17T23:56:01.199550+0000","last_unstale":"2024-03-17T23:56:02.163588+0000","last_undegraded":"2024-03-17T23:56:02.163588+0000","last_fullsized":"2024-03-17T23:56:02.163588+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T00:21:36.556648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:02.855187+0000","last_change":"2024-03-17T23:56:01.212574+0000","last_active":"2024-03-17T23:56:02.855187+0000","last_peered":"2024-03-17T23:56:02.855187+0000","last_clean":"2024-03-17T23:56:02.855187+0000","last_became_active":"2024-03-17T23:56:01.211860+0000","last_became_peered":"2024-03-17T23:56:01.211860+0000","last_unstale":"2024-03-17T23:56:02.855187+0000","last_undegraded":"2024-03-17T23:56:02.855187+0000","last_fullsized":"2024-03-17T23:56:02.855187+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T02:15:18.353466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:02.164413+0000","last_change":"2024-03-17T23:56:01.214731+0000","last_active":"2024-03-17T23:56:02.164413+0000","last_peered":"2024-03-17T23:56:02.164413+0000","last_clean":"2024-03-17T23:56:02.164413+0000","last_became_active":"2024-03-17T23:56:01.213795+0000","last_became_peered":"2024-03-17T23:56:01.213795+0000","last_unstale":"2024-03-17T23:56:02.164413+0000","last_undegraded":"2024-03-17T23:56:02.164413+0000","last_fullsized":"2024-03-17T23:56:02.164413+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T11:32:23.716236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:02.856823+0000","last_change":"2024-03-17T23:56:01.212409+0000","last_active":"2024-03-17T23:56:02.856823+0000","last_peered":"2024-03-17T23:56:02.856823+0000","last_clean":"2024-03-17T23:56:02.856823+0000","last_became_active":"2024-03-17T23:56:01.211620+0000","last_became_peered":"2024-03-17T23:56:01.211620+0000","last_unstale":"2024-03-17T23:56:02.856823+0000","last_undegraded":"2024-03-17T23:56:02.856823+0000","last_fullsized":"2024-03-17T23:56:02.856823+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T11:40:55.653472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:02.856758+0000","last_change":"2024-03-17T23:56:01.212568+0000","last_active":"2024-03-17T23:56:02.856758+0000","last_peered":"2024-03-17T23:56:02.856758+0000","last_clean":"2024-03-17T23:56:02.856758+0000","last_became_active":"2024-03-17T23:56:01.211561+0000","last_became_peered":"2024-03-17T23:56:01.211561+0000","last_unstale":"2024-03-17T23:56:02.856758+0000","last_undegraded":"2024-03-17T23:56:02.856758+0000","last_fullsized":"2024-03-17T23:56:02.856758+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T02:46:13.650384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:02.165562+0000","last_change":"2024-03-17T23:56:01.186811+0000","last_active":"2024-03-17T23:56:02.165562+0000","last_peered":"2024-03-17T23:56:02.165562+0000","last_clean":"2024-03-17T23:56:02.165562+0000","last_became_active":"2024-03-17T23:56:01.186012+0000","last_became_peered":"2024-03-17T23:56:01.186012+0000","last_unstale":"2024-03-17T23:56:02.165562+0000","last_undegraded":"2024-03-17T23:56:02.165562+0000","last_fullsized":"2024-03-17T23:56:02.165562+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T10:35:20.142750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:02.855904+0000","last_change":"2024-03-17T23:56:01.213648+0000","last_active":"2024-03-17T23:56:02.855904+0000","last_peered":"2024-03-17T23:56:02.855904+0000","last_clean":"2024-03-17T23:56:02.855904+0000","last_became_active":"2024-03-17T23:56:01.205058+0000","last_became_peered":"2024-03-17T23:56:01.205058+0000","last_unstale":"2024-03-17T23:56:02.855904+0000","last_undegraded":"2024-03-17T23:56:02.855904+0000","last_fullsized":"2024-03-17T23:56:02.855904+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T03:49:46.522282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:02.857959+0000","last_change":"2024-03-17T23:56:01.196817+0000","last_active":"2024-03-17T23:56:02.857959+0000","last_peered":"2024-03-17T23:56:02.857959+0000","last_clean":"2024-03-17T23:56:02.857959+0000","last_became_active":"2024-03-17T23:56:01.195960+0000","last_became_peered":"2024-03-17T23:56:01.195960+0000","last_unstale":"2024-03-17T23:56:02.857959+0000","last_undegraded":"2024-03-17T23:56:02.857959+0000","last_fullsized":"2024-03-17T23:56:02.857959+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T10:13:51.662432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:02.756001+0000","last_change":"2024-03-17T23:56:01.182140+0000","last_active":"2024-03-17T23:56:02.756001+0000","last_peered":"2024-03-17T23:56:02.756001+0000","last_clean":"2024-03-17T23:56:02.756001+0000","last_became_active":"2024-03-17T23:56:01.181405+0000","last_became_peered":"2024-03-17T23:56:01.181405+0000","last_unstale":"2024-03-17T23:56:02.756001+0000","last_undegraded":"2024-03-17T23:56:02.756001+0000","last_fullsized":"2024-03-17T23:56:02.756001+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T02:46:13.650384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:02.169320+0000","last_change":"2024-03-17T23:56:01.194871+0000","last_active":"2024-03-17T23:56:02.169320+0000","last_peered":"2024-03-17T23:56:02.169320+0000","last_clean":"2024-03-17T23:56:02.169320+0000","last_became_active":"2024-03-17T23:56:01.193384+0000","last_became_peered":"2024-03-17T23:56:01.193384+0000","last_unstale":"2024-03-17T23:56:02.169320+0000","last_undegraded":"2024-03-17T23:56:02.169320+0000","last_fullsized":"2024-03-17T23:56:02.169320+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T11:40:55.653472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:02.170892+0000","last_change":"2024-03-17T23:56:01.209960+0000","last_active":"2024-03-17T23:56:02.170892+0000","last_peered":"2024-03-17T23:56:02.170892+0000","last_clean":"2024-03-17T23:56:02.170892+0000","last_became_active":"2024-03-17T23:56:01.209291+0000","last_became_peered":"2024-03-17T23:56:01.209291+0000","last_unstale":"2024-03-17T23:56:02.170892+0000","last_undegraded":"2024-03-17T23:56:02.170892+0000","last_fullsized":"2024-03-17T23:56:02.170892+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T03:01:01.120023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:02.355033+0000","last_change":"2024-03-17T23:56:01.186830+0000","last_active":"2024-03-17T23:56:02.355033+0000","last_peered":"2024-03-17T23:56:02.355033+0000","last_clean":"2024-03-17T23:56:02.355033+0000","last_became_active":"2024-03-17T23:56:01.186001+0000","last_became_peered":"2024-03-17T23:56:01.186001+0000","last_unstale":"2024-03-17T23:56:02.355033+0000","last_undegraded":"2024-03-17T23:56:02.355033+0000","last_fullsized":"2024-03-17T23:56:02.355033+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T01:56:02.340062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:02.163525+0000","last_change":"2024-03-17T23:56:01.195354+0000","last_active":"2024-03-17T23:56:02.163525+0000","last_peered":"2024-03-17T23:56:02.163525+0000","last_clean":"2024-03-17T23:56:02.163525+0000","last_became_active":"2024-03-17T23:56:01.194579+0000","last_became_peered":"2024-03-17T23:56:01.194579+0000","last_unstale":"2024-03-17T23:56:02.163525+0000","last_undegraded":"2024-03-17T23:56:02.163525+0000","last_fullsized":"2024-03-17T23:56:02.163525+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T07:53:44.598091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:02.855890+0000","last_change":"2024-03-17T23:56:01.193429+0000","last_active":"2024-03-17T23:56:02.855890+0000","last_peered":"2024-03-17T23:56:02.855890+0000","last_clean":"2024-03-17T23:56:02.855890+0000","last_became_active":"2024-03-17T23:56:01.192711+0000","last_became_peered":"2024-03-17T23:56:01.192711+0000","last_unstale":"2024-03-17T23:56:02.855890+0000","last_undegraded":"2024-03-17T23:56:02.855890+0000","last_fullsized":"2024-03-17T23:56:02.855890+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T08:24:06.922044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:02.858321+0000","last_change":"2024-03-17T23:56:01.203203+0000","last_active":"2024-03-17T23:56:02.858321+0000","last_peered":"2024-03-17T23:56:02.858321+0000","last_clean":"2024-03-17T23:56:02.858321+0000","last_became_active":"2024-03-17T23:56:01.202491+0000","last_became_peered":"2024-03-17T23:56:01.202491+0000","last_unstale":"2024-03-17T23:56:02.858321+0000","last_undegraded":"2024-03-17T23:56:02.858321+0000","last_fullsized":"2024-03-17T23:56:02.858321+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T11:35:21.037222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:02.169686+0000","last_change":"2024-03-17T23:56:01.215437+0000","last_active":"2024-03-17T23:56:02.169686+0000","last_peered":"2024-03-17T23:56:02.169686+0000","last_clean":"2024-03-17T23:56:02.169686+0000","last_became_active":"2024-03-17T23:56:01.214127+0000","last_became_peered":"2024-03-17T23:56:01.214127+0000","last_unstale":"2024-03-17T23:56:02.169686+0000","last_undegraded":"2024-03-17T23:56:02.169686+0000","last_fullsized":"2024-03-17T23:56:02.169686+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T04:45:41.506781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:02.855523+0000","last_change":"2024-03-17T23:56:01.213157+0000","last_active":"2024-03-17T23:56:02.855523+0000","last_peered":"2024-03-17T23:56:02.855523+0000","last_clean":"2024-03-17T23:56:02.855523+0000","last_became_active":"2024-03-17T23:56:01.205601+0000","last_became_peered":"2024-03-17T23:56:01.205601+0000","last_unstale":"2024-03-17T23:56:02.855523+0000","last_undegraded":"2024-03-17T23:56:02.855523+0000","last_fullsized":"2024-03-17T23:56:02.855523+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T00:26:55.287891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:02.169576+0000","last_change":"2024-03-17T23:56:01.194995+0000","last_active":"2024-03-17T23:56:02.169576+0000","last_peered":"2024-03-17T23:56:02.169576+0000","last_clean":"2024-03-17T23:56:02.169576+0000","last_became_active":"2024-03-17T23:56:01.194290+0000","last_became_peered":"2024-03-17T23:56:01.194290+0000","last_unstale":"2024-03-17T23:56:02.169576+0000","last_undegraded":"2024-03-17T23:56:02.169576+0000","last_fullsized":"2024-03-17T23:56:02.169576+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T07:03:18.208772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:02.856011+0000","last_change":"2024-03-17T23:56:01.205233+0000","last_active":"2024-03-17T23:56:02.856011+0000","last_peered":"2024-03-17T23:56:02.856011+0000","last_clean":"2024-03-17T23:56:02.856011+0000","last_became_active":"2024-03-17T23:56:01.204456+0000","last_became_peered":"2024-03-17T23:56:01.204456+0000","last_unstale":"2024-03-17T23:56:02.856011+0000","last_undegraded":"2024-03-17T23:56:02.856011+0000","last_fullsized":"2024-03-17T23:56:02.856011+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T06:25:58.489959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:02.856820+0000","last_change":"2024-03-17T23:56:01.210984+0000","last_active":"2024-03-17T23:56:02.856820+0000","last_peered":"2024-03-17T23:56:02.856820+0000","last_clean":"2024-03-17T23:56:02.856820+0000","last_became_active":"2024-03-17T23:56:01.210025+0000","last_became_peered":"2024-03-17T23:56:01.210025+0000","last_unstale":"2024-03-17T23:56:02.856820+0000","last_undegraded":"2024-03-17T23:56:02.856820+0000","last_fullsized":"2024-03-17T23:56:02.856820+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T00:26:55.287891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:02.756301+0000","last_change":"2024-03-17T23:56:01.205461+0000","last_active":"2024-03-17T23:56:02.756301+0000","last_peered":"2024-03-17T23:56:02.756301+0000","last_clean":"2024-03-17T23:56:02.756301+0000","last_became_active":"2024-03-17T23:56:01.204676+0000","last_became_peered":"2024-03-17T23:56:01.204676+0000","last_unstale":"2024-03-17T23:56:02.756301+0000","last_undegraded":"2024-03-17T23:56:02.756301+0000","last_fullsized":"2024-03-17T23:56:02.756301+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T11:40:55.653472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:02.855842+0000","last_change":"2024-03-17T23:56:01.205530+0000","last_active":"2024-03-17T23:56:02.855842+0000","last_peered":"2024-03-17T23:56:02.855842+0000","last_clean":"2024-03-17T23:56:02.855842+0000","last_became_active":"2024-03-17T23:56:01.204637+0000","last_became_peered":"2024-03-17T23:56:01.204637+0000","last_unstale":"2024-03-17T23:56:02.855842+0000","last_undegraded":"2024-03-17T23:56:02.855842+0000","last_fullsized":"2024-03-17T23:56:02.855842+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T07:03:18.208772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:02.858534+0000","last_change":"2024-03-17T23:56:01.207143+0000","last_active":"2024-03-17T23:56:02.858534+0000","last_peered":"2024-03-17T23:56:02.858534+0000","last_clean":"2024-03-17T23:56:02.858534+0000","last_became_active":"2024-03-17T23:56:01.206466+0000","last_became_peered":"2024-03-17T23:56:01.206466+0000","last_unstale":"2024-03-17T23:56:02.858534+0000","last_undegraded":"2024-03-17T23:56:02.858534+0000","last_fullsized":"2024-03-17T23:56:02.858534+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T02:46:13.650384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:02.170795+0000","last_change":"2024-03-17T23:56:01.205414+0000","last_active":"2024-03-17T23:56:02.170795+0000","last_peered":"2024-03-17T23:56:02.170795+0000","last_clean":"2024-03-17T23:56:02.170795+0000","last_became_active":"2024-03-17T23:56:01.204418+0000","last_became_peered":"2024-03-17T23:56:01.204418+0000","last_unstale":"2024-03-17T23:56:02.170795+0000","last_undegraded":"2024-03-17T23:56:02.170795+0000","last_fullsized":"2024-03-17T23:56:02.170795+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T03:59:56.032635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:02.354820+0000","last_change":"2024-03-17T23:56:01.213242+0000","last_active":"2024-03-17T23:56:02.354820+0000","last_peered":"2024-03-17T23:56:02.354820+0000","last_clean":"2024-03-17T23:56:02.354820+0000","last_became_active":"2024-03-17T23:56:01.212456+0000","last_became_peered":"2024-03-17T23:56:01.212456+0000","last_unstale":"2024-03-17T23:56:02.354820+0000","last_undegraded":"2024-03-17T23:56:02.354820+0000","last_fullsized":"2024-03-17T23:56:02.354820+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T11:11:33.525431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:02.855686+0000","last_change":"2024-03-17T23:56:01.197502+0000","last_active":"2024-03-17T23:56:02.855686+0000","last_peered":"2024-03-17T23:56:02.855686+0000","last_clean":"2024-03-17T23:56:02.855686+0000","last_became_active":"2024-03-17T23:56:01.196672+0000","last_became_peered":"2024-03-17T23:56:01.196672+0000","last_unstale":"2024-03-17T23:56:02.855686+0000","last_undegraded":"2024-03-17T23:56:02.855686+0000","last_fullsized":"2024-03-17T23:56:02.855686+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T05:26:03.654839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:02.165727+0000","last_change":"2024-03-17T23:56:01.169196+0000","last_active":"2024-03-17T23:56:02.165727+0000","last_peered":"2024-03-17T23:56:02.165727+0000","last_clean":"2024-03-17T23:56:02.165727+0000","last_became_active":"2024-03-17T23:56:01.168199+0000","last_became_peered":"2024-03-17T23:56:01.168199+0000","last_unstale":"2024-03-17T23:56:02.165727+0000","last_undegraded":"2024-03-17T23:56:02.165727+0000","last_fullsized":"2024-03-17T23:56:02.165727+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T11:11:33.525431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"21'5","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:03.681175+0000","last_change":"2024-03-17T23:56:00.675134+0000","last_active":"2024-03-17T23:56:03.681175+0000","last_peered":"2024-03-17T23:56:03.681175+0000","last_clean":"2024-03-17T23:56:03.681175+0000","last_became_active":"2024-03-17T23:56:00.674772+0000","last_became_peered":"2024-03-17T23:56:00.674772+0000","last_unstale":"2024-03-17T23:56:03.681175+0000","last_undegraded":"2024-03-17T23:56:03.681175+0000","last_fullsized":"2024-03-17T23:56:03.681175+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_clean_scrub_stamp":"2024-03-17T23:55:59.626739+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T07:03:16.148691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:02.858578+0000","last_change":"2024-03-17T23:56:01.199837+0000","last_active":"2024-03-17T23:56:02.858578+0000","last_peered":"2024-03-17T23:56:02.858578+0000","last_clean":"2024-03-17T23:56:02.858578+0000","last_became_active":"2024-03-17T23:56:01.199084+0000","last_became_peered":"2024-03-17T23:56:01.199084+0000","last_unstale":"2024-03-17T23:56:02.858578+0000","last_undegraded":"2024-03-17T23:56:02.858578+0000","last_fullsized":"2024-03-17T23:56:02.858578+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T00:26:55.287891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"21'7","reported_seq":21,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:05.699286+0000","last_change":"2024-03-17T23:56:00.683252+0000","last_active":"2024-03-17T23:56:05.699286+0000","last_peered":"2024-03-17T23:56:05.699286+0000","last_clean":"2024-03-17T23:56:05.699286+0000","last_became_active":"2024-03-17T23:56:00.682487+0000","last_became_peered":"2024-03-17T23:56:00.682487+0000","last_unstale":"2024-03-17T23:56:05.699286+0000","last_undegraded":"2024-03-17T23:56:05.699286+0000","last_fullsized":"2024-03-17T23:56:05.699286+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_clean_scrub_stamp":"2024-03-17T23:55:59.626739+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T04:07:26.256885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"21'3","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:04.690098+0000","last_change":"2024-03-17T23:56:00.688353+0000","last_active":"2024-03-17T23:56:04.690098+0000","last_peered":"2024-03-17T23:56:04.690098+0000","last_clean":"2024-03-17T23:56:04.690098+0000","last_became_active":"2024-03-17T23:56:00.688016+0000","last_became_peered":"2024-03-17T23:56:00.688016+0000","last_unstale":"2024-03-17T23:56:04.690098+0000","last_undegraded":"2024-03-17T23:56:04.690098+0000","last_fullsized":"2024-03-17T23:56:04.690098+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_clean_scrub_stamp":"2024-03-17T23:55:59.626739+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T09:07:52.005791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:02.855275+0000","last_change":"2024-03-17T23:56:01.211541+0000","last_active":"2024-03-17T23:56:02.855275+0000","last_peered":"2024-03-17T23:56:02.855275+0000","last_clean":"2024-03-17T23:56:02.855275+0000","last_became_active":"2024-03-17T23:56:01.205709+0000","last_became_peered":"2024-03-17T23:56:01.205709+0000","last_unstale":"2024-03-17T23:56:02.855275+0000","last_undegraded":"2024-03-17T23:56:02.855275+0000","last_fullsized":"2024-03-17T23:56:02.855275+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T11:35:21.037222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"21'3","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:05.698637+0000","last_change":"2024-03-17T23:56:00.690234+0000","last_active":"2024-03-17T23:56:05.698637+0000","last_peered":"2024-03-17T23:56:05.698637+0000","last_clean":"2024-03-17T23:56:05.698637+0000","last_became_active":"2024-03-17T23:56:00.689202+0000","last_became_peered":"2024-03-17T23:56:00.689202+0000","last_unstale":"2024-03-17T23:56:05.698637+0000","last_undegraded":"2024-03-17T23:56:05.698637+0000","last_fullsized":"2024-03-17T23:56:05.698637+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_clean_scrub_stamp":"2024-03-17T23:55:59.626739+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T05:52:39.451210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:02.755906+0000","last_change":"2024-03-17T23:56:01.194109+0000","last_active":"2024-03-17T23:56:02.755906+0000","last_peered":"2024-03-17T23:56:02.755906+0000","last_clean":"2024-03-17T23:56:02.755906+0000","last_became_active":"2024-03-17T23:56:01.192420+0000","last_became_peered":"2024-03-17T23:56:01.192420+0000","last_unstale":"2024-03-17T23:56:02.755906+0000","last_undegraded":"2024-03-17T23:56:02.755906+0000","last_fullsized":"2024-03-17T23:56:02.755906+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T08:24:06.922044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"21'4","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:03.685236+0000","last_change":"2024-03-17T23:56:00.696649+0000","last_active":"2024-03-17T23:56:03.685236+0000","last_peered":"2024-03-17T23:56:03.685236+0000","last_clean":"2024-03-17T23:56:03.685236+0000","last_became_active":"2024-03-17T23:56:00.696307+0000","last_became_peered":"2024-03-17T23:56:00.696307+0000","last_unstale":"2024-03-17T23:56:03.685236+0000","last_undegraded":"2024-03-17T23:56:03.685236+0000","last_fullsized":"2024-03-17T23:56:03.685236+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_clean_scrub_stamp":"2024-03-17T23:55:59.626739+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T07:28:27.310340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:02.170611+0000","last_change":"2024-03-17T23:56:01.194103+0000","last_active":"2024-03-17T23:56:02.170611+0000","last_peered":"2024-03-17T23:56:02.170611+0000","last_clean":"2024-03-17T23:56:02.170611+0000","last_became_active":"2024-03-17T23:56:01.193354+0000","last_became_peered":"2024-03-17T23:56:01.193354+0000","last_unstale":"2024-03-17T23:56:02.170611+0000","last_undegraded":"2024-03-17T23:56:02.170611+0000","last_fullsized":"2024-03-17T23:56:02.170611+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T00:21:36.556648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"21'4","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:06.710774+0000","last_change":"2024-03-17T23:56:00.689876+0000","last_active":"2024-03-17T23:56:06.710774+0000","last_peered":"2024-03-17T23:56:06.710774+0000","last_clean":"2024-03-17T23:56:06.710774+0000","last_became_active":"2024-03-17T23:56:00.688667+0000","last_became_peered":"2024-03-17T23:56:00.688667+0000","last_unstale":"2024-03-17T23:56:06.710774+0000","last_undegraded":"2024-03-17T23:56:06.710774+0000","last_fullsized":"2024-03-17T23:56:06.710774+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_clean_scrub_stamp":"2024-03-17T23:55:59.626739+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T09:45:24.650866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:02.858681+0000","last_change":"2024-03-17T23:56:01.215247+0000","last_active":"2024-03-17T23:56:02.858681+0000","last_peered":"2024-03-17T23:56:02.858681+0000","last_clean":"2024-03-17T23:56:02.858681+0000","last_became_active":"2024-03-17T23:56:01.214438+0000","last_became_peered":"2024-03-17T23:56:01.214438+0000","last_unstale":"2024-03-17T23:56:02.858681+0000","last_undegraded":"2024-03-17T23:56:02.858681+0000","last_fullsized":"2024-03-17T23:56:02.858681+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T11:40:55.653472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"21'5","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:03.685323+0000","last_change":"2024-03-17T23:56:00.677495+0000","last_active":"2024-03-17T23:56:03.685323+0000","last_peered":"2024-03-17T23:56:03.685323+0000","last_clean":"2024-03-17T23:56:03.685323+0000","last_became_active":"2024-03-17T23:56:00.677165+0000","last_became_peered":"2024-03-17T23:56:00.677165+0000","last_unstale":"2024-03-17T23:56:03.685323+0000","last_undegraded":"2024-03-17T23:56:03.685323+0000","last_fullsized":"2024-03-17T23:56:03.685323+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_clean_scrub_stamp":"2024-03-17T23:55:59.626739+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T04:07:26.256885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:02.165606+0000","last_change":"2024-03-17T23:56:01.190913+0000","last_active":"2024-03-17T23:56:02.165606+0000","last_peered":"2024-03-17T23:56:02.165606+0000","last_clean":"2024-03-17T23:56:02.165606+0000","last_became_active":"2024-03-17T23:56:01.190191+0000","last_became_peered":"2024-03-17T23:56:01.190191+0000","last_unstale":"2024-03-17T23:56:02.165606+0000","last_undegraded":"2024-03-17T23:56:02.165606+0000","last_fullsized":"2024-03-17T23:56:02.165606+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T09:57:50.285832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"21'10","reported_seq":24,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:06.711421+0000","last_change":"2024-03-17T23:56:00.686597+0000","last_active":"2024-03-17T23:56:06.711421+0000","last_peered":"2024-03-17T23:56:06.711421+0000","last_clean":"2024-03-17T23:56:06.711421+0000","last_became_active":"2024-03-17T23:56:00.685757+0000","last_became_peered":"2024-03-17T23:56:00.685757+0000","last_unstale":"2024-03-17T23:56:06.711421+0000","last_undegraded":"2024-03-17T23:56:06.711421+0000","last_fullsized":"2024-03-17T23:56:06.711421+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_clean_scrub_stamp":"2024-03-17T23:55:59.626739+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T10:35:19.139554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:02.162892+0000","last_change":"2024-03-17T23:56:01.216238+0000","last_active":"2024-03-17T23:56:02.162892+0000","last_peered":"2024-03-17T23:56:02.162892+0000","last_clean":"2024-03-17T23:56:02.162892+0000","last_became_active":"2024-03-17T23:56:01.215526+0000","last_became_peered":"2024-03-17T23:56:01.215526+0000","last_unstale":"2024-03-17T23:56:02.162892+0000","last_undegraded":"2024-03-17T23:56:02.162892+0000","last_fullsized":"2024-03-17T23:56:02.162892+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T03:18:40.457769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"21'9","reported_seq":23,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:06.709365+0000","last_change":"2024-03-17T23:56:00.682756+0000","last_active":"2024-03-17T23:56:06.709365+0000","last_peered":"2024-03-17T23:56:06.709365+0000","last_clean":"2024-03-17T23:56:06.709365+0000","last_became_active":"2024-03-17T23:56:00.682392+0000","last_became_peered":"2024-03-17T23:56:00.682392+0000","last_unstale":"2024-03-17T23:56:06.709365+0000","last_undegraded":"2024-03-17T23:56:06.709365+0000","last_fullsized":"2024-03-17T23:56:06.709365+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_clean_scrub_stamp":"2024-03-17T23:55:59.626739+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T04:54:08.515514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:02.858030+0000","last_change":"2024-03-17T23:56:01.218114+0000","last_active":"2024-03-17T23:56:02.858030+0000","last_peered":"2024-03-17T23:56:02.858030+0000","last_clean":"2024-03-17T23:56:02.858030+0000","last_became_active":"2024-03-17T23:56:01.217434+0000","last_became_peered":"2024-03-17T23:56:01.217434+0000","last_unstale":"2024-03-17T23:56:02.858030+0000","last_undegraded":"2024-03-17T23:56:02.858030+0000","last_fullsized":"2024-03-17T23:56:02.858030+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T06:56:40.687109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"21'5","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:05.694982+0000","last_change":"2024-03-17T23:56:00.696766+0000","last_active":"2024-03-17T23:56:05.694982+0000","last_peered":"2024-03-17T23:56:05.694982+0000","last_clean":"2024-03-17T23:56:05.694982+0000","last_became_active":"2024-03-17T23:56:00.695592+0000","last_became_peered":"2024-03-17T23:56:00.695592+0000","last_unstale":"2024-03-17T23:56:05.694982+0000","last_undegraded":"2024-03-17T23:56:05.694982+0000","last_fullsized":"2024-03-17T23:56:05.694982+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_clean_scrub_stamp":"2024-03-17T23:55:59.626739+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T04:07:26.256885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:02.162832+0000","last_change":"2024-03-17T23:56:01.208385+0000","last_active":"2024-03-17T23:56:02.162832+0000","last_peered":"2024-03-17T23:56:02.162832+0000","last_clean":"2024-03-17T23:56:02.162832+0000","last_became_active":"2024-03-17T23:56:01.207791+0000","last_became_peered":"2024-03-17T23:56:01.207791+0000","last_unstale":"2024-03-17T23:56:02.162832+0000","last_undegraded":"2024-03-17T23:56:02.162832+0000","last_fullsized":"2024-03-17T23:56:02.162832+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T11:08:21.695552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"21'5","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:05.698896+0000","last_change":"2024-03-17T23:56:00.686159+0000","last_active":"2024-03-17T23:56:05.698896+0000","last_peered":"2024-03-17T23:56:05.698896+0000","last_clean":"2024-03-17T23:56:05.698896+0000","last_became_active":"2024-03-17T23:56:00.685354+0000","last_became_peered":"2024-03-17T23:56:00.685354+0000","last_unstale":"2024-03-17T23:56:05.698896+0000","last_undegraded":"2024-03-17T23:56:05.698896+0000","last_fullsized":"2024-03-17T23:56:05.698896+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_clean_scrub_stamp":"2024-03-17T23:55:59.626739+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T09:45:24.650866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:02.855800+0000","last_change":"2024-03-17T23:56:01.197137+0000","last_active":"2024-03-17T23:56:02.855800+0000","last_peered":"2024-03-17T23:56:02.855800+0000","last_clean":"2024-03-17T23:56:02.855800+0000","last_became_active":"2024-03-17T23:56:01.196356+0000","last_became_peered":"2024-03-17T23:56:01.196356+0000","last_unstale":"2024-03-17T23:56:02.855800+0000","last_undegraded":"2024-03-17T23:56:02.855800+0000","last_fullsized":"2024-03-17T23:56:02.855800+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T11:35:21.037222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"21'17","reported_seq":31,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:05.703884+0000","last_change":"2024-03-17T23:56:00.682828+0000","last_active":"2024-03-17T23:56:05.703884+0000","last_peered":"2024-03-17T23:56:05.703884+0000","last_clean":"2024-03-17T23:56:05.703884+0000","last_became_active":"2024-03-17T23:56:00.682469+0000","last_became_peered":"2024-03-17T23:56:00.682469+0000","last_unstale":"2024-03-17T23:56:05.703884+0000","last_undegraded":"2024-03-17T23:56:05.703884+0000","last_fullsized":"2024-03-17T23:56:05.703884+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_clean_scrub_stamp":"2024-03-17T23:55:59.626739+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T05:52:39.451210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:02.163955+0000","last_change":"2024-03-17T23:56:01.209356+0000","last_active":"2024-03-17T23:56:02.163955+0000","last_peered":"2024-03-17T23:56:02.163955+0000","last_clean":"2024-03-17T23:56:02.163955+0000","last_became_active":"2024-03-17T23:56:01.208381+0000","last_became_peered":"2024-03-17T23:56:01.208381+0000","last_unstale":"2024-03-17T23:56:02.163955+0000","last_undegraded":"2024-03-17T23:56:02.163955+0000","last_fullsized":"2024-03-17T23:56:02.163955+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T03:01:01.120023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"21'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:02.165932+0000","last_change":"2024-03-17T23:56:00.683595+0000","last_active":"2024-03-17T23:56:02.165932+0000","last_peered":"2024-03-17T23:56:02.165932+0000","last_clean":"2024-03-17T23:56:02.165932+0000","last_became_active":"2024-03-17T23:56:00.681338+0000","last_became_peered":"2024-03-17T23:56:00.681338+0000","last_unstale":"2024-03-17T23:56:02.165932+0000","last_undegraded":"2024-03-17T23:56:02.165932+0000","last_fullsized":"2024-03-17T23:56:02.165932+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_clean_scrub_stamp":"2024-03-17T23:55:59.626739+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T08:58:55.725638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:02.163647+0000","last_change":"2024-03-17T23:56:01.212669+0000","last_active":"2024-03-17T23:56:02.163647+0000","last_peered":"2024-03-17T23:56:02.163647+0000","last_clean":"2024-03-17T23:56:02.163647+0000","last_became_active":"2024-03-17T23:56:01.206691+0000","last_became_peered":"2024-03-17T23:56:01.206691+0000","last_unstale":"2024-03-17T23:56:02.163647+0000","last_undegraded":"2024-03-17T23:56:02.163647+0000","last_fullsized":"2024-03-17T23:56:02.163647+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T03:59:56.032635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"21'5","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:06.712346+0000","last_change":"2024-03-17T23:56:00.690801+0000","last_active":"2024-03-17T23:56:06.712346+0000","last_peered":"2024-03-17T23:56:06.712346+0000","last_clean":"2024-03-17T23:56:06.712346+0000","last_became_active":"2024-03-17T23:56:00.690516+0000","last_became_peered":"2024-03-17T23:56:00.690516+0000","last_unstale":"2024-03-17T23:56:06.712346+0000","last_undegraded":"2024-03-17T23:56:06.712346+0000","last_fullsized":"2024-03-17T23:56:06.712346+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_clean_scrub_stamp":"2024-03-17T23:55:59.626739+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T09:07:52.005791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:02.164761+0000","last_change":"2024-03-17T23:56:01.213733+0000","last_active":"2024-03-17T23:56:02.164761+0000","last_peered":"2024-03-17T23:56:02.164761+0000","last_clean":"2024-03-17T23:56:02.164761+0000","last_became_active":"2024-03-17T23:56:01.213095+0000","last_became_peered":"2024-03-17T23:56:01.213095+0000","last_unstale":"2024-03-17T23:56:02.164761+0000","last_undegraded":"2024-03-17T23:56:02.164761+0000","last_fullsized":"2024-03-17T23:56:02.164761+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T08:57:40.944494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"21'3","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:05.703188+0000","last_change":"2024-03-17T23:56:00.672267+0000","last_active":"2024-03-17T23:56:05.703188+0000","last_peered":"2024-03-17T23:56:05.703188+0000","last_clean":"2024-03-17T23:56:05.703188+0000","last_became_active":"2024-03-17T23:56:00.671655+0000","last_became_peered":"2024-03-17T23:56:00.671655+0000","last_unstale":"2024-03-17T23:56:05.703188+0000","last_undegraded":"2024-03-17T23:56:05.703188+0000","last_fullsized":"2024-03-17T23:56:05.703188+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_clean_scrub_stamp":"2024-03-17T23:55:59.626739+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T09:45:24.650866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:02.170496+0000","last_change":"2024-03-17T23:56:01.204789+0000","last_active":"2024-03-17T23:56:02.170496+0000","last_peered":"2024-03-17T23:56:02.170496+0000","last_clean":"2024-03-17T23:56:02.170496+0000","last_became_active":"2024-03-17T23:56:01.196002+0000","last_became_peered":"2024-03-17T23:56:01.196002+0000","last_unstale":"2024-03-17T23:56:02.170496+0000","last_undegraded":"2024-03-17T23:56:02.170496+0000","last_fullsized":"2024-03-17T23:56:02.170496+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T07:53:44.598091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"21'5","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:05.698947+0000","last_change":"2024-03-17T23:56:00.679054+0000","last_active":"2024-03-17T23:56:05.698947+0000","last_peered":"2024-03-17T23:56:05.698947+0000","last_clean":"2024-03-17T23:56:05.698947+0000","last_became_active":"2024-03-17T23:56:00.677831+0000","last_became_peered":"2024-03-17T23:56:00.677831+0000","last_unstale":"2024-03-17T23:56:05.698947+0000","last_undegraded":"2024-03-17T23:56:05.698947+0000","last_fullsized":"2024-03-17T23:56:05.698947+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_clean_scrub_stamp":"2024-03-17T23:55:59.626739+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T04:07:26.256885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:02.163086+0000","last_change":"2024-03-17T23:56:01.214619+0000","last_active":"2024-03-17T23:56:02.163086+0000","last_peered":"2024-03-17T23:56:02.163086+0000","last_clean":"2024-03-17T23:56:02.163086+0000","last_became_active":"2024-03-17T23:56:01.213960+0000","last_became_peered":"2024-03-17T23:56:01.213960+0000","last_unstale":"2024-03-17T23:56:02.163086+0000","last_undegraded":"2024-03-17T23:56:02.163086+0000","last_fullsized":"2024-03-17T23:56:02.163086+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T11:01:47.143880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":170,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:02.161950+0000","last_change":"2024-03-17T23:55:58.106405+0000","last_active":"2024-03-17T23:56:02.161950+0000","last_peered":"2024-03-17T23:56:02.161950+0000","last_clean":"2024-03-17T23:56:02.161950+0000","last_became_active":"2024-03-17T23:55:58.104493+0000","last_became_peered":"2024-03-17T23:55:58.104493+0000","last_unstale":"2024-03-17T23:56:02.161950+0000","last_undegraded":"2024-03-17T23:56:02.161950+0000","last_fullsized":"2024-03-17T23:56:02.161950+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:55:56.609001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:55:56.609001+0000","last_clean_scrub_stamp":"2024-03-17T23:55:56.609001+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T08:58:52.707900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"21'6","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:05.700355+0000","last_change":"2024-03-17T23:56:00.678791+0000","last_active":"2024-03-17T23:56:05.700355+0000","last_peered":"2024-03-17T23:56:05.700355+0000","last_clean":"2024-03-17T23:56:05.700355+0000","last_became_active":"2024-03-17T23:56:00.677660+0000","last_became_peered":"2024-03-17T23:56:00.677660+0000","last_unstale":"2024-03-17T23:56:05.700355+0000","last_undegraded":"2024-03-17T23:56:05.700355+0000","last_fullsized":"2024-03-17T23:56:05.700355+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_clean_scrub_stamp":"2024-03-17T23:55:59.626739+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T07:28:27.310340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:02.855352+0000","last_change":"2024-03-17T23:56:01.213073+0000","last_active":"2024-03-17T23:56:02.855352+0000","last_peered":"2024-03-17T23:56:02.855352+0000","last_clean":"2024-03-17T23:56:02.855352+0000","last_became_active":"2024-03-17T23:56:01.212434+0000","last_became_peered":"2024-03-17T23:56:01.212434+0000","last_unstale":"2024-03-17T23:56:02.855352+0000","last_undegraded":"2024-03-17T23:56:02.855352+0000","last_fullsized":"2024-03-17T23:56:02.855352+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T08:24:06.922044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"21'4","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:04.687663+0000","last_change":"2024-03-17T23:56:00.700634+0000","last_active":"2024-03-17T23:56:04.687663+0000","last_peered":"2024-03-17T23:56:04.687663+0000","last_clean":"2024-03-17T23:56:04.687663+0000","last_became_active":"2024-03-17T23:56:00.691617+0000","last_became_peered":"2024-03-17T23:56:00.691617+0000","last_unstale":"2024-03-17T23:56:04.687663+0000","last_undegraded":"2024-03-17T23:56:04.687663+0000","last_fullsized":"2024-03-17T23:56:04.687663+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_clean_scrub_stamp":"2024-03-17T23:55:59.626739+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T11:11:32.522234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:02.857916+0000","last_change":"2024-03-17T23:56:01.199855+0000","last_active":"2024-03-17T23:56:02.857916+0000","last_peered":"2024-03-17T23:56:02.857916+0000","last_clean":"2024-03-17T23:56:02.857916+0000","last_became_active":"2024-03-17T23:56:01.199121+0000","last_became_peered":"2024-03-17T23:56:01.199121+0000","last_unstale":"2024-03-17T23:56:02.857916+0000","last_undegraded":"2024-03-17T23:56:02.857916+0000","last_fullsized":"2024-03-17T23:56:02.857916+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T09:59:28.908069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"21'5","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:04.690435+0000","last_change":"2024-03-17T23:56:00.686560+0000","last_active":"2024-03-17T23:56:04.690435+0000","last_peered":"2024-03-17T23:56:04.690435+0000","last_clean":"2024-03-17T23:56:04.690435+0000","last_became_active":"2024-03-17T23:56:00.686215+0000","last_became_peered":"2024-03-17T23:56:00.686215+0000","last_unstale":"2024-03-17T23:56:04.690435+0000","last_undegraded":"2024-03-17T23:56:04.690435+0000","last_fullsized":"2024-03-17T23:56:04.690435+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_clean_scrub_stamp":"2024-03-17T23:55:59.626739+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T07:28:27.310340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:02.755813+0000","last_change":"2024-03-17T23:56:01.193197+0000","last_active":"2024-03-17T23:56:02.755813+0000","last_peered":"2024-03-17T23:56:02.755813+0000","last_clean":"2024-03-17T23:56:02.755813+0000","last_became_active":"2024-03-17T23:56:01.192117+0000","last_became_peered":"2024-03-17T23:56:01.192117+0000","last_unstale":"2024-03-17T23:56:02.755813+0000","last_undegraded":"2024-03-17T23:56:02.755813+0000","last_fullsized":"2024-03-17T23:56:02.755813+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T11:35:21.037222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"21'5","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:06.714103+0000","last_change":"2024-03-17T23:56:00.696254+0000","last_active":"2024-03-17T23:56:06.714103+0000","last_peered":"2024-03-17T23:56:06.714103+0000","last_clean":"2024-03-17T23:56:06.714103+0000","last_became_active":"2024-03-17T23:56:00.694605+0000","last_became_peered":"2024-03-17T23:56:00.694605+0000","last_unstale":"2024-03-17T23:56:06.714103+0000","last_undegraded":"2024-03-17T23:56:06.714103+0000","last_fullsized":"2024-03-17T23:56:06.714103+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_clean_scrub_stamp":"2024-03-17T23:55:59.626739+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T10:35:19.139554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:02.165616+0000","last_change":"2024-03-17T23:56:01.188278+0000","last_active":"2024-03-17T23:56:02.165616+0000","last_peered":"2024-03-17T23:56:02.165616+0000","last_clean":"2024-03-17T23:56:02.165616+0000","last_became_active":"2024-03-17T23:56:01.187571+0000","last_became_peered":"2024-03-17T23:56:01.187571+0000","last_unstale":"2024-03-17T23:56:02.165616+0000","last_undegraded":"2024-03-17T23:56:02.165616+0000","last_fullsized":"2024-03-17T23:56:02.165616+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T09:45:25.654063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"21'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:02.756178+0000","last_change":"2024-03-17T23:56:00.680290+0000","last_active":"2024-03-17T23:56:02.756178+0000","last_peered":"2024-03-17T23:56:02.756178+0000","last_clean":"2024-03-17T23:56:02.756178+0000","last_became_active":"2024-03-17T23:56:00.679981+0000","last_became_peered":"2024-03-17T23:56:00.679981+0000","last_unstale":"2024-03-17T23:56:02.756178+0000","last_undegraded":"2024-03-17T23:56:02.756178+0000","last_fullsized":"2024-03-17T23:56:02.756178+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_clean_scrub_stamp":"2024-03-17T23:55:59.626739+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T10:35:19.139554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:02.170359+0000","last_change":"2024-03-17T23:56:01.216640+0000","last_active":"2024-03-17T23:56:02.170359+0000","last_peered":"2024-03-17T23:56:02.170359+0000","last_clean":"2024-03-17T23:56:02.170359+0000","last_became_active":"2024-03-17T23:56:01.216145+0000","last_became_peered":"2024-03-17T23:56:01.216145+0000","last_unstale":"2024-03-17T23:56:02.170359+0000","last_undegraded":"2024-03-17T23:56:02.170359+0000","last_fullsized":"2024-03-17T23:56:02.170359+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T11:01:47.143880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"21'4","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:05.699680+0000","last_change":"2024-03-17T23:56:00.692896+0000","last_active":"2024-03-17T23:56:05.699680+0000","last_peered":"2024-03-17T23:56:05.699680+0000","last_clean":"2024-03-17T23:56:05.699680+0000","last_became_active":"2024-03-17T23:56:00.692054+0000","last_became_peered":"2024-03-17T23:56:00.692054+0000","last_unstale":"2024-03-17T23:56:05.699680+0000","last_undegraded":"2024-03-17T23:56:05.699680+0000","last_fullsized":"2024-03-17T23:56:05.699680+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_clean_scrub_stamp":"2024-03-17T23:55:59.626739+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T10:55:17.061099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:02.756195+0000","last_change":"2024-03-17T23:56:01.189102+0000","last_active":"2024-03-17T23:56:02.756195+0000","last_peered":"2024-03-17T23:56:02.756195+0000","last_clean":"2024-03-17T23:56:02.756195+0000","last_became_active":"2024-03-17T23:56:01.188353+0000","last_became_peered":"2024-03-17T23:56:01.188353+0000","last_unstale":"2024-03-17T23:56:02.756195+0000","last_undegraded":"2024-03-17T23:56:02.756195+0000","last_fullsized":"2024-03-17T23:56:02.756195+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T00:26:55.287891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"21'7","reported_seq":21,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:05.704975+0000","last_change":"2024-03-17T23:56:00.689216+0000","last_active":"2024-03-17T23:56:05.704975+0000","last_peered":"2024-03-17T23:56:05.704975+0000","last_clean":"2024-03-17T23:56:05.704975+0000","last_became_active":"2024-03-17T23:56:00.688978+0000","last_became_peered":"2024-03-17T23:56:00.688978+0000","last_unstale":"2024-03-17T23:56:05.704975+0000","last_undegraded":"2024-03-17T23:56:05.704975+0000","last_fullsized":"2024-03-17T23:56:05.704975+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_clean_scrub_stamp":"2024-03-17T23:55:59.626739+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T09:57:49.282635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:02.856072+0000","last_change":"2024-03-17T23:56:01.212041+0000","last_active":"2024-03-17T23:56:02.856072+0000","last_peered":"2024-03-17T23:56:02.856072+0000","last_clean":"2024-03-17T23:56:02.856072+0000","last_became_active":"2024-03-17T23:56:01.211359+0000","last_became_peered":"2024-03-17T23:56:01.211359+0000","last_unstale":"2024-03-17T23:56:02.856072+0000","last_undegraded":"2024-03-17T23:56:02.856072+0000","last_fullsized":"2024-03-17T23:56:02.856072+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T11:08:21.695552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"21'7","reported_seq":21,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:06.710496+0000","last_change":"2024-03-17T23:56:00.686768+0000","last_active":"2024-03-17T23:56:06.710496+0000","last_peered":"2024-03-17T23:56:06.710496+0000","last_clean":"2024-03-17T23:56:06.710496+0000","last_became_active":"2024-03-17T23:56:00.685461+0000","last_became_peered":"2024-03-17T23:56:00.685461+0000","last_unstale":"2024-03-17T23:56:06.710496+0000","last_undegraded":"2024-03-17T23:56:06.710496+0000","last_fullsized":"2024-03-17T23:56:06.710496+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_clean_scrub_stamp":"2024-03-17T23:55:59.626739+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T05:52:39.451210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:02.858191+0000","last_change":"2024-03-17T23:56:01.196364+0000","last_active":"2024-03-17T23:56:02.858191+0000","last_peered":"2024-03-17T23:56:02.858191+0000","last_clean":"2024-03-17T23:56:02.858191+0000","last_became_active":"2024-03-17T23:56:01.191450+0000","last_became_peered":"2024-03-17T23:56:01.191450+0000","last_unstale":"2024-03-17T23:56:02.858191+0000","last_undegraded":"2024-03-17T23:56:02.858191+0000","last_fullsized":"2024-03-17T23:56:02.858191+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T02:15:18.353466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"21'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:03.681131+0000","last_change":"2024-03-17T23:56:00.691812+0000","last_active":"2024-03-17T23:56:03.681131+0000","last_peered":"2024-03-17T23:56:03.681131+0000","last_clean":"2024-03-17T23:56:03.681131+0000","last_became_active":"2024-03-17T23:56:00.691381+0000","last_became_peered":"2024-03-17T23:56:00.691381+0000","last_unstale":"2024-03-17T23:56:03.681131+0000","last_undegraded":"2024-03-17T23:56:03.681131+0000","last_fullsized":"2024-03-17T23:56:03.681131+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_clean_scrub_stamp":"2024-03-17T23:55:59.626739+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T10:35:19.139554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:02.165033+0000","last_change":"2024-03-17T23:56:01.195278+0000","last_active":"2024-03-17T23:56:02.165033+0000","last_peered":"2024-03-17T23:56:02.165033+0000","last_clean":"2024-03-17T23:56:02.165033+0000","last_became_active":"2024-03-17T23:56:01.192316+0000","last_became_peered":"2024-03-17T23:56:01.192316+0000","last_unstale":"2024-03-17T23:56:02.165033+0000","last_undegraded":"2024-03-17T23:56:02.165033+0000","last_fullsized":"2024-03-17T23:56:02.165033+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T04:07:27.260081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"21'7","reported_seq":21,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:06.712038+0000","last_change":"2024-03-17T23:56:00.703680+0000","last_active":"2024-03-17T23:56:06.712038+0000","last_peered":"2024-03-17T23:56:06.712038+0000","last_clean":"2024-03-17T23:56:06.712038+0000","last_became_active":"2024-03-17T23:56:00.703439+0000","last_became_peered":"2024-03-17T23:56:00.703439+0000","last_unstale":"2024-03-17T23:56:06.712038+0000","last_undegraded":"2024-03-17T23:56:06.712038+0000","last_fullsized":"2024-03-17T23:56:06.712038+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_clean_scrub_stamp":"2024-03-17T23:55:59.626739+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T11:11:32.522234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:02.855387+0000","last_change":"2024-03-17T23:56:01.191678+0000","last_active":"2024-03-17T23:56:02.855387+0000","last_peered":"2024-03-17T23:56:02.855387+0000","last_clean":"2024-03-17T23:56:02.855387+0000","last_became_active":"2024-03-17T23:56:01.190681+0000","last_became_peered":"2024-03-17T23:56:01.190681+0000","last_unstale":"2024-03-17T23:56:02.855387+0000","last_undegraded":"2024-03-17T23:56:02.855387+0000","last_fullsized":"2024-03-17T23:56:02.855387+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T02:46:13.650384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"21'3","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:05.705455+0000","last_change":"2024-03-17T23:56:00.679281+0000","last_active":"2024-03-17T23:56:05.705455+0000","last_peered":"2024-03-17T23:56:05.705455+0000","last_clean":"2024-03-17T23:56:05.705455+0000","last_became_active":"2024-03-17T23:56:00.678950+0000","last_became_peered":"2024-03-17T23:56:00.678950+0000","last_unstale":"2024-03-17T23:56:05.705455+0000","last_undegraded":"2024-03-17T23:56:05.705455+0000","last_fullsized":"2024-03-17T23:56:05.705455+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_clean_scrub_stamp":"2024-03-17T23:55:59.626739+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T05:52:39.451210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:02.855656+0000","last_change":"2024-03-17T23:56:01.215539+0000","last_active":"2024-03-17T23:56:02.855656+0000","last_peered":"2024-03-17T23:56:02.855656+0000","last_clean":"2024-03-17T23:56:02.855656+0000","last_became_active":"2024-03-17T23:56:01.211163+0000","last_became_peered":"2024-03-17T23:56:01.211163+0000","last_unstale":"2024-03-17T23:56:02.855656+0000","last_undegraded":"2024-03-17T23:56:02.855656+0000","last_fullsized":"2024-03-17T23:56:02.855656+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T11:40:55.653472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"21'4","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:03.679557+0000","last_change":"2024-03-17T23:56:00.692384+0000","last_active":"2024-03-17T23:56:03.679557+0000","last_peered":"2024-03-17T23:56:03.679557+0000","last_clean":"2024-03-17T23:56:03.679557+0000","last_became_active":"2024-03-17T23:56:00.684178+0000","last_became_peered":"2024-03-17T23:56:00.684178+0000","last_unstale":"2024-03-17T23:56:03.679557+0000","last_undegraded":"2024-03-17T23:56:03.679557+0000","last_fullsized":"2024-03-17T23:56:03.679557+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_clean_scrub_stamp":"2024-03-17T23:55:59.626739+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T09:45:24.650866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:02.855803+0000","last_change":"2024-03-17T23:56:01.193547+0000","last_active":"2024-03-17T23:56:02.855803+0000","last_peered":"2024-03-17T23:56:02.855803+0000","last_clean":"2024-03-17T23:56:02.855803+0000","last_became_active":"2024-03-17T23:56:01.192775+0000","last_became_peered":"2024-03-17T23:56:01.192775+0000","last_unstale":"2024-03-17T23:56:02.855803+0000","last_undegraded":"2024-03-17T23:56:02.855803+0000","last_fullsized":"2024-03-17T23:56:02.855803+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T02:15:18.353466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:02.170196+0000","last_change":"2024-03-17T23:56:01.178436+0000","last_active":"2024-03-17T23:56:02.170196+0000","last_peered":"2024-03-17T23:56:02.170196+0000","last_clean":"2024-03-17T23:56:02.170196+0000","last_became_active":"2024-03-17T23:56:01.177533+0000","last_became_peered":"2024-03-17T23:56:01.177533+0000","last_unstale":"2024-03-17T23:56:02.170196+0000","last_undegraded":"2024-03-17T23:56:02.170196+0000","last_fullsized":"2024-03-17T23:56:02.170196+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T03:18:40.457769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"21'5","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:06.711424+0000","last_change":"2024-03-17T23:56:00.691483+0000","last_active":"2024-03-17T23:56:06.711424+0000","last_peered":"2024-03-17T23:56:06.711424+0000","last_clean":"2024-03-17T23:56:06.711424+0000","last_became_active":"2024-03-17T23:56:00.684714+0000","last_became_peered":"2024-03-17T23:56:00.684714+0000","last_unstale":"2024-03-17T23:56:06.711424+0000","last_undegraded":"2024-03-17T23:56:06.711424+0000","last_fullsized":"2024-03-17T23:56:06.711424+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_clean_scrub_stamp":"2024-03-17T23:55:59.626739+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T09:57:49.282635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:02.169948+0000","last_change":"2024-03-17T23:56:01.194350+0000","last_active":"2024-03-17T23:56:02.169948+0000","last_peered":"2024-03-17T23:56:02.169948+0000","last_clean":"2024-03-17T23:56:02.169948+0000","last_became_active":"2024-03-17T23:56:01.193625+0000","last_became_peered":"2024-03-17T23:56:01.193625+0000","last_unstale":"2024-03-17T23:56:02.169948+0000","last_undegraded":"2024-03-17T23:56:02.169948+0000","last_fullsized":"2024-03-17T23:56:02.169948+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T11:08:21.695552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"21'12","reported_seq":26,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:06.712804+0000","last_change":"2024-03-17T23:56:00.699785+0000","last_active":"2024-03-17T23:56:06.712804+0000","last_peered":"2024-03-17T23:56:06.712804+0000","last_clean":"2024-03-17T23:56:06.712804+0000","last_became_active":"2024-03-17T23:56:00.699049+0000","last_became_peered":"2024-03-17T23:56:00.699049+0000","last_unstale":"2024-03-17T23:56:06.712804+0000","last_undegraded":"2024-03-17T23:56:06.712804+0000","last_fullsized":"2024-03-17T23:56:06.712804+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_clean_scrub_stamp":"2024-03-17T23:55:59.626739+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T01:56:01.336865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:02.858502+0000","last_change":"2024-03-17T23:56:01.208117+0000","last_active":"2024-03-17T23:56:02.858502+0000","last_peered":"2024-03-17T23:56:02.858502+0000","last_clean":"2024-03-17T23:56:02.858502+0000","last_became_active":"2024-03-17T23:56:01.207342+0000","last_became_peered":"2024-03-17T23:56:01.207342+0000","last_unstale":"2024-03-17T23:56:02.858502+0000","last_undegraded":"2024-03-17T23:56:02.858502+0000","last_fullsized":"2024-03-17T23:56:02.858502+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T08:24:06.922044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"21'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:02.855982+0000","last_change":"2024-03-17T23:56:00.691595+0000","last_active":"2024-03-17T23:56:02.855982+0000","last_peered":"2024-03-17T23:56:02.855982+0000","last_clean":"2024-03-17T23:56:02.855982+0000","last_became_active":"2024-03-17T23:56:00.690892+0000","last_became_peered":"2024-03-17T23:56:00.690892+0000","last_unstale":"2024-03-17T23:56:02.855982+0000","last_undegraded":"2024-03-17T23:56:02.855982+0000","last_fullsized":"2024-03-17T23:56:02.855982+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_clean_scrub_stamp":"2024-03-17T23:55:59.626739+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T07:28:27.310340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:02.855919+0000","last_change":"2024-03-17T23:56:01.212430+0000","last_active":"2024-03-17T23:56:02.855919+0000","last_peered":"2024-03-17T23:56:02.855919+0000","last_clean":"2024-03-17T23:56:02.855919+0000","last_became_active":"2024-03-17T23:56:01.204930+0000","last_became_peered":"2024-03-17T23:56:01.204930+0000","last_unstale":"2024-03-17T23:56:02.855919+0000","last_undegraded":"2024-03-17T23:56:02.855919+0000","last_fullsized":"2024-03-17T23:56:02.855919+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T04:45:41.506781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"21'13","reported_seq":27,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:06.713168+0000","last_change":"2024-03-17T23:56:00.682405+0000","last_active":"2024-03-17T23:56:06.713168+0000","last_peered":"2024-03-17T23:56:06.713168+0000","last_clean":"2024-03-17T23:56:06.713168+0000","last_became_active":"2024-03-17T23:56:00.681938+0000","last_became_peered":"2024-03-17T23:56:00.681938+0000","last_unstale":"2024-03-17T23:56:06.713168+0000","last_undegraded":"2024-03-17T23:56:06.713168+0000","last_fullsized":"2024-03-17T23:56:06.713168+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_clean_scrub_stamp":"2024-03-17T23:55:59.626739+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T07:03:16.148691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":8034,"num_objects":98,"num_object_clones":0,"num_object_copies":196,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":205,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":262144,"data_stored":16068,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":179,"ondisk_log_size":179,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66348,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27328,"kb_used_data":312,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344512,"statfs":{"total":96636764160,"available":96608780288,"internally_reserved":0,"allocated":319488,"data_stored":668073,"data_compressed":33174,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":240,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":245760,"data_stored":78007,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574853,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":79537,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574855,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":241664,"data_stored":76935,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574856,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27260,"kb_used_data":244,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344580,"statfs":{"total":96636764160,"available":96608849920,"internally_reserved":0,"allocated":249856,"data_stored":78041,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574855,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27260,"kb_used_data":244,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344580,"statfs":{"total":96636764160,"available":96608849920,"internally_reserved":0,"allocated":249856,"data_stored":77067,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":240,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":245760,"data_stored":77137,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574853,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27320,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344520,"statfs":{"total":96636764160,"available":96608788480,"internally_reserved":0,"allocated":311296,"data_stored":666847,"data_compressed":33174,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33174,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33174,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":874,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1532,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3932,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2402,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":2100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-17T23:56:12.391 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-17T23:56:12.534 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:12.532+0000 7fdcd1394640 1 Processor -- start 2024-03-17T23:56:12.535 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:12.532+0000 7fdcd1394640 1 -- start start 2024-03-17T23:56:12.536 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:12.532+0000 7fdcd1394640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fdccc153f60 0x7fdccc0705f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:12.536 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:12.532+0000 7fdcd1394640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fdccc0c9470 0x7fdccc072c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:12.536 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:12.532+0000 7fdcd1394640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdccc15d5d0 con 0x7fdccc154340 2024-03-17T23:56:12.536 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:12.532+0000 7fdcd1394640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7fdccc072770 con 0x7fdccc0c9470 2024-03-17T23:56:12.536 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:12.532+0000 7fdcd1394640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 -- 0x7fdccc15d380 con 0x7fdccc153f60 2024-03-17T23:56:12.536 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:12.532+0000 7fdccb7fe640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fdccc0c9470 0x7fdccc072c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:12.537 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:12.532+0000 7fdccaffd640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fdccc153f60 0x7fdccc0705f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:12.537 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:12.532+0000 7fdccb7fe640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fdccc0c9470 0x7fdccc072c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.196:38020/0 (socket says 172.21.15.196:38020) 2024-03-17T23:56:12.537 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:12.532+0000 7fdccb7fe640 1 -- 172.21.15.196:0/3183121268 learned_addr learned my addr 172.21.15.196:0/3183121268 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-03-17T23:56:12.537 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:12.532+0000 7fdccb7fe640 1 -- 172.21.15.196:0/3183121268 >> v2:172.21.15.204:3300/0 conn(0x7fdccc153f60 msgr2=0x7fdccc0705f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-17T23:56:12.537 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:12.532+0000 7fdccb7fe640 1 --2- 172.21.15.196:0/3183121268 >> v2:172.21.15.204:3300/0 conn(0x7fdccc153f60 0x7fdccc0705f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:12.537 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:12.532+0000 7fdccb7fe640 1 -- 172.21.15.196:0/3183121268 >> v1:172.21.15.204:6789/0 conn(0x7fdccc154340 legacy=0x7fdccc0c8d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:12.537 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:12.532+0000 7fdccb7fe640 1 -- 172.21.15.196:0/3183121268 --> v2:172.21.15.196:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdccc15d8b0 con 0x7fdccc0c9470 2024-03-17T23:56:12.540 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:12.536+0000 7fdccb7fe640 1 --2- 172.21.15.196:0/3183121268 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fdccc0c9470 0x7fdccc072c00 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fdccc070580 tx=0x7fdcc401f1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed89435ee72adc40 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:56:12.540 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:12.536+0000 7fdcc9ffb640 1 -- 172.21.15.196:0/3183121268 <== mon.0 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcc40b4070 con 0x7fdccc0c9470 2024-03-17T23:56:12.540 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:12.536+0000 7fdcc9ffb640 1 -- 172.21.15.196:0/3183121268 <== mon.0 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdcc40af400 con 0x7fdccc0c9470 2024-03-17T23:56:12.540 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:12.536+0000 7fdcc9ffb640 1 -- 172.21.15.196:0/3183121268 <== mon.0 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcc40af7d0 con 0x7fdccc0c9470 2024-03-17T23:56:12.540 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:12.536+0000 7fdcd1394640 1 -- 172.21.15.196:0/3183121268 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fdccc0c9470 msgr2=0x7fdccc072c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:12.540 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:12.536+0000 7fdcd1394640 1 --2- 172.21.15.196:0/3183121268 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fdccc0c9470 0x7fdccc072c00 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fdccc070580 tx=0x7fdcc401f1e0 comp rx=0 tx=0).stop 2024-03-17T23:56:12.540 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:12.536+0000 7fdcd1394640 1 -- 172.21.15.196:0/3183121268 shutdown_connections 2024-03-17T23:56:12.540 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:12.536+0000 7fdcd1394640 1 --2- 172.21.15.196:0/3183121268 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fdccc0c9470 0x7fdccc072c00 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:12.541 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:12.536+0000 7fdcd1394640 1 --2- 172.21.15.196:0/3183121268 >> v2:172.21.15.204:3300/0 conn(0x7fdccc153f60 0x7fdccc0705f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:12.541 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:12.536+0000 7fdcd1394640 1 -- 172.21.15.196:0/3183121268 >> 172.21.15.196:0/3183121268 conn(0x7fdccc06c3c0 msgr2=0x7fdccc06c7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-17T23:56:12.541 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:12.536+0000 7fdcd1394640 1 -- 172.21.15.196:0/3183121268 shutdown_connections 2024-03-17T23:56:12.541 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:12.536+0000 7fdcd1394640 1 -- 172.21.15.196:0/3183121268 wait complete. 2024-03-17T23:56:12.541 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:12.540+0000 7fdcd1394640 1 Processor -- start 2024-03-17T23:56:12.541 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:12.540+0000 7fdcd1394640 1 -- start start 2024-03-17T23:56:12.544 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:12.540+0000 7fdcd1394640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fdccc0c9470 0x7fdccc159670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:12.545 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:12.540+0000 7fdcd1394640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fdccc153f60 0x7fdccc0c78b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:12.545 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:12.540+0000 7fdcd1394640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fdccc154340 0x7fdccc1efc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:12.545 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:12.540+0000 7fdcd1394640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fdccc15e150 con 0x7fdccc153f60 2024-03-17T23:56:12.545 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:12.540+0000 7fdcd1394640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7fdccc15de70 con 0x7fdccc154340 2024-03-17T23:56:12.545 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:12.540+0000 7fdcd1394640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7fdccc15aa70 con 0x7fdccc0c9470 2024-03-17T23:56:12.545 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:12.540+0000 7fdcca7fc640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fdccc153f60 0x7fdccc0c78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:12.545 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:12.540+0000 7fdcca7fc640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fdccc153f60 0x7fdccc0c78b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.196:38024/0 (socket says 172.21.15.196:38024) 2024-03-17T23:56:12.545 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:12.540+0000 7fdcca7fc640 1 -- 172.21.15.196:0/1678885686 learned_addr learned my addr 172.21.15.196:0/1678885686 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-03-17T23:56:12.546 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:12.540+0000 7fdccaffd640 1 --2- 172.21.15.196:0/1678885686 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fdccc0c9470 0x7fdccc159670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:12.546 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:12.540+0000 7fdccb7fe640 1 --2- 172.21.15.196:0/1678885686 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fdccc154340 0x7fdccc1efc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:12.546 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:12.540+0000 7fdcca7fc640 1 -- 172.21.15.196:0/1678885686 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fdccc0c9470 msgr2=0x7fdccc159670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:12.546 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:12.540+0000 7fdcca7fc640 1 --2- 172.21.15.196:0/1678885686 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fdccc0c9470 0x7fdccc159670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:12.546 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:12.540+0000 7fdcca7fc640 1 -- 172.21.15.196:0/1678885686 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fdccc154340 msgr2=0x7fdccc1efc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:12.546 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:12.540+0000 7fdcca7fc640 1 --2- 172.21.15.196:0/1678885686 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fdccc154340 0x7fdccc1efc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:12.546 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:12.540+0000 7fdcca7fc640 1 -- 172.21.15.196:0/1678885686 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdccc1f2eb0 con 0x7fdccc153f60 2024-03-17T23:56:12.546 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:12.540+0000 7fdccb7fe640 1 --2- 172.21.15.196:0/1678885686 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fdccc154340 0x7fdccc1efc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-17T23:56:12.546 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:12.540+0000 7fdcca7fc640 1 --2- 172.21.15.196:0/1678885686 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fdccc153f60 0x7fdccc0c78b0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fdcc000c3a0 tx=0x7fdcc000c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:56:12.547 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:12.540+0000 7fdcb37fe640 1 -- 172.21.15.196:0/1678885686 <== mon.0 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcc00052d0 con 0x7fdccc153f60 2024-03-17T23:56:12.547 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:12.540+0000 7fdcb37fe640 1 -- 172.21.15.196:0/1678885686 <== mon.0 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdcc0005470 con 0x7fdccc153f60 2024-03-17T23:56:12.547 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:12.540+0000 7fdcd1394640 1 -- 172.21.15.196:0/1678885686 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdccc1f3190 con 0x7fdccc153f60 2024-03-17T23:56:12.547 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:12.540+0000 7fdcb37fe640 1 -- 172.21.15.196:0/1678885686 <== mon.0 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcc0007260 con 0x7fdccc153f60 2024-03-17T23:56:12.547 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:12.540+0000 7fdcd1394640 1 -- 172.21.15.196:0/1678885686 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdccc1f3750 con 0x7fdccc153f60 2024-03-17T23:56:12.547 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:12.544+0000 7fdcb17fa640 1 -- 172.21.15.196:0/1678885686 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdca40052a0 con 0x7fdccc153f60 2024-03-17T23:56:12.548 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:12.544+0000 7fdcb37fe640 1 -- 172.21.15.196:0/1678885686 <== mon.0 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 5) ==== 87083+0+0 (secure 0 0 0) 0x7fdcc0007400 con 0x7fdccc153f60 2024-03-17T23:56:12.548 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:12.544+0000 7fdcb37fe640 1 --2- 172.21.15.196:0/1678885686 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7fdcb8067660 0x7fdcb8069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:12.548 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:12.544+0000 7fdcb37fe640 1 -- 172.21.15.196:0/1678885686 <== mon.0 v2:172.21.15.196:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fdcc0084bc0 con 0x7fdccc153f60 2024-03-17T23:56:12.548 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:12.544+0000 7fdccaffd640 1 --2- 172.21.15.196:0/1678885686 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7fdcb8067660 0x7fdcb8069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:12.548 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:12.544+0000 7fdccaffd640 1 --2- 172.21.15.196:0/1678885686 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7fdcb8067660 0x7fdcb8069b20 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fdcbc009b60 tx=0x7fdcbc009190 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:56:12.555 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:12.552+0000 7fdcb37fe640 1 -- 172.21.15.196:0/1678885686 <== mon.0 v2:172.21.15.196:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177849 (secure 0 0 0) 0x7fdcc0055280 con 0x7fdccc153f60 2024-03-17T23:56:12.754 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:12.752+0000 7fdcb17fa640 1 -- 172.21.15.196:0/1678885686 --> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fdca4000bd0 con 0x7fdcb8067660 2024-03-17T23:56:12.766 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:12.764+0000 7fdcb37fe640 1 -- 172.21.15.196:0/1678885686 <== mgr.4099 v2:172.21.15.204:6832/2505201055 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252007 (secure 0 0 0) 0x7fdca4000bd0 con 0x7fdcb8067660 2024-03-17T23:56:12.768 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-03-17T23:56:12.770 INFO:teuthology.orchestra.run.smithi196.stderr:dumped all 2024-03-17T23:56:12.771 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:12.768+0000 7fdcb17fa640 1 -- 172.21.15.196:0/1678885686 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7fdcb8067660 msgr2=0x7fdcb8069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:12.771 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:12.768+0000 7fdcb17fa640 1 --2- 172.21.15.196:0/1678885686 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7fdcb8067660 0x7fdcb8069b20 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fdcbc009b60 tx=0x7fdcbc009190 comp rx=0 tx=0).stop 2024-03-17T23:56:12.771 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:12.768+0000 7fdcb17fa640 1 -- 172.21.15.196:0/1678885686 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fdccc153f60 msgr2=0x7fdccc0c78b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:12.771 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:12.768+0000 7fdcb17fa640 1 --2- 172.21.15.196:0/1678885686 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fdccc153f60 0x7fdccc0c78b0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fdcc000c3a0 tx=0x7fdcc000c860 comp rx=0 tx=0).stop 2024-03-17T23:56:12.771 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:12.768+0000 7fdcb17fa640 1 -- 172.21.15.196:0/1678885686 shutdown_connections 2024-03-17T23:56:12.771 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:12.768+0000 7fdcb17fa640 1 --2- 172.21.15.196:0/1678885686 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7fdcb8067660 0x7fdcb8069b20 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:12.771 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:12.768+0000 7fdcb17fa640 1 --2- 172.21.15.196:0/1678885686 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fdccc154340 0x7fdccc1efc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:12.771 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:12.768+0000 7fdcb17fa640 1 --2- 172.21.15.196:0/1678885686 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fdccc153f60 0x7fdccc0c78b0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:12.772 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:12.768+0000 7fdcb17fa640 1 --2- 172.21.15.196:0/1678885686 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fdccc0c9470 0x7fdccc159670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:12.772 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:12.768+0000 7fdcb17fa640 1 -- 172.21.15.196:0/1678885686 >> 172.21.15.196:0/1678885686 conn(0x7fdccc06c3c0 msgr2=0x7fdccc151f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-17T23:56:12.772 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:12.768+0000 7fdcb17fa640 1 -- 172.21.15.196:0/1678885686 shutdown_connections 2024-03-17T23:56:12.772 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:12.768+0000 7fdcb17fa640 1 -- 172.21.15.196:0/1678885686 wait complete. 2024-03-17T23:56:12.791 INFO:teuthology.orchestra.run.smithi196.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2024-03-17T23:56:11.958638+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":598402,"num_objects":100,"num_object_clones":0,"num_object_copies":200,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":100,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":364,"num_write_kb":2478,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":296,"ondisk_log_size":296,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218208,"kb_used_data":2080,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754756512,"statfs":{"total":773094113280,"available":772870668288,"internally_reserved":0,"allocated":2129920,"data_stored":1801644,"data_compressed":66348,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12748,"internal_metadata":221236788},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":8034,"num_objects":98,"num_object_clones":0,"num_object_copies":196,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":205,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.003588"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:02.164060+0000","last_change":"2024-03-17T23:56:01.208245+0000","last_active":"2024-03-17T23:56:02.164060+0000","last_peered":"2024-03-17T23:56:02.164060+0000","last_clean":"2024-03-17T23:56:02.164060+0000","last_became_active":"2024-03-17T23:56:01.207533+0000","last_became_peered":"2024-03-17T23:56:01.207533+0000","last_unstale":"2024-03-17T23:56:02.164060+0000","last_undegraded":"2024-03-17T23:56:02.164060+0000","last_fullsized":"2024-03-17T23:56:02.164060+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T09:33:28.935701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:02.756375+0000","last_change":"2024-03-17T23:56:01.193546+0000","last_active":"2024-03-17T23:56:02.756375+0000","last_peered":"2024-03-17T23:56:02.756375+0000","last_clean":"2024-03-17T23:56:02.756375+0000","last_became_active":"2024-03-17T23:56:01.192736+0000","last_became_peered":"2024-03-17T23:56:01.192736+0000","last_unstale":"2024-03-17T23:56:02.756375+0000","last_undegraded":"2024-03-17T23:56:02.756375+0000","last_fullsized":"2024-03-17T23:56:02.756375+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T07:03:18.208772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:02.858181+0000","last_change":"2024-03-17T23:56:01.188859+0000","last_active":"2024-03-17T23:56:02.858181+0000","last_peered":"2024-03-17T23:56:02.858181+0000","last_clean":"2024-03-17T23:56:02.858181+0000","last_became_active":"2024-03-17T23:56:01.188339+0000","last_became_peered":"2024-03-17T23:56:01.188339+0000","last_unstale":"2024-03-17T23:56:02.858181+0000","last_undegraded":"2024-03-17T23:56:02.858181+0000","last_fullsized":"2024-03-17T23:56:02.858181+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T05:26:03.654839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:02.169804+0000","last_change":"2024-03-17T23:56:01.204810+0000","last_active":"2024-03-17T23:56:02.169804+0000","last_peered":"2024-03-17T23:56:02.169804+0000","last_clean":"2024-03-17T23:56:02.169804+0000","last_became_active":"2024-03-17T23:56:01.196978+0000","last_became_peered":"2024-03-17T23:56:01.196978+0000","last_unstale":"2024-03-17T23:56:02.169804+0000","last_undegraded":"2024-03-17T23:56:02.169804+0000","last_fullsized":"2024-03-17T23:56:02.169804+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T06:25:58.489959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:02.162704+0000","last_change":"2024-03-17T23:56:01.195423+0000","last_active":"2024-03-17T23:56:02.162704+0000","last_peered":"2024-03-17T23:56:02.162704+0000","last_clean":"2024-03-17T23:56:02.162704+0000","last_became_active":"2024-03-17T23:56:01.194710+0000","last_became_peered":"2024-03-17T23:56:01.194710+0000","last_unstale":"2024-03-17T23:56:02.162704+0000","last_undegraded":"2024-03-17T23:56:02.162704+0000","last_fullsized":"2024-03-17T23:56:02.162704+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T06:25:58.489959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:02.169622+0000","last_change":"2024-03-17T23:56:01.204633+0000","last_active":"2024-03-17T23:56:02.169622+0000","last_peered":"2024-03-17T23:56:02.169622+0000","last_clean":"2024-03-17T23:56:02.169622+0000","last_became_active":"2024-03-17T23:56:01.192908+0000","last_became_peered":"2024-03-17T23:56:01.192908+0000","last_unstale":"2024-03-17T23:56:02.169622+0000","last_undegraded":"2024-03-17T23:56:02.169622+0000","last_fullsized":"2024-03-17T23:56:02.169622+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T03:49:46.522282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:02.163588+0000","last_change":"2024-03-17T23:56:01.208861+0000","last_active":"2024-03-17T23:56:02.163588+0000","last_peered":"2024-03-17T23:56:02.163588+0000","last_clean":"2024-03-17T23:56:02.163588+0000","last_became_active":"2024-03-17T23:56:01.199550+0000","last_became_peered":"2024-03-17T23:56:01.199550+0000","last_unstale":"2024-03-17T23:56:02.163588+0000","last_undegraded":"2024-03-17T23:56:02.163588+0000","last_fullsized":"2024-03-17T23:56:02.163588+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T00:21:36.556648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:02.855187+0000","last_change":"2024-03-17T23:56:01.212574+0000","last_active":"2024-03-17T23:56:02.855187+0000","last_peered":"2024-03-17T23:56:02.855187+0000","last_clean":"2024-03-17T23:56:02.855187+0000","last_became_active":"2024-03-17T23:56:01.211860+0000","last_became_peered":"2024-03-17T23:56:01.211860+0000","last_unstale":"2024-03-17T23:56:02.855187+0000","last_undegraded":"2024-03-17T23:56:02.855187+0000","last_fullsized":"2024-03-17T23:56:02.855187+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T02:15:18.353466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:02.164413+0000","last_change":"2024-03-17T23:56:01.214731+0000","last_active":"2024-03-17T23:56:02.164413+0000","last_peered":"2024-03-17T23:56:02.164413+0000","last_clean":"2024-03-17T23:56:02.164413+0000","last_became_active":"2024-03-17T23:56:01.213795+0000","last_became_peered":"2024-03-17T23:56:01.213795+0000","last_unstale":"2024-03-17T23:56:02.164413+0000","last_undegraded":"2024-03-17T23:56:02.164413+0000","last_fullsized":"2024-03-17T23:56:02.164413+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T11:32:23.716236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:02.856823+0000","last_change":"2024-03-17T23:56:01.212409+0000","last_active":"2024-03-17T23:56:02.856823+0000","last_peered":"2024-03-17T23:56:02.856823+0000","last_clean":"2024-03-17T23:56:02.856823+0000","last_became_active":"2024-03-17T23:56:01.211620+0000","last_became_peered":"2024-03-17T23:56:01.211620+0000","last_unstale":"2024-03-17T23:56:02.856823+0000","last_undegraded":"2024-03-17T23:56:02.856823+0000","last_fullsized":"2024-03-17T23:56:02.856823+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T11:40:55.653472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:02.856758+0000","last_change":"2024-03-17T23:56:01.212568+0000","last_active":"2024-03-17T23:56:02.856758+0000","last_peered":"2024-03-17T23:56:02.856758+0000","last_clean":"2024-03-17T23:56:02.856758+0000","last_became_active":"2024-03-17T23:56:01.211561+0000","last_became_peered":"2024-03-17T23:56:01.211561+0000","last_unstale":"2024-03-17T23:56:02.856758+0000","last_undegraded":"2024-03-17T23:56:02.856758+0000","last_fullsized":"2024-03-17T23:56:02.856758+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T02:46:13.650384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:02.165562+0000","last_change":"2024-03-17T23:56:01.186811+0000","last_active":"2024-03-17T23:56:02.165562+0000","last_peered":"2024-03-17T23:56:02.165562+0000","last_clean":"2024-03-17T23:56:02.165562+0000","last_became_active":"2024-03-17T23:56:01.186012+0000","last_became_peered":"2024-03-17T23:56:01.186012+0000","last_unstale":"2024-03-17T23:56:02.165562+0000","last_undegraded":"2024-03-17T23:56:02.165562+0000","last_fullsized":"2024-03-17T23:56:02.165562+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T10:35:20.142750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:02.855904+0000","last_change":"2024-03-17T23:56:01.213648+0000","last_active":"2024-03-17T23:56:02.855904+0000","last_peered":"2024-03-17T23:56:02.855904+0000","last_clean":"2024-03-17T23:56:02.855904+0000","last_became_active":"2024-03-17T23:56:01.205058+0000","last_became_peered":"2024-03-17T23:56:01.205058+0000","last_unstale":"2024-03-17T23:56:02.855904+0000","last_undegraded":"2024-03-17T23:56:02.855904+0000","last_fullsized":"2024-03-17T23:56:02.855904+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T03:49:46.522282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:02.857959+0000","last_change":"2024-03-17T23:56:01.196817+0000","last_active":"2024-03-17T23:56:02.857959+0000","last_peered":"2024-03-17T23:56:02.857959+0000","last_clean":"2024-03-17T23:56:02.857959+0000","last_became_active":"2024-03-17T23:56:01.195960+0000","last_became_peered":"2024-03-17T23:56:01.195960+0000","last_unstale":"2024-03-17T23:56:02.857959+0000","last_undegraded":"2024-03-17T23:56:02.857959+0000","last_fullsized":"2024-03-17T23:56:02.857959+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T10:13:51.662432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:02.756001+0000","last_change":"2024-03-17T23:56:01.182140+0000","last_active":"2024-03-17T23:56:02.756001+0000","last_peered":"2024-03-17T23:56:02.756001+0000","last_clean":"2024-03-17T23:56:02.756001+0000","last_became_active":"2024-03-17T23:56:01.181405+0000","last_became_peered":"2024-03-17T23:56:01.181405+0000","last_unstale":"2024-03-17T23:56:02.756001+0000","last_undegraded":"2024-03-17T23:56:02.756001+0000","last_fullsized":"2024-03-17T23:56:02.756001+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T02:46:13.650384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:02.169320+0000","last_change":"2024-03-17T23:56:01.194871+0000","last_active":"2024-03-17T23:56:02.169320+0000","last_peered":"2024-03-17T23:56:02.169320+0000","last_clean":"2024-03-17T23:56:02.169320+0000","last_became_active":"2024-03-17T23:56:01.193384+0000","last_became_peered":"2024-03-17T23:56:01.193384+0000","last_unstale":"2024-03-17T23:56:02.169320+0000","last_undegraded":"2024-03-17T23:56:02.169320+0000","last_fullsized":"2024-03-17T23:56:02.169320+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T11:40:55.653472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:02.170892+0000","last_change":"2024-03-17T23:56:01.209960+0000","last_active":"2024-03-17T23:56:02.170892+0000","last_peered":"2024-03-17T23:56:02.170892+0000","last_clean":"2024-03-17T23:56:02.170892+0000","last_became_active":"2024-03-17T23:56:01.209291+0000","last_became_peered":"2024-03-17T23:56:01.209291+0000","last_unstale":"2024-03-17T23:56:02.170892+0000","last_undegraded":"2024-03-17T23:56:02.170892+0000","last_fullsized":"2024-03-17T23:56:02.170892+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T03:01:01.120023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:02.355033+0000","last_change":"2024-03-17T23:56:01.186830+0000","last_active":"2024-03-17T23:56:02.355033+0000","last_peered":"2024-03-17T23:56:02.355033+0000","last_clean":"2024-03-17T23:56:02.355033+0000","last_became_active":"2024-03-17T23:56:01.186001+0000","last_became_peered":"2024-03-17T23:56:01.186001+0000","last_unstale":"2024-03-17T23:56:02.355033+0000","last_undegraded":"2024-03-17T23:56:02.355033+0000","last_fullsized":"2024-03-17T23:56:02.355033+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T01:56:02.340062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:02.163525+0000","last_change":"2024-03-17T23:56:01.195354+0000","last_active":"2024-03-17T23:56:02.163525+0000","last_peered":"2024-03-17T23:56:02.163525+0000","last_clean":"2024-03-17T23:56:02.163525+0000","last_became_active":"2024-03-17T23:56:01.194579+0000","last_became_peered":"2024-03-17T23:56:01.194579+0000","last_unstale":"2024-03-17T23:56:02.163525+0000","last_undegraded":"2024-03-17T23:56:02.163525+0000","last_fullsized":"2024-03-17T23:56:02.163525+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T07:53:44.598091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:02.855890+0000","last_change":"2024-03-17T23:56:01.193429+0000","last_active":"2024-03-17T23:56:02.855890+0000","last_peered":"2024-03-17T23:56:02.855890+0000","last_clean":"2024-03-17T23:56:02.855890+0000","last_became_active":"2024-03-17T23:56:01.192711+0000","last_became_peered":"2024-03-17T23:56:01.192711+0000","last_unstale":"2024-03-17T23:56:02.855890+0000","last_undegraded":"2024-03-17T23:56:02.855890+0000","last_fullsized":"2024-03-17T23:56:02.855890+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T08:24:06.922044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:02.858321+0000","last_change":"2024-03-17T23:56:01.203203+0000","last_active":"2024-03-17T23:56:02.858321+0000","last_peered":"2024-03-17T23:56:02.858321+0000","last_clean":"2024-03-17T23:56:02.858321+0000","last_became_active":"2024-03-17T23:56:01.202491+0000","last_became_peered":"2024-03-17T23:56:01.202491+0000","last_unstale":"2024-03-17T23:56:02.858321+0000","last_undegraded":"2024-03-17T23:56:02.858321+0000","last_fullsized":"2024-03-17T23:56:02.858321+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T11:35:21.037222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:02.169686+0000","last_change":"2024-03-17T23:56:01.215437+0000","last_active":"2024-03-17T23:56:02.169686+0000","last_peered":"2024-03-17T23:56:02.169686+0000","last_clean":"2024-03-17T23:56:02.169686+0000","last_became_active":"2024-03-17T23:56:01.214127+0000","last_became_peered":"2024-03-17T23:56:01.214127+0000","last_unstale":"2024-03-17T23:56:02.169686+0000","last_undegraded":"2024-03-17T23:56:02.169686+0000","last_fullsized":"2024-03-17T23:56:02.169686+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T04:45:41.506781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:02.855523+0000","last_change":"2024-03-17T23:56:01.213157+0000","last_active":"2024-03-17T23:56:02.855523+0000","last_peered":"2024-03-17T23:56:02.855523+0000","last_clean":"2024-03-17T23:56:02.855523+0000","last_became_active":"2024-03-17T23:56:01.205601+0000","last_became_peered":"2024-03-17T23:56:01.205601+0000","last_unstale":"2024-03-17T23:56:02.855523+0000","last_undegraded":"2024-03-17T23:56:02.855523+0000","last_fullsized":"2024-03-17T23:56:02.855523+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T00:26:55.287891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:02.169576+0000","last_change":"2024-03-17T23:56:01.194995+0000","last_active":"2024-03-17T23:56:02.169576+0000","last_peered":"2024-03-17T23:56:02.169576+0000","last_clean":"2024-03-17T23:56:02.169576+0000","last_became_active":"2024-03-17T23:56:01.194290+0000","last_became_peered":"2024-03-17T23:56:01.194290+0000","last_unstale":"2024-03-17T23:56:02.169576+0000","last_undegraded":"2024-03-17T23:56:02.169576+0000","last_fullsized":"2024-03-17T23:56:02.169576+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T07:03:18.208772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:02.856011+0000","last_change":"2024-03-17T23:56:01.205233+0000","last_active":"2024-03-17T23:56:02.856011+0000","last_peered":"2024-03-17T23:56:02.856011+0000","last_clean":"2024-03-17T23:56:02.856011+0000","last_became_active":"2024-03-17T23:56:01.204456+0000","last_became_peered":"2024-03-17T23:56:01.204456+0000","last_unstale":"2024-03-17T23:56:02.856011+0000","last_undegraded":"2024-03-17T23:56:02.856011+0000","last_fullsized":"2024-03-17T23:56:02.856011+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T06:25:58.489959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:02.856820+0000","last_change":"2024-03-17T23:56:01.210984+0000","last_active":"2024-03-17T23:56:02.856820+0000","last_peered":"2024-03-17T23:56:02.856820+0000","last_clean":"2024-03-17T23:56:02.856820+0000","last_became_active":"2024-03-17T23:56:01.210025+0000","last_became_peered":"2024-03-17T23:56:01.210025+0000","last_unstale":"2024-03-17T23:56:02.856820+0000","last_undegraded":"2024-03-17T23:56:02.856820+0000","last_fullsized":"2024-03-17T23:56:02.856820+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T00:26:55.287891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:02.756301+0000","last_change":"2024-03-17T23:56:01.205461+0000","last_active":"2024-03-17T23:56:02.756301+0000","last_peered":"2024-03-17T23:56:02.756301+0000","last_clean":"2024-03-17T23:56:02.756301+0000","last_became_active":"2024-03-17T23:56:01.204676+0000","last_became_peered":"2024-03-17T23:56:01.204676+0000","last_unstale":"2024-03-17T23:56:02.756301+0000","last_undegraded":"2024-03-17T23:56:02.756301+0000","last_fullsized":"2024-03-17T23:56:02.756301+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T11:40:55.653472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:02.855842+0000","last_change":"2024-03-17T23:56:01.205530+0000","last_active":"2024-03-17T23:56:02.855842+0000","last_peered":"2024-03-17T23:56:02.855842+0000","last_clean":"2024-03-17T23:56:02.855842+0000","last_became_active":"2024-03-17T23:56:01.204637+0000","last_became_peered":"2024-03-17T23:56:01.204637+0000","last_unstale":"2024-03-17T23:56:02.855842+0000","last_undegraded":"2024-03-17T23:56:02.855842+0000","last_fullsized":"2024-03-17T23:56:02.855842+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T07:03:18.208772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:02.858534+0000","last_change":"2024-03-17T23:56:01.207143+0000","last_active":"2024-03-17T23:56:02.858534+0000","last_peered":"2024-03-17T23:56:02.858534+0000","last_clean":"2024-03-17T23:56:02.858534+0000","last_became_active":"2024-03-17T23:56:01.206466+0000","last_became_peered":"2024-03-17T23:56:01.206466+0000","last_unstale":"2024-03-17T23:56:02.858534+0000","last_undegraded":"2024-03-17T23:56:02.858534+0000","last_fullsized":"2024-03-17T23:56:02.858534+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T02:46:13.650384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:02.170795+0000","last_change":"2024-03-17T23:56:01.205414+0000","last_active":"2024-03-17T23:56:02.170795+0000","last_peered":"2024-03-17T23:56:02.170795+0000","last_clean":"2024-03-17T23:56:02.170795+0000","last_became_active":"2024-03-17T23:56:01.204418+0000","last_became_peered":"2024-03-17T23:56:01.204418+0000","last_unstale":"2024-03-17T23:56:02.170795+0000","last_undegraded":"2024-03-17T23:56:02.170795+0000","last_fullsized":"2024-03-17T23:56:02.170795+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T03:59:56.032635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:02.354820+0000","last_change":"2024-03-17T23:56:01.213242+0000","last_active":"2024-03-17T23:56:02.354820+0000","last_peered":"2024-03-17T23:56:02.354820+0000","last_clean":"2024-03-17T23:56:02.354820+0000","last_became_active":"2024-03-17T23:56:01.212456+0000","last_became_peered":"2024-03-17T23:56:01.212456+0000","last_unstale":"2024-03-17T23:56:02.354820+0000","last_undegraded":"2024-03-17T23:56:02.354820+0000","last_fullsized":"2024-03-17T23:56:02.354820+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T11:11:33.525431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:02.855686+0000","last_change":"2024-03-17T23:56:01.197502+0000","last_active":"2024-03-17T23:56:02.855686+0000","last_peered":"2024-03-17T23:56:02.855686+0000","last_clean":"2024-03-17T23:56:02.855686+0000","last_became_active":"2024-03-17T23:56:01.196672+0000","last_became_peered":"2024-03-17T23:56:01.196672+0000","last_unstale":"2024-03-17T23:56:02.855686+0000","last_undegraded":"2024-03-17T23:56:02.855686+0000","last_fullsized":"2024-03-17T23:56:02.855686+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T05:26:03.654839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:02.165727+0000","last_change":"2024-03-17T23:56:01.169196+0000","last_active":"2024-03-17T23:56:02.165727+0000","last_peered":"2024-03-17T23:56:02.165727+0000","last_clean":"2024-03-17T23:56:02.165727+0000","last_became_active":"2024-03-17T23:56:01.168199+0000","last_became_peered":"2024-03-17T23:56:01.168199+0000","last_unstale":"2024-03-17T23:56:02.165727+0000","last_undegraded":"2024-03-17T23:56:02.165727+0000","last_fullsized":"2024-03-17T23:56:02.165727+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T11:11:33.525431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"21'5","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:03.681175+0000","last_change":"2024-03-17T23:56:00.675134+0000","last_active":"2024-03-17T23:56:03.681175+0000","last_peered":"2024-03-17T23:56:03.681175+0000","last_clean":"2024-03-17T23:56:03.681175+0000","last_became_active":"2024-03-17T23:56:00.674772+0000","last_became_peered":"2024-03-17T23:56:00.674772+0000","last_unstale":"2024-03-17T23:56:03.681175+0000","last_undegraded":"2024-03-17T23:56:03.681175+0000","last_fullsized":"2024-03-17T23:56:03.681175+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_clean_scrub_stamp":"2024-03-17T23:55:59.626739+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T07:03:16.148691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:02.858578+0000","last_change":"2024-03-17T23:56:01.199837+0000","last_active":"2024-03-17T23:56:02.858578+0000","last_peered":"2024-03-17T23:56:02.858578+0000","last_clean":"2024-03-17T23:56:02.858578+0000","last_became_active":"2024-03-17T23:56:01.199084+0000","last_became_peered":"2024-03-17T23:56:01.199084+0000","last_unstale":"2024-03-17T23:56:02.858578+0000","last_undegraded":"2024-03-17T23:56:02.858578+0000","last_fullsized":"2024-03-17T23:56:02.858578+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T00:26:55.287891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"21'7","reported_seq":21,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:05.699286+0000","last_change":"2024-03-17T23:56:00.683252+0000","last_active":"2024-03-17T23:56:05.699286+0000","last_peered":"2024-03-17T23:56:05.699286+0000","last_clean":"2024-03-17T23:56:05.699286+0000","last_became_active":"2024-03-17T23:56:00.682487+0000","last_became_peered":"2024-03-17T23:56:00.682487+0000","last_unstale":"2024-03-17T23:56:05.699286+0000","last_undegraded":"2024-03-17T23:56:05.699286+0000","last_fullsized":"2024-03-17T23:56:05.699286+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_clean_scrub_stamp":"2024-03-17T23:55:59.626739+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T04:07:26.256885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"21'3","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:04.690098+0000","last_change":"2024-03-17T23:56:00.688353+0000","last_active":"2024-03-17T23:56:04.690098+0000","last_peered":"2024-03-17T23:56:04.690098+0000","last_clean":"2024-03-17T23:56:04.690098+0000","last_became_active":"2024-03-17T23:56:00.688016+0000","last_became_peered":"2024-03-17T23:56:00.688016+0000","last_unstale":"2024-03-17T23:56:04.690098+0000","last_undegraded":"2024-03-17T23:56:04.690098+0000","last_fullsized":"2024-03-17T23:56:04.690098+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_clean_scrub_stamp":"2024-03-17T23:55:59.626739+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T09:07:52.005791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:02.855275+0000","last_change":"2024-03-17T23:56:01.211541+0000","last_active":"2024-03-17T23:56:02.855275+0000","last_peered":"2024-03-17T23:56:02.855275+0000","last_clean":"2024-03-17T23:56:02.855275+0000","last_became_active":"2024-03-17T23:56:01.205709+0000","last_became_peered":"2024-03-17T23:56:01.205709+0000","last_unstale":"2024-03-17T23:56:02.855275+0000","last_undegraded":"2024-03-17T23:56:02.855275+0000","last_fullsized":"2024-03-17T23:56:02.855275+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T11:35:21.037222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"21'3","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:05.698637+0000","last_change":"2024-03-17T23:56:00.690234+0000","last_active":"2024-03-17T23:56:05.698637+0000","last_peered":"2024-03-17T23:56:05.698637+0000","last_clean":"2024-03-17T23:56:05.698637+0000","last_became_active":"2024-03-17T23:56:00.689202+0000","last_became_peered":"2024-03-17T23:56:00.689202+0000","last_unstale":"2024-03-17T23:56:05.698637+0000","last_undegraded":"2024-03-17T23:56:05.698637+0000","last_fullsized":"2024-03-17T23:56:05.698637+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_clean_scrub_stamp":"2024-03-17T23:55:59.626739+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T05:52:39.451210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:02.755906+0000","last_change":"2024-03-17T23:56:01.194109+0000","last_active":"2024-03-17T23:56:02.755906+0000","last_peered":"2024-03-17T23:56:02.755906+0000","last_clean":"2024-03-17T23:56:02.755906+0000","last_became_active":"2024-03-17T23:56:01.192420+0000","last_became_peered":"2024-03-17T23:56:01.192420+0000","last_unstale":"2024-03-17T23:56:02.755906+0000","last_undegraded":"2024-03-17T23:56:02.755906+0000","last_fullsized":"2024-03-17T23:56:02.755906+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T08:24:06.922044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"21'4","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:03.685236+0000","last_change":"2024-03-17T23:56:00.696649+0000","last_active":"2024-03-17T23:56:03.685236+0000","last_peered":"2024-03-17T23:56:03.685236+0000","last_clean":"2024-03-17T23:56:03.685236+0000","last_became_active":"2024-03-17T23:56:00.696307+0000","last_became_peered":"2024-03-17T23:56:00.696307+0000","last_unstale":"2024-03-17T23:56:03.685236+0000","last_undegraded":"2024-03-17T23:56:03.685236+0000","last_fullsized":"2024-03-17T23:56:03.685236+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_clean_scrub_stamp":"2024-03-17T23:55:59.626739+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T07:28:27.310340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:02.170611+0000","last_change":"2024-03-17T23:56:01.194103+0000","last_active":"2024-03-17T23:56:02.170611+0000","last_peered":"2024-03-17T23:56:02.170611+0000","last_clean":"2024-03-17T23:56:02.170611+0000","last_became_active":"2024-03-17T23:56:01.193354+0000","last_became_peered":"2024-03-17T23:56:01.193354+0000","last_unstale":"2024-03-17T23:56:02.170611+0000","last_undegraded":"2024-03-17T23:56:02.170611+0000","last_fullsized":"2024-03-17T23:56:02.170611+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T00:21:36.556648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"21'4","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:06.710774+0000","last_change":"2024-03-17T23:56:00.689876+0000","last_active":"2024-03-17T23:56:06.710774+0000","last_peered":"2024-03-17T23:56:06.710774+0000","last_clean":"2024-03-17T23:56:06.710774+0000","last_became_active":"2024-03-17T23:56:00.688667+0000","last_became_peered":"2024-03-17T23:56:00.688667+0000","last_unstale":"2024-03-17T23:56:06.710774+0000","last_undegraded":"2024-03-17T23:56:06.710774+0000","last_fullsized":"2024-03-17T23:56:06.710774+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_clean_scrub_stamp":"2024-03-17T23:55:59.626739+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T09:45:24.650866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:02.858681+0000","last_change":"2024-03-17T23:56:01.215247+0000","last_active":"2024-03-17T23:56:02.858681+0000","last_peered":"2024-03-17T23:56:02.858681+0000","last_clean":"2024-03-17T23:56:02.858681+0000","last_became_active":"2024-03-17T23:56:01.214438+0000","last_became_peered":"2024-03-17T23:56:01.214438+0000","last_unstale":"2024-03-17T23:56:02.858681+0000","last_undegraded":"2024-03-17T23:56:02.858681+0000","last_fullsized":"2024-03-17T23:56:02.858681+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T11:40:55.653472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"21'5","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:03.685323+0000","last_change":"2024-03-17T23:56:00.677495+0000","last_active":"2024-03-17T23:56:03.685323+0000","last_peered":"2024-03-17T23:56:03.685323+0000","last_clean":"2024-03-17T23:56:03.685323+0000","last_became_active":"2024-03-17T23:56:00.677165+0000","last_became_peered":"2024-03-17T23:56:00.677165+0000","last_unstale":"2024-03-17T23:56:03.685323+0000","last_undegraded":"2024-03-17T23:56:03.685323+0000","last_fullsized":"2024-03-17T23:56:03.685323+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_clean_scrub_stamp":"2024-03-17T23:55:59.626739+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T04:07:26.256885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:02.165606+0000","last_change":"2024-03-17T23:56:01.190913+0000","last_active":"2024-03-17T23:56:02.165606+0000","last_peered":"2024-03-17T23:56:02.165606+0000","last_clean":"2024-03-17T23:56:02.165606+0000","last_became_active":"2024-03-17T23:56:01.190191+0000","last_became_peered":"2024-03-17T23:56:01.190191+0000","last_unstale":"2024-03-17T23:56:02.165606+0000","last_undegraded":"2024-03-17T23:56:02.165606+0000","last_fullsized":"2024-03-17T23:56:02.165606+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T09:57:50.285832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"21'10","reported_seq":24,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:06.711421+0000","last_change":"2024-03-17T23:56:00.686597+0000","last_active":"2024-03-17T23:56:06.711421+0000","last_peered":"2024-03-17T23:56:06.711421+0000","last_clean":"2024-03-17T23:56:06.711421+0000","last_became_active":"2024-03-17T23:56:00.685757+0000","last_became_peered":"2024-03-17T23:56:00.685757+0000","last_unstale":"2024-03-17T23:56:06.711421+0000","last_undegraded":"2024-03-17T23:56:06.711421+0000","last_fullsized":"2024-03-17T23:56:06.711421+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_clean_scrub_stamp":"2024-03-17T23:55:59.626739+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T10:35:19.139554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:02.162892+0000","last_change":"2024-03-17T23:56:01.216238+0000","last_active":"2024-03-17T23:56:02.162892+0000","last_peered":"2024-03-17T23:56:02.162892+0000","last_clean":"2024-03-17T23:56:02.162892+0000","last_became_active":"2024-03-17T23:56:01.215526+0000","last_became_peered":"2024-03-17T23:56:01.215526+0000","last_unstale":"2024-03-17T23:56:02.162892+0000","last_undegraded":"2024-03-17T23:56:02.162892+0000","last_fullsized":"2024-03-17T23:56:02.162892+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T03:18:40.457769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"21'9","reported_seq":23,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:06.709365+0000","last_change":"2024-03-17T23:56:00.682756+0000","last_active":"2024-03-17T23:56:06.709365+0000","last_peered":"2024-03-17T23:56:06.709365+0000","last_clean":"2024-03-17T23:56:06.709365+0000","last_became_active":"2024-03-17T23:56:00.682392+0000","last_became_peered":"2024-03-17T23:56:00.682392+0000","last_unstale":"2024-03-17T23:56:06.709365+0000","last_undegraded":"2024-03-17T23:56:06.709365+0000","last_fullsized":"2024-03-17T23:56:06.709365+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_clean_scrub_stamp":"2024-03-17T23:55:59.626739+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T04:54:08.515514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:02.858030+0000","last_change":"2024-03-17T23:56:01.218114+0000","last_active":"2024-03-17T23:56:02.858030+0000","last_peered":"2024-03-17T23:56:02.858030+0000","last_clean":"2024-03-17T23:56:02.858030+0000","last_became_active":"2024-03-17T23:56:01.217434+0000","last_became_peered":"2024-03-17T23:56:01.217434+0000","last_unstale":"2024-03-17T23:56:02.858030+0000","last_undegraded":"2024-03-17T23:56:02.858030+0000","last_fullsized":"2024-03-17T23:56:02.858030+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T06:56:40.687109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"21'5","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:05.694982+0000","last_change":"2024-03-17T23:56:00.696766+0000","last_active":"2024-03-17T23:56:05.694982+0000","last_peered":"2024-03-17T23:56:05.694982+0000","last_clean":"2024-03-17T23:56:05.694982+0000","last_became_active":"2024-03-17T23:56:00.695592+0000","last_became_peered":"2024-03-17T23:56:00.695592+0000","last_unstale":"2024-03-17T23:56:05.694982+0000","last_undegraded":"2024-03-17T23:56:05.694982+0000","last_fullsized":"2024-03-17T23:56:05.694982+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_clean_scrub_stamp":"2024-03-17T23:55:59.626739+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T04:07:26.256885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:02.162832+0000","last_change":"2024-03-17T23:56:01.208385+0000","last_active":"2024-03-17T23:56:02.162832+0000","last_peered":"2024-03-17T23:56:02.162832+0000","last_clean":"2024-03-17T23:56:02.162832+0000","last_became_active":"2024-03-17T23:56:01.207791+0000","last_became_peered":"2024-03-17T23:56:01.207791+0000","last_unstale":"2024-03-17T23:56:02.162832+0000","last_undegraded":"2024-03-17T23:56:02.162832+0000","last_fullsized":"2024-03-17T23:56:02.162832+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T11:08:21.695552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"21'5","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:05.698896+0000","last_change":"2024-03-17T23:56:00.686159+0000","last_active":"2024-03-17T23:56:05.698896+0000","last_peered":"2024-03-17T23:56:05.698896+0000","last_clean":"2024-03-17T23:56:05.698896+0000","last_became_active":"2024-03-17T23:56:00.685354+0000","last_became_peered":"2024-03-17T23:56:00.685354+0000","last_unstale":"2024-03-17T23:56:05.698896+0000","last_undegraded":"2024-03-17T23:56:05.698896+0000","last_fullsized":"2024-03-17T23:56:05.698896+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_clean_scrub_stamp":"2024-03-17T23:55:59.626739+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T09:45:24.650866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:02.855800+0000","last_change":"2024-03-17T23:56:01.197137+0000","last_active":"2024-03-17T23:56:02.855800+0000","last_peered":"2024-03-17T23:56:02.855800+0000","last_clean":"2024-03-17T23:56:02.855800+0000","last_became_active":"2024-03-17T23:56:01.196356+0000","last_became_peered":"2024-03-17T23:56:01.196356+0000","last_unstale":"2024-03-17T23:56:02.855800+0000","last_undegraded":"2024-03-17T23:56:02.855800+0000","last_fullsized":"2024-03-17T23:56:02.855800+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T11:35:21.037222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"21'17","reported_seq":31,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:05.703884+0000","last_change":"2024-03-17T23:56:00.682828+0000","last_active":"2024-03-17T23:56:05.703884+0000","last_peered":"2024-03-17T23:56:05.703884+0000","last_clean":"2024-03-17T23:56:05.703884+0000","last_became_active":"2024-03-17T23:56:00.682469+0000","last_became_peered":"2024-03-17T23:56:00.682469+0000","last_unstale":"2024-03-17T23:56:05.703884+0000","last_undegraded":"2024-03-17T23:56:05.703884+0000","last_fullsized":"2024-03-17T23:56:05.703884+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_clean_scrub_stamp":"2024-03-17T23:55:59.626739+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T05:52:39.451210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:02.163955+0000","last_change":"2024-03-17T23:56:01.209356+0000","last_active":"2024-03-17T23:56:02.163955+0000","last_peered":"2024-03-17T23:56:02.163955+0000","last_clean":"2024-03-17T23:56:02.163955+0000","last_became_active":"2024-03-17T23:56:01.208381+0000","last_became_peered":"2024-03-17T23:56:01.208381+0000","last_unstale":"2024-03-17T23:56:02.163955+0000","last_undegraded":"2024-03-17T23:56:02.163955+0000","last_fullsized":"2024-03-17T23:56:02.163955+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T03:01:01.120023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"21'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:02.165932+0000","last_change":"2024-03-17T23:56:00.683595+0000","last_active":"2024-03-17T23:56:02.165932+0000","last_peered":"2024-03-17T23:56:02.165932+0000","last_clean":"2024-03-17T23:56:02.165932+0000","last_became_active":"2024-03-17T23:56:00.681338+0000","last_became_peered":"2024-03-17T23:56:00.681338+0000","last_unstale":"2024-03-17T23:56:02.165932+0000","last_undegraded":"2024-03-17T23:56:02.165932+0000","last_fullsized":"2024-03-17T23:56:02.165932+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_clean_scrub_stamp":"2024-03-17T23:55:59.626739+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T08:58:55.725638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:02.163647+0000","last_change":"2024-03-17T23:56:01.212669+0000","last_active":"2024-03-17T23:56:02.163647+0000","last_peered":"2024-03-17T23:56:02.163647+0000","last_clean":"2024-03-17T23:56:02.163647+0000","last_became_active":"2024-03-17T23:56:01.206691+0000","last_became_peered":"2024-03-17T23:56:01.206691+0000","last_unstale":"2024-03-17T23:56:02.163647+0000","last_undegraded":"2024-03-17T23:56:02.163647+0000","last_fullsized":"2024-03-17T23:56:02.163647+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T03:59:56.032635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"21'5","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:06.712346+0000","last_change":"2024-03-17T23:56:00.690801+0000","last_active":"2024-03-17T23:56:06.712346+0000","last_peered":"2024-03-17T23:56:06.712346+0000","last_clean":"2024-03-17T23:56:06.712346+0000","last_became_active":"2024-03-17T23:56:00.690516+0000","last_became_peered":"2024-03-17T23:56:00.690516+0000","last_unstale":"2024-03-17T23:56:06.712346+0000","last_undegraded":"2024-03-17T23:56:06.712346+0000","last_fullsized":"2024-03-17T23:56:06.712346+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_clean_scrub_stamp":"2024-03-17T23:55:59.626739+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T09:07:52.005791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:02.164761+0000","last_change":"2024-03-17T23:56:01.213733+0000","last_active":"2024-03-17T23:56:02.164761+0000","last_peered":"2024-03-17T23:56:02.164761+0000","last_clean":"2024-03-17T23:56:02.164761+0000","last_became_active":"2024-03-17T23:56:01.213095+0000","last_became_peered":"2024-03-17T23:56:01.213095+0000","last_unstale":"2024-03-17T23:56:02.164761+0000","last_undegraded":"2024-03-17T23:56:02.164761+0000","last_fullsized":"2024-03-17T23:56:02.164761+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T08:57:40.944494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"21'3","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:05.703188+0000","last_change":"2024-03-17T23:56:00.672267+0000","last_active":"2024-03-17T23:56:05.703188+0000","last_peered":"2024-03-17T23:56:05.703188+0000","last_clean":"2024-03-17T23:56:05.703188+0000","last_became_active":"2024-03-17T23:56:00.671655+0000","last_became_peered":"2024-03-17T23:56:00.671655+0000","last_unstale":"2024-03-17T23:56:05.703188+0000","last_undegraded":"2024-03-17T23:56:05.703188+0000","last_fullsized":"2024-03-17T23:56:05.703188+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_clean_scrub_stamp":"2024-03-17T23:55:59.626739+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T09:45:24.650866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:02.170496+0000","last_change":"2024-03-17T23:56:01.204789+0000","last_active":"2024-03-17T23:56:02.170496+0000","last_peered":"2024-03-17T23:56:02.170496+0000","last_clean":"2024-03-17T23:56:02.170496+0000","last_became_active":"2024-03-17T23:56:01.196002+0000","last_became_peered":"2024-03-17T23:56:01.196002+0000","last_unstale":"2024-03-17T23:56:02.170496+0000","last_undegraded":"2024-03-17T23:56:02.170496+0000","last_fullsized":"2024-03-17T23:56:02.170496+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T07:53:44.598091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"21'5","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:05.698947+0000","last_change":"2024-03-17T23:56:00.679054+0000","last_active":"2024-03-17T23:56:05.698947+0000","last_peered":"2024-03-17T23:56:05.698947+0000","last_clean":"2024-03-17T23:56:05.698947+0000","last_became_active":"2024-03-17T23:56:00.677831+0000","last_became_peered":"2024-03-17T23:56:00.677831+0000","last_unstale":"2024-03-17T23:56:05.698947+0000","last_undegraded":"2024-03-17T23:56:05.698947+0000","last_fullsized":"2024-03-17T23:56:05.698947+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_clean_scrub_stamp":"2024-03-17T23:55:59.626739+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T04:07:26.256885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:02.163086+0000","last_change":"2024-03-17T23:56:01.214619+0000","last_active":"2024-03-17T23:56:02.163086+0000","last_peered":"2024-03-17T23:56:02.163086+0000","last_clean":"2024-03-17T23:56:02.163086+0000","last_became_active":"2024-03-17T23:56:01.213960+0000","last_became_peered":"2024-03-17T23:56:01.213960+0000","last_unstale":"2024-03-17T23:56:02.163086+0000","last_undegraded":"2024-03-17T23:56:02.163086+0000","last_fullsized":"2024-03-17T23:56:02.163086+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T11:01:47.143880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":170,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:02.161950+0000","last_change":"2024-03-17T23:55:58.106405+0000","last_active":"2024-03-17T23:56:02.161950+0000","last_peered":"2024-03-17T23:56:02.161950+0000","last_clean":"2024-03-17T23:56:02.161950+0000","last_became_active":"2024-03-17T23:55:58.104493+0000","last_became_peered":"2024-03-17T23:55:58.104493+0000","last_unstale":"2024-03-17T23:56:02.161950+0000","last_undegraded":"2024-03-17T23:56:02.161950+0000","last_fullsized":"2024-03-17T23:56:02.161950+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:55:56.609001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:55:56.609001+0000","last_clean_scrub_stamp":"2024-03-17T23:55:56.609001+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T08:58:52.707900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"21'6","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:05.700355+0000","last_change":"2024-03-17T23:56:00.678791+0000","last_active":"2024-03-17T23:56:05.700355+0000","last_peered":"2024-03-17T23:56:05.700355+0000","last_clean":"2024-03-17T23:56:05.700355+0000","last_became_active":"2024-03-17T23:56:00.677660+0000","last_became_peered":"2024-03-17T23:56:00.677660+0000","last_unstale":"2024-03-17T23:56:05.700355+0000","last_undegraded":"2024-03-17T23:56:05.700355+0000","last_fullsized":"2024-03-17T23:56:05.700355+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_clean_scrub_stamp":"2024-03-17T23:55:59.626739+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T07:28:27.310340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:02.855352+0000","last_change":"2024-03-17T23:56:01.213073+0000","last_active":"2024-03-17T23:56:02.855352+0000","last_peered":"2024-03-17T23:56:02.855352+0000","last_clean":"2024-03-17T23:56:02.855352+0000","last_became_active":"2024-03-17T23:56:01.212434+0000","last_became_peered":"2024-03-17T23:56:01.212434+0000","last_unstale":"2024-03-17T23:56:02.855352+0000","last_undegraded":"2024-03-17T23:56:02.855352+0000","last_fullsized":"2024-03-17T23:56:02.855352+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T08:24:06.922044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"21'4","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:04.687663+0000","last_change":"2024-03-17T23:56:00.700634+0000","last_active":"2024-03-17T23:56:04.687663+0000","last_peered":"2024-03-17T23:56:04.687663+0000","last_clean":"2024-03-17T23:56:04.687663+0000","last_became_active":"2024-03-17T23:56:00.691617+0000","last_became_peered":"2024-03-17T23:56:00.691617+0000","last_unstale":"2024-03-17T23:56:04.687663+0000","last_undegraded":"2024-03-17T23:56:04.687663+0000","last_fullsized":"2024-03-17T23:56:04.687663+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_clean_scrub_stamp":"2024-03-17T23:55:59.626739+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T11:11:32.522234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:02.857916+0000","last_change":"2024-03-17T23:56:01.199855+0000","last_active":"2024-03-17T23:56:02.857916+0000","last_peered":"2024-03-17T23:56:02.857916+0000","last_clean":"2024-03-17T23:56:02.857916+0000","last_became_active":"2024-03-17T23:56:01.199121+0000","last_became_peered":"2024-03-17T23:56:01.199121+0000","last_unstale":"2024-03-17T23:56:02.857916+0000","last_undegraded":"2024-03-17T23:56:02.857916+0000","last_fullsized":"2024-03-17T23:56:02.857916+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T09:59:28.908069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"21'5","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:04.690435+0000","last_change":"2024-03-17T23:56:00.686560+0000","last_active":"2024-03-17T23:56:04.690435+0000","last_peered":"2024-03-17T23:56:04.690435+0000","last_clean":"2024-03-17T23:56:04.690435+0000","last_became_active":"2024-03-17T23:56:00.686215+0000","last_became_peered":"2024-03-17T23:56:00.686215+0000","last_unstale":"2024-03-17T23:56:04.690435+0000","last_undegraded":"2024-03-17T23:56:04.690435+0000","last_fullsized":"2024-03-17T23:56:04.690435+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_clean_scrub_stamp":"2024-03-17T23:55:59.626739+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T07:28:27.310340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:02.755813+0000","last_change":"2024-03-17T23:56:01.193197+0000","last_active":"2024-03-17T23:56:02.755813+0000","last_peered":"2024-03-17T23:56:02.755813+0000","last_clean":"2024-03-17T23:56:02.755813+0000","last_became_active":"2024-03-17T23:56:01.192117+0000","last_became_peered":"2024-03-17T23:56:01.192117+0000","last_unstale":"2024-03-17T23:56:02.755813+0000","last_undegraded":"2024-03-17T23:56:02.755813+0000","last_fullsized":"2024-03-17T23:56:02.755813+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T11:35:21.037222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"21'5","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:06.714103+0000","last_change":"2024-03-17T23:56:00.696254+0000","last_active":"2024-03-17T23:56:06.714103+0000","last_peered":"2024-03-17T23:56:06.714103+0000","last_clean":"2024-03-17T23:56:06.714103+0000","last_became_active":"2024-03-17T23:56:00.694605+0000","last_became_peered":"2024-03-17T23:56:00.694605+0000","last_unstale":"2024-03-17T23:56:06.714103+0000","last_undegraded":"2024-03-17T23:56:06.714103+0000","last_fullsized":"2024-03-17T23:56:06.714103+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_clean_scrub_stamp":"2024-03-17T23:55:59.626739+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T10:35:19.139554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:02.165616+0000","last_change":"2024-03-17T23:56:01.188278+0000","last_active":"2024-03-17T23:56:02.165616+0000","last_peered":"2024-03-17T23:56:02.165616+0000","last_clean":"2024-03-17T23:56:02.165616+0000","last_became_active":"2024-03-17T23:56:01.187571+0000","last_became_peered":"2024-03-17T23:56:01.187571+0000","last_unstale":"2024-03-17T23:56:02.165616+0000","last_undegraded":"2024-03-17T23:56:02.165616+0000","last_fullsized":"2024-03-17T23:56:02.165616+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T09:45:25.654063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"21'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:02.756178+0000","last_change":"2024-03-17T23:56:00.680290+0000","last_active":"2024-03-17T23:56:02.756178+0000","last_peered":"2024-03-17T23:56:02.756178+0000","last_clean":"2024-03-17T23:56:02.756178+0000","last_became_active":"2024-03-17T23:56:00.679981+0000","last_became_peered":"2024-03-17T23:56:00.679981+0000","last_unstale":"2024-03-17T23:56:02.756178+0000","last_undegraded":"2024-03-17T23:56:02.756178+0000","last_fullsized":"2024-03-17T23:56:02.756178+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_clean_scrub_stamp":"2024-03-17T23:55:59.626739+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T10:35:19.139554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:02.170359+0000","last_change":"2024-03-17T23:56:01.216640+0000","last_active":"2024-03-17T23:56:02.170359+0000","last_peered":"2024-03-17T23:56:02.170359+0000","last_clean":"2024-03-17T23:56:02.170359+0000","last_became_active":"2024-03-17T23:56:01.216145+0000","last_became_peered":"2024-03-17T23:56:01.216145+0000","last_unstale":"2024-03-17T23:56:02.170359+0000","last_undegraded":"2024-03-17T23:56:02.170359+0000","last_fullsized":"2024-03-17T23:56:02.170359+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T11:01:47.143880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"21'4","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:05.699680+0000","last_change":"2024-03-17T23:56:00.692896+0000","last_active":"2024-03-17T23:56:05.699680+0000","last_peered":"2024-03-17T23:56:05.699680+0000","last_clean":"2024-03-17T23:56:05.699680+0000","last_became_active":"2024-03-17T23:56:00.692054+0000","last_became_peered":"2024-03-17T23:56:00.692054+0000","last_unstale":"2024-03-17T23:56:05.699680+0000","last_undegraded":"2024-03-17T23:56:05.699680+0000","last_fullsized":"2024-03-17T23:56:05.699680+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_clean_scrub_stamp":"2024-03-17T23:55:59.626739+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T10:55:17.061099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:02.756195+0000","last_change":"2024-03-17T23:56:01.189102+0000","last_active":"2024-03-17T23:56:02.756195+0000","last_peered":"2024-03-17T23:56:02.756195+0000","last_clean":"2024-03-17T23:56:02.756195+0000","last_became_active":"2024-03-17T23:56:01.188353+0000","last_became_peered":"2024-03-17T23:56:01.188353+0000","last_unstale":"2024-03-17T23:56:02.756195+0000","last_undegraded":"2024-03-17T23:56:02.756195+0000","last_fullsized":"2024-03-17T23:56:02.756195+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T00:26:55.287891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"21'7","reported_seq":21,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:05.704975+0000","last_change":"2024-03-17T23:56:00.689216+0000","last_active":"2024-03-17T23:56:05.704975+0000","last_peered":"2024-03-17T23:56:05.704975+0000","last_clean":"2024-03-17T23:56:05.704975+0000","last_became_active":"2024-03-17T23:56:00.688978+0000","last_became_peered":"2024-03-17T23:56:00.688978+0000","last_unstale":"2024-03-17T23:56:05.704975+0000","last_undegraded":"2024-03-17T23:56:05.704975+0000","last_fullsized":"2024-03-17T23:56:05.704975+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_clean_scrub_stamp":"2024-03-17T23:55:59.626739+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T09:57:49.282635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:02.856072+0000","last_change":"2024-03-17T23:56:01.212041+0000","last_active":"2024-03-17T23:56:02.856072+0000","last_peered":"2024-03-17T23:56:02.856072+0000","last_clean":"2024-03-17T23:56:02.856072+0000","last_became_active":"2024-03-17T23:56:01.211359+0000","last_became_peered":"2024-03-17T23:56:01.211359+0000","last_unstale":"2024-03-17T23:56:02.856072+0000","last_undegraded":"2024-03-17T23:56:02.856072+0000","last_fullsized":"2024-03-17T23:56:02.856072+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T11:08:21.695552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"21'7","reported_seq":21,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:06.710496+0000","last_change":"2024-03-17T23:56:00.686768+0000","last_active":"2024-03-17T23:56:06.710496+0000","last_peered":"2024-03-17T23:56:06.710496+0000","last_clean":"2024-03-17T23:56:06.710496+0000","last_became_active":"2024-03-17T23:56:00.685461+0000","last_became_peered":"2024-03-17T23:56:00.685461+0000","last_unstale":"2024-03-17T23:56:06.710496+0000","last_undegraded":"2024-03-17T23:56:06.710496+0000","last_fullsized":"2024-03-17T23:56:06.710496+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_clean_scrub_stamp":"2024-03-17T23:55:59.626739+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T05:52:39.451210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:02.858191+0000","last_change":"2024-03-17T23:56:01.196364+0000","last_active":"2024-03-17T23:56:02.858191+0000","last_peered":"2024-03-17T23:56:02.858191+0000","last_clean":"2024-03-17T23:56:02.858191+0000","last_became_active":"2024-03-17T23:56:01.191450+0000","last_became_peered":"2024-03-17T23:56:01.191450+0000","last_unstale":"2024-03-17T23:56:02.858191+0000","last_undegraded":"2024-03-17T23:56:02.858191+0000","last_fullsized":"2024-03-17T23:56:02.858191+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T02:15:18.353466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"21'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:03.681131+0000","last_change":"2024-03-17T23:56:00.691812+0000","last_active":"2024-03-17T23:56:03.681131+0000","last_peered":"2024-03-17T23:56:03.681131+0000","last_clean":"2024-03-17T23:56:03.681131+0000","last_became_active":"2024-03-17T23:56:00.691381+0000","last_became_peered":"2024-03-17T23:56:00.691381+0000","last_unstale":"2024-03-17T23:56:03.681131+0000","last_undegraded":"2024-03-17T23:56:03.681131+0000","last_fullsized":"2024-03-17T23:56:03.681131+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_clean_scrub_stamp":"2024-03-17T23:55:59.626739+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T10:35:19.139554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:02.165033+0000","last_change":"2024-03-17T23:56:01.195278+0000","last_active":"2024-03-17T23:56:02.165033+0000","last_peered":"2024-03-17T23:56:02.165033+0000","last_clean":"2024-03-17T23:56:02.165033+0000","last_became_active":"2024-03-17T23:56:01.192316+0000","last_became_peered":"2024-03-17T23:56:01.192316+0000","last_unstale":"2024-03-17T23:56:02.165033+0000","last_undegraded":"2024-03-17T23:56:02.165033+0000","last_fullsized":"2024-03-17T23:56:02.165033+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T04:07:27.260081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"21'7","reported_seq":21,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:06.712038+0000","last_change":"2024-03-17T23:56:00.703680+0000","last_active":"2024-03-17T23:56:06.712038+0000","last_peered":"2024-03-17T23:56:06.712038+0000","last_clean":"2024-03-17T23:56:06.712038+0000","last_became_active":"2024-03-17T23:56:00.703439+0000","last_became_peered":"2024-03-17T23:56:00.703439+0000","last_unstale":"2024-03-17T23:56:06.712038+0000","last_undegraded":"2024-03-17T23:56:06.712038+0000","last_fullsized":"2024-03-17T23:56:06.712038+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_clean_scrub_stamp":"2024-03-17T23:55:59.626739+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T11:11:32.522234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:02.855387+0000","last_change":"2024-03-17T23:56:01.191678+0000","last_active":"2024-03-17T23:56:02.855387+0000","last_peered":"2024-03-17T23:56:02.855387+0000","last_clean":"2024-03-17T23:56:02.855387+0000","last_became_active":"2024-03-17T23:56:01.190681+0000","last_became_peered":"2024-03-17T23:56:01.190681+0000","last_unstale":"2024-03-17T23:56:02.855387+0000","last_undegraded":"2024-03-17T23:56:02.855387+0000","last_fullsized":"2024-03-17T23:56:02.855387+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T02:46:13.650384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"21'3","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:05.705455+0000","last_change":"2024-03-17T23:56:00.679281+0000","last_active":"2024-03-17T23:56:05.705455+0000","last_peered":"2024-03-17T23:56:05.705455+0000","last_clean":"2024-03-17T23:56:05.705455+0000","last_became_active":"2024-03-17T23:56:00.678950+0000","last_became_peered":"2024-03-17T23:56:00.678950+0000","last_unstale":"2024-03-17T23:56:05.705455+0000","last_undegraded":"2024-03-17T23:56:05.705455+0000","last_fullsized":"2024-03-17T23:56:05.705455+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_clean_scrub_stamp":"2024-03-17T23:55:59.626739+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T05:52:39.451210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:02.855656+0000","last_change":"2024-03-17T23:56:01.215539+0000","last_active":"2024-03-17T23:56:02.855656+0000","last_peered":"2024-03-17T23:56:02.855656+0000","last_clean":"2024-03-17T23:56:02.855656+0000","last_became_active":"2024-03-17T23:56:01.211163+0000","last_became_peered":"2024-03-17T23:56:01.211163+0000","last_unstale":"2024-03-17T23:56:02.855656+0000","last_undegraded":"2024-03-17T23:56:02.855656+0000","last_fullsized":"2024-03-17T23:56:02.855656+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T11:40:55.653472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"21'4","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:03.679557+0000","last_change":"2024-03-17T23:56:00.692384+0000","last_active":"2024-03-17T23:56:03.679557+0000","last_peered":"2024-03-17T23:56:03.679557+0000","last_clean":"2024-03-17T23:56:03.679557+0000","last_became_active":"2024-03-17T23:56:00.684178+0000","last_became_peered":"2024-03-17T23:56:00.684178+0000","last_unstale":"2024-03-17T23:56:03.679557+0000","last_undegraded":"2024-03-17T23:56:03.679557+0000","last_fullsized":"2024-03-17T23:56:03.679557+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_clean_scrub_stamp":"2024-03-17T23:55:59.626739+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T09:45:24.650866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:02.855803+0000","last_change":"2024-03-17T23:56:01.193547+0000","last_active":"2024-03-17T23:56:02.855803+0000","last_peered":"2024-03-17T23:56:02.855803+0000","last_clean":"2024-03-17T23:56:02.855803+0000","last_became_active":"2024-03-17T23:56:01.192775+0000","last_became_peered":"2024-03-17T23:56:01.192775+0000","last_unstale":"2024-03-17T23:56:02.855803+0000","last_undegraded":"2024-03-17T23:56:02.855803+0000","last_fullsized":"2024-03-17T23:56:02.855803+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T02:15:18.353466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:02.170196+0000","last_change":"2024-03-17T23:56:01.178436+0000","last_active":"2024-03-17T23:56:02.170196+0000","last_peered":"2024-03-17T23:56:02.170196+0000","last_clean":"2024-03-17T23:56:02.170196+0000","last_became_active":"2024-03-17T23:56:01.177533+0000","last_became_peered":"2024-03-17T23:56:01.177533+0000","last_unstale":"2024-03-17T23:56:02.170196+0000","last_undegraded":"2024-03-17T23:56:02.170196+0000","last_fullsized":"2024-03-17T23:56:02.170196+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T03:18:40.457769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"21'5","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:06.711424+0000","last_change":"2024-03-17T23:56:00.691483+0000","last_active":"2024-03-17T23:56:06.711424+0000","last_peered":"2024-03-17T23:56:06.711424+0000","last_clean":"2024-03-17T23:56:06.711424+0000","last_became_active":"2024-03-17T23:56:00.684714+0000","last_became_peered":"2024-03-17T23:56:00.684714+0000","last_unstale":"2024-03-17T23:56:06.711424+0000","last_undegraded":"2024-03-17T23:56:06.711424+0000","last_fullsized":"2024-03-17T23:56:06.711424+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_clean_scrub_stamp":"2024-03-17T23:55:59.626739+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T09:57:49.282635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:02.169948+0000","last_change":"2024-03-17T23:56:01.194350+0000","last_active":"2024-03-17T23:56:02.169948+0000","last_peered":"2024-03-17T23:56:02.169948+0000","last_clean":"2024-03-17T23:56:02.169948+0000","last_became_active":"2024-03-17T23:56:01.193625+0000","last_became_peered":"2024-03-17T23:56:01.193625+0000","last_unstale":"2024-03-17T23:56:02.169948+0000","last_undegraded":"2024-03-17T23:56:02.169948+0000","last_fullsized":"2024-03-17T23:56:02.169948+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T11:08:21.695552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"21'12","reported_seq":26,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:06.712804+0000","last_change":"2024-03-17T23:56:00.699785+0000","last_active":"2024-03-17T23:56:06.712804+0000","last_peered":"2024-03-17T23:56:06.712804+0000","last_clean":"2024-03-17T23:56:06.712804+0000","last_became_active":"2024-03-17T23:56:00.699049+0000","last_became_peered":"2024-03-17T23:56:00.699049+0000","last_unstale":"2024-03-17T23:56:06.712804+0000","last_undegraded":"2024-03-17T23:56:06.712804+0000","last_fullsized":"2024-03-17T23:56:06.712804+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_clean_scrub_stamp":"2024-03-17T23:55:59.626739+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T01:56:01.336865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:02.858502+0000","last_change":"2024-03-17T23:56:01.208117+0000","last_active":"2024-03-17T23:56:02.858502+0000","last_peered":"2024-03-17T23:56:02.858502+0000","last_clean":"2024-03-17T23:56:02.858502+0000","last_became_active":"2024-03-17T23:56:01.207342+0000","last_became_peered":"2024-03-17T23:56:01.207342+0000","last_unstale":"2024-03-17T23:56:02.858502+0000","last_undegraded":"2024-03-17T23:56:02.858502+0000","last_fullsized":"2024-03-17T23:56:02.858502+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T08:24:06.922044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"21'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:02.855982+0000","last_change":"2024-03-17T23:56:00.691595+0000","last_active":"2024-03-17T23:56:02.855982+0000","last_peered":"2024-03-17T23:56:02.855982+0000","last_clean":"2024-03-17T23:56:02.855982+0000","last_became_active":"2024-03-17T23:56:00.690892+0000","last_became_peered":"2024-03-17T23:56:00.690892+0000","last_unstale":"2024-03-17T23:56:02.855982+0000","last_undegraded":"2024-03-17T23:56:02.855982+0000","last_fullsized":"2024-03-17T23:56:02.855982+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_clean_scrub_stamp":"2024-03-17T23:55:59.626739+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T07:28:27.310340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:02.855919+0000","last_change":"2024-03-17T23:56:01.212430+0000","last_active":"2024-03-17T23:56:02.855919+0000","last_peered":"2024-03-17T23:56:02.855919+0000","last_clean":"2024-03-17T23:56:02.855919+0000","last_became_active":"2024-03-17T23:56:01.204930+0000","last_became_peered":"2024-03-17T23:56:01.204930+0000","last_unstale":"2024-03-17T23:56:02.855919+0000","last_undegraded":"2024-03-17T23:56:02.855919+0000","last_fullsized":"2024-03-17T23:56:02.855919+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T04:45:41.506781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"21'13","reported_seq":27,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-17T23:56:06.713168+0000","last_change":"2024-03-17T23:56:00.682405+0000","last_active":"2024-03-17T23:56:06.713168+0000","last_peered":"2024-03-17T23:56:06.713168+0000","last_clean":"2024-03-17T23:56:06.713168+0000","last_became_active":"2024-03-17T23:56:00.681938+0000","last_became_peered":"2024-03-17T23:56:00.681938+0000","last_unstale":"2024-03-17T23:56:06.713168+0000","last_undegraded":"2024-03-17T23:56:06.713168+0000","last_fullsized":"2024-03-17T23:56:06.713168+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_clean_scrub_stamp":"2024-03-17T23:55:59.626739+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T07:03:16.148691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":8034,"num_objects":98,"num_object_clones":0,"num_object_copies":196,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":205,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":262144,"data_stored":16068,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":179,"ondisk_log_size":179,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66348,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27328,"kb_used_data":312,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344512,"statfs":{"total":96636764160,"available":96608780288,"internally_reserved":0,"allocated":319488,"data_stored":668073,"data_compressed":33174,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":240,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":245760,"data_stored":78007,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574853,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":79537,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574855,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":241664,"data_stored":76935,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574856,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27260,"kb_used_data":244,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344580,"statfs":{"total":96636764160,"available":96608849920,"internally_reserved":0,"allocated":249856,"data_stored":78041,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574855,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27260,"kb_used_data":244,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344580,"statfs":{"total":96636764160,"available":96608849920,"internally_reserved":0,"allocated":249856,"data_stored":77067,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":240,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":245760,"data_stored":77137,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574853,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27320,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344520,"statfs":{"total":96636764160,"available":96608788480,"internally_reserved":0,"allocated":311296,"data_stored":666847,"data_compressed":33174,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33174,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33174,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":874,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1532,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3932,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2402,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":2100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-17T23:56:12.794 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-03-17T23:56:12.794 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-03-17T23:56:12.794 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-03-17T23:56:12.794 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-03-17T23:56:12.937 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:12.936+0000 7fa4be1eb640 1 Processor -- start 2024-03-17T23:56:12.937 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:12.936+0000 7fa4be1eb640 1 -- start start 2024-03-17T23:56:12.940 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:12.936+0000 7fa4be1eb640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fa4b80c6fe0 0x7fa4b8072b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:12.940 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:12.936+0000 7fa4be1eb640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa4b80c8310 0x7fa4b8073070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:12.940 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:12.936+0000 7fa4be1eb640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa4b80c44c0 con 0x7fa4b8150e80 2024-03-17T23:56:12.940 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:12.936+0000 7fa4be1eb640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 -- 0x7fa4b81573b0 con 0x7fa4b80c6fe0 2024-03-17T23:56:12.940 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:12.936+0000 7fa4be1eb640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7fa4b80c3f00 con 0x7fa4b80c8310 2024-03-17T23:56:12.940 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:12.936+0000 7fa4b77fe640 1 --1- >> v1:172.21.15.196:6789/0 conn(0x7fa4b8150e80 0x7fa4b815a120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.196:6789/0 says I am v1:172.21.15.196:57258/0 (socket says 172.21.15.196:57258) 2024-03-17T23:56:12.940 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:12.936+0000 7fa4b77fe640 1 -- 172.21.15.196:0/1350215414 learned_addr learned my addr 172.21.15.196:0/1350215414 (peer_addr_for_me v1:172.21.15.196:0/0) 2024-03-17T23:56:12.940 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:12.936+0000 7fa4b6ffd640 1 --2- 172.21.15.196:0/1350215414 >> v2:172.21.15.204:3300/0 conn(0x7fa4b80c6fe0 0x7fa4b8072b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:12.940 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:12.936+0000 7fa4b7fff640 1 --2- 172.21.15.196:0/1350215414 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa4b80c8310 0x7fa4b8073070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:12.940 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:12.936+0000 7fa4b67fc640 1 -- 172.21.15.196:0/1350215414 <== mon.0 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 98603780 0 0) 0x7fa4b80c44c0 con 0x7fa4b8150e80 2024-03-17T23:56:12.940 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:12.936+0000 7fa4b67fc640 1 -- 172.21.15.196:0/1350215414 --> v1:172.21.15.196:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa4a0003530 con 0x7fa4b8150e80 2024-03-17T23:56:12.940 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:12.936+0000 7fa4b67fc640 1 -- 172.21.15.196:0/1350215414 <== mon.0 v1:172.21.15.196:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2076224532 0 0) 0x7fa4a0003530 con 0x7fa4b8150e80 2024-03-17T23:56:12.940 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:12.936+0000 7fa4b67fc640 1 -- 172.21.15.196:0/1350215414 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa4b80c8310 msgr2=0x7fa4b8073070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-17T23:56:12.940 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:12.936+0000 7fa4b67fc640 1 --2- 172.21.15.196:0/1350215414 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa4b80c8310 0x7fa4b8073070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:12.941 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:12.936+0000 7fa4b67fc640 1 -- 172.21.15.196:0/1350215414 >> v2:172.21.15.204:3300/0 conn(0x7fa4b80c6fe0 msgr2=0x7fa4b8072b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-17T23:56:12.941 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:12.936+0000 7fa4b67fc640 1 --2- 172.21.15.196:0/1350215414 >> v2:172.21.15.204:3300/0 conn(0x7fa4b80c6fe0 0x7fa4b8072b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:12.941 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:12.936+0000 7fa4b67fc640 1 -- 172.21.15.196:0/1350215414 --> v1:172.21.15.196:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4b80c41e0 con 0x7fa4b8150e80 2024-03-17T23:56:12.941 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:12.936+0000 7fa4b67fc640 1 -- 172.21.15.196:0/1350215414 <== mon.0 v1:172.21.15.196:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 981458915 0 0) 0x7fa4a8001680 con 0x7fa4b8150e80 2024-03-17T23:56:12.941 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:12.936+0000 7fa4b67fc640 1 -- 172.21.15.196:0/1350215414 >> v1:172.21.15.196:6789/0 conn(0x7fa4b8150e80 legacy=0x7fa4b815a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:12.941 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:12.936+0000 7fa4b67fc640 1 --2- 172.21.15.196:0/1350215414 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa4a00039c0 0x7fa4a0003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:12.941 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:12.936+0000 7fa4b67fc640 1 --2- 172.21.15.196:0/1350215414 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa4b80c8310 0x7fa4a0004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:12.941 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:12.936+0000 7fa4b67fc640 1 --2- 172.21.15.196:0/1350215414 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa4a0004d50 0x7fa4a00051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:12.941 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:12.936+0000 7fa4b67fc640 1 -- 172.21.15.196:0/1350215414 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fa4b81573b0 con 0x7fa4a00039c0 2024-03-17T23:56:12.941 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:12.936+0000 7fa4b67fc640 1 -- 172.21.15.196:0/1350215414 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7fa4b80c3f00 con 0x7fa4a0004d50 2024-03-17T23:56:12.941 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:12.936+0000 7fa4b67fc640 1 -- 172.21.15.196:0/1350215414 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7fa4a000b9d0 con 0x7fa4b80c8310 2024-03-17T23:56:12.941 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:12.936+0000 7fa4b77fe640 1 --2- 172.21.15.196:0/1350215414 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa4a00039c0 0x7fa4a0003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:12.941 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:12.936+0000 7fa4b7fff640 1 --2- 172.21.15.196:0/1350215414 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa4a0004d50 0x7fa4a00051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:12.941 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:12.936+0000 7fa4b6ffd640 1 --2- 172.21.15.196:0/1350215414 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa4b80c8310 0x7fa4a0004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:12.941 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:12.936+0000 7fa4b77fe640 1 -- 172.21.15.196:0/1350215414 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa4b80c8310 msgr2=0x7fa4a0004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-17T23:56:12.942 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:12.936+0000 7fa4b77fe640 1 --2- 172.21.15.196:0/1350215414 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa4b80c8310 0x7fa4a0004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:12.942 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:12.936+0000 7fa4b77fe640 1 -- 172.21.15.196:0/1350215414 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa4a0004d50 msgr2=0x7fa4a00051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-17T23:56:12.942 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:12.936+0000 7fa4b77fe640 1 --2- 172.21.15.196:0/1350215414 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa4a0004d50 0x7fa4a00051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:12.942 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:12.936+0000 7fa4b77fe640 1 -- 172.21.15.196:0/1350215414 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4a0003530 con 0x7fa4a00039c0 2024-03-17T23:56:12.942 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:12.936+0000 7fa4b6ffd640 1 --2- 172.21.15.196:0/1350215414 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa4b80c8310 0x7fa4a0004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-17T23:56:12.943 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:12.940+0000 7fa4b77fe640 1 --2- 172.21.15.196:0/1350215414 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa4a00039c0 0x7fa4a0003de0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fa4a8001060 tx=0x7fa4a801f410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6545be39f6825ae4 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:56:12.943 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:12.940+0000 7fa4b67fc640 1 -- 172.21.15.196:0/1350215414 <== mon.0 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4a8007d80 con 0x7fa4a00039c0 2024-03-17T23:56:12.943 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:12.940+0000 7fa4b67fc640 1 -- 172.21.15.196:0/1350215414 <== mon.0 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa4a8005b00 con 0x7fa4a00039c0 2024-03-17T23:56:12.943 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:12.940+0000 7fa4b67fc640 1 -- 172.21.15.196:0/1350215414 <== mon.0 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4a8007070 con 0x7fa4a00039c0 2024-03-17T23:56:12.944 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:12.940+0000 7fa4be1eb640 1 -- 172.21.15.196:0/1350215414 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa4a00039c0 msgr2=0x7fa4a0003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:12.944 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:12.940+0000 7fa4be1eb640 1 --2- 172.21.15.196:0/1350215414 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa4a00039c0 0x7fa4a0003de0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fa4a8001060 tx=0x7fa4a801f410 comp rx=0 tx=0).stop 2024-03-17T23:56:12.944 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:12.940+0000 7fa4b7fff640 1 -- 172.21.15.196:0/1350215414 reap_dead start 2024-03-17T23:56:12.944 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:12.940+0000 7fa4be1eb640 1 -- 172.21.15.196:0/1350215414 shutdown_connections 2024-03-17T23:56:12.944 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:12.940+0000 7fa4be1eb640 1 -- 172.21.15.196:0/1350215414 >> 172.21.15.196:0/1350215414 conn(0x7fa4b806c3c0 msgr2=0x7fa4b806c7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-17T23:56:12.944 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:12.940+0000 7fa4be1eb640 1 -- 172.21.15.196:0/1350215414 shutdown_connections 2024-03-17T23:56:12.944 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:12.940+0000 7fa4be1eb640 1 -- 172.21.15.196:0/1350215414 wait complete. 2024-03-17T23:56:12.945 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:12.944+0000 7fa4be1eb640 1 Processor -- start 2024-03-17T23:56:12.945 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:12.944+0000 7fa4be1eb640 1 -- start start 2024-03-17T23:56:12.947 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:12.944+0000 7fa4be1eb640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa4a00039c0 0x7fa4b81e6370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:12.947 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:12.944+0000 7fa4be1eb640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa4b81546f0 0x7fa4b8149f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:12.947 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:12.944+0000 7fa4be1eb640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa4b8154b30 0x7fa4b814a440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:12.947 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:12.944+0000 7fa4be1eb640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fa4b8151260 con 0x7fa4a00039c0 2024-03-17T23:56:12.947 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:12.944+0000 7fa4be1eb640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7fa4b8157040 con 0x7fa4b8154b30 2024-03-17T23:56:12.947 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:12.944+0000 7fa4be1eb640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7fa4b80c3610 con 0x7fa4b81546f0 2024-03-17T23:56:12.947 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:12.944+0000 7fa4b77fe640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa4a00039c0 0x7fa4b81e6370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:12.947 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:12.944+0000 7fa4b77fe640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa4a00039c0 0x7fa4b81e6370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.196:38040/0 (socket says 172.21.15.196:38040) 2024-03-17T23:56:12.947 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:12.944+0000 7fa4b77fe640 1 -- 172.21.15.196:0/2994748090 learned_addr learned my addr 172.21.15.196:0/2994748090 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-03-17T23:56:12.947 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:12.944+0000 7fa4b6ffd640 1 --2- 172.21.15.196:0/2994748090 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa4b81546f0 0x7fa4b8149f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:12.947 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:12.944+0000 7fa4b7fff640 1 --2- 172.21.15.196:0/2994748090 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa4b8154b30 0x7fa4b814a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:12.947 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:12.944+0000 7fa4b77fe640 1 -- 172.21.15.196:0/2994748090 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa4b81546f0 msgr2=0x7fa4b8149f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:12.947 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:12.944+0000 7fa4b77fe640 1 --2- 172.21.15.196:0/2994748090 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa4b81546f0 0x7fa4b8149f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:12.948 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:12.944+0000 7fa4b77fe640 1 -- 172.21.15.196:0/2994748090 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa4b8154b30 msgr2=0x7fa4b814a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:12.948 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:12.944+0000 7fa4b77fe640 1 --2- 172.21.15.196:0/2994748090 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa4b8154b30 0x7fa4b814a440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:12.948 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:12.944+0000 7fa4b77fe640 1 -- 172.21.15.196:0/2994748090 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4b8154210 con 0x7fa4a00039c0 2024-03-17T23:56:12.948 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:12.944+0000 7fa4b77fe640 1 --2- 172.21.15.196:0/2994748090 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa4a00039c0 0x7fa4b81e6370 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fa4a8001060 tx=0x7fa4a0005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:56:12.948 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:12.944+0000 7fa49ffff640 1 -- 172.21.15.196:0/2994748090 <== mon.0 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4a8005cb0 con 0x7fa4a00039c0 2024-03-17T23:56:12.948 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:12.944+0000 7fa49ffff640 1 -- 172.21.15.196:0/2994748090 <== mon.0 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa4a8005e50 con 0x7fa4a00039c0 2024-03-17T23:56:12.948 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:12.944+0000 7fa49ffff640 1 -- 172.21.15.196:0/2994748090 <== mon.0 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4a80049f0 con 0x7fa4a00039c0 2024-03-17T23:56:12.948 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:12.944+0000 7fa4be1eb640 1 -- 172.21.15.196:0/2994748090 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4b81f09e0 con 0x7fa4a00039c0 2024-03-17T23:56:12.948 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:12.944+0000 7fa4be1eb640 1 -- 172.21.15.196:0/2994748090 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4b8153730 con 0x7fa4a00039c0 2024-03-17T23:56:12.949 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:12.944+0000 7fa4be1eb640 1 -- 172.21.15.196:0/2994748090 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa4b80689a0 con 0x7fa4a00039c0 2024-03-17T23:56:12.949 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:12.944+0000 7fa49ffff640 1 -- 172.21.15.196:0/2994748090 <== mon.0 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 5) ==== 87083+0+0 (secure 0 0 0) 0x7fa4a8004b90 con 0x7fa4a00039c0 2024-03-17T23:56:12.949 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:12.948+0000 7fa49ffff640 1 --2- 172.21.15.196:0/2994748090 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7fa4a4067690 0x7fa4a4069b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:12.949 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:12.948+0000 7fa49ffff640 1 -- 172.21.15.196:0/2994748090 <== mon.0 v2:172.21.15.196:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fa4a8122530 con 0x7fa4a00039c0 2024-03-17T23:56:12.949 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:12.948+0000 7fa4b6ffd640 1 --2- 172.21.15.196:0/2994748090 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7fa4a4067690 0x7fa4a4069b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:12.949 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:12.948+0000 7fa4b6ffd640 1 --2- 172.21.15.196:0/2994748090 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7fa4a4067690 0x7fa4a4069b50 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fa4b8153020 tx=0x7fa4ac008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:56:12.953 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:12.952+0000 7fa49ffff640 1 -- 172.21.15.196:0/2994748090 <== mon.0 v2:172.21.15.196:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177849 (secure 0 0 0) 0x7fa4a80c3030 con 0x7fa4a00039c0 2024-03-17T23:56:13.141 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:13.140+0000 7fa4be1eb640 1 -- 172.21.15.196:0/2994748090 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fa4b8157a80 con 0x7fa4a00039c0 2024-03-17T23:56:13.141 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:13.140+0000 7fa49ffff640 1 -- 172.21.15.196:0/2994748090 <== mon.0 v2:172.21.15.196:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7fa4a8019120 con 0x7fa4a00039c0 2024-03-17T23:56:13.142 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-03-17T23:56:13.142 INFO:teuthology.orchestra.run.smithi196.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-03-17T23:56:13.144 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:13.140+0000 7fa4be1eb640 1 -- 172.21.15.196:0/2994748090 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7fa4a4067690 msgr2=0x7fa4a4069b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:13.144 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:13.140+0000 7fa4be1eb640 1 --2- 172.21.15.196:0/2994748090 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7fa4a4067690 0x7fa4a4069b50 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fa4b8153020 tx=0x7fa4ac008040 comp rx=0 tx=0).stop 2024-03-17T23:56:13.144 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:13.140+0000 7fa4be1eb640 1 -- 172.21.15.196:0/2994748090 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa4a00039c0 msgr2=0x7fa4b81e6370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:13.144 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:13.140+0000 7fa4be1eb640 1 --2- 172.21.15.196:0/2994748090 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa4a00039c0 0x7fa4b81e6370 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fa4a8001060 tx=0x7fa4a0005840 comp rx=0 tx=0).stop 2024-03-17T23:56:13.144 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:13.140+0000 7fa4be1eb640 1 -- 172.21.15.196:0/2994748090 shutdown_connections 2024-03-17T23:56:13.144 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:13.140+0000 7fa4be1eb640 1 --2- 172.21.15.196:0/2994748090 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7fa4a4067690 0x7fa4a4069b50 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:13.145 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:13.140+0000 7fa4be1eb640 1 --2- 172.21.15.196:0/2994748090 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa4b81546f0 0x7fa4b8149f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:13.145 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:13.140+0000 7fa4be1eb640 1 --2- 172.21.15.196:0/2994748090 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa4b8154b30 0x7fa4b814a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:13.145 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:13.140+0000 7fa4be1eb640 1 --2- 172.21.15.196:0/2994748090 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa4a00039c0 0x7fa4b81e6370 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:13.145 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:13.140+0000 7fa4be1eb640 1 -- 172.21.15.196:0/2994748090 >> 172.21.15.196:0/2994748090 conn(0x7fa4b806c3c0 msgr2=0x7fa4b814e9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-17T23:56:13.145 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:13.140+0000 7fa4be1eb640 1 -- 172.21.15.196:0/2994748090 shutdown_connections 2024-03-17T23:56:13.145 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:13.140+0000 7fa4be1eb640 1 -- 172.21.15.196:0/2994748090 wait complete. 2024-03-17T23:56:13.159 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-03-17T23:56:13.159 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-17T23:56:13.278 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:13.276+0000 7fa9cc163640 1 Processor -- start 2024-03-17T23:56:13.278 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:13.276+0000 7fa9cc163640 1 -- start start 2024-03-17T23:56:13.280 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:13.276+0000 7fa9cc163640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fa9c41574c0 0x7fa9c40c4080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:13.280 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:13.276+0000 7fa9cc163640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fa9c40c3a80 0x7fa9c415dad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:13.280 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:13.276+0000 7fa9cc163640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa9c415e010 0x7fa9c406cb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:13.280 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:13.276+0000 7fa9cc163640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7fa9c40c8730 con 0x7fa9c40c3a80 2024-03-17T23:56:13.280 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:13.276+0000 7fa9cc163640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 -- 0x7fa9c415d5f0 con 0x7fa9c41574c0 2024-03-17T23:56:13.280 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:13.276+0000 7fa9cc163640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7fa9c406c4d0 con 0x7fa9c415e010 2024-03-17T23:56:13.280 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:13.276+0000 7fa9c96fe640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fa9c40c3a80 0x7fa9c415dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:13.280 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:13.276+0000 7fa9c96fe640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fa9c40c3a80 0x7fa9c415dad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.196:38044/0 (socket says 172.21.15.196:38044) 2024-03-17T23:56:13.280 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:13.276+0000 7fa9c96fe640 1 -- 172.21.15.196:0/1775519093 learned_addr learned my addr 172.21.15.196:0/1775519093 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-03-17T23:56:13.280 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:13.276+0000 7fa9c9eff640 1 --2- 172.21.15.196:0/1775519093 >> v2:172.21.15.204:3300/0 conn(0x7fa9c41574c0 0x7fa9c40c4080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:13.280 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:13.276+0000 7fa9ca700640 1 --2- 172.21.15.196:0/1775519093 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa9c415e010 0x7fa9c406cb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:13.281 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:13.276+0000 7fa9c96fe640 1 -- 172.21.15.196:0/1775519093 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa9c415e010 msgr2=0x7fa9c406cb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-17T23:56:13.281 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:13.276+0000 7fa9c96fe640 1 --2- 172.21.15.196:0/1775519093 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa9c415e010 0x7fa9c406cb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:13.281 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:13.276+0000 7fa9c96fe640 1 -- 172.21.15.196:0/1775519093 >> v2:172.21.15.204:3300/0 conn(0x7fa9c41574c0 msgr2=0x7fa9c40c4080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-17T23:56:13.281 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:13.276+0000 7fa9c96fe640 1 --2- 172.21.15.196:0/1775519093 >> v2:172.21.15.204:3300/0 conn(0x7fa9c41574c0 0x7fa9c40c4080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:13.281 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:13.276+0000 7fa9c96fe640 1 -- 172.21.15.196:0/1775519093 --> v2:172.21.15.196:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9c40c8170 con 0x7fa9c40c3a80 2024-03-17T23:56:13.283 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:13.280+0000 7fa9c96fe640 1 --2- 172.21.15.196:0/1775519093 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa9c40c3a80 0x7fa9c415dad0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fa9c4070420 tx=0x7fa9b401ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6d62dd1f35f8408 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:56:13.283 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:13.280+0000 7fa9c8efd640 1 -- 172.21.15.196:0/1775519093 <== mon.0 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9b40b5070 con 0x7fa9c40c3a80 2024-03-17T23:56:13.283 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:13.280+0000 7fa9c8efd640 1 -- 172.21.15.196:0/1775519093 <== mon.0 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa9b40a89d0 con 0x7fa9c40c3a80 2024-03-17T23:56:13.283 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:13.280+0000 7fa9c8efd640 1 -- 172.21.15.196:0/1775519093 <== mon.0 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9b40a8da0 con 0x7fa9c40c3a80 2024-03-17T23:56:13.283 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:13.280+0000 7fa9cc163640 1 -- 172.21.15.196:0/1775519093 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa9c40c3a80 msgr2=0x7fa9c415dad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:13.283 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:13.280+0000 7fa9cc163640 1 --2- 172.21.15.196:0/1775519093 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa9c40c3a80 0x7fa9c415dad0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fa9c4070420 tx=0x7fa9b401ed10 comp rx=0 tx=0).stop 2024-03-17T23:56:13.283 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:13.280+0000 7fa9cc163640 1 -- 172.21.15.196:0/1775519093 shutdown_connections 2024-03-17T23:56:13.283 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:13.280+0000 7fa9cc163640 1 --2- 172.21.15.196:0/1775519093 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa9c415e010 0x7fa9c406cb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:13.283 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:13.280+0000 7fa9cc163640 1 --2- 172.21.15.196:0/1775519093 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa9c40c3a80 0x7fa9c415dad0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:13.284 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:13.280+0000 7fa9cc163640 1 --2- 172.21.15.196:0/1775519093 >> v2:172.21.15.204:3300/0 conn(0x7fa9c41574c0 0x7fa9c40c4080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:13.284 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:13.280+0000 7fa9cc163640 1 -- 172.21.15.196:0/1775519093 >> 172.21.15.196:0/1775519093 conn(0x7fa9c4071020 msgr2=0x7fa9c4071430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-17T23:56:13.284 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:13.280+0000 7fa9cc163640 1 -- 172.21.15.196:0/1775519093 shutdown_connections 2024-03-17T23:56:13.284 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:13.280+0000 7fa9cc163640 1 -- 172.21.15.196:0/1775519093 wait complete. 2024-03-17T23:56:13.284 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:13.280+0000 7fa9cc163640 1 Processor -- start 2024-03-17T23:56:13.284 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:13.280+0000 7fa9cc163640 1 -- start start 2024-03-17T23:56:13.286 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:13.284+0000 7fa9cc163640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa9c41574c0 0x7fa9c41efea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:13.287 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:13.284+0000 7fa9cc163640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa9c415e010 0x7fa9c4152650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:13.287 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:13.284+0000 7fa9cc163640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa9c40cd0c0 0x7fa9c41500f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:13.287 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:13.284+0000 7fa9cc163640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fa9c41578a0 con 0x7fa9c40cd0c0 2024-03-17T23:56:13.287 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:13.284+0000 7fa9cc163640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7fa9c406c790 con 0x7fa9c41574c0 2024-03-17T23:56:13.287 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:13.284+0000 7fa9cc163640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7fa9c4157a20 con 0x7fa9c415e010 2024-03-17T23:56:13.287 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:13.284+0000 7fa9ca700640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa9c40cd0c0 0x7fa9c41500f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:13.287 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:13.284+0000 7fa9ca700640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa9c40cd0c0 0x7fa9c41500f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.196:38054/0 (socket says 172.21.15.196:38054) 2024-03-17T23:56:13.287 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:13.284+0000 7fa9ca700640 1 -- 172.21.15.196:0/2628941484 learned_addr learned my addr 172.21.15.196:0/2628941484 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-03-17T23:56:13.287 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:13.284+0000 7fa9c9eff640 1 --2- 172.21.15.196:0/2628941484 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa9c41574c0 0x7fa9c41efea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:13.287 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:13.284+0000 7fa9c96fe640 1 --2- 172.21.15.196:0/2628941484 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa9c415e010 0x7fa9c4152650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:13.287 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:13.284+0000 7fa9ca700640 1 -- 172.21.15.196:0/2628941484 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa9c415e010 msgr2=0x7fa9c4152650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:13.287 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:13.284+0000 7fa9ca700640 1 --2- 172.21.15.196:0/2628941484 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa9c415e010 0x7fa9c4152650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:13.287 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:13.284+0000 7fa9ca700640 1 -- 172.21.15.196:0/2628941484 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa9c41574c0 msgr2=0x7fa9c41efea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:13.288 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:13.284+0000 7fa9ca700640 1 --2- 172.21.15.196:0/2628941484 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa9c41574c0 0x7fa9c41efea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:13.288 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:13.284+0000 7fa9ca700640 1 -- 172.21.15.196:0/2628941484 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9c41f37e0 con 0x7fa9c40cd0c0 2024-03-17T23:56:13.288 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:13.284+0000 7fa9ca700640 1 --2- 172.21.15.196:0/2628941484 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa9c40cd0c0 0x7fa9c41500f0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fa9bc00efc0 tx=0x7fa9bc00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:56:13.288 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:13.284+0000 7fa9ba7fc640 1 -- 172.21.15.196:0/2628941484 <== mon.0 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9bc018020 con 0x7fa9c40cd0c0 2024-03-17T23:56:13.288 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:13.284+0000 7fa9ba7fc640 1 -- 172.21.15.196:0/2628941484 <== mon.0 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa9bc014480 con 0x7fa9c40cd0c0 2024-03-17T23:56:13.288 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:13.284+0000 7fa9cc163640 1 -- 172.21.15.196:0/2628941484 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa9c41f3ac0 con 0x7fa9c40cd0c0 2024-03-17T23:56:13.288 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:13.284+0000 7fa9ba7fc640 1 -- 172.21.15.196:0/2628941484 <== mon.0 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9bc014870 con 0x7fa9c40cd0c0 2024-03-17T23:56:13.288 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:13.284+0000 7fa9cc163640 1 -- 172.21.15.196:0/2628941484 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa9c41f4080 con 0x7fa9c40cd0c0 2024-03-17T23:56:13.288 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:13.284+0000 7fa9cc163640 1 -- 172.21.15.196:0/2628941484 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa9c40689a0 con 0x7fa9c40cd0c0 2024-03-17T23:56:13.289 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:13.284+0000 7fa9ba7fc640 1 -- 172.21.15.196:0/2628941484 <== mon.0 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 5) ==== 87083+0+0 (secure 0 0 0) 0x7fa9bc01b020 con 0x7fa9c40cd0c0 2024-03-17T23:56:13.289 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:13.284+0000 7fa9ba7fc640 1 --2- 172.21.15.196:0/2628941484 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7fa9a8067690 0x7fa9a8069b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:13.289 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:13.284+0000 7fa9ba7fc640 1 -- 172.21.15.196:0/2628941484 <== mon.0 v2:172.21.15.196:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fa9bc086040 con 0x7fa9c40cd0c0 2024-03-17T23:56:13.289 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:13.284+0000 7fa9c9eff640 1 --2- 172.21.15.196:0/2628941484 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7fa9a8067690 0x7fa9a8069b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:13.289 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:13.288+0000 7fa9c9eff640 1 --2- 172.21.15.196:0/2628941484 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7fa9a8067690 0x7fa9a8069b50 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fa9c0009ae0 tx=0x7fa9c0009190 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:56:13.292 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:13.288+0000 7fa9ba7fc640 1 -- 172.21.15.196:0/2628941484 <== mon.0 v2:172.21.15.196:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177849 (secure 0 0 0) 0x7fa9bc022070 con 0x7fa9c40cd0c0 2024-03-17T23:56:13.465 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:13.463+0000 7fa9cc163640 1 -- 172.21.15.196:0/2628941484 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa9c40c88f0 con 0x7fa9c40cd0c0 2024-03-17T23:56:13.466 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:13.463+0000 7fa9ba7fc640 1 -- 172.21.15.196:0/2628941484 <== mon.0 v2:172.21.15.196:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16641 (secure 0 0 0) 0x7fa9bc010040 con 0x7fa9c40cd0c0 2024-03-17T23:56:13.467 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-03-17T23:56:13.467 INFO:teuthology.orchestra.run.smithi196.stdout:{"epoch":21,"fsid":"b80f9c80-17ad-4126-8957-4c0c46f5b803","created":"2024-03-17T23:55:43.368838+0000","modified":"2024-03-17T23:56:02.157128+0000","last_up_change":"2024-03-17T23:55:54.132187+0000","last_in_change":"2024-03-17T23:55:46.016435+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-17T23:55:56.030640+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-17T23:55:58.658234+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-17T23:56:00.003208+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"224d699f-bc10-4661-a8b5-6ca73290ffa0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6806","nonce":1194547591},{"type":"v1","addr":"172.21.15.196:6807","nonce":1194547591}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6809","nonce":1194547591},{"type":"v1","addr":"172.21.15.196:6811","nonce":1194547591}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6814","nonce":1194547591},{"type":"v1","addr":"172.21.15.196:6815","nonce":1194547591}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6812","nonce":1194547591},{"type":"v1","addr":"172.21.15.196:6813","nonce":1194547591}]},"public_addr":"172.21.15.196:6807/1194547591","cluster_addr":"172.21.15.196:6811/1194547591","heartbeat_back_addr":"172.21.15.196:6815/1194547591","heartbeat_front_addr":"172.21.15.196:6813/1194547591","state":["exists","up"]},{"osd":1,"uuid":"d8d6a0b0-450b-4ab5-b143-d4f36286e81e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6800","nonce":1901246986},{"type":"v1","addr":"172.21.15.196:6801","nonce":1901246986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6802","nonce":1901246986},{"type":"v1","addr":"172.21.15.196:6803","nonce":1901246986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6808","nonce":1901246986},{"type":"v1","addr":"172.21.15.196:6810","nonce":1901246986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6804","nonce":1901246986},{"type":"v1","addr":"172.21.15.196:6805","nonce":1901246986}]},"public_addr":"172.21.15.196:6801/1901246986","cluster_addr":"172.21.15.196:6803/1901246986","heartbeat_back_addr":"172.21.15.196:6810/1901246986","heartbeat_front_addr":"172.21.15.196:6805/1901246986","state":["exists","up"]},{"osd":2,"uuid":"d732ba94-1db0-41ed-930a-5abb6188980a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6824","nonce":673819559},{"type":"v1","addr":"172.21.15.196:6825","nonce":673819559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6826","nonce":673819559},{"type":"v1","addr":"172.21.15.196:6827","nonce":673819559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6830","nonce":673819559},{"type":"v1","addr":"172.21.15.196:6831","nonce":673819559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6828","nonce":673819559},{"type":"v1","addr":"172.21.15.196:6829","nonce":673819559}]},"public_addr":"172.21.15.196:6825/673819559","cluster_addr":"172.21.15.196:6827/673819559","heartbeat_back_addr":"172.21.15.196:6831/673819559","heartbeat_front_addr":"172.21.15.196:6829/673819559","state":["exists","up"]},{"osd":3,"uuid":"b79cab98-a49f-4544-b6b0-546dcfbd47a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6816","nonce":1104340623},{"type":"v1","addr":"172.21.15.196:6817","nonce":1104340623}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6818","nonce":1104340623},{"type":"v1","addr":"172.21.15.196:6819","nonce":1104340623}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6822","nonce":1104340623},{"type":"v1","addr":"172.21.15.196:6823","nonce":1104340623}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6820","nonce":1104340623},{"type":"v1","addr":"172.21.15.196:6821","nonce":1104340623}]},"public_addr":"172.21.15.196:6817/1104340623","cluster_addr":"172.21.15.196:6819/1104340623","heartbeat_back_addr":"172.21.15.196:6823/1104340623","heartbeat_front_addr":"172.21.15.196:6821/1104340623","state":["exists","up"]},{"osd":4,"uuid":"d5892856-6eb4-4188-beb0-368f64169af1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6816","nonce":658561863},{"type":"v1","addr":"172.21.15.204:6818","nonce":658561863}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6819","nonce":658561863},{"type":"v1","addr":"172.21.15.204:6821","nonce":658561863}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6826","nonce":658561863},{"type":"v1","addr":"172.21.15.204:6828","nonce":658561863}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6823","nonce":658561863},{"type":"v1","addr":"172.21.15.204:6825","nonce":658561863}]},"public_addr":"172.21.15.204:6818/658561863","cluster_addr":"172.21.15.204:6821/658561863","heartbeat_back_addr":"172.21.15.204:6828/658561863","heartbeat_front_addr":"172.21.15.204:6825/658561863","state":["exists","up"]},{"osd":5,"uuid":"89d6b48d-aa8a-4cb8-aa2e-e0aae04928b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6817","nonce":3367327749},{"type":"v1","addr":"172.21.15.204:6820","nonce":3367327749}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6822","nonce":3367327749},{"type":"v1","addr":"172.21.15.204:6824","nonce":3367327749}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6830","nonce":3367327749},{"type":"v1","addr":"172.21.15.204:6831","nonce":3367327749}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6827","nonce":3367327749},{"type":"v1","addr":"172.21.15.204:6829","nonce":3367327749}]},"public_addr":"172.21.15.204:6820/3367327749","cluster_addr":"172.21.15.204:6824/3367327749","heartbeat_back_addr":"172.21.15.204:6831/3367327749","heartbeat_front_addr":"172.21.15.204:6829/3367327749","state":["exists","up"]},{"osd":6,"uuid":"ff7d0949-2836-42a6-a63d-bc5a4269e080","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6805","nonce":2586742078},{"type":"v1","addr":"172.21.15.204:6807","nonce":2586742078}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6809","nonce":2586742078},{"type":"v1","addr":"172.21.15.204:6811","nonce":2586742078}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6814","nonce":2586742078},{"type":"v1","addr":"172.21.15.204:6815","nonce":2586742078}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6812","nonce":2586742078},{"type":"v1","addr":"172.21.15.204:6813","nonce":2586742078}]},"public_addr":"172.21.15.204:6807/2586742078","cluster_addr":"172.21.15.204:6811/2586742078","heartbeat_back_addr":"172.21.15.204:6815/2586742078","heartbeat_front_addr":"172.21.15.204:6813/2586742078","state":["exists","up"]},{"osd":7,"uuid":"42bcc14b-70b3-4c59-bf81-41436e4eb272","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6800","nonce":3361860686},{"type":"v1","addr":"172.21.15.204:6801","nonce":3361860686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6802","nonce":3361860686},{"type":"v1","addr":"172.21.15.204:6803","nonce":3361860686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6808","nonce":3361860686},{"type":"v1","addr":"172.21.15.204:6810","nonce":3361860686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6804","nonce":3361860686},{"type":"v1","addr":"172.21.15.204:6806","nonce":3361860686}]},"public_addr":"172.21.15.204:6801/3361860686","cluster_addr":"172.21.15.204:6803/3361860686","heartbeat_back_addr":"172.21.15.204:6810/3361860686","heartbeat_front_addr":"172.21.15.204:6806/3361860686","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-17T23:55:51.372683+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-17T23:55:51.466291+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-17T23:55:51.608084+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-17T23:55:51.680819+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-17T23:55:51.528198+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-17T23:55:51.537065+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-17T23:55:51.558146+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-17T23:55:51.382540+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-17T23:56:13.469 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:13.467+0000 7fa9cc163640 1 -- 172.21.15.196:0/2628941484 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7fa9a8067690 msgr2=0x7fa9a8069b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:13.469 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:13.467+0000 7fa9cc163640 1 --2- 172.21.15.196:0/2628941484 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7fa9a8067690 0x7fa9a8069b50 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fa9c0009ae0 tx=0x7fa9c0009190 comp rx=0 tx=0).stop 2024-03-17T23:56:13.469 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:13.467+0000 7fa9cc163640 1 -- 172.21.15.196:0/2628941484 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa9c40cd0c0 msgr2=0x7fa9c41500f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:13.469 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:13.467+0000 7fa9cc163640 1 --2- 172.21.15.196:0/2628941484 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa9c40cd0c0 0x7fa9c41500f0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fa9bc00efc0 tx=0x7fa9bc00c490 comp rx=0 tx=0).stop 2024-03-17T23:56:13.469 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:13.467+0000 7fa9cc163640 1 -- 172.21.15.196:0/2628941484 shutdown_connections 2024-03-17T23:56:13.469 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:13.467+0000 7fa9cc163640 1 --2- 172.21.15.196:0/2628941484 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7fa9a8067690 0x7fa9a8069b50 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:13.469 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:13.467+0000 7fa9cc163640 1 --2- 172.21.15.196:0/2628941484 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa9c415e010 0x7fa9c4152650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:13.469 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:13.467+0000 7fa9cc163640 1 --2- 172.21.15.196:0/2628941484 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa9c40cd0c0 0x7fa9c41500f0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:13.469 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:13.467+0000 7fa9cc163640 1 --2- 172.21.15.196:0/2628941484 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa9c41574c0 0x7fa9c41efea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:13.469 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:13.467+0000 7fa9cc163640 1 -- 172.21.15.196:0/2628941484 >> 172.21.15.196:0/2628941484 conn(0x7fa9c4071020 msgr2=0x7fa9c406c910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-17T23:56:13.469 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:13.467+0000 7fa9cc163640 1 -- 172.21.15.196:0/2628941484 shutdown_connections 2024-03-17T23:56:13.470 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:13.467+0000 7fa9cc163640 1 -- 172.21.15.196:0/2628941484 wait complete. 2024-03-17T23:56:13.484 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-17T23:55:56.030640+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-17T23:55:58.658234+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-17T23:56:00.003208+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-17T23:56:13.484 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-17T23:56:13.594 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:13.591+0000 7f8b52316640 1 Processor -- start 2024-03-17T23:56:13.594 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:13.591+0000 7f8b52316640 1 -- start start 2024-03-17T23:56:13.595 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:13.591+0000 7f8b52316640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f8b4c072430 0x7f8b4c0c5980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:13.595 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:13.591+0000 7f8b52316640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8b4c0c3490 0x7f8b4c0c5ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:13.595 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:13.591+0000 7f8b52316640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8b4c1511d0 con 0x7f8b4c150df0 2024-03-17T23:56:13.596 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:13.591+0000 7f8b52316640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7f8b4c157630 con 0x7f8b4c072430 2024-03-17T23:56:13.596 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:13.591+0000 7f8b52316640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f8b4c156a40 con 0x7f8b4c0c3490 2024-03-17T23:56:13.596 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:13.591+0000 7f8b4b7fe640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f8b4c072430 0x7f8b4c0c5980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:13.596 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:13.591+0000 7f8b4b7fe640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f8b4c072430 0x7f8b4c0c5980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.196:38058/0 (socket says 172.21.15.196:38058) 2024-03-17T23:56:13.596 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:13.591+0000 7f8b4b7fe640 1 -- 172.21.15.196:0/347924974 learned_addr learned my addr 172.21.15.196:0/347924974 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-03-17T23:56:13.596 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:13.591+0000 7f8b508b3640 1 --2- 172.21.15.196:0/347924974 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8b4c0c3490 0x7f8b4c0c5ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:13.596 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:13.591+0000 7f8b4b7fe640 1 -- 172.21.15.196:0/347924974 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8b4c0c3490 msgr2=0x7f8b4c0c5ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-17T23:56:13.596 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:13.591+0000 7f8b4b7fe640 1 --2- 172.21.15.196:0/347924974 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8b4c0c3490 0x7f8b4c0c5ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:13.596 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:13.591+0000 7f8b4b7fe640 1 -- 172.21.15.196:0/347924974 >> v1:172.21.15.204:6789/0 conn(0x7f8b4c150df0 legacy=0x7f8b4c0c3ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:13.596 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:13.591+0000 7f8b4b7fe640 1 -- 172.21.15.196:0/347924974 --> v2:172.21.15.196:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b4c072a70 con 0x7f8b4c072430 2024-03-17T23:56:13.597 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:13.595+0000 7f8b4b7fe640 1 --2- 172.21.15.196:0/347924974 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8b4c072430 0x7f8b4c0c5980 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f8b40009870 tx=0x7f8b4001e6e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e74c826302f0687 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:56:13.597 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:13.595+0000 7f8b4affd640 1 -- 172.21.15.196:0/347924974 <== mon.0 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b400aa630 con 0x7f8b4c072430 2024-03-17T23:56:13.597 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:13.595+0000 7f8b4affd640 1 -- 172.21.15.196:0/347924974 <== mon.0 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b400aa7d0 con 0x7f8b4c072430 2024-03-17T23:56:13.597 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:13.595+0000 7f8b4affd640 1 -- 172.21.15.196:0/347924974 <== mon.0 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b400aaba0 con 0x7f8b4c072430 2024-03-17T23:56:13.598 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:13.595+0000 7f8b52316640 1 -- 172.21.15.196:0/347924974 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8b4c072430 msgr2=0x7f8b4c0c5980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:13.598 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:13.595+0000 7f8b52316640 1 --2- 172.21.15.196:0/347924974 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8b4c072430 0x7f8b4c0c5980 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f8b40009870 tx=0x7f8b4001e6e0 comp rx=0 tx=0).stop 2024-03-17T23:56:13.598 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:13.595+0000 7f8b52316640 1 -- 172.21.15.196:0/347924974 shutdown_connections 2024-03-17T23:56:13.598 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:13.595+0000 7f8b52316640 1 --2- 172.21.15.196:0/347924974 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8b4c0c3490 0x7f8b4c0c5ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:13.598 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:13.595+0000 7f8b52316640 1 --2- 172.21.15.196:0/347924974 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8b4c072430 0x7f8b4c0c5980 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:13.599 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:13.595+0000 7f8b52316640 1 -- 172.21.15.196:0/347924974 >> 172.21.15.196:0/347924974 conn(0x7f8b4c06e7f0 msgr2=0x7f8b4c070020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-17T23:56:13.599 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:13.595+0000 7f8b52316640 1 -- 172.21.15.196:0/347924974 shutdown_connections 2024-03-17T23:56:13.599 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:13.595+0000 7f8b52316640 1 -- 172.21.15.196:0/347924974 wait complete. 2024-03-17T23:56:13.601 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:13.595+0000 7f8b52316640 1 Processor -- start 2024-03-17T23:56:13.601 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:13.595+0000 7f8b52316640 1 -- start start 2024-03-17T23:56:13.601 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:13.595+0000 7f8b52316640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8b4c072430 0x7f8b4c0c8170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:13.601 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:13.595+0000 7f8b52316640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8b4c0c3490 0x7f8b4c0cbe40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:13.601 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:13.595+0000 7f8b52316640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8b4c150df0 0x7f8b4c1e8570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:13.601 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:13.595+0000 7f8b52316640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f8b4c0c4370 con 0x7f8b4c072430 2024-03-17T23:56:13.601 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:13.595+0000 7f8b52316640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f8b4c0c41f0 con 0x7f8b4c150df0 2024-03-17T23:56:13.601 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:13.595+0000 7f8b52316640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f8b4c06bac0 con 0x7f8b4c0c3490 2024-03-17T23:56:13.601 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:13.595+0000 7f8b4bfff640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8b4c072430 0x7f8b4c0c8170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:13.601 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:13.595+0000 7f8b4bfff640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8b4c072430 0x7f8b4c0c8170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.196:38074/0 (socket says 172.21.15.196:38074) 2024-03-17T23:56:13.601 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:13.595+0000 7f8b4bfff640 1 -- 172.21.15.196:0/1074802796 learned_addr learned my addr 172.21.15.196:0/1074802796 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-03-17T23:56:13.602 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:13.595+0000 7f8b4b7fe640 1 --2- 172.21.15.196:0/1074802796 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8b4c0c3490 0x7f8b4c0cbe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:13.602 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:13.595+0000 7f8b508b3640 1 --2- 172.21.15.196:0/1074802796 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8b4c150df0 0x7f8b4c1e8570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:13.602 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:13.595+0000 7f8b4bfff640 1 -- 172.21.15.196:0/1074802796 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8b4c0c3490 msgr2=0x7f8b4c0cbe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:13.602 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:13.595+0000 7f8b4bfff640 1 --2- 172.21.15.196:0/1074802796 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8b4c0c3490 0x7f8b4c0cbe40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:13.602 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:13.595+0000 7f8b4bfff640 1 -- 172.21.15.196:0/1074802796 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8b4c150df0 msgr2=0x7f8b4c1e8570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:13.602 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:13.595+0000 7f8b4bfff640 1 --2- 172.21.15.196:0/1074802796 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8b4c150df0 0x7f8b4c1e8570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:13.602 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:13.595+0000 7f8b4bfff640 1 -- 172.21.15.196:0/1074802796 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b4c0ca580 con 0x7f8b4c072430 2024-03-17T23:56:13.602 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:13.595+0000 7f8b508b3640 1 --2- 172.21.15.196:0/1074802796 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8b4c150df0 0x7f8b4c1e8570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-17T23:56:13.602 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:13.599+0000 7f8b4bfff640 1 --2- 172.21.15.196:0/1074802796 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8b4c072430 0x7f8b4c0c8170 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f8b3c00c3a0 tx=0x7f8b3c00c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:56:13.602 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:13.599+0000 7f8b48ff9640 1 -- 172.21.15.196:0/1074802796 <== mon.0 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b3c0052d0 con 0x7f8b4c072430 2024-03-17T23:56:13.602 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:13.599+0000 7f8b48ff9640 1 -- 172.21.15.196:0/1074802796 <== mon.0 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b3c005470 con 0x7f8b4c072430 2024-03-17T23:56:13.602 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:13.599+0000 7f8b52316640 1 -- 172.21.15.196:0/1074802796 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b4c0ca840 con 0x7f8b4c072430 2024-03-17T23:56:13.602 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:13.599+0000 7f8b48ff9640 1 -- 172.21.15.196:0/1074802796 <== mon.0 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b3c007260 con 0x7f8b4c072430 2024-03-17T23:56:13.602 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:13.599+0000 7f8b52316640 1 -- 172.21.15.196:0/1074802796 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b4c0cae00 con 0x7f8b4c072430 2024-03-17T23:56:13.604 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:13.599+0000 7f8b52316640 1 -- 172.21.15.196:0/1074802796 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8b4c0689a0 con 0x7f8b4c072430 2024-03-17T23:56:13.604 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:13.599+0000 7f8b48ff9640 1 -- 172.21.15.196:0/1074802796 <== mon.0 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 5) ==== 87083+0+0 (secure 0 0 0) 0x7f8b3c007400 con 0x7f8b4c072430 2024-03-17T23:56:13.604 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:13.599+0000 7f8b48ff9640 1 --2- 172.21.15.196:0/1074802796 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f8b38067660 0x7f8b38069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:13.604 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:13.599+0000 7f8b48ff9640 1 -- 172.21.15.196:0/1074802796 <== mon.0 v2:172.21.15.196:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f8b3c084ca0 con 0x7f8b4c072430 2024-03-17T23:56:13.604 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:13.599+0000 7f8b4b7fe640 1 --2- 172.21.15.196:0/1074802796 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f8b38067660 0x7f8b38069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:13.604 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:13.599+0000 7f8b4b7fe640 1 --2- 172.21.15.196:0/1074802796 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f8b38067660 0x7f8b38069b20 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f8b400b1000 tx=0x7f8b40008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:56:13.607 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:13.603+0000 7f8b48ff9640 1 -- 172.21.15.196:0/1074802796 <== mon.0 v2:172.21.15.196:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177849 (secure 0 0 0) 0x7f8b4c1511d0 con 0x7f8b4c072430 2024-03-17T23:56:13.762 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:13.759+0000 7f8b52316640 1 -- 172.21.15.196:0/1074802796 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f8b4c0733e0 con 0x7f8b4c072430 2024-03-17T23:56:13.763 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:13.759+0000 7f8b48ff9640 1 -- 172.21.15.196:0/1074802796 <== mon.0 v2:172.21.15.196:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) ==== 93+0+10 (secure 0 0 0) 0x7f8b3c0559b0 con 0x7f8b4c072430 2024-03-17T23:56:13.763 INFO:teuthology.orchestra.run.smithi196.stdout:pg_num: 1 2024-03-17T23:56:13.765 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:13.763+0000 7f8b52316640 1 -- 172.21.15.196:0/1074802796 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f8b38067660 msgr2=0x7f8b38069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:13.765 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:13.763+0000 7f8b52316640 1 --2- 172.21.15.196:0/1074802796 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f8b38067660 0x7f8b38069b20 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f8b400b1000 tx=0x7f8b40008040 comp rx=0 tx=0).stop 2024-03-17T23:56:13.765 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:13.763+0000 7f8b52316640 1 -- 172.21.15.196:0/1074802796 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8b4c072430 msgr2=0x7f8b4c0c8170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:13.765 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:13.763+0000 7f8b52316640 1 --2- 172.21.15.196:0/1074802796 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8b4c072430 0x7f8b4c0c8170 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f8b3c00c3a0 tx=0x7f8b3c00c860 comp rx=0 tx=0).stop 2024-03-17T23:56:13.765 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:13.763+0000 7f8b52316640 1 -- 172.21.15.196:0/1074802796 shutdown_connections 2024-03-17T23:56:13.765 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:13.763+0000 7f8b52316640 1 --2- 172.21.15.196:0/1074802796 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f8b38067660 0x7f8b38069b20 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:13.765 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:13.763+0000 7f8b52316640 1 --2- 172.21.15.196:0/1074802796 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8b4c0c3490 0x7f8b4c0cbe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:13.765 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:13.763+0000 7f8b52316640 1 --2- 172.21.15.196:0/1074802796 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8b4c150df0 0x7f8b4c1e8570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:13.765 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:13.763+0000 7f8b52316640 1 --2- 172.21.15.196:0/1074802796 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8b4c072430 0x7f8b4c0c8170 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:13.766 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:13.763+0000 7f8b52316640 1 -- 172.21.15.196:0/1074802796 >> 172.21.15.196:0/1074802796 conn(0x7f8b4c06e7f0 msgr2=0x7f8b4c14fbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-17T23:56:13.766 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:13.763+0000 7f8b52316640 1 -- 172.21.15.196:0/1074802796 shutdown_connections 2024-03-17T23:56:13.766 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:13.763+0000 7f8b52316640 1 -- 172.21.15.196:0/1074802796 wait complete. 2024-03-17T23:56:13.786 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-17T23:56:13.894 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:13.891+0000 7f837305e640 1 Processor -- start 2024-03-17T23:56:13.894 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:13.891+0000 7f837305e640 1 -- start start 2024-03-17T23:56:13.895 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:13.891+0000 7f837305e640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f836c1511a0 0x7f836c0c78f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:13.895 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:13.891+0000 7f837305e640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f836c1577e0 con 0x7f836c0c7f70 2024-03-17T23:56:13.895 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:13.891+0000 7f837305e640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f836c157ac0 con 0x7f836c0735f0 2024-03-17T23:56:13.895 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:13.891+0000 7f837305e640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7f836c0c8970 con 0x7f836c1511a0 2024-03-17T23:56:13.895 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:13.891+0000 7f8370dfa640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f836c1511a0 0x7f836c0c78f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:13.895 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:13.891+0000 7f83715fb640 1 --1- >> v1:172.21.15.196:6789/0 conn(0x7f836c0c7f70 0x7f836c0c3ae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.196:6789/0 says I am v1:172.21.15.196:57264/0 (socket says 172.21.15.196:57264) 2024-03-17T23:56:13.895 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:13.891+0000 7f83715fb640 1 -- 172.21.15.196:0/210976256 learned_addr learned my addr 172.21.15.196:0/210976256 (peer_addr_for_me v1:172.21.15.196:0/0) 2024-03-17T23:56:13.896 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:13.891+0000 7f8370dfa640 1 -- 172.21.15.196:0/210976256 >> v1:172.21.15.204:6789/0 conn(0x7f836c0735f0 legacy=0x7f836c072450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:13.896 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:13.891+0000 7f8370dfa640 1 -- 172.21.15.196:0/210976256 >> v1:172.21.15.196:6789/0 conn(0x7f836c0c7f70 legacy=0x7f836c0c3ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:13.896 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:13.891+0000 7f8370dfa640 1 -- 172.21.15.196:0/210976256 --> v2:172.21.15.196:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f836c0c8bc0 con 0x7f836c1511a0 2024-03-17T23:56:13.896 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:13.891+0000 7f836b7fe640 1 -- 172.21.15.196:0/210976256 <== mon.0 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 982696421 0 0) 0x7f836c1577e0 con 0x7f836c0c7f70 2024-03-17T23:56:13.897 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:13.895+0000 7f8370dfa640 1 --2- 172.21.15.196:0/210976256 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f836c1511a0 0x7f836c0c78f0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f83640097c0 tx=0x7f836401ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c717482776aa6ea0 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:56:13.897 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:13.895+0000 7f836b7fe640 1 -- 172.21.15.196:0/210976256 <== mon.0 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83640b5070 con 0x7f836c1511a0 2024-03-17T23:56:13.897 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:13.895+0000 7f836b7fe640 1 -- 172.21.15.196:0/210976256 <== mon.0 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f83640a8990 con 0x7f836c1511a0 2024-03-17T23:56:13.898 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:13.895+0000 7f836b7fe640 1 -- 172.21.15.196:0/210976256 <== mon.0 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83640a8d60 con 0x7f836c1511a0 2024-03-17T23:56:13.898 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:13.895+0000 7f837305e640 1 -- 172.21.15.196:0/210976256 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f836c1511a0 msgr2=0x7f836c0c78f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:13.898 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:13.895+0000 7f837305e640 1 --2- 172.21.15.196:0/210976256 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f836c1511a0 0x7f836c0c78f0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f83640097c0 tx=0x7f836401ec90 comp rx=0 tx=0).stop 2024-03-17T23:56:13.899 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:13.895+0000 7f837305e640 1 -- 172.21.15.196:0/210976256 shutdown_connections 2024-03-17T23:56:13.899 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:13.895+0000 7f837305e640 1 --2- 172.21.15.196:0/210976256 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f836c1511a0 0x7f836c0c78f0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:13.899 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:13.895+0000 7f837305e640 1 -- 172.21.15.196:0/210976256 >> 172.21.15.196:0/210976256 conn(0x7f836c0cc5e0 msgr2=0x7f836c0cc9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-17T23:56:13.899 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:13.895+0000 7f837305e640 1 -- 172.21.15.196:0/210976256 shutdown_connections 2024-03-17T23:56:13.899 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:13.895+0000 7f837305e640 1 -- 172.21.15.196:0/210976256 wait complete. 2024-03-17T23:56:13.899 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:13.895+0000 7f837305e640 1 Processor -- start 2024-03-17T23:56:13.899 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:13.895+0000 7f837305e640 1 -- start start 2024-03-17T23:56:13.901 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:13.895+0000 7f837305e640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f836c0735f0 0x7f836c1f06a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:13.901 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:13.895+0000 7f837305e640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f836c0c7f70 0x7f836c1e13b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:13.901 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:13.895+0000 7f837305e640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f836c1511a0 0x7f836c155610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:13.901 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:13.895+0000 7f837305e640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f836c0c75a0 con 0x7f836c0735f0 2024-03-17T23:56:13.902 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:13.895+0000 7f837305e640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f836c0c7080 con 0x7f836c0c7f70 2024-03-17T23:56:13.902 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:13.895+0000 7f837305e640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f836c072b60 con 0x7f836c1511a0 2024-03-17T23:56:13.902 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:13.899+0000 7f8370dfa640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f836c0735f0 0x7f836c1f06a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:13.902 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:13.899+0000 7f8370dfa640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f836c0735f0 0x7f836c1f06a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.196:38100/0 (socket says 172.21.15.196:38100) 2024-03-17T23:56:13.902 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:13.899+0000 7f8370dfa640 1 -- 172.21.15.196:0/2913598194 learned_addr learned my addr 172.21.15.196:0/2913598194 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-03-17T23:56:13.902 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:13.899+0000 7f836bfff640 1 --2- 172.21.15.196:0/2913598194 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f836c0c7f70 0x7f836c1e13b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:13.902 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:13.899+0000 7f83715fb640 1 --2- 172.21.15.196:0/2913598194 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f836c1511a0 0x7f836c155610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:13.902 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:13.899+0000 7f8370dfa640 1 -- 172.21.15.196:0/2913598194 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f836c1511a0 msgr2=0x7f836c155610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:13.902 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:13.899+0000 7f8370dfa640 1 --2- 172.21.15.196:0/2913598194 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f836c1511a0 0x7f836c155610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:13.902 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:13.899+0000 7f8370dfa640 1 -- 172.21.15.196:0/2913598194 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f836c0c7f70 msgr2=0x7f836c1e13b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:13.902 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:13.899+0000 7f8370dfa640 1 --2- 172.21.15.196:0/2913598194 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f836c0c7f70 0x7f836c1e13b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:13.902 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:13.899+0000 7f8370dfa640 1 -- 172.21.15.196:0/2913598194 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f836c156360 con 0x7f836c0735f0 2024-03-17T23:56:13.902 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:13.899+0000 7f8370dfa640 1 --2- 172.21.15.196:0/2913598194 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f836c0735f0 0x7f836c1f06a0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f836401b8a0 tx=0x7f836401ba30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:56:13.902 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:13.899+0000 7f83697fa640 1 -- 172.21.15.196:0/2913598194 <== mon.0 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83640bd020 con 0x7f836c0735f0 2024-03-17T23:56:13.903 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:13.899+0000 7f83697fa640 1 -- 172.21.15.196:0/2913598194 <== mon.0 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f83640b0920 con 0x7f836c0735f0 2024-03-17T23:56:13.903 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:13.899+0000 7f837305e640 1 -- 172.21.15.196:0/2913598194 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f836c156640 con 0x7f836c0735f0 2024-03-17T23:56:13.903 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:13.899+0000 7f83697fa640 1 -- 172.21.15.196:0/2913598194 <== mon.0 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83640b5040 con 0x7f836c0735f0 2024-03-17T23:56:13.903 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:13.899+0000 7f837305e640 1 -- 172.21.15.196:0/2913598194 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f836c154e10 con 0x7f836c0735f0 2024-03-17T23:56:13.904 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:13.899+0000 7f837305e640 1 -- 172.21.15.196:0/2913598194 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f836c154c30 con 0x7f836c0735f0 2024-03-17T23:56:13.904 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:13.899+0000 7f83697fa640 1 -- 172.21.15.196:0/2913598194 <== mon.0 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 5) ==== 87083+0+0 (secure 0 0 0) 0x7f83640c0020 con 0x7f836c0735f0 2024-03-17T23:56:13.904 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:13.899+0000 7f83697fa640 1 --2- 172.21.15.196:0/2913598194 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f8358067660 0x7f8358069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:13.904 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:13.899+0000 7f83697fa640 1 -- 172.21.15.196:0/2913598194 <== mon.0 v2:172.21.15.196:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f8364122c00 con 0x7f836c0735f0 2024-03-17T23:56:13.904 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:13.899+0000 7f836bfff640 1 --2- 172.21.15.196:0/2913598194 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f8358067660 0x7f8358069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:13.904 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:13.903+0000 7f836bfff640 1 --2- 172.21.15.196:0/2913598194 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f8358067660 0x7f8358069b20 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f836c14b870 tx=0x7f8360009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:56:13.907 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:13.903+0000 7f83697fa640 1 -- 172.21.15.196:0/2913598194 <== mon.0 v2:172.21.15.196:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177849 (secure 0 0 0) 0x7f836c154c30 con 0x7f836c0735f0 2024-03-17T23:56:14.059 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:14.055+0000 7f837305e640 1 -- 172.21.15.196:0/2913598194 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f836c0689a0 con 0x7f836c0735f0 2024-03-17T23:56:14.060 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:14.055+0000 7f83697fa640 1 -- 172.21.15.196:0/2913598194 <== mon.0 v2:172.21.15.196:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) ==== 104+0+11 (secure 0 0 0) 0x7f8364129080 con 0x7f836c0735f0 2024-03-17T23:56:14.060 INFO:teuthology.orchestra.run.smithi196.stdout:pg_num: 32 2024-03-17T23:56:14.062 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:14.059+0000 7f837305e640 1 -- 172.21.15.196:0/2913598194 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f8358067660 msgr2=0x7f8358069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:14.062 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:14.059+0000 7f837305e640 1 --2- 172.21.15.196:0/2913598194 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f8358067660 0x7f8358069b20 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f836c14b870 tx=0x7f8360009040 comp rx=0 tx=0).stop 2024-03-17T23:56:14.062 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:14.059+0000 7f837305e640 1 -- 172.21.15.196:0/2913598194 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f836c0735f0 msgr2=0x7f836c1f06a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:14.062 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:14.059+0000 7f837305e640 1 --2- 172.21.15.196:0/2913598194 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f836c0735f0 0x7f836c1f06a0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f836401b8a0 tx=0x7f836401ba30 comp rx=0 tx=0).stop 2024-03-17T23:56:14.062 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:14.059+0000 7f837305e640 1 -- 172.21.15.196:0/2913598194 shutdown_connections 2024-03-17T23:56:14.062 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:14.059+0000 7f837305e640 1 --2- 172.21.15.196:0/2913598194 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f8358067660 0x7f8358069b20 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:14.062 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:14.059+0000 7f837305e640 1 --2- 172.21.15.196:0/2913598194 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f836c1511a0 0x7f836c155610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:14.062 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:14.059+0000 7f837305e640 1 --2- 172.21.15.196:0/2913598194 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f836c0c7f70 0x7f836c1e13b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:14.062 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:14.059+0000 7f837305e640 1 --2- 172.21.15.196:0/2913598194 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f836c0735f0 0x7f836c1f06a0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:14.063 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:14.059+0000 7f837305e640 1 -- 172.21.15.196:0/2913598194 >> 172.21.15.196:0/2913598194 conn(0x7f836c0cc5e0 msgr2=0x7f836c070100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-17T23:56:14.063 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:14.059+0000 7f837305e640 1 -- 172.21.15.196:0/2913598194 shutdown_connections 2024-03-17T23:56:14.063 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:14.059+0000 7f837305e640 1 -- 172.21.15.196:0/2913598194 wait complete. 2024-03-17T23:56:14.076 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-17T23:56:14.186 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:14.183+0000 7f769ffff640 1 Processor -- start 2024-03-17T23:56:14.187 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:14.183+0000 7f769ffff640 1 -- start start 2024-03-17T23:56:14.187 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:14.183+0000 7f769ffff640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f7698151fc0 0x7f769806b2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:14.188 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:14.183+0000 7f769ffff640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f769806e2f0 0x7f76981589d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:14.188 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:14.183+0000 7f769ffff640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f76980731e0 con 0x7f7698071bd0 2024-03-17T23:56:14.188 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:14.183+0000 7f769ffff640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7f7698157f30 con 0x7f7698151fc0 2024-03-17T23:56:14.188 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:14.183+0000 7f769ffff640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 -- 0x7f7698073450 con 0x7f769806e2f0 2024-03-17T23:56:14.188 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:14.183+0000 7f769dd9b640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f7698151fc0 0x7f769806b2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:14.188 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:14.183+0000 7f769e59c640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f769806e2f0 0x7f76981589d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:14.188 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:14.183+0000 7f769dd9b640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f7698151fc0 0x7f769806b2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.196:38112/0 (socket says 172.21.15.196:38112) 2024-03-17T23:56:14.188 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:14.183+0000 7f769dd9b640 1 -- 172.21.15.196:0/1433197317 learned_addr learned my addr 172.21.15.196:0/1433197317 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-03-17T23:56:14.188 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:14.183+0000 7f769dd9b640 1 -- 172.21.15.196:0/1433197317 >> v2:172.21.15.204:3300/0 conn(0x7f769806e2f0 msgr2=0x7f76981589d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-17T23:56:14.188 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:14.183+0000 7f769dd9b640 1 --2- 172.21.15.196:0/1433197317 >> v2:172.21.15.204:3300/0 conn(0x7f769806e2f0 0x7f76981589d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:14.188 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:14.183+0000 7f769dd9b640 1 -- 172.21.15.196:0/1433197317 >> v1:172.21.15.204:6789/0 conn(0x7f7698071bd0 legacy=0x7f769806d240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:14.188 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:14.183+0000 7f769dd9b640 1 -- 172.21.15.196:0/1433197317 --> v2:172.21.15.196:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76981581d0 con 0x7f7698151fc0 2024-03-17T23:56:14.189 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:14.187+0000 7f769e59c640 1 --2- 172.21.15.196:0/1433197317 >> v2:172.21.15.204:3300/0 conn(0x7f769806e2f0 0x7f76981589d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-17T23:56:14.190 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:14.187+0000 7f769dd9b640 1 --2- 172.21.15.196:0/1433197317 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7698151fc0 0x7f769806b2b0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f76980c8870 tx=0x7f769401ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c19efe69d428de17 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:56:14.190 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:14.187+0000 7f769cd99640 1 -- 172.21.15.196:0/1433197317 <== mon.0 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76940b5070 con 0x7f7698151fc0 2024-03-17T23:56:14.190 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:14.187+0000 7f769cd99640 1 -- 172.21.15.196:0/1433197317 <== mon.0 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f76940a8a10 con 0x7f7698151fc0 2024-03-17T23:56:14.190 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:14.187+0000 7f769cd99640 1 -- 172.21.15.196:0/1433197317 <== mon.0 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76940a8de0 con 0x7f7698151fc0 2024-03-17T23:56:14.191 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:14.187+0000 7f769ffff640 1 -- 172.21.15.196:0/1433197317 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7698151fc0 msgr2=0x7f769806b2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:14.191 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:14.187+0000 7f769ffff640 1 --2- 172.21.15.196:0/1433197317 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7698151fc0 0x7f769806b2b0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f76980c8870 tx=0x7f769401ed10 comp rx=0 tx=0).stop 2024-03-17T23:56:14.191 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:14.187+0000 7f769ffff640 1 -- 172.21.15.196:0/1433197317 shutdown_connections 2024-03-17T23:56:14.191 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:14.187+0000 7f769ffff640 1 --2- 172.21.15.196:0/1433197317 >> v2:172.21.15.204:3300/0 conn(0x7f769806e2f0 0x7f76981589d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:14.191 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:14.187+0000 7f769ffff640 1 --2- 172.21.15.196:0/1433197317 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7698151fc0 0x7f769806b2b0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:14.191 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:14.187+0000 7f769ffff640 1 -- 172.21.15.196:0/1433197317 >> 172.21.15.196:0/1433197317 conn(0x7f76980c8b70 msgr2=0x7f76980c8f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-17T23:56:14.191 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:14.187+0000 7f769ffff640 1 -- 172.21.15.196:0/1433197317 shutdown_connections 2024-03-17T23:56:14.192 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:14.187+0000 7f769ffff640 1 -- 172.21.15.196:0/1433197317 wait complete. 2024-03-17T23:56:14.192 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:14.187+0000 7f769ffff640 1 Processor -- start 2024-03-17T23:56:14.192 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:14.187+0000 7f769ffff640 1 -- start start 2024-03-17T23:56:14.194 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:14.191+0000 7f769ffff640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f769806e2f0 0x7f76981532d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:14.194 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:14.191+0000 7f769ffff640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7698071bd0 0x7f769806f740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:14.194 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:14.191+0000 7f769ffff640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7698151fc0 0x7f7698154000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:14.194 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:14.191+0000 7f769ffff640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f76980c72b0 con 0x7f769806e2f0 2024-03-17T23:56:14.194 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:14.191+0000 7f769ffff640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f7698073730 con 0x7f7698071bd0 2024-03-17T23:56:14.194 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:14.191+0000 7f769ffff640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f76980c7430 con 0x7f7698151fc0 2024-03-17T23:56:14.194 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:14.191+0000 7f769dd9b640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f769806e2f0 0x7f76981532d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:14.195 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:14.191+0000 7f769dd9b640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f769806e2f0 0x7f76981532d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.196:38126/0 (socket says 172.21.15.196:38126) 2024-03-17T23:56:14.195 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:14.191+0000 7f769dd9b640 1 -- 172.21.15.196:0/1937819811 learned_addr learned my addr 172.21.15.196:0/1937819811 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-03-17T23:56:14.195 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:14.191+0000 7f769d59a640 1 --2- 172.21.15.196:0/1937819811 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7698071bd0 0x7f769806f740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:14.195 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:14.191+0000 7f769e59c640 1 --2- 172.21.15.196:0/1937819811 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7698151fc0 0x7f7698154000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:14.195 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:14.191+0000 7f769dd9b640 1 -- 172.21.15.196:0/1937819811 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7698151fc0 msgr2=0x7f7698154000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:14.195 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:14.191+0000 7f769dd9b640 1 --2- 172.21.15.196:0/1937819811 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7698151fc0 0x7f7698154000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:14.195 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:14.191+0000 7f769dd9b640 1 -- 172.21.15.196:0/1937819811 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7698071bd0 msgr2=0x7f769806f740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:14.195 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:14.191+0000 7f769dd9b640 1 --2- 172.21.15.196:0/1937819811 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7698071bd0 0x7f769806f740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:14.195 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:14.191+0000 7f769dd9b640 1 -- 172.21.15.196:0/1937819811 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76981e3e50 con 0x7f769806e2f0 2024-03-17T23:56:14.195 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:14.191+0000 7f769dd9b640 1 --2- 172.21.15.196:0/1937819811 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f769806e2f0 0x7f76981532d0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f769401b920 tx=0x7f769401bab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:56:14.195 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:14.191+0000 7f768e7fc640 1 -- 172.21.15.196:0/1937819811 <== mon.0 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76940b5070 con 0x7f769806e2f0 2024-03-17T23:56:14.195 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:14.191+0000 7f768e7fc640 1 -- 172.21.15.196:0/1937819811 <== mon.0 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f76940b0ab0 con 0x7f769806e2f0 2024-03-17T23:56:14.195 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:14.191+0000 7f768e7fc640 1 -- 172.21.15.196:0/1937819811 <== mon.0 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76940bb410 con 0x7f769806e2f0 2024-03-17T23:56:14.195 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:14.191+0000 7f769ffff640 1 -- 172.21.15.196:0/1937819811 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f76981528b0 con 0x7f769806e2f0 2024-03-17T23:56:14.195 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:14.191+0000 7f769ffff640 1 -- 172.21.15.196:0/1937819811 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76981e1250 con 0x7f769806e2f0 2024-03-17T23:56:14.196 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:14.191+0000 7f767bfff640 1 -- 172.21.15.196:0/1937819811 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f76740052a0 con 0x7f769806e2f0 2024-03-17T23:56:14.196 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:14.191+0000 7f768e7fc640 1 -- 172.21.15.196:0/1937819811 <== mon.0 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 5) ==== 87083+0+0 (secure 0 0 0) 0x7f76940c2060 con 0x7f769806e2f0 2024-03-17T23:56:14.196 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:14.191+0000 7f768e7fc640 1 --2- 172.21.15.196:0/1937819811 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f767c067660 0x7f767c069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:14.196 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:14.191+0000 7f768e7fc640 1 -- 172.21.15.196:0/1937819811 <== mon.0 v2:172.21.15.196:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f7694122880 con 0x7f769806e2f0 2024-03-17T23:56:14.196 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:14.191+0000 7f769d59a640 1 --2- 172.21.15.196:0/1937819811 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f767c067660 0x7f767c069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:14.197 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:14.195+0000 7f769d59a640 1 --2- 172.21.15.196:0/1937819811 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f767c067660 0x7f767c069b20 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f769813f780 tx=0x7f7688009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:56:14.200 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:14.195+0000 7f768e7fc640 1 -- 172.21.15.196:0/1937819811 <== mon.0 v2:172.21.15.196:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177849 (secure 0 0 0) 0x7f7694018890 con 0x7f769806e2f0 2024-03-17T23:56:14.353 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:14.351+0000 7f767bfff640 1 -- 172.21.15.196:0/1937819811 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f7674005860 con 0x7f769806e2f0 2024-03-17T23:56:14.353 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:14.351+0000 7f768e7fc640 1 -- 172.21.15.196:0/1937819811 <== mon.0 v2:172.21.15.196:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) ==== 100+0+11 (secure 0 0 0) 0x7f76940f3500 con 0x7f769806e2f0 2024-03-17T23:56:14.353 INFO:teuthology.orchestra.run.smithi196.stdout:pg_num: 64 2024-03-17T23:56:14.357 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:14.355+0000 7f767bfff640 1 -- 172.21.15.196:0/1937819811 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f767c067660 msgr2=0x7f767c069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:14.357 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:14.355+0000 7f767bfff640 1 --2- 172.21.15.196:0/1937819811 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f767c067660 0x7f767c069b20 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f769813f780 tx=0x7f7688009040 comp rx=0 tx=0).stop 2024-03-17T23:56:14.357 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:14.355+0000 7f767bfff640 1 -- 172.21.15.196:0/1937819811 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f769806e2f0 msgr2=0x7f76981532d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:14.357 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:14.355+0000 7f767bfff640 1 --2- 172.21.15.196:0/1937819811 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f769806e2f0 0x7f76981532d0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f769401b920 tx=0x7f769401bab0 comp rx=0 tx=0).stop 2024-03-17T23:56:14.357 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:14.355+0000 7f767bfff640 1 -- 172.21.15.196:0/1937819811 shutdown_connections 2024-03-17T23:56:14.357 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:14.355+0000 7f767bfff640 1 --2- 172.21.15.196:0/1937819811 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f767c067660 0x7f767c069b20 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:14.357 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:14.355+0000 7f767bfff640 1 --2- 172.21.15.196:0/1937819811 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7698151fc0 0x7f7698154000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:14.357 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:14.355+0000 7f767bfff640 1 --2- 172.21.15.196:0/1937819811 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7698071bd0 0x7f769806f740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:14.357 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:14.355+0000 7f767bfff640 1 --2- 172.21.15.196:0/1937819811 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f769806e2f0 0x7f76981532d0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:14.357 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:14.355+0000 7f767bfff640 1 -- 172.21.15.196:0/1937819811 >> 172.21.15.196:0/1937819811 conn(0x7f76980c8b70 msgr2=0x7f7698147b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-17T23:56:14.357 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:14.355+0000 7f767bfff640 1 -- 172.21.15.196:0/1937819811 shutdown_connections 2024-03-17T23:56:14.357 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:14.355+0000 7f767bfff640 1 -- 172.21.15.196:0/1937819811 wait complete. 2024-03-17T23:56:14.372 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-17T23:56:14.478 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:14.475+0000 7fa5d37d6640 1 Processor -- start 2024-03-17T23:56:14.478 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:14.475+0000 7fa5d37d6640 1 -- start start 2024-03-17T23:56:14.480 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:14.475+0000 7fa5d37d6640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fa5cc150e50 0x7fa5cc0c8600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:14.480 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:14.475+0000 7fa5d37d6640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa5cc15a470 0x7fa5cc15a890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:14.480 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:14.475+0000 7fa5d37d6640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fa5cc06f8d0 0x7fa5cc06fd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:14.480 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:14.475+0000 7fa5d37d6640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7fa5cc151230 con 0x7fa5cc06f8d0 2024-03-17T23:56:14.480 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:14.475+0000 7fa5d37d6640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 -- 0x7fa5cc0c7620 con 0x7fa5cc150e50 2024-03-17T23:56:14.480 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:14.475+0000 7fa5d37d6640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7fa5cc0c7900 con 0x7fa5cc15a470 2024-03-17T23:56:14.480 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:14.475+0000 7fa5d1d73640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fa5cc06f8d0 0x7fa5cc06fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:14.480 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:14.475+0000 7fa5d1d73640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fa5cc06f8d0 0x7fa5cc06fd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.196:38128/0 (socket says 172.21.15.196:38128) 2024-03-17T23:56:14.480 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:14.475+0000 7fa5d1d73640 1 -- 172.21.15.196:0/2922167018 learned_addr learned my addr 172.21.15.196:0/2922167018 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-03-17T23:56:14.480 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:14.475+0000 7fa5d0d71640 1 --2- 172.21.15.196:0/2922167018 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa5cc15a470 0x7fa5cc15a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:14.480 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:14.475+0000 7fa5d1572640 1 --2- 172.21.15.196:0/2922167018 >> v2:172.21.15.204:3300/0 conn(0x7fa5cc150e50 0x7fa5cc0c8600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:14.480 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:14.475+0000 7fa5d1d73640 1 -- 172.21.15.196:0/2922167018 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa5cc15a470 msgr2=0x7fa5cc15a890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-17T23:56:14.481 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:14.475+0000 7fa5d1d73640 1 --2- 172.21.15.196:0/2922167018 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa5cc15a470 0x7fa5cc15a890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:14.481 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:14.475+0000 7fa5d1d73640 1 -- 172.21.15.196:0/2922167018 >> v2:172.21.15.204:3300/0 conn(0x7fa5cc150e50 msgr2=0x7fa5cc0c8600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-17T23:56:14.481 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:14.475+0000 7fa5d1d73640 1 --2- 172.21.15.196:0/2922167018 >> v2:172.21.15.204:3300/0 conn(0x7fa5cc150e50 0x7fa5cc0c8600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:14.481 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:14.475+0000 7fa5d1d73640 1 -- 172.21.15.196:0/2922167018 --> v2:172.21.15.196:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5cc0c7be0 con 0x7fa5cc06f8d0 2024-03-17T23:56:14.483 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:14.479+0000 7fa5d0d71640 1 --2- 172.21.15.196:0/2922167018 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa5cc15a470 0x7fa5cc15a890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-17T23:56:14.483 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:14.479+0000 7fa5d1d73640 1 --2- 172.21.15.196:0/2922167018 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa5cc06f8d0 0x7fa5cc06fd20 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fa5cc068640 tx=0x7fa5c401f200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f6193a800c7e13 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:56:14.483 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:14.479+0000 7fa5c3fff640 1 -- 172.21.15.196:0/2922167018 <== mon.0 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5c40b4070 con 0x7fa5cc06f8d0 2024-03-17T23:56:14.483 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:14.479+0000 7fa5c3fff640 1 -- 172.21.15.196:0/2922167018 <== mon.0 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa5c40af400 con 0x7fa5cc06f8d0 2024-03-17T23:56:14.483 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:14.479+0000 7fa5c3fff640 1 -- 172.21.15.196:0/2922167018 <== mon.0 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5c40af7b0 con 0x7fa5cc06f8d0 2024-03-17T23:56:14.484 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:14.479+0000 7fa5d37d6640 1 -- 172.21.15.196:0/2922167018 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa5cc06f8d0 msgr2=0x7fa5cc06fd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:14.484 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:14.479+0000 7fa5d37d6640 1 --2- 172.21.15.196:0/2922167018 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa5cc06f8d0 0x7fa5cc06fd20 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fa5cc068640 tx=0x7fa5c401f200 comp rx=0 tx=0).stop 2024-03-17T23:56:14.484 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:14.479+0000 7fa5d37d6640 1 -- 172.21.15.196:0/2922167018 shutdown_connections 2024-03-17T23:56:14.484 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:14.479+0000 7fa5d37d6640 1 --2- 172.21.15.196:0/2922167018 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa5cc06f8d0 0x7fa5cc06fd20 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:14.484 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:14.479+0000 7fa5d37d6640 1 --2- 172.21.15.196:0/2922167018 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa5cc15a470 0x7fa5cc15a890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:14.484 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:14.479+0000 7fa5d37d6640 1 --2- 172.21.15.196:0/2922167018 >> v2:172.21.15.204:3300/0 conn(0x7fa5cc150e50 0x7fa5cc0c8600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:14.484 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:14.479+0000 7fa5d37d6640 1 -- 172.21.15.196:0/2922167018 >> 172.21.15.196:0/2922167018 conn(0x7fa5cc0cc420 msgr2=0x7fa5cc0cc830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-17T23:56:14.484 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:14.479+0000 7fa5d37d6640 1 -- 172.21.15.196:0/2922167018 shutdown_connections 2024-03-17T23:56:14.484 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:14.479+0000 7fa5d37d6640 1 -- 172.21.15.196:0/2922167018 wait complete. 2024-03-17T23:56:14.486 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:14.483+0000 7fa5d37d6640 1 Processor -- start 2024-03-17T23:56:14.486 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:14.483+0000 7fa5d37d6640 1 -- start start 2024-03-17T23:56:14.487 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:14.483+0000 7fa5d37d6640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa5cc06f8d0 0x7fa5cc1f3bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:14.487 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:14.483+0000 7fa5d37d6640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa5cc150e50 0x7fa5cc159bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:14.487 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:14.483+0000 7fa5d37d6640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa5cc15a470 0x7fa5cc0cb590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:14.487 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:14.483+0000 7fa5d37d6640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fa5cc15add0 con 0x7fa5cc06f8d0 2024-03-17T23:56:14.487 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:14.483+0000 7fa5d37d6640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7fa5cc0c81a0 con 0x7fa5cc15a470 2024-03-17T23:56:14.487 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:14.483+0000 7fa5d37d6640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7fa5cc070db0 con 0x7fa5cc150e50 2024-03-17T23:56:14.487 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:14.483+0000 7fa5d1572640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa5cc06f8d0 0x7fa5cc1f3bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:14.487 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:14.483+0000 7fa5d1572640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa5cc06f8d0 0x7fa5cc1f3bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.196:38136/0 (socket says 172.21.15.196:38136) 2024-03-17T23:56:14.487 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:14.483+0000 7fa5d1572640 1 -- 172.21.15.196:0/163907966 learned_addr learned my addr 172.21.15.196:0/163907966 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-03-17T23:56:14.487 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:14.483+0000 7fa5d1d73640 1 --2- 172.21.15.196:0/163907966 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa5cc15a470 0x7fa5cc0cb590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:14.487 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:14.483+0000 7fa5d0d71640 1 --2- 172.21.15.196:0/163907966 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa5cc150e50 0x7fa5cc159bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:14.487 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:14.483+0000 7fa5d1572640 1 -- 172.21.15.196:0/163907966 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa5cc150e50 msgr2=0x7fa5cc159bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:14.487 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:14.483+0000 7fa5d1572640 1 --2- 172.21.15.196:0/163907966 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa5cc150e50 0x7fa5cc159bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:14.487 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:14.483+0000 7fa5d1572640 1 -- 172.21.15.196:0/163907966 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa5cc15a470 msgr2=0x7fa5cc0cb590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:14.488 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:14.483+0000 7fa5d1572640 1 --2- 172.21.15.196:0/163907966 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa5cc15a470 0x7fa5cc0cb590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:14.488 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:14.483+0000 7fa5d1572640 1 -- 172.21.15.196:0/163907966 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5cc1f4100 con 0x7fa5cc06f8d0 2024-03-17T23:56:14.488 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:14.483+0000 7fa5d1d73640 1 --2- 172.21.15.196:0/163907966 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa5cc15a470 0x7fa5cc0cb590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-17T23:56:14.488 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:14.483+0000 7fa5d1572640 1 --2- 172.21.15.196:0/163907966 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa5cc06f8d0 0x7fa5cc1f3bc0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fa5c800e8e0 tx=0x7fa5c800eda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:56:14.488 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:14.483+0000 7fa5c1ffb640 1 -- 172.21.15.196:0/163907966 <== mon.0 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5c8017070 con 0x7fa5cc06f8d0 2024-03-17T23:56:14.488 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:14.483+0000 7fa5c1ffb640 1 -- 172.21.15.196:0/163907966 <== mon.0 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa5c800ca00 con 0x7fa5cc06f8d0 2024-03-17T23:56:14.488 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:14.483+0000 7fa5d37d6640 1 -- 172.21.15.196:0/163907966 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa5cc1529c0 con 0x7fa5cc06f8d0 2024-03-17T23:56:14.488 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:14.483+0000 7fa5c1ffb640 1 -- 172.21.15.196:0/163907966 <== mon.0 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5c800cdd0 con 0x7fa5cc06f8d0 2024-03-17T23:56:14.488 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:14.483+0000 7fa5d37d6640 1 -- 172.21.15.196:0/163907966 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5cc152f80 con 0x7fa5cc06f8d0 2024-03-17T23:56:14.489 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:14.483+0000 7fa5d37d6640 1 -- 172.21.15.196:0/163907966 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa5cc0689a0 con 0x7fa5cc06f8d0 2024-03-17T23:56:14.489 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:14.483+0000 7fa5c1ffb640 1 -- 172.21.15.196:0/163907966 <== mon.0 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 5) ==== 87083+0+0 (secure 0 0 0) 0x7fa5c801a070 con 0x7fa5cc06f8d0 2024-03-17T23:56:14.489 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:14.487+0000 7fa5c1ffb640 1 --2- 172.21.15.196:0/163907966 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7fa5b0067660 0x7fa5b0069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:14.489 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:14.487+0000 7fa5c1ffb640 1 -- 172.21.15.196:0/163907966 <== mon.0 v2:172.21.15.196:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fa5c80858c0 con 0x7fa5cc06f8d0 2024-03-17T23:56:14.489 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:14.487+0000 7fa5d0d71640 1 --2- 172.21.15.196:0/163907966 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7fa5b0067660 0x7fa5b0069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:14.489 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:14.487+0000 7fa5d0d71640 1 --2- 172.21.15.196:0/163907966 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7fa5b0067660 0x7fa5b0069b20 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fa5bc009580 tx=0x7fa5bc009190 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:56:14.496 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:14.495+0000 7fa5c1ffb640 1 -- 172.21.15.196:0/163907966 <== mon.0 v2:172.21.15.196:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177849 (secure 0 0 0) 0x7fa5c8055e60 con 0x7fa5cc06f8d0 2024-03-17T23:56:14.684 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:14.679+0000 7fa5d37d6640 1 -- 172.21.15.196:0/163907966 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa5cc150680 con 0x7fa5cc06f8d0 2024-03-17T23:56:14.685 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:14.683+0000 7fa5c1ffb640 1 -- 172.21.15.196:0/163907966 <== mon.0 v2:172.21.15.196:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) ==== 94+0+6922 (secure 0 0 0) 0x7fa5c8059f00 con 0x7fa5cc06f8d0 2024-03-17T23:56:14.685 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-03-17T23:56:14.685 INFO:teuthology.orchestra.run.smithi196.stdout:{"epoch":14,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4211,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6835/1901351791","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6834","nonce":1901351791},{"type":"v1","addr":"172.21.15.204:6835","nonce":1901351791}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-17T23:56:01.019247+0000","modified":"2024-03-17T23:56:07.696894+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4284,"mds_1":4281,"mds_2":4275,"mds_3":4264,"mds_4":4261},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4261":{"gid":4261,"name":"d","rank":4,"incarnation":13,"state":"up:active","state_seq":5,"addr":"172.21.15.204:6837/3888512151","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6836","nonce":3888512151},{"type":"v1","addr":"172.21.15.204:6837","nonce":3888512151}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4264":{"gid":4264,"name":"f","rank":3,"incarnation":11,"state":"up:active","state_seq":4,"addr":"172.21.15.204:6839/2849161202","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6838","nonce":2849161202},{"type":"v1","addr":"172.21.15.204:6839","nonce":2849161202}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4275":{"gid":4275,"name":"a","rank":2,"incarnation":9,"state":"up:active","state_seq":4,"addr":"172.21.15.196:6833/2075619627","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6832","nonce":2075619627},{"type":"v1","addr":"172.21.15.196:6833","nonce":2075619627}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4281":{"gid":4281,"name":"e","rank":1,"incarnation":7,"state":"up:active","state_seq":4,"addr":"172.21.15.196:6835/1837184297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6834","nonce":1837184297},{"type":"v1","addr":"172.21.15.196:6835","nonce":1837184297}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4284":{"gid":4284,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.196:6837/2436120950","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6836","nonce":2436120950},{"type":"v1","addr":"172.21.15.196:6837","nonce":2436120950}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4284,"qdb_cluster":[4261,4264,4275,4281,4284]},"id":1}]} 2024-03-17T23:56:14.685 INFO:teuthology.orchestra.run.smithi196.stderr:dumped fsmap epoch 14 2024-03-17T23:56:14.687 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:14.683+0000 7fa5d37d6640 1 -- 172.21.15.196:0/163907966 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7fa5b0067660 msgr2=0x7fa5b0069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:14.687 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:14.683+0000 7fa5d37d6640 1 --2- 172.21.15.196:0/163907966 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7fa5b0067660 0x7fa5b0069b20 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fa5bc009580 tx=0x7fa5bc009190 comp rx=0 tx=0).stop 2024-03-17T23:56:14.687 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:14.683+0000 7fa5d37d6640 1 -- 172.21.15.196:0/163907966 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa5cc06f8d0 msgr2=0x7fa5cc1f3bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:14.687 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:14.683+0000 7fa5d37d6640 1 --2- 172.21.15.196:0/163907966 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa5cc06f8d0 0x7fa5cc1f3bc0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fa5c800e8e0 tx=0x7fa5c800eda0 comp rx=0 tx=0).stop 2024-03-17T23:56:14.687 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:14.683+0000 7fa5d37d6640 1 -- 172.21.15.196:0/163907966 shutdown_connections 2024-03-17T23:56:14.687 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:14.683+0000 7fa5d37d6640 1 --2- 172.21.15.196:0/163907966 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7fa5b0067660 0x7fa5b0069b20 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:14.687 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:14.683+0000 7fa5d37d6640 1 --2- 172.21.15.196:0/163907966 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa5cc150e50 0x7fa5cc159bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:14.687 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:14.683+0000 7fa5d37d6640 1 --2- 172.21.15.196:0/163907966 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa5cc15a470 0x7fa5cc0cb590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:14.687 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:14.683+0000 7fa5d37d6640 1 --2- 172.21.15.196:0/163907966 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa5cc06f8d0 0x7fa5cc1f3bc0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:14.688 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:14.683+0000 7fa5d37d6640 1 -- 172.21.15.196:0/163907966 >> 172.21.15.196:0/163907966 conn(0x7fa5cc0cc420 msgr2=0x7fa5cc0c98c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-17T23:56:14.688 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:14.683+0000 7fa5d37d6640 1 -- 172.21.15.196:0/163907966 shutdown_connections 2024-03-17T23:56:14.688 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:14.683+0000 7fa5d37d6640 1 -- 172.21.15.196:0/163907966 wait complete. 2024-03-17T23:56:14.702 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-17T23:56:14.806 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:14.803+0000 7feba2354640 1 Processor -- start 2024-03-17T23:56:14.806 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:14.803+0000 7feba2354640 1 -- start start 2024-03-17T23:56:14.807 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:14.803+0000 7feba2354640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7feb9c150e50 0x7feb9c0c8600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:14.807 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:14.803+0000 7feba2354640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7feb9c06f8d0 0x7feb9c06fd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:14.808 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:14.803+0000 7feba2354640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feb9c151230 con 0x7feb9c15a470 2024-03-17T23:56:14.808 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:14.803+0000 7feba2354640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7feb9c0c7620 con 0x7feb9c06f8d0 2024-03-17T23:56:14.808 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:14.803+0000 7feba2354640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7feb9c0c7900 con 0x7feb9c150e50 2024-03-17T23:56:14.808 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:14.803+0000 7feba08f1640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7feb9c06f8d0 0x7feb9c06fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:14.808 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:14.803+0000 7feb9b7fe640 1 --1- >> v1:172.21.15.196:6789/0 conn(0x7feb9c15a470 0x7feb9c15a890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.196:6789/0 says I am v1:172.21.15.196:57280/0 (socket says 172.21.15.196:57280) 2024-03-17T23:56:14.808 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:14.803+0000 7feb9b7fe640 1 -- 172.21.15.196:0/1311252828 learned_addr learned my addr 172.21.15.196:0/1311252828 (peer_addr_for_me v1:172.21.15.196:0/0) 2024-03-17T23:56:14.808 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:14.803+0000 7feb9bfff640 1 --2- 172.21.15.196:0/1311252828 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7feb9c150e50 0x7feb9c0c8600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:14.808 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:14.803+0000 7feba08f1640 1 -- 172.21.15.196:0/1311252828 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7feb9c150e50 msgr2=0x7feb9c0c8600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-17T23:56:14.808 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:14.803+0000 7feba08f1640 1 --2- 172.21.15.196:0/1311252828 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7feb9c150e50 0x7feb9c0c8600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:14.808 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:14.803+0000 7feba08f1640 1 -- 172.21.15.196:0/1311252828 >> v1:172.21.15.196:6789/0 conn(0x7feb9c15a470 legacy=0x7feb9c15a890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:14.808 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:14.803+0000 7feba08f1640 1 -- 172.21.15.196:0/1311252828 --> v2:172.21.15.196:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb9c0c7be0 con 0x7feb9c06f8d0 2024-03-17T23:56:14.808 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:14.803+0000 7feb9affd640 1 -- 172.21.15.196:0/1311252828 <== mon.0 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 233943712 0 0) 0x7feb9c151230 con 0x7feb9c15a470 2024-03-17T23:56:14.811 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:14.807+0000 7feba08f1640 1 --2- 172.21.15.196:0/1311252828 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7feb9c06f8d0 0x7feb9c06fd20 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7feb94009d90 tx=0x7feb9401f150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba3bb2fc61dbbeb5 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:56:14.811 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:14.807+0000 7feb9affd640 1 -- 172.21.15.196:0/1311252828 <== mon.0 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb940b4070 con 0x7feb9c06f8d0 2024-03-17T23:56:14.811 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:14.807+0000 7feb9affd640 1 -- 172.21.15.196:0/1311252828 <== mon.0 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb940af600 con 0x7feb9c06f8d0 2024-03-17T23:56:14.811 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:14.807+0000 7feb9affd640 1 -- 172.21.15.196:0/1311252828 <== mon.0 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb940af9d0 con 0x7feb9c06f8d0 2024-03-17T23:56:14.812 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:14.807+0000 7feba2354640 1 -- 172.21.15.196:0/1311252828 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7feb9c06f8d0 msgr2=0x7feb9c06fd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:14.812 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:14.807+0000 7feba2354640 1 --2- 172.21.15.196:0/1311252828 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7feb9c06f8d0 0x7feb9c06fd20 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7feb94009d90 tx=0x7feb9401f150 comp rx=0 tx=0).stop 2024-03-17T23:56:14.812 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:14.807+0000 7feba2354640 1 -- 172.21.15.196:0/1311252828 shutdown_connections 2024-03-17T23:56:14.812 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:14.807+0000 7feba2354640 1 --2- 172.21.15.196:0/1311252828 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7feb9c06f8d0 0x7feb9c06fd20 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:14.812 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:14.807+0000 7feba2354640 1 --2- 172.21.15.196:0/1311252828 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7feb9c150e50 0x7feb9c0c8600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:14.812 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:14.807+0000 7feba2354640 1 -- 172.21.15.196:0/1311252828 >> 172.21.15.196:0/1311252828 conn(0x7feb9c0cc420 msgr2=0x7feb9c0cc830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-17T23:56:14.812 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:14.807+0000 7feba2354640 1 -- 172.21.15.196:0/1311252828 shutdown_connections 2024-03-17T23:56:14.812 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:14.807+0000 7feba2354640 1 -- 172.21.15.196:0/1311252828 wait complete. 2024-03-17T23:56:14.813 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:14.811+0000 7feba2354640 1 Processor -- start 2024-03-17T23:56:14.813 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:14.811+0000 7feba2354640 1 -- start start 2024-03-17T23:56:14.816 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:14.811+0000 7feba2354640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7feb9c06f8d0 0x7feb9c14a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:14.816 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:14.811+0000 7feba2354640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7feb9c150e50 0x7feb9c143360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:14.816 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:14.811+0000 7feba2354640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7feb9c15a470 0x7feb9c1438a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:14.816 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:14.811+0000 7feba2354640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7feb9c070db0 con 0x7feb9c15a470 2024-03-17T23:56:14.816 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:14.811+0000 7feba2354640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7feb9c0c81a0 con 0x7feb9c06f8d0 2024-03-17T23:56:14.816 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:14.811+0000 7feba2354640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7feb9c0c8b40 con 0x7feb9c150e50 2024-03-17T23:56:14.816 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:14.811+0000 7feba08f1640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7feb9c15a470 0x7feb9c1438a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:14.816 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:14.811+0000 7feba08f1640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7feb9c15a470 0x7feb9c1438a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.196:38154/0 (socket says 172.21.15.196:38154) 2024-03-17T23:56:14.816 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:14.811+0000 7feba08f1640 1 -- 172.21.15.196:0/2199098995 learned_addr learned my addr 172.21.15.196:0/2199098995 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-03-17T23:56:14.816 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:14.811+0000 7feb9bfff640 1 --2- 172.21.15.196:0/2199098995 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7feb9c06f8d0 0x7feb9c14a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:14.816 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:14.811+0000 7feb9b7fe640 1 --2- 172.21.15.196:0/2199098995 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7feb9c150e50 0x7feb9c143360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:14.816 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:14.811+0000 7feba08f1640 1 -- 172.21.15.196:0/2199098995 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7feb9c150e50 msgr2=0x7feb9c143360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:14.817 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:14.811+0000 7feba08f1640 1 --2- 172.21.15.196:0/2199098995 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7feb9c150e50 0x7feb9c143360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:14.817 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:14.811+0000 7feba08f1640 1 -- 172.21.15.196:0/2199098995 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7feb9c06f8d0 msgr2=0x7feb9c14a5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:14.817 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:14.811+0000 7feba08f1640 1 --2- 172.21.15.196:0/2199098995 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7feb9c06f8d0 0x7feb9c14a5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:14.817 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:14.811+0000 7feba08f1640 1 -- 172.21.15.196:0/2199098995 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb9c14c8e0 con 0x7feb9c15a470 2024-03-17T23:56:14.817 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:14.811+0000 7feb9b7fe640 1 --2- 172.21.15.196:0/2199098995 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7feb9c150e50 0x7feb9c143360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-17T23:56:14.817 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:14.811+0000 7feb9bfff640 1 --2- 172.21.15.196:0/2199098995 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7feb9c06f8d0 0x7feb9c14a5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-17T23:56:14.817 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:14.811+0000 7feba08f1640 1 --2- 172.21.15.196:0/2199098995 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7feb9c15a470 0x7feb9c1438a0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7feb940b2040 tx=0x7feb9401bef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:56:14.817 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:14.811+0000 7feb98ff9640 1 -- 172.21.15.196:0/2199098995 <== mon.0 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb940b4040 con 0x7feb9c15a470 2024-03-17T23:56:14.817 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:14.811+0000 7feb98ff9640 1 -- 172.21.15.196:0/2199098995 <== mon.0 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb940039a0 con 0x7feb9c15a470 2024-03-17T23:56:14.817 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:14.811+0000 7feba2354640 1 -- 172.21.15.196:0/2199098995 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb9c14f9a0 con 0x7feb9c15a470 2024-03-17T23:56:14.817 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:14.811+0000 7feb98ff9640 1 -- 172.21.15.196:0/2199098995 <== mon.0 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb94009450 con 0x7feb9c15a470 2024-03-17T23:56:14.817 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:14.811+0000 7feba2354640 1 -- 172.21.15.196:0/2199098995 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb9c14fc40 con 0x7feb9c15a470 2024-03-17T23:56:14.818 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:14.815+0000 7feba2354640 1 -- 172.21.15.196:0/2199098995 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feb9c0689a0 con 0x7feb9c15a470 2024-03-17T23:56:14.818 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:14.815+0000 7feb98ff9640 1 -- 172.21.15.196:0/2199098995 <== mon.0 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 5) ==== 87083+0+0 (secure 0 0 0) 0x7feb940c4060 con 0x7feb9c15a470 2024-03-17T23:56:14.818 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:14.815+0000 7feb98ff9640 1 --2- 172.21.15.196:0/2199098995 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7feb88067690 0x7feb88069b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:14.818 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:14.815+0000 7feb98ff9640 1 -- 172.21.15.196:0/2199098995 <== mon.0 v2:172.21.15.196:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7feb941231f0 con 0x7feb9c15a470 2024-03-17T23:56:14.818 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:14.815+0000 7feb9bfff640 1 --2- 172.21.15.196:0/2199098995 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7feb88067690 0x7feb88069b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:14.819 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:14.815+0000 7feb9bfff640 1 --2- 172.21.15.196:0/2199098995 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7feb88067690 0x7feb88069b50 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7feb8c009bb0 tx=0x7feb8c008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:56:14.822 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:14.819+0000 7feb98ff9640 1 -- 172.21.15.196:0/2199098995 <== mon.0 v2:172.21.15.196:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177849 (secure 0 0 0) 0x7feb94018cb0 con 0x7feb9c15a470 2024-03-17T23:56:14.975 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:14.971+0000 7feba2354640 1 -- 172.21.15.196:0/2199098995 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7feb9c0745e0 con 0x7feb9c15a470 2024-03-17T23:56:14.977 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:14.975+0000 7feb98ff9640 1 -- 172.21.15.196:0/2199098995 <== mon.0 v2:172.21.15.196:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16641 (secure 0 0 0) 0x7feb940f3e70 con 0x7feb9c15a470 2024-03-17T23:56:14.977 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-03-17T23:56:14.977 INFO:teuthology.orchestra.run.smithi196.stdout:{"epoch":21,"fsid":"b80f9c80-17ad-4126-8957-4c0c46f5b803","created":"2024-03-17T23:55:43.368838+0000","modified":"2024-03-17T23:56:02.157128+0000","last_up_change":"2024-03-17T23:55:54.132187+0000","last_in_change":"2024-03-17T23:55:46.016435+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-17T23:55:56.030640+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-17T23:55:58.658234+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-17T23:56:00.003208+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"224d699f-bc10-4661-a8b5-6ca73290ffa0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6806","nonce":1194547591},{"type":"v1","addr":"172.21.15.196:6807","nonce":1194547591}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6809","nonce":1194547591},{"type":"v1","addr":"172.21.15.196:6811","nonce":1194547591}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6814","nonce":1194547591},{"type":"v1","addr":"172.21.15.196:6815","nonce":1194547591}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6812","nonce":1194547591},{"type":"v1","addr":"172.21.15.196:6813","nonce":1194547591}]},"public_addr":"172.21.15.196:6807/1194547591","cluster_addr":"172.21.15.196:6811/1194547591","heartbeat_back_addr":"172.21.15.196:6815/1194547591","heartbeat_front_addr":"172.21.15.196:6813/1194547591","state":["exists","up"]},{"osd":1,"uuid":"d8d6a0b0-450b-4ab5-b143-d4f36286e81e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6800","nonce":1901246986},{"type":"v1","addr":"172.21.15.196:6801","nonce":1901246986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6802","nonce":1901246986},{"type":"v1","addr":"172.21.15.196:6803","nonce":1901246986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6808","nonce":1901246986},{"type":"v1","addr":"172.21.15.196:6810","nonce":1901246986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6804","nonce":1901246986},{"type":"v1","addr":"172.21.15.196:6805","nonce":1901246986}]},"public_addr":"172.21.15.196:6801/1901246986","cluster_addr":"172.21.15.196:6803/1901246986","heartbeat_back_addr":"172.21.15.196:6810/1901246986","heartbeat_front_addr":"172.21.15.196:6805/1901246986","state":["exists","up"]},{"osd":2,"uuid":"d732ba94-1db0-41ed-930a-5abb6188980a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6824","nonce":673819559},{"type":"v1","addr":"172.21.15.196:6825","nonce":673819559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6826","nonce":673819559},{"type":"v1","addr":"172.21.15.196:6827","nonce":673819559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6830","nonce":673819559},{"type":"v1","addr":"172.21.15.196:6831","nonce":673819559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6828","nonce":673819559},{"type":"v1","addr":"172.21.15.196:6829","nonce":673819559}]},"public_addr":"172.21.15.196:6825/673819559","cluster_addr":"172.21.15.196:6827/673819559","heartbeat_back_addr":"172.21.15.196:6831/673819559","heartbeat_front_addr":"172.21.15.196:6829/673819559","state":["exists","up"]},{"osd":3,"uuid":"b79cab98-a49f-4544-b6b0-546dcfbd47a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6816","nonce":1104340623},{"type":"v1","addr":"172.21.15.196:6817","nonce":1104340623}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6818","nonce":1104340623},{"type":"v1","addr":"172.21.15.196:6819","nonce":1104340623}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6822","nonce":1104340623},{"type":"v1","addr":"172.21.15.196:6823","nonce":1104340623}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6820","nonce":1104340623},{"type":"v1","addr":"172.21.15.196:6821","nonce":1104340623}]},"public_addr":"172.21.15.196:6817/1104340623","cluster_addr":"172.21.15.196:6819/1104340623","heartbeat_back_addr":"172.21.15.196:6823/1104340623","heartbeat_front_addr":"172.21.15.196:6821/1104340623","state":["exists","up"]},{"osd":4,"uuid":"d5892856-6eb4-4188-beb0-368f64169af1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6816","nonce":658561863},{"type":"v1","addr":"172.21.15.204:6818","nonce":658561863}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6819","nonce":658561863},{"type":"v1","addr":"172.21.15.204:6821","nonce":658561863}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6826","nonce":658561863},{"type":"v1","addr":"172.21.15.204:6828","nonce":658561863}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6823","nonce":658561863},{"type":"v1","addr":"172.21.15.204:6825","nonce":658561863}]},"public_addr":"172.21.15.204:6818/658561863","cluster_addr":"172.21.15.204:6821/658561863","heartbeat_back_addr":"172.21.15.204:6828/658561863","heartbeat_front_addr":"172.21.15.204:6825/658561863","state":["exists","up"]},{"osd":5,"uuid":"89d6b48d-aa8a-4cb8-aa2e-e0aae04928b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6817","nonce":3367327749},{"type":"v1","addr":"172.21.15.204:6820","nonce":3367327749}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6822","nonce":3367327749},{"type":"v1","addr":"172.21.15.204:6824","nonce":3367327749}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6830","nonce":3367327749},{"type":"v1","addr":"172.21.15.204:6831","nonce":3367327749}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6827","nonce":3367327749},{"type":"v1","addr":"172.21.15.204:6829","nonce":3367327749}]},"public_addr":"172.21.15.204:6820/3367327749","cluster_addr":"172.21.15.204:6824/3367327749","heartbeat_back_addr":"172.21.15.204:6831/3367327749","heartbeat_front_addr":"172.21.15.204:6829/3367327749","state":["exists","up"]},{"osd":6,"uuid":"ff7d0949-2836-42a6-a63d-bc5a4269e080","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6805","nonce":2586742078},{"type":"v1","addr":"172.21.15.204:6807","nonce":2586742078}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6809","nonce":2586742078},{"type":"v1","addr":"172.21.15.204:6811","nonce":2586742078}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6814","nonce":2586742078},{"type":"v1","addr":"172.21.15.204:6815","nonce":2586742078}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6812","nonce":2586742078},{"type":"v1","addr":"172.21.15.204:6813","nonce":2586742078}]},"public_addr":"172.21.15.204:6807/2586742078","cluster_addr":"172.21.15.204:6811/2586742078","heartbeat_back_addr":"172.21.15.204:6815/2586742078","heartbeat_front_addr":"172.21.15.204:6813/2586742078","state":["exists","up"]},{"osd":7,"uuid":"42bcc14b-70b3-4c59-bf81-41436e4eb272","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6800","nonce":3361860686},{"type":"v1","addr":"172.21.15.204:6801","nonce":3361860686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6802","nonce":3361860686},{"type":"v1","addr":"172.21.15.204:6803","nonce":3361860686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6808","nonce":3361860686},{"type":"v1","addr":"172.21.15.204:6810","nonce":3361860686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6804","nonce":3361860686},{"type":"v1","addr":"172.21.15.204:6806","nonce":3361860686}]},"public_addr":"172.21.15.204:6801/3361860686","cluster_addr":"172.21.15.204:6803/3361860686","heartbeat_back_addr":"172.21.15.204:6810/3361860686","heartbeat_front_addr":"172.21.15.204:6806/3361860686","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-17T23:55:51.372683+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-17T23:55:51.466291+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-17T23:55:51.608084+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-17T23:55:51.680819+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-17T23:55:51.528198+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-17T23:55:51.537065+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-17T23:55:51.558146+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-17T23:55:51.382540+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-17T23:56:14.979 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:14.975+0000 7feba2354640 1 -- 172.21.15.196:0/2199098995 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7feb88067690 msgr2=0x7feb88069b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:14.979 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:14.975+0000 7feba2354640 1 --2- 172.21.15.196:0/2199098995 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7feb88067690 0x7feb88069b50 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7feb8c009bb0 tx=0x7feb8c008040 comp rx=0 tx=0).stop 2024-03-17T23:56:14.979 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:14.975+0000 7feba2354640 1 -- 172.21.15.196:0/2199098995 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7feb9c15a470 msgr2=0x7feb9c1438a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:14.979 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:14.975+0000 7feba2354640 1 --2- 172.21.15.196:0/2199098995 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7feb9c15a470 0x7feb9c1438a0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7feb940b2040 tx=0x7feb9401bef0 comp rx=0 tx=0).stop 2024-03-17T23:56:14.979 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:14.975+0000 7feba2354640 1 -- 172.21.15.196:0/2199098995 shutdown_connections 2024-03-17T23:56:14.979 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:14.975+0000 7feba2354640 1 --2- 172.21.15.196:0/2199098995 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7feb88067690 0x7feb88069b50 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:14.979 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:14.975+0000 7feba2354640 1 --2- 172.21.15.196:0/2199098995 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7feb9c150e50 0x7feb9c143360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:14.979 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:14.975+0000 7feba2354640 1 --2- 172.21.15.196:0/2199098995 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7feb9c15a470 0x7feb9c1438a0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:14.979 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:14.975+0000 7feba2354640 1 --2- 172.21.15.196:0/2199098995 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7feb9c06f8d0 0x7feb9c14a5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:14.979 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:14.975+0000 7feba2354640 1 -- 172.21.15.196:0/2199098995 >> 172.21.15.196:0/2199098995 conn(0x7feb9c0cc420 msgr2=0x7feb9c0c5790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-17T23:56:14.980 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:14.975+0000 7feba2354640 1 -- 172.21.15.196:0/2199098995 shutdown_connections 2024-03-17T23:56:14.980 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:14.975+0000 7feba2354640 1 -- 172.21.15.196:0/2199098995 wait complete. 2024-03-17T23:56:14.994 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-17T23:55:56.030640+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-17T23:55:58.658234+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-17T23:56:00.003208+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-17T23:56:14.994 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-17T23:56:15.102 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:15.099+0000 7f14b8b9b640 1 Processor -- start 2024-03-17T23:56:15.102 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:15.099+0000 7f14b8b9b640 1 -- start start 2024-03-17T23:56:15.103 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:15.099+0000 7f14b8b9b640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f14b4152000 0x7f14b406fde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:15.103 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:15.099+0000 7f14b8b9b640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f14b40c4730 0x7f14b415ba80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:15.103 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:15.099+0000 7f14b8b9b640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f14b415bfc0 con 0x7f14b40ca1d0 2024-03-17T23:56:15.103 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:15.099+0000 7f14b8b9b640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7f14b4070420 con 0x7f14b40c4730 2024-03-17T23:56:15.103 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:15.099+0000 7f14b8b9b640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 -- 0x7f14b4070790 con 0x7f14b4152000 2024-03-17T23:56:15.103 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:15.099+0000 7f14b2d9d640 1 --1- >> v1:172.21.15.196:6789/0 conn(0x7f14b40ca1d0 0x7f14b40cd6b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.196:6789/0 says I am v1:172.21.15.196:57286/0 (socket says 172.21.15.196:57286) 2024-03-17T23:56:15.103 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:15.099+0000 7f14b2d9d640 1 -- 172.21.15.196:0/3994182768 learned_addr learned my addr 172.21.15.196:0/3994182768 (peer_addr_for_me v1:172.21.15.196:0/0) 2024-03-17T23:56:15.103 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:15.099+0000 7f14b1d9b640 1 --2- 172.21.15.196:0/3994182768 >> v2:172.21.15.196:3300/0 conn(0x7f14b40c4730 0x7f14b415ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:15.103 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:15.099+0000 7f14b259c640 1 --2- 172.21.15.196:0/3994182768 >> v2:172.21.15.204:3300/0 conn(0x7f14b4152000 0x7f14b406fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:15.104 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:15.099+0000 7f14b159a640 1 -- 172.21.15.196:0/3994182768 <== mon.0 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3029183835 0 0) 0x7f14b415bfc0 con 0x7f14b40ca1d0 2024-03-17T23:56:15.104 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:15.099+0000 7f14b159a640 1 -- 172.21.15.196:0/3994182768 --> v1:172.21.15.196:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f149c003530 con 0x7f14b40ca1d0 2024-03-17T23:56:15.104 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:15.099+0000 7f14b1d9b640 1 -- 172.21.15.196:0/3994182768 >> v2:172.21.15.204:3300/0 conn(0x7f14b4152000 msgr2=0x7f14b406fde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-17T23:56:15.104 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:15.099+0000 7f14b1d9b640 1 --2- 172.21.15.196:0/3994182768 >> v2:172.21.15.204:3300/0 conn(0x7f14b4152000 0x7f14b406fde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:15.104 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:15.099+0000 7f14b1d9b640 1 -- 172.21.15.196:0/3994182768 >> v1:172.21.15.196:6789/0 conn(0x7f14b40ca1d0 legacy=0x7f14b40cd6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:15.104 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:15.099+0000 7f14b1d9b640 1 -- 172.21.15.196:0/3994182768 --> v2:172.21.15.196:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14b40c82e0 con 0x7f14b40c4730 2024-03-17T23:56:15.105 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:15.103+0000 7f14b1d9b640 1 --2- 172.21.15.196:0/3994182768 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f14b40c4730 0x7f14b415ba80 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f14b40ce290 tx=0x7f14a801ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74aeddda3614b098 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:56:15.106 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:15.103+0000 7f14b159a640 1 -- 172.21.15.196:0/3994182768 <== mon.0 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14a80b5070 con 0x7f14b40c4730 2024-03-17T23:56:15.106 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:15.103+0000 7f14b159a640 1 -- 172.21.15.196:0/3994182768 <== mon.0 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f14a80a8970 con 0x7f14b40c4730 2024-03-17T23:56:15.106 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:15.103+0000 7f14b159a640 1 -- 172.21.15.196:0/3994182768 <== mon.0 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14a80a8d20 con 0x7f14b40c4730 2024-03-17T23:56:15.106 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:15.103+0000 7f14b8b9b640 1 -- 172.21.15.196:0/3994182768 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f14b40c4730 msgr2=0x7f14b415ba80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:15.107 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:15.103+0000 7f14b8b9b640 1 --2- 172.21.15.196:0/3994182768 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f14b40c4730 0x7f14b415ba80 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f14b40ce290 tx=0x7f14a801ec70 comp rx=0 tx=0).stop 2024-03-17T23:56:15.107 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:15.103+0000 7f14b8b9b640 1 -- 172.21.15.196:0/3994182768 shutdown_connections 2024-03-17T23:56:15.107 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:15.103+0000 7f14b8b9b640 1 --2- 172.21.15.196:0/3994182768 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f14b40c4730 0x7f14b415ba80 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:15.107 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:15.103+0000 7f14b8b9b640 1 --2- 172.21.15.196:0/3994182768 >> v2:172.21.15.204:3300/0 conn(0x7f14b4152000 0x7f14b406fde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:15.107 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:15.103+0000 7f14b8b9b640 1 -- 172.21.15.196:0/3994182768 >> 172.21.15.196:0/3994182768 conn(0x7f14b406b2b0 msgr2=0x7f14b406b6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-17T23:56:15.107 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:15.103+0000 7f14b8b9b640 1 -- 172.21.15.196:0/3994182768 shutdown_connections 2024-03-17T23:56:15.107 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:15.103+0000 7f14b8b9b640 1 -- 172.21.15.196:0/3994182768 wait complete. 2024-03-17T23:56:15.108 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:15.103+0000 7f14b8b9b640 1 Processor -- start 2024-03-17T23:56:15.108 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:15.103+0000 7f14b8b9b640 1 -- start start 2024-03-17T23:56:15.111 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:15.107+0000 7f14b8b9b640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f14b40c4730 0x7f14b4158d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:15.111 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:15.107+0000 7f14b8b9b640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f14b40ca1d0 0x7f14b4159280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:15.111 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:15.107+0000 7f14b8b9b640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f14b4152000 0x7f14b41e19e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:15.111 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:15.107+0000 7f14b8b9b640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f14b415b280 con 0x7f14b40c4730 2024-03-17T23:56:15.111 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:15.107+0000 7f14b8b9b640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f14b40c88a0 con 0x7f14b4152000 2024-03-17T23:56:15.111 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:15.107+0000 7f14b8b9b640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f14b415b560 con 0x7f14b40ca1d0 2024-03-17T23:56:15.111 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:15.107+0000 7f14b259c640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f14b40c4730 0x7f14b4158d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:15.111 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:15.107+0000 7f14b259c640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f14b40c4730 0x7f14b4158d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.196:38176/0 (socket says 172.21.15.196:38176) 2024-03-17T23:56:15.111 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:15.107+0000 7f14b259c640 1 -- 172.21.15.196:0/2118298957 learned_addr learned my addr 172.21.15.196:0/2118298957 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-03-17T23:56:15.111 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:15.107+0000 7f14b2d9d640 1 --2- 172.21.15.196:0/2118298957 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f14b4152000 0x7f14b41e19e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:15.111 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:15.107+0000 7f14b1d9b640 1 --2- 172.21.15.196:0/2118298957 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f14b40ca1d0 0x7f14b4159280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:15.112 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:15.107+0000 7f14b259c640 1 -- 172.21.15.196:0/2118298957 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f14b40ca1d0 msgr2=0x7f14b4159280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:15.112 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:15.107+0000 7f14b259c640 1 --2- 172.21.15.196:0/2118298957 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f14b40ca1d0 0x7f14b4159280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:15.112 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:15.107+0000 7f14b259c640 1 -- 172.21.15.196:0/2118298957 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f14b4152000 msgr2=0x7f14b41e19e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:15.112 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:15.107+0000 7f14b259c640 1 --2- 172.21.15.196:0/2118298957 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f14b4152000 0x7f14b41e19e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:15.112 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:15.107+0000 7f14b259c640 1 -- 172.21.15.196:0/2118298957 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14b41ee2e0 con 0x7f14b40c4730 2024-03-17T23:56:15.112 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:15.107+0000 7f14b259c640 1 --2- 172.21.15.196:0/2118298957 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f14b40c4730 0x7f14b4158d40 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f14a400e870 tx=0x7f14a400ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:56:15.112 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:15.107+0000 7f14a2ffd640 1 -- 172.21.15.196:0/2118298957 <== mon.0 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14a4017070 con 0x7f14b40c4730 2024-03-17T23:56:15.112 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:15.107+0000 7f14a2ffd640 1 -- 172.21.15.196:0/2118298957 <== mon.0 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f14a400c940 con 0x7f14b40c4730 2024-03-17T23:56:15.112 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:15.107+0000 7f14a2ffd640 1 -- 172.21.15.196:0/2118298957 <== mon.0 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14a400cd10 con 0x7f14b40c4730 2024-03-17T23:56:15.112 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:15.107+0000 7f14b8b9b640 1 -- 172.21.15.196:0/2118298957 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f14b41ee030 con 0x7f14b40c4730 2024-03-17T23:56:15.112 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:15.107+0000 7f14b8b9b640 1 -- 172.21.15.196:0/2118298957 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14b4159d70 con 0x7f14b40c4730 2024-03-17T23:56:15.113 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:15.107+0000 7f14a0ff9640 1 -- 172.21.15.196:0/2118298957 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f148c0052a0 con 0x7f14b40c4730 2024-03-17T23:56:15.113 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:15.107+0000 7f14a2ffd640 1 -- 172.21.15.196:0/2118298957 <== mon.0 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 5) ==== 87083+0+0 (secure 0 0 0) 0x7f14a401a070 con 0x7f14b40c4730 2024-03-17T23:56:15.113 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:15.107+0000 7f14a2ffd640 1 --2- 172.21.15.196:0/2118298957 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f1494067660 0x7f1494069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:15.113 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:15.111+0000 7f14a2ffd640 1 -- 172.21.15.196:0/2118298957 <== mon.0 v2:172.21.15.196:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f14a4085700 con 0x7f14b40c4730 2024-03-17T23:56:15.113 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:15.111+0000 7f14b1d9b640 1 --2- 172.21.15.196:0/2118298957 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f1494067660 0x7f1494069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:15.114 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:15.111+0000 7f14b1d9b640 1 --2- 172.21.15.196:0/2118298957 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f1494067660 0x7f1494069b20 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f14a80b2000 tx=0x7f14a80aa070 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:56:15.116 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:15.115+0000 7f14a2ffd640 1 -- 172.21.15.196:0/2118298957 <== mon.0 v2:172.21.15.196:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177849 (secure 0 0 0) 0x7f14a4055dc0 con 0x7f14b40c4730 2024-03-17T23:56:15.268 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:15.263+0000 7f14a0ff9640 1 -- 172.21.15.196:0/2118298957 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f148c005860 con 0x7f14b40c4730 2024-03-17T23:56:15.269 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:15.267+0000 7f14a2ffd640 1 -- 172.21.15.196:0/2118298957 <== mon.0 v2:172.21.15.196:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) ==== 93+0+10 (secure 0 0 0) 0x7f14a4059e60 con 0x7f14b40c4730 2024-03-17T23:56:15.269 INFO:teuthology.orchestra.run.smithi196.stdout:pg_num: 1 2024-03-17T23:56:15.271 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:15.267+0000 7f14a0ff9640 1 -- 172.21.15.196:0/2118298957 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f1494067660 msgr2=0x7f1494069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:15.271 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:15.267+0000 7f14a0ff9640 1 --2- 172.21.15.196:0/2118298957 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f1494067660 0x7f1494069b20 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f14a80b2000 tx=0x7f14a80aa070 comp rx=0 tx=0).stop 2024-03-17T23:56:15.271 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:15.267+0000 7f14a0ff9640 1 -- 172.21.15.196:0/2118298957 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f14b40c4730 msgr2=0x7f14b4158d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:15.271 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:15.267+0000 7f14a0ff9640 1 --2- 172.21.15.196:0/2118298957 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f14b40c4730 0x7f14b4158d40 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f14a400e870 tx=0x7f14a400ed30 comp rx=0 tx=0).stop 2024-03-17T23:56:15.271 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:15.267+0000 7f14a0ff9640 1 -- 172.21.15.196:0/2118298957 shutdown_connections 2024-03-17T23:56:15.271 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:15.267+0000 7f14a0ff9640 1 --2- 172.21.15.196:0/2118298957 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f1494067660 0x7f1494069b20 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:15.271 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:15.267+0000 7f14a0ff9640 1 --2- 172.21.15.196:0/2118298957 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f14b40ca1d0 0x7f14b4159280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:15.271 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:15.267+0000 7f14a0ff9640 1 --2- 172.21.15.196:0/2118298957 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f14b4152000 0x7f14b41e19e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:15.271 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:15.267+0000 7f14a0ff9640 1 --2- 172.21.15.196:0/2118298957 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f14b40c4730 0x7f14b4158d40 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:15.272 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:15.267+0000 7f14a0ff9640 1 -- 172.21.15.196:0/2118298957 >> 172.21.15.196:0/2118298957 conn(0x7f14b406b2b0 msgr2=0x7f14b4150230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-17T23:56:15.272 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:15.267+0000 7f14a0ff9640 1 -- 172.21.15.196:0/2118298957 shutdown_connections 2024-03-17T23:56:15.272 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:15.267+0000 7f14a0ff9640 1 -- 172.21.15.196:0/2118298957 wait complete. 2024-03-17T23:56:15.286 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-17T23:56:15.404 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:15.399+0000 7f9677b28640 1 Processor -- start 2024-03-17T23:56:15.404 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:15.403+0000 7f9677b28640 1 -- start start 2024-03-17T23:56:15.406 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:15.403+0000 7f9677b28640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f9670151fc0 0x7f96700ca800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:15.406 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:15.403+0000 7f9677b28640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f96700b2ad0 0x7f967006f140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:15.406 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:15.403+0000 7f9677b28640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f967006f680 0x7f96700c9070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:15.406 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:15.403+0000 7f9677b28640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7f96700c9d30 con 0x7f967006f680 2024-03-17T23:56:15.406 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:15.403+0000 7f9677b28640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 -- 0x7f96700ca010 con 0x7f9670151fc0 2024-03-17T23:56:15.406 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:15.403+0000 7f9677b28640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f96700c81b0 con 0x7f96700b2ad0 2024-03-17T23:56:15.406 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:15.403+0000 7f96760c5640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f967006f680 0x7f96700c9070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:15.406 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:15.403+0000 7f96760c5640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f967006f680 0x7f96700c9070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.196:38178/0 (socket says 172.21.15.196:38178) 2024-03-17T23:56:15.407 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:15.403+0000 7f96760c5640 1 -- 172.21.15.196:0/3764766456 learned_addr learned my addr 172.21.15.196:0/3764766456 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-03-17T23:56:15.407 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:15.403+0000 7f96750c3640 1 --2- 172.21.15.196:0/3764766456 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f96700b2ad0 0x7f967006f140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:15.407 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:15.403+0000 7f96758c4640 1 --2- 172.21.15.196:0/3764766456 >> v2:172.21.15.204:3300/0 conn(0x7f9670151fc0 0x7f96700ca800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:15.407 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:15.403+0000 7f96760c5640 1 -- 172.21.15.196:0/3764766456 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f96700b2ad0 msgr2=0x7f967006f140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-17T23:56:15.407 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:15.403+0000 7f96760c5640 1 --2- 172.21.15.196:0/3764766456 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f96700b2ad0 0x7f967006f140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:15.407 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:15.403+0000 7f96760c5640 1 -- 172.21.15.196:0/3764766456 >> v2:172.21.15.204:3300/0 conn(0x7f9670151fc0 msgr2=0x7f96700ca800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-17T23:56:15.407 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:15.403+0000 7f96760c5640 1 --2- 172.21.15.196:0/3764766456 >> v2:172.21.15.204:3300/0 conn(0x7f9670151fc0 0x7f96700ca800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:15.407 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:15.403+0000 7f96760c5640 1 -- 172.21.15.196:0/3764766456 --> v2:172.21.15.196:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96700c8490 con 0x7f967006f680 2024-03-17T23:56:15.407 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:15.403+0000 7f96758c4640 1 --2- 172.21.15.196:0/3764766456 >> v2:172.21.15.204:3300/0 conn(0x7f9670151fc0 0x7f96700ca800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-17T23:56:15.408 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:15.403+0000 7f96760c5640 1 --2- 172.21.15.196:0/3764766456 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f967006f680 0x7f96700c9070 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f967006bcc0 tx=0x7f966801f1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bfd8b286d8018200 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:56:15.408 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:15.403+0000 7f96748c2640 1 -- 172.21.15.196:0/3764766456 <== mon.0 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96680b4070 con 0x7f967006f680 2024-03-17T23:56:15.408 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:15.403+0000 7f96748c2640 1 -- 172.21.15.196:0/3764766456 <== mon.0 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f96680af400 con 0x7f967006f680 2024-03-17T23:56:15.409 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:15.403+0000 7f96748c2640 1 -- 172.21.15.196:0/3764766456 <== mon.0 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96680af7d0 con 0x7f967006f680 2024-03-17T23:56:15.409 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:15.407+0000 7f9677b28640 1 -- 172.21.15.196:0/3764766456 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f967006f680 msgr2=0x7f96700c9070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:15.409 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:15.407+0000 7f9677b28640 1 --2- 172.21.15.196:0/3764766456 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f967006f680 0x7f96700c9070 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f967006bcc0 tx=0x7f966801f1e0 comp rx=0 tx=0).stop 2024-03-17T23:56:15.409 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:15.407+0000 7f9677b28640 1 -- 172.21.15.196:0/3764766456 shutdown_connections 2024-03-17T23:56:15.409 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:15.407+0000 7f9677b28640 1 --2- 172.21.15.196:0/3764766456 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f967006f680 0x7f96700c9070 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:15.409 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:15.407+0000 7f9677b28640 1 --2- 172.21.15.196:0/3764766456 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f96700b2ad0 0x7f967006f140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:15.409 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:15.407+0000 7f9677b28640 1 --2- 172.21.15.196:0/3764766456 >> v2:172.21.15.204:3300/0 conn(0x7f9670151fc0 0x7f96700ca800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:15.409 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:15.407+0000 7f9677b28640 1 -- 172.21.15.196:0/3764766456 >> 172.21.15.196:0/3764766456 conn(0x7f96700703f0 msgr2=0x7f967006b2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-17T23:56:15.409 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:15.407+0000 7f9677b28640 1 -- 172.21.15.196:0/3764766456 shutdown_connections 2024-03-17T23:56:15.409 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:15.407+0000 7f9677b28640 1 -- 172.21.15.196:0/3764766456 wait complete. 2024-03-17T23:56:15.410 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:15.407+0000 7f9677b28640 1 Processor -- start 2024-03-17T23:56:15.410 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:15.407+0000 7f9677b28640 1 -- start start 2024-03-17T23:56:15.412 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:15.407+0000 7f9677b28640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f967006f680 0x7f96700cddb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:15.412 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:15.407+0000 7f9677b28640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f96700b2ad0 0x7f96701f0480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:15.412 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:15.407+0000 7f9677b28640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9670151fc0 0x7f96700aeb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:15.412 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:15.407+0000 7f9677b28640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f96700cade0 con 0x7f9670151fc0 2024-03-17T23:56:15.412 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:15.407+0000 7f9677b28640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f96700c4910 con 0x7f96700b2ad0 2024-03-17T23:56:15.413 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:15.407+0000 7f9677b28640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f96701523a0 con 0x7f967006f680 2024-03-17T23:56:15.413 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:15.407+0000 7f96760c5640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9670151fc0 0x7f96700aeb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:15.413 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:15.407+0000 7f96760c5640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9670151fc0 0x7f96700aeb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.196:38180/0 (socket says 172.21.15.196:38180) 2024-03-17T23:56:15.413 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:15.407+0000 7f96760c5640 1 -- 172.21.15.196:0/1901056096 learned_addr learned my addr 172.21.15.196:0/1901056096 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-03-17T23:56:15.413 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:15.407+0000 7f96758c4640 1 --2- 172.21.15.196:0/1901056096 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f967006f680 0x7f96700cddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:15.413 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:15.407+0000 7f96750c3640 1 --2- 172.21.15.196:0/1901056096 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f96700b2ad0 0x7f96701f0480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:15.413 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:15.407+0000 7f96760c5640 1 -- 172.21.15.196:0/1901056096 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f967006f680 msgr2=0x7f96700cddb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:15.413 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:15.407+0000 7f96760c5640 1 --2- 172.21.15.196:0/1901056096 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f967006f680 0x7f96700cddb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:15.413 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:15.407+0000 7f96760c5640 1 -- 172.21.15.196:0/1901056096 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f96700b2ad0 msgr2=0x7f96701f0480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:15.413 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:15.407+0000 7f96760c5640 1 --2- 172.21.15.196:0/1901056096 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f96700b2ad0 0x7f96701f0480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:15.413 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:15.407+0000 7f96760c5640 1 -- 172.21.15.196:0/1901056096 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f967014d1d0 con 0x7f9670151fc0 2024-03-17T23:56:15.413 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:15.407+0000 7f96760c5640 1 --2- 172.21.15.196:0/1901056096 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9670151fc0 0x7f96700aeb00 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f96680b2040 tx=0x7f966801bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:56:15.413 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:15.407+0000 7f96667fc640 1 -- 172.21.15.196:0/1901056096 <== mon.0 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96680b4040 con 0x7f9670151fc0 2024-03-17T23:56:15.413 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:15.407+0000 7f96667fc640 1 -- 172.21.15.196:0/1901056096 <== mon.0 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f96680afdb0 con 0x7f9670151fc0 2024-03-17T23:56:15.414 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:15.407+0000 7f9677b28640 1 -- 172.21.15.196:0/1901056096 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96700cbb60 con 0x7f9670151fc0 2024-03-17T23:56:15.414 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:15.407+0000 7f96667fc640 1 -- 172.21.15.196:0/1901056096 <== mon.0 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9668009510 con 0x7f9670151fc0 2024-03-17T23:56:15.414 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:15.407+0000 7f9677b28640 1 -- 172.21.15.196:0/1901056096 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f967014c6f0 con 0x7f9670151fc0 2024-03-17T23:56:15.415 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:15.411+0000 7f9677b28640 1 -- 172.21.15.196:0/1901056096 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f96700689a0 con 0x7f9670151fc0 2024-03-17T23:56:15.415 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:15.411+0000 7f96667fc640 1 -- 172.21.15.196:0/1901056096 <== mon.0 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 5) ==== 87083+0+0 (secure 0 0 0) 0x7f96680c3020 con 0x7f9670151fc0 2024-03-17T23:56:15.415 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:15.411+0000 7f96667fc640 1 --2- 172.21.15.196:0/1901056096 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f9654067660 0x7f9654069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:15.415 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:15.411+0000 7f96667fc640 1 -- 172.21.15.196:0/1901056096 <== mon.0 v2:172.21.15.196:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f9668123cd0 con 0x7f9670151fc0 2024-03-17T23:56:15.415 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:15.411+0000 7f96758c4640 1 --2- 172.21.15.196:0/1901056096 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f9654067660 0x7f9654069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:15.415 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:15.411+0000 7f96758c4640 1 --2- 172.21.15.196:0/1901056096 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f9654067660 0x7f9654069b20 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f966c006fd0 tx=0x7f966c008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:56:15.421 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:15.419+0000 7f96667fc640 1 -- 172.21.15.196:0/1901056096 <== mon.0 v2:172.21.15.196:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177849 (secure 0 0 0) 0x7f96680ca020 con 0x7f9670151fc0 2024-03-17T23:56:15.637 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:15.635+0000 7f9677b28640 1 -- 172.21.15.196:0/1901056096 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f96700cb0f0 con 0x7f9670151fc0 2024-03-17T23:56:15.637 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:15.635+0000 7f96667fc640 1 -- 172.21.15.196:0/1901056096 <== mon.0 v2:172.21.15.196:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) ==== 104+0+11 (secure 0 0 0) 0x7f9668018d40 con 0x7f9670151fc0 2024-03-17T23:56:15.638 INFO:teuthology.orchestra.run.smithi196.stdout:pg_num: 32 2024-03-17T23:56:15.639 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:15.635+0000 7f9677b28640 1 -- 172.21.15.196:0/1901056096 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f9654067660 msgr2=0x7f9654069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:15.639 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:15.635+0000 7f9677b28640 1 --2- 172.21.15.196:0/1901056096 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f9654067660 0x7f9654069b20 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f966c006fd0 tx=0x7f966c008040 comp rx=0 tx=0).stop 2024-03-17T23:56:15.641 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:15.635+0000 7f9677b28640 1 -- 172.21.15.196:0/1901056096 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9670151fc0 msgr2=0x7f96700aeb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:15.641 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:15.635+0000 7f9677b28640 1 --2- 172.21.15.196:0/1901056096 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9670151fc0 0x7f96700aeb00 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f96680b2040 tx=0x7f966801bf80 comp rx=0 tx=0).stop 2024-03-17T23:56:15.641 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:15.635+0000 7f9677b28640 1 -- 172.21.15.196:0/1901056096 shutdown_connections 2024-03-17T23:56:15.641 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:15.635+0000 7f9677b28640 1 --2- 172.21.15.196:0/1901056096 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f9654067660 0x7f9654069b20 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:15.641 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:15.635+0000 7f9677b28640 1 --2- 172.21.15.196:0/1901056096 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9670151fc0 0x7f96700aeb00 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:15.641 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:15.635+0000 7f9677b28640 1 --2- 172.21.15.196:0/1901056096 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f96700b2ad0 0x7f96701f0480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:15.641 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:15.635+0000 7f9677b28640 1 --2- 172.21.15.196:0/1901056096 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f967006f680 0x7f96700cddb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:15.641 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:15.635+0000 7f9677b28640 1 -- 172.21.15.196:0/1901056096 >> 172.21.15.196:0/1901056096 conn(0x7f96700703f0 msgr2=0x7f967015a770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-17T23:56:15.641 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:15.635+0000 7f9677b28640 1 -- 172.21.15.196:0/1901056096 shutdown_connections 2024-03-17T23:56:15.642 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:15.635+0000 7f9677b28640 1 -- 172.21.15.196:0/1901056096 wait complete. 2024-03-17T23:56:15.655 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-17T23:56:15.761 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:15.759+0000 7f0117fe6640 1 Processor -- start 2024-03-17T23:56:15.761 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:15.759+0000 7f0117fe6640 1 -- start start 2024-03-17T23:56:15.763 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:15.759+0000 7f0117fe6640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f01100b0fe0 0x7f01100c72b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:15.763 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:15.759+0000 7f0117fe6640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0110071f10 con 0x7f0110154130 2024-03-17T23:56:15.763 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:15.759+0000 7f0117fe6640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f011015a120 con 0x7f0110154510 2024-03-17T23:56:15.763 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:15.759+0000 7f0117fe6640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f011015a3e0 con 0x7f01100b0fe0 2024-03-17T23:56:15.763 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:15.759+0000 7f0115d82640 1 --1- >> v1:172.21.15.196:6789/0 conn(0x7f0110154130 0x7f0110072400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.196:6789/0 says I am v1:172.21.15.196:57288/0 (socket says 172.21.15.196:57288) 2024-03-17T23:56:15.763 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:15.759+0000 7f0115d82640 1 -- 172.21.15.196:0/2976614241 learned_addr learned my addr 172.21.15.196:0/2976614241 (peer_addr_for_me v1:172.21.15.196:0/0) 2024-03-17T23:56:15.763 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:15.759+0000 7f0116583640 1 --2- 172.21.15.196:0/2976614241 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f01100b0fe0 0x7f01100c72b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:15.763 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:15.759+0000 7f0114d80640 1 -- 172.21.15.196:0/2976614241 <== mon.0 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 739594815 0 0) 0x7f0110071f10 con 0x7f0110154130 2024-03-17T23:56:15.763 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:15.759+0000 7f0114d80640 1 -- 172.21.15.196:0/2976614241 --> v1:172.21.15.196:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f00fc003530 con 0x7f0110154130 2024-03-17T23:56:15.763 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:15.759+0000 7f0114d80640 1 -- 172.21.15.196:0/2976614241 <== mon.1 v1:172.21.15.204:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3273692779 0 0) 0x7f011015a120 con 0x7f0110154510 2024-03-17T23:56:15.763 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:15.759+0000 7f0116583640 1 -- 172.21.15.196:0/2976614241 >> v1:172.21.15.204:6789/0 conn(0x7f0110154510 legacy=0x7f011006d240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:15.764 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:15.759+0000 7f0116583640 1 -- 172.21.15.196:0/2976614241 >> v1:172.21.15.196:6789/0 conn(0x7f0110154130 legacy=0x7f0110072400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:15.764 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:15.759+0000 7f0116583640 1 -- 172.21.15.196:0/2976614241 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f011015a6c0 con 0x7f01100b0fe0 2024-03-17T23:56:15.766 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:15.763+0000 7f0116583640 1 --2- 172.21.15.196:0/2976614241 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f01100b0fe0 0x7f01100c72b0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f0108009df0 tx=0x7f010801c9b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=51fae8d517ada742 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:56:15.766 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:15.763+0000 7f0114d80640 1 -- 172.21.15.196:0/2976614241 <== mon.2 v2:172.21.15.204:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01080b2070 con 0x7f01100b0fe0 2024-03-17T23:56:15.766 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:15.763+0000 7f0114d80640 1 -- 172.21.15.196:0/2976614241 <== mon.2 v2:172.21.15.204:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f01080a5960 con 0x7f01100b0fe0 2024-03-17T23:56:15.766 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:15.763+0000 7f0114d80640 1 -- 172.21.15.196:0/2976614241 <== mon.2 v2:172.21.15.204:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01080a5d10 con 0x7f01100b0fe0 2024-03-17T23:56:15.767 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:15.763+0000 7f0117fe6640 1 -- 172.21.15.196:0/2976614241 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f01100b0fe0 msgr2=0x7f01100c72b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:15.767 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:15.763+0000 7f0117fe6640 1 --2- 172.21.15.196:0/2976614241 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f01100b0fe0 0x7f01100c72b0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f0108009df0 tx=0x7f010801c9b0 comp rx=0 tx=0).stop 2024-03-17T23:56:15.767 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:15.763+0000 7f0117fe6640 1 -- 172.21.15.196:0/2976614241 shutdown_connections 2024-03-17T23:56:15.768 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:15.763+0000 7f0117fe6640 1 --2- 172.21.15.196:0/2976614241 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f01100b0fe0 0x7f01100c72b0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:15.768 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:15.763+0000 7f0117fe6640 1 -- 172.21.15.196:0/2976614241 >> 172.21.15.196:0/2976614241 conn(0x7f01100c8b70 msgr2=0x7f01100c8f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-17T23:56:15.768 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:15.763+0000 7f0117fe6640 1 -- 172.21.15.196:0/2976614241 shutdown_connections 2024-03-17T23:56:15.768 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:15.763+0000 7f0117fe6640 1 -- 172.21.15.196:0/2976614241 wait complete. 2024-03-17T23:56:15.768 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:15.767+0000 7f0117fe6640 1 Processor -- start 2024-03-17T23:56:15.768 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:15.767+0000 7f0117fe6640 1 -- start start 2024-03-17T23:56:15.770 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:15.767+0000 7f0117fe6640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f01100b0fe0 0x7f01101f7030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:15.770 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:15.767+0000 7f0117fe6640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0110154130 0x7f0110141a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:15.771 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:15.767+0000 7f0117fe6640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f011014c150 0x7f0110147b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:15.771 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:15.767+0000 7f0117fe6640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f01101681c0 con 0x7f011014c150 2024-03-17T23:56:15.771 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:15.767+0000 7f0117fe6640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f011006dd60 con 0x7f01100b0fe0 2024-03-17T23:56:15.771 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:15.767+0000 7f0117fe6640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f0110168340 con 0x7f0110154130 2024-03-17T23:56:15.771 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:15.767+0000 7f0116583640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f011014c150 0x7f0110147b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:15.771 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:15.767+0000 7f0116583640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f011014c150 0x7f0110147b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.196:38186/0 (socket says 172.21.15.196:38186) 2024-03-17T23:56:15.771 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:15.767+0000 7f0116583640 1 -- 172.21.15.196:0/712732708 learned_addr learned my addr 172.21.15.196:0/712732708 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-03-17T23:56:15.771 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:15.767+0000 7f0115d82640 1 --2- 172.21.15.196:0/712732708 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f01100b0fe0 0x7f01101f7030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:15.771 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:15.767+0000 7f0115581640 1 --2- 172.21.15.196:0/712732708 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0110154130 0x7f0110141a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:15.771 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:15.767+0000 7f0116583640 1 -- 172.21.15.196:0/712732708 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0110154130 msgr2=0x7f0110141a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:15.771 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:15.767+0000 7f0116583640 1 --2- 172.21.15.196:0/712732708 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0110154130 0x7f0110141a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:15.771 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:15.767+0000 7f0116583640 1 -- 172.21.15.196:0/712732708 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f01100b0fe0 msgr2=0x7f01101f7030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:15.771 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:15.767+0000 7f0116583640 1 --2- 172.21.15.196:0/712732708 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f01100b0fe0 0x7f01101f7030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:15.771 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:15.767+0000 7f0116583640 1 -- 172.21.15.196:0/712732708 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0110151940 con 0x7f011014c150 2024-03-17T23:56:15.772 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:15.767+0000 7f0116583640 1 --2- 172.21.15.196:0/712732708 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f011014c150 0x7f0110147b80 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f010801ce90 tx=0x7f0108019750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:56:15.772 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:15.767+0000 7f01067fc640 1 -- 172.21.15.196:0/712732708 <== mon.0 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01080b2050 con 0x7f011014c150 2024-03-17T23:56:15.772 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:15.767+0000 7f01067fc640 1 -- 172.21.15.196:0/712732708 <== mon.0 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f01080be070 con 0x7f011014c150 2024-03-17T23:56:15.772 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:15.767+0000 7f01067fc640 1 -- 172.21.15.196:0/712732708 <== mon.0 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0108003db0 con 0x7f011014c150 2024-03-17T23:56:15.772 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:15.767+0000 7f0117fe6640 1 -- 172.21.15.196:0/712732708 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0110153600 con 0x7f011014c150 2024-03-17T23:56:15.772 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:15.767+0000 7f0117fe6640 1 -- 172.21.15.196:0/712732708 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0110147380 con 0x7f011014c150 2024-03-17T23:56:15.773 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:15.767+0000 7f0117fe6640 1 -- 172.21.15.196:0/712732708 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f01100689a0 con 0x7f011014c150 2024-03-17T23:56:15.773 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:15.767+0000 7f01067fc640 1 -- 172.21.15.196:0/712732708 <== mon.0 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 5) ==== 87083+0+0 (secure 0 0 0) 0x7f0108004040 con 0x7f011014c150 2024-03-17T23:56:15.773 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:15.771+0000 7f01067fc640 1 --2- 172.21.15.196:0/712732708 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f00f4067660 0x7f00f4069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:15.773 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:15.771+0000 7f01067fc640 1 -- 172.21.15.196:0/712732708 <== mon.0 v2:172.21.15.196:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f0108120d30 con 0x7f011014c150 2024-03-17T23:56:15.773 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:15.771+0000 7f0115d82640 1 --2- 172.21.15.196:0/712732708 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f00f4067660 0x7f00f4069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:15.773 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:15.771+0000 7f0115d82640 1 --2- 172.21.15.196:0/712732708 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f00f4067660 0x7f00f4069b20 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f010c007fd0 tx=0x7f010c009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:56:15.776 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:15.775+0000 7f01067fc640 1 -- 172.21.15.196:0/712732708 <== mon.0 v2:172.21.15.196:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177849 (secure 0 0 0) 0x7f01080c7020 con 0x7f011014c150 2024-03-17T23:56:15.932 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:15.927+0000 7f0117fe6640 1 -- 172.21.15.196:0/712732708 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f0110157a30 con 0x7f011014c150 2024-03-17T23:56:15.932 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:15.927+0000 7f01067fc640 1 -- 172.21.15.196:0/712732708 <== mon.0 v2:172.21.15.196:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) ==== 100+0+11 (secure 0 0 0) 0x7f01080165a0 con 0x7f011014c150 2024-03-17T23:56:15.932 INFO:teuthology.orchestra.run.smithi196.stdout:pg_num: 64 2024-03-17T23:56:15.937 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:15.931+0000 7f0117fe6640 1 -- 172.21.15.196:0/712732708 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f00f4067660 msgr2=0x7f00f4069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:15.937 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:15.931+0000 7f0117fe6640 1 --2- 172.21.15.196:0/712732708 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f00f4067660 0x7f00f4069b20 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f010c007fd0 tx=0x7f010c009040 comp rx=0 tx=0).stop 2024-03-17T23:56:15.937 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:15.931+0000 7f0117fe6640 1 -- 172.21.15.196:0/712732708 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f011014c150 msgr2=0x7f0110147b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:15.937 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:15.931+0000 7f0117fe6640 1 --2- 172.21.15.196:0/712732708 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f011014c150 0x7f0110147b80 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f010801ce90 tx=0x7f0108019750 comp rx=0 tx=0).stop 2024-03-17T23:56:15.937 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:15.935+0000 7f0117fe6640 1 -- 172.21.15.196:0/712732708 shutdown_connections 2024-03-17T23:56:15.937 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:15.935+0000 7f0117fe6640 1 --2- 172.21.15.196:0/712732708 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f00f4067660 0x7f00f4069b20 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:15.937 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:15.935+0000 7f0117fe6640 1 --2- 172.21.15.196:0/712732708 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0110154130 0x7f0110141a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:15.937 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:15.935+0000 7f0117fe6640 1 --2- 172.21.15.196:0/712732708 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f011014c150 0x7f0110147b80 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:15.937 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:15.935+0000 7f0117fe6640 1 --2- 172.21.15.196:0/712732708 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f01100b0fe0 0x7f01101f7030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:15.937 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:15.935+0000 7f0117fe6640 1 -- 172.21.15.196:0/712732708 >> 172.21.15.196:0/712732708 conn(0x7f01100c8b70 msgr2=0x7f0110071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-17T23:56:15.938 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:15.935+0000 7f0117fe6640 1 -- 172.21.15.196:0/712732708 shutdown_connections 2024-03-17T23:56:15.938 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:15.935+0000 7f0117fe6640 1 -- 172.21.15.196:0/712732708 wait complete. 2024-03-17T23:56:15.952 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-17T23:56:16.058 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:16.055+0000 7f74cc6e8640 1 Processor -- start 2024-03-17T23:56:16.058 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:16.055+0000 7f74cc6e8640 1 -- start start 2024-03-17T23:56:16.060 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:16.055+0000 7f74cc6e8640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f74c4151d00 0x7f74c406fb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:16.060 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:16.055+0000 7f74cc6e8640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f74c406be30 0x7f74c4157f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:16.060 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:16.055+0000 7f74cc6e8640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f74c40c74b0 con 0x7f74c40c6fe0 2024-03-17T23:56:16.060 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:16.055+0000 7f74cc6e8640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7f74c4070420 con 0x7f74c4151d00 2024-03-17T23:56:16.060 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:16.055+0000 7f74cc6e8640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 -- 0x7f74c4070700 con 0x7f74c406be30 2024-03-17T23:56:16.060 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:16.055+0000 7f74ca484640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f74c4151d00 0x7f74c406fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:16.060 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:16.055+0000 7f74c9c83640 1 --1- >> v1:172.21.15.196:6789/0 conn(0x7f74c40c6fe0 0x7f74c40c5cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.196:6789/0 says I am v1:172.21.15.196:57300/0 (socket says 172.21.15.196:57300) 2024-03-17T23:56:16.060 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:16.055+0000 7f74c9c83640 1 -- 172.21.15.196:0/4024720525 learned_addr learned my addr 172.21.15.196:0/4024720525 (peer_addr_for_me v1:172.21.15.196:0/0) 2024-03-17T23:56:16.060 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:16.055+0000 7f74cac85640 1 --2- 172.21.15.196:0/4024720525 >> v2:172.21.15.204:3300/0 conn(0x7f74c406be30 0x7f74c4157f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:16.060 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:16.055+0000 7f74ca484640 1 -- 172.21.15.196:0/4024720525 >> v2:172.21.15.204:3300/0 conn(0x7f74c406be30 msgr2=0x7f74c4157f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-17T23:56:16.060 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:16.055+0000 7f74ca484640 1 --2- 172.21.15.196:0/4024720525 >> v2:172.21.15.204:3300/0 conn(0x7f74c406be30 0x7f74c4157f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:16.061 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:16.055+0000 7f74ca484640 1 -- 172.21.15.196:0/4024720525 >> v1:172.21.15.196:6789/0 conn(0x7f74c40c6fe0 legacy=0x7f74c40c5cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:16.061 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:16.055+0000 7f74ca484640 1 -- 172.21.15.196:0/4024720525 --> v2:172.21.15.196:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74c40709e0 con 0x7f74c4151d00 2024-03-17T23:56:16.061 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:16.055+0000 7f74c9482640 1 -- 172.21.15.196:0/4024720525 <== mon.0 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1219397678 0 0) 0x7f74c40c74b0 con 0x7f74c40c6fe0 2024-03-17T23:56:16.064 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:16.059+0000 7f74ca484640 1 --2- 172.21.15.196:0/4024720525 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f74c4151d00 0x7f74c406fb80 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f74c00097c0 tx=0x7f74c001c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58b7ad5922ce49f9 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:56:16.064 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:16.059+0000 7f74c9482640 1 -- 172.21.15.196:0/4024720525 <== mon.0 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74c00b0070 con 0x7f74c4151d00 2024-03-17T23:56:16.064 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:16.059+0000 7f74c9482640 1 -- 172.21.15.196:0/4024720525 <== mon.0 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f74c00ab600 con 0x7f74c4151d00 2024-03-17T23:56:16.064 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:16.059+0000 7f74c9482640 1 -- 172.21.15.196:0/4024720525 <== mon.0 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74c00ab9d0 con 0x7f74c4151d00 2024-03-17T23:56:16.064 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:16.059+0000 7f74cc6e8640 1 -- 172.21.15.196:0/4024720525 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f74c4151d00 msgr2=0x7f74c406fb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:16.064 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:16.059+0000 7f74cc6e8640 1 --2- 172.21.15.196:0/4024720525 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f74c4151d00 0x7f74c406fb80 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f74c00097c0 tx=0x7f74c001c460 comp rx=0 tx=0).stop 2024-03-17T23:56:16.064 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:16.059+0000 7f74cc6e8640 1 -- 172.21.15.196:0/4024720525 shutdown_connections 2024-03-17T23:56:16.064 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:16.059+0000 7f74cc6e8640 1 --2- 172.21.15.196:0/4024720525 >> v2:172.21.15.204:3300/0 conn(0x7f74c406be30 0x7f74c4157f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:16.064 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:16.059+0000 7f74cc6e8640 1 --2- 172.21.15.196:0/4024720525 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f74c4151d00 0x7f74c406fb80 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:16.064 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:16.059+0000 7f74cc6e8640 1 -- 172.21.15.196:0/4024720525 >> 172.21.15.196:0/4024720525 conn(0x7f74c406c3c0 msgr2=0x7f74c406c7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-17T23:56:16.064 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:16.059+0000 7f74cc6e8640 1 -- 172.21.15.196:0/4024720525 shutdown_connections 2024-03-17T23:56:16.064 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:16.059+0000 7f74cc6e8640 1 -- 172.21.15.196:0/4024720525 wait complete. 2024-03-17T23:56:16.065 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:16.063+0000 7f74cc6e8640 1 Processor -- start 2024-03-17T23:56:16.065 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:16.063+0000 7f74cc6e8640 1 -- start start 2024-03-17T23:56:16.067 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:16.063+0000 7f74cc6e8640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f74c406be30 0x7f74c4154840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:16.067 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:16.063+0000 7f74cc6e8640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f74c40c6fe0 0x7f74c41f0ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:16.067 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:16.063+0000 7f74cc6e8640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f74c4151d00 0x7f74c41f4250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:16.067 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:16.063+0000 7f74cc6e8640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f74c40c6580 con 0x7f74c40c6fe0 2024-03-17T23:56:16.068 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:16.063+0000 7f74cc6e8640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f74c40c6400 con 0x7f74c4151d00 2024-03-17T23:56:16.068 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:16.063+0000 7f74cc6e8640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f74c4164ce0 con 0x7f74c406be30 2024-03-17T23:56:16.068 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:16.063+0000 7f74c9c83640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f74c40c6fe0 0x7f74c41f0ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:16.068 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:16.063+0000 7f74c9c83640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f74c40c6fe0 0x7f74c41f0ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.196:38194/0 (socket says 172.21.15.196:38194) 2024-03-17T23:56:16.068 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:16.063+0000 7f74c9c83640 1 -- 172.21.15.196:0/4157591799 learned_addr learned my addr 172.21.15.196:0/4157591799 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-03-17T23:56:16.068 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:16.063+0000 7f74cac85640 1 --2- 172.21.15.196:0/4157591799 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f74c4151d00 0x7f74c41f4250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:16.068 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:16.063+0000 7f74ca484640 1 --2- 172.21.15.196:0/4157591799 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f74c406be30 0x7f74c4154840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:16.068 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:16.063+0000 7f74c9c83640 1 -- 172.21.15.196:0/4157591799 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f74c406be30 msgr2=0x7f74c4154840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:16.068 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:16.063+0000 7f74c9c83640 1 --2- 172.21.15.196:0/4157591799 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f74c406be30 0x7f74c4154840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:16.068 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:16.063+0000 7f74c9c83640 1 -- 172.21.15.196:0/4157591799 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f74c4151d00 msgr2=0x7f74c41f4250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:16.068 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:16.063+0000 7f74c9c83640 1 --2- 172.21.15.196:0/4157591799 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f74c4151d00 0x7f74c41f4250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:16.068 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:16.063+0000 7f74c9c83640 1 -- 172.21.15.196:0/4157591799 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74c414b3e0 con 0x7f74c40c6fe0 2024-03-17T23:56:16.068 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:16.063+0000 7f74c9c83640 1 --2- 172.21.15.196:0/4157591799 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f74c40c6fe0 0x7f74c41f0ce0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f74b400c480 tx=0x7f74b400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:56:16.068 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:16.063+0000 7f74baffd640 1 -- 172.21.15.196:0/4157591799 <== mon.0 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74b4018070 con 0x7f74c40c6fe0 2024-03-17T23:56:16.069 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:16.063+0000 7f74baffd640 1 -- 172.21.15.196:0/4157591799 <== mon.0 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f74b40074e0 con 0x7f74c40c6fe0 2024-03-17T23:56:16.069 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:16.063+0000 7f74cc6e8640 1 -- 172.21.15.196:0/4157591799 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f74c40c3580 con 0x7f74c40c6fe0 2024-03-17T23:56:16.069 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:16.063+0000 7f74baffd640 1 -- 172.21.15.196:0/4157591799 <== mon.0 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74b40049f0 con 0x7f74c40c6fe0 2024-03-17T23:56:16.069 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:16.063+0000 7f74cc6e8640 1 -- 172.21.15.196:0/4157591799 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f74c4154d80 con 0x7f74c40c6fe0 2024-03-17T23:56:16.070 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:16.063+0000 7f74cc6e8640 1 -- 172.21.15.196:0/4157591799 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f74c414bdd0 con 0x7f74c40c6fe0 2024-03-17T23:56:16.070 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:16.067+0000 7f74baffd640 1 -- 172.21.15.196:0/4157591799 <== mon.0 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 5) ==== 87083+0+0 (secure 0 0 0) 0x7f74b401b070 con 0x7f74c40c6fe0 2024-03-17T23:56:16.070 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:16.067+0000 7f74baffd640 1 --2- 172.21.15.196:0/4157591799 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f74a8067690 0x7f74a8069b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:16.070 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:16.067+0000 7f74baffd640 1 -- 172.21.15.196:0/4157591799 <== mon.0 v2:172.21.15.196:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f74b4084ba0 con 0x7f74c40c6fe0 2024-03-17T23:56:16.070 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:16.067+0000 7f74ca484640 1 --2- 172.21.15.196:0/4157591799 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f74a8067690 0x7f74a8069b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:16.070 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:16.067+0000 7f74ca484640 1 --2- 172.21.15.196:0/4157591799 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f74a8067690 0x7f74a8069b50 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f74c00ad000 tx=0x7f74c00a6000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:56:16.073 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:16.071+0000 7f74baffd640 1 -- 172.21.15.196:0/4157591799 <== mon.0 v2:172.21.15.196:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177849 (secure 0 0 0) 0x7f74c414bdd0 con 0x7f74c40c6fe0 2024-03-17T23:56:16.259 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:16.255+0000 7f74cc6e8640 1 -- 172.21.15.196:0/4157591799 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f74c40689a0 con 0x7f74c40c6fe0 2024-03-17T23:56:16.260 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:16.255+0000 7f74baffd640 1 -- 172.21.15.196:0/4157591799 <== mon.0 v2:172.21.15.196:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) ==== 94+0+6922 (secure 0 0 0) 0x7f74b4055260 con 0x7f74c40c6fe0 2024-03-17T23:56:16.260 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-03-17T23:56:16.260 INFO:teuthology.orchestra.run.smithi196.stdout:{"epoch":14,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4211,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6835/1901351791","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6834","nonce":1901351791},{"type":"v1","addr":"172.21.15.204:6835","nonce":1901351791}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-17T23:56:01.019247+0000","modified":"2024-03-17T23:56:07.696894+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4284,"mds_1":4281,"mds_2":4275,"mds_3":4264,"mds_4":4261},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4261":{"gid":4261,"name":"d","rank":4,"incarnation":13,"state":"up:active","state_seq":5,"addr":"172.21.15.204:6837/3888512151","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6836","nonce":3888512151},{"type":"v1","addr":"172.21.15.204:6837","nonce":3888512151}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4264":{"gid":4264,"name":"f","rank":3,"incarnation":11,"state":"up:active","state_seq":4,"addr":"172.21.15.204:6839/2849161202","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6838","nonce":2849161202},{"type":"v1","addr":"172.21.15.204:6839","nonce":2849161202}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4275":{"gid":4275,"name":"a","rank":2,"incarnation":9,"state":"up:active","state_seq":4,"addr":"172.21.15.196:6833/2075619627","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6832","nonce":2075619627},{"type":"v1","addr":"172.21.15.196:6833","nonce":2075619627}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4281":{"gid":4281,"name":"e","rank":1,"incarnation":7,"state":"up:active","state_seq":4,"addr":"172.21.15.196:6835/1837184297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6834","nonce":1837184297},{"type":"v1","addr":"172.21.15.196:6835","nonce":1837184297}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4284":{"gid":4284,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.196:6837/2436120950","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6836","nonce":2436120950},{"type":"v1","addr":"172.21.15.196:6837","nonce":2436120950}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4284,"qdb_cluster":[4261,4264,4275,4281,4284]},"id":1}]} 2024-03-17T23:56:16.261 INFO:teuthology.orchestra.run.smithi196.stderr:dumped fsmap epoch 14 2024-03-17T23:56:16.263 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:16.259+0000 7f74cc6e8640 1 -- 172.21.15.196:0/4157591799 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f74a8067690 msgr2=0x7f74a8069b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:16.263 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:16.259+0000 7f74cc6e8640 1 --2- 172.21.15.196:0/4157591799 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f74a8067690 0x7f74a8069b50 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f74c00ad000 tx=0x7f74c00a6000 comp rx=0 tx=0).stop 2024-03-17T23:56:16.264 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:16.259+0000 7f74cc6e8640 1 -- 172.21.15.196:0/4157591799 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f74c40c6fe0 msgr2=0x7f74c41f0ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:16.264 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:16.259+0000 7f74cc6e8640 1 --2- 172.21.15.196:0/4157591799 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f74c40c6fe0 0x7f74c41f0ce0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f74b400c480 tx=0x7f74b400c940 comp rx=0 tx=0).stop 2024-03-17T23:56:16.264 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:16.259+0000 7f74cc6e8640 1 -- 172.21.15.196:0/4157591799 shutdown_connections 2024-03-17T23:56:16.264 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:16.259+0000 7f74cc6e8640 1 --2- 172.21.15.196:0/4157591799 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f74a8067690 0x7f74a8069b50 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:16.264 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:16.259+0000 7f74cc6e8640 1 --2- 172.21.15.196:0/4157591799 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f74c4151d00 0x7f74c41f4250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:16.264 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:16.259+0000 7f74cc6e8640 1 --2- 172.21.15.196:0/4157591799 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f74c40c6fe0 0x7f74c41f0ce0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:16.264 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:16.259+0000 7f74cc6e8640 1 --2- 172.21.15.196:0/4157591799 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f74c406be30 0x7f74c4154840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:16.264 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:16.259+0000 7f74cc6e8640 1 -- 172.21.15.196:0/4157591799 >> 172.21.15.196:0/4157591799 conn(0x7f74c406c3c0 msgr2=0x7f74c40c8e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-17T23:56:16.264 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:16.259+0000 7f74cc6e8640 1 -- 172.21.15.196:0/4157591799 shutdown_connections 2024-03-17T23:56:16.264 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:16.259+0000 7f74cc6e8640 1 -- 172.21.15.196:0/4157591799 wait complete. 2024-03-17T23:56:16.279 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-17T23:56:16.389 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:16.387+0000 7f4712b6e640 1 Processor -- start 2024-03-17T23:56:16.389 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:16.387+0000 7f4712b6e640 1 -- start start 2024-03-17T23:56:16.391 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:16.387+0000 7f4712b6e640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f470c154310 0x7f470c0c4ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:16.391 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:16.387+0000 7f4712b6e640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f470c15df80 0x7f470c0cba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:16.391 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:16.387+0000 7f4712b6e640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f470c15a9d0 0x7f470c0cf810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:16.391 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:16.387+0000 7f4712b6e640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7f470c0ca6a0 con 0x7f470c15a9d0 2024-03-17T23:56:16.391 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:16.387+0000 7f4712b6e640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 -- 0x7f470c15daf0 con 0x7f470c15df80 2024-03-17T23:56:16.391 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:16.387+0000 7f4712b6e640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f470c1546f0 con 0x7f470c154310 2024-03-17T23:56:16.391 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:16.387+0000 7f471110b640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f470c15a9d0 0x7f470c0cf810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:16.391 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:16.387+0000 7f471110b640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f470c15a9d0 0x7f470c0cf810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.196:38196/0 (socket says 172.21.15.196:38196) 2024-03-17T23:56:16.392 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:16.387+0000 7f471110b640 1 -- 172.21.15.196:0/478430799 learned_addr learned my addr 172.21.15.196:0/478430799 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-03-17T23:56:16.392 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:16.387+0000 7f471090a640 1 --2- 172.21.15.196:0/478430799 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f470c154310 0x7f470c0c4ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:16.392 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:16.387+0000 7f470bfff640 1 --2- 172.21.15.196:0/478430799 >> v2:172.21.15.204:3300/0 conn(0x7f470c15df80 0x7f470c0cba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:16.392 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:16.387+0000 7f471110b640 1 -- 172.21.15.196:0/478430799 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f470c154310 msgr2=0x7f470c0c4ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-17T23:56:16.392 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:16.387+0000 7f471110b640 1 --2- 172.21.15.196:0/478430799 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f470c154310 0x7f470c0c4ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:16.392 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:16.387+0000 7f471110b640 1 -- 172.21.15.196:0/478430799 >> v2:172.21.15.204:3300/0 conn(0x7f470c15df80 msgr2=0x7f470c0cba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-17T23:56:16.392 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:16.387+0000 7f471110b640 1 --2- 172.21.15.196:0/478430799 >> v2:172.21.15.204:3300/0 conn(0x7f470c15df80 0x7f470c0cba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:16.392 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:16.387+0000 7f471110b640 1 -- 172.21.15.196:0/478430799 --> v2:172.21.15.196:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f470c15d4c0 con 0x7f470c15a9d0 2024-03-17T23:56:16.392 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:16.387+0000 7f470bfff640 1 --2- 172.21.15.196:0/478430799 >> v2:172.21.15.204:3300/0 conn(0x7f470c15df80 0x7f470c0cba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-17T23:56:16.393 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:16.391+0000 7f471110b640 1 --2- 172.21.15.196:0/478430799 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f470c15a9d0 0x7f470c0cf810 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f470c0d0360 tx=0x7f470401c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31977cadda97ca77 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:56:16.393 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:16.391+0000 7f470b7fe640 1 -- 172.21.15.196:0/478430799 <== mon.0 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47040a5670 con 0x7f470c15a9d0 2024-03-17T23:56:16.393 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:16.391+0000 7f470b7fe640 1 -- 172.21.15.196:0/478430799 <== mon.0 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47040a5810 con 0x7f470c15a9d0 2024-03-17T23:56:16.393 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:16.391+0000 7f470b7fe640 1 -- 172.21.15.196:0/478430799 <== mon.0 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47040a5be0 con 0x7f470c15a9d0 2024-03-17T23:56:16.394 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:16.391+0000 7f4712b6e640 1 -- 172.21.15.196:0/478430799 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f470c15a9d0 msgr2=0x7f470c0cf810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:16.394 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:16.391+0000 7f4712b6e640 1 --2- 172.21.15.196:0/478430799 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f470c15a9d0 0x7f470c0cf810 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f470c0d0360 tx=0x7f470401c9f0 comp rx=0 tx=0).stop 2024-03-17T23:56:16.394 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:16.391+0000 7f4712b6e640 1 -- 172.21.15.196:0/478430799 shutdown_connections 2024-03-17T23:56:16.394 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:16.391+0000 7f4712b6e640 1 --2- 172.21.15.196:0/478430799 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f470c15a9d0 0x7f470c0cf810 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:16.394 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:16.391+0000 7f4712b6e640 1 --2- 172.21.15.196:0/478430799 >> v2:172.21.15.204:3300/0 conn(0x7f470c15df80 0x7f470c0cba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:16.394 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:16.391+0000 7f4712b6e640 1 --2- 172.21.15.196:0/478430799 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f470c154310 0x7f470c0c4ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:16.394 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:16.391+0000 7f4712b6e640 1 -- 172.21.15.196:0/478430799 >> 172.21.15.196:0/478430799 conn(0x7f470c06c350 msgr2=0x7f470c06ce90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-17T23:56:16.395 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:16.391+0000 7f4712b6e640 1 -- 172.21.15.196:0/478430799 shutdown_connections 2024-03-17T23:56:16.395 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:16.391+0000 7f4712b6e640 1 -- 172.21.15.196:0/478430799 wait complete. 2024-03-17T23:56:16.397 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:16.391+0000 7f4712b6e640 1 Processor -- start 2024-03-17T23:56:16.397 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:16.391+0000 7f4712b6e640 1 -- start start 2024-03-17T23:56:16.397 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:16.391+0000 7f4712b6e640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f470c154310 0x7f470c15cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:16.397 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:16.391+0000 7f4712b6e640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f470c15a9d0 0x7f470c14a150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:16.397 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:16.391+0000 7f4712b6e640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f470c15df80 0x7f470c14a690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:16.397 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:16.391+0000 7f4712b6e640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f470c15ae60 con 0x7f470c15a9d0 2024-03-17T23:56:16.397 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:16.391+0000 7f4712b6e640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f470c15d780 con 0x7f470c154310 2024-03-17T23:56:16.397 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:16.391+0000 7f4712b6e640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f470c0c4b00 con 0x7f470c15df80 2024-03-17T23:56:16.397 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:16.391+0000 7f470bfff640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f470c15a9d0 0x7f470c14a150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:16.397 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:16.391+0000 7f470bfff640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f470c15a9d0 0x7f470c14a150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.196:38198/0 (socket says 172.21.15.196:38198) 2024-03-17T23:56:16.397 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:16.391+0000 7f470bfff640 1 -- 172.21.15.196:0/485276079 learned_addr learned my addr 172.21.15.196:0/485276079 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-03-17T23:56:16.397 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:16.391+0000 7f471090a640 1 --2- 172.21.15.196:0/485276079 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f470c154310 0x7f470c15cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:16.398 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:16.391+0000 7f471110b640 1 --2- 172.21.15.196:0/485276079 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f470c15df80 0x7f470c14a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:16.398 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:16.391+0000 7f470bfff640 1 -- 172.21.15.196:0/485276079 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f470c15df80 msgr2=0x7f470c14a690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:16.398 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:16.391+0000 7f470bfff640 1 --2- 172.21.15.196:0/485276079 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f470c15df80 0x7f470c14a690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:16.398 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:16.391+0000 7f470bfff640 1 -- 172.21.15.196:0/485276079 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f470c154310 msgr2=0x7f470c15cb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:16.398 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:16.391+0000 7f470bfff640 1 --2- 172.21.15.196:0/485276079 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f470c154310 0x7f470c15cb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:16.398 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:16.391+0000 7f470bfff640 1 -- 172.21.15.196:0/485276079 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f470c14e180 con 0x7f470c15a9d0 2024-03-17T23:56:16.398 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:16.391+0000 7f470bfff640 1 --2- 172.21.15.196:0/485276079 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f470c15a9d0 0x7f470c14a150 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f46f800d800 tx=0x7f46f800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:56:16.398 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:16.395+0000 7f47097fa640 1 -- 172.21.15.196:0/485276079 <== mon.0 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46f8018020 con 0x7f470c15a9d0 2024-03-17T23:56:16.398 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:16.395+0000 7f47097fa640 1 -- 172.21.15.196:0/485276079 <== mon.0 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46f80096c0 con 0x7f470c15a9d0 2024-03-17T23:56:16.398 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:16.395+0000 7f47097fa640 1 -- 172.21.15.196:0/485276079 <== mon.0 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46f8009ab0 con 0x7f470c15a9d0 2024-03-17T23:56:16.398 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:16.395+0000 7f4712b6e640 1 -- 172.21.15.196:0/485276079 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f470c1f6930 con 0x7f470c15a9d0 2024-03-17T23:56:16.398 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:16.395+0000 7f4712b6e640 1 -- 172.21.15.196:0/485276079 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f470c156a70 con 0x7f470c15a9d0 2024-03-17T23:56:16.399 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:16.395+0000 7f4712b6e640 1 -- 172.21.15.196:0/485276079 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f470c068290 con 0x7f470c15a9d0 2024-03-17T23:56:16.399 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:16.395+0000 7f47097fa640 1 -- 172.21.15.196:0/485276079 <== mon.0 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 5) ==== 87083+0+0 (secure 0 0 0) 0x7f46f801b020 con 0x7f470c15a9d0 2024-03-17T23:56:16.399 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:16.395+0000 7f47097fa640 1 --2- 172.21.15.196:0/485276079 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f46f0067690 0x7f46f0069b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:16.399 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:16.395+0000 7f47097fa640 1 -- 172.21.15.196:0/485276079 <== mon.0 v2:172.21.15.196:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f46f8085d80 con 0x7f470c15a9d0 2024-03-17T23:56:16.399 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:16.395+0000 7f471090a640 1 --2- 172.21.15.196:0/485276079 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f46f0067690 0x7f46f0069b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:16.400 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:16.395+0000 7f471090a640 1 --2- 172.21.15.196:0/485276079 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f46f0067690 0x7f46f0069b50 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f470000ba30 tx=0x7f4700008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:56:16.403 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:16.399+0000 7f47097fa640 1 -- 172.21.15.196:0/485276079 <== mon.0 v2:172.21.15.196:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177849 (secure 0 0 0) 0x7f46f8022020 con 0x7f470c15a9d0 2024-03-17T23:56:16.560 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:16.555+0000 7f4712b6e640 1 -- 172.21.15.196:0/485276079 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f470c0cb200 con 0x7f470c15a9d0 2024-03-17T23:56:16.561 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:16.559+0000 7f47097fa640 1 -- 172.21.15.196:0/485276079 <== mon.0 v2:172.21.15.196:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16641 (secure 0 0 0) 0x7f46f8056a00 con 0x7f470c15a9d0 2024-03-17T23:56:16.561 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-03-17T23:56:16.561 INFO:teuthology.orchestra.run.smithi196.stdout:{"epoch":21,"fsid":"b80f9c80-17ad-4126-8957-4c0c46f5b803","created":"2024-03-17T23:55:43.368838+0000","modified":"2024-03-17T23:56:02.157128+0000","last_up_change":"2024-03-17T23:55:54.132187+0000","last_in_change":"2024-03-17T23:55:46.016435+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-17T23:55:56.030640+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-17T23:55:58.658234+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-17T23:56:00.003208+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"224d699f-bc10-4661-a8b5-6ca73290ffa0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6806","nonce":1194547591},{"type":"v1","addr":"172.21.15.196:6807","nonce":1194547591}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6809","nonce":1194547591},{"type":"v1","addr":"172.21.15.196:6811","nonce":1194547591}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6814","nonce":1194547591},{"type":"v1","addr":"172.21.15.196:6815","nonce":1194547591}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6812","nonce":1194547591},{"type":"v1","addr":"172.21.15.196:6813","nonce":1194547591}]},"public_addr":"172.21.15.196:6807/1194547591","cluster_addr":"172.21.15.196:6811/1194547591","heartbeat_back_addr":"172.21.15.196:6815/1194547591","heartbeat_front_addr":"172.21.15.196:6813/1194547591","state":["exists","up"]},{"osd":1,"uuid":"d8d6a0b0-450b-4ab5-b143-d4f36286e81e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6800","nonce":1901246986},{"type":"v1","addr":"172.21.15.196:6801","nonce":1901246986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6802","nonce":1901246986},{"type":"v1","addr":"172.21.15.196:6803","nonce":1901246986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6808","nonce":1901246986},{"type":"v1","addr":"172.21.15.196:6810","nonce":1901246986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6804","nonce":1901246986},{"type":"v1","addr":"172.21.15.196:6805","nonce":1901246986}]},"public_addr":"172.21.15.196:6801/1901246986","cluster_addr":"172.21.15.196:6803/1901246986","heartbeat_back_addr":"172.21.15.196:6810/1901246986","heartbeat_front_addr":"172.21.15.196:6805/1901246986","state":["exists","up"]},{"osd":2,"uuid":"d732ba94-1db0-41ed-930a-5abb6188980a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6824","nonce":673819559},{"type":"v1","addr":"172.21.15.196:6825","nonce":673819559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6826","nonce":673819559},{"type":"v1","addr":"172.21.15.196:6827","nonce":673819559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6830","nonce":673819559},{"type":"v1","addr":"172.21.15.196:6831","nonce":673819559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6828","nonce":673819559},{"type":"v1","addr":"172.21.15.196:6829","nonce":673819559}]},"public_addr":"172.21.15.196:6825/673819559","cluster_addr":"172.21.15.196:6827/673819559","heartbeat_back_addr":"172.21.15.196:6831/673819559","heartbeat_front_addr":"172.21.15.196:6829/673819559","state":["exists","up"]},{"osd":3,"uuid":"b79cab98-a49f-4544-b6b0-546dcfbd47a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6816","nonce":1104340623},{"type":"v1","addr":"172.21.15.196:6817","nonce":1104340623}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6818","nonce":1104340623},{"type":"v1","addr":"172.21.15.196:6819","nonce":1104340623}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6822","nonce":1104340623},{"type":"v1","addr":"172.21.15.196:6823","nonce":1104340623}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6820","nonce":1104340623},{"type":"v1","addr":"172.21.15.196:6821","nonce":1104340623}]},"public_addr":"172.21.15.196:6817/1104340623","cluster_addr":"172.21.15.196:6819/1104340623","heartbeat_back_addr":"172.21.15.196:6823/1104340623","heartbeat_front_addr":"172.21.15.196:6821/1104340623","state":["exists","up"]},{"osd":4,"uuid":"d5892856-6eb4-4188-beb0-368f64169af1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6816","nonce":658561863},{"type":"v1","addr":"172.21.15.204:6818","nonce":658561863}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6819","nonce":658561863},{"type":"v1","addr":"172.21.15.204:6821","nonce":658561863}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6826","nonce":658561863},{"type":"v1","addr":"172.21.15.204:6828","nonce":658561863}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6823","nonce":658561863},{"type":"v1","addr":"172.21.15.204:6825","nonce":658561863}]},"public_addr":"172.21.15.204:6818/658561863","cluster_addr":"172.21.15.204:6821/658561863","heartbeat_back_addr":"172.21.15.204:6828/658561863","heartbeat_front_addr":"172.21.15.204:6825/658561863","state":["exists","up"]},{"osd":5,"uuid":"89d6b48d-aa8a-4cb8-aa2e-e0aae04928b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6817","nonce":3367327749},{"type":"v1","addr":"172.21.15.204:6820","nonce":3367327749}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6822","nonce":3367327749},{"type":"v1","addr":"172.21.15.204:6824","nonce":3367327749}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6830","nonce":3367327749},{"type":"v1","addr":"172.21.15.204:6831","nonce":3367327749}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6827","nonce":3367327749},{"type":"v1","addr":"172.21.15.204:6829","nonce":3367327749}]},"public_addr":"172.21.15.204:6820/3367327749","cluster_addr":"172.21.15.204:6824/3367327749","heartbeat_back_addr":"172.21.15.204:6831/3367327749","heartbeat_front_addr":"172.21.15.204:6829/3367327749","state":["exists","up"]},{"osd":6,"uuid":"ff7d0949-2836-42a6-a63d-bc5a4269e080","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6805","nonce":2586742078},{"type":"v1","addr":"172.21.15.204:6807","nonce":2586742078}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6809","nonce":2586742078},{"type":"v1","addr":"172.21.15.204:6811","nonce":2586742078}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6814","nonce":2586742078},{"type":"v1","addr":"172.21.15.204:6815","nonce":2586742078}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6812","nonce":2586742078},{"type":"v1","addr":"172.21.15.204:6813","nonce":2586742078}]},"public_addr":"172.21.15.204:6807/2586742078","cluster_addr":"172.21.15.204:6811/2586742078","heartbeat_back_addr":"172.21.15.204:6815/2586742078","heartbeat_front_addr":"172.21.15.204:6813/2586742078","state":["exists","up"]},{"osd":7,"uuid":"42bcc14b-70b3-4c59-bf81-41436e4eb272","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6800","nonce":3361860686},{"type":"v1","addr":"172.21.15.204:6801","nonce":3361860686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6802","nonce":3361860686},{"type":"v1","addr":"172.21.15.204:6803","nonce":3361860686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6808","nonce":3361860686},{"type":"v1","addr":"172.21.15.204:6810","nonce":3361860686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6804","nonce":3361860686},{"type":"v1","addr":"172.21.15.204:6806","nonce":3361860686}]},"public_addr":"172.21.15.204:6801/3361860686","cluster_addr":"172.21.15.204:6803/3361860686","heartbeat_back_addr":"172.21.15.204:6810/3361860686","heartbeat_front_addr":"172.21.15.204:6806/3361860686","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-17T23:55:51.372683+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-17T23:55:51.466291+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-17T23:55:51.608084+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-17T23:55:51.680819+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-17T23:55:51.528198+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-17T23:55:51.537065+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-17T23:55:51.558146+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-17T23:55:51.382540+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-17T23:56:16.564 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:16.559+0000 7f4712b6e640 1 -- 172.21.15.196:0/485276079 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f46f0067690 msgr2=0x7f46f0069b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:16.564 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:16.559+0000 7f4712b6e640 1 --2- 172.21.15.196:0/485276079 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f46f0067690 0x7f46f0069b50 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f470000ba30 tx=0x7f4700008040 comp rx=0 tx=0).stop 2024-03-17T23:56:16.564 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:16.559+0000 7f4712b6e640 1 -- 172.21.15.196:0/485276079 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f470c15a9d0 msgr2=0x7f470c14a150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:16.564 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:16.559+0000 7f4712b6e640 1 --2- 172.21.15.196:0/485276079 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f470c15a9d0 0x7f470c14a150 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f46f800d800 tx=0x7f46f800dcc0 comp rx=0 tx=0).stop 2024-03-17T23:56:16.564 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:16.559+0000 7f4712b6e640 1 -- 172.21.15.196:0/485276079 shutdown_connections 2024-03-17T23:56:16.564 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:16.559+0000 7f4712b6e640 1 --2- 172.21.15.196:0/485276079 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f46f0067690 0x7f46f0069b50 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:16.564 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:16.559+0000 7f4712b6e640 1 --2- 172.21.15.196:0/485276079 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f470c15df80 0x7f470c14a690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:16.564 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:16.559+0000 7f4712b6e640 1 --2- 172.21.15.196:0/485276079 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f470c15a9d0 0x7f470c14a150 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:16.564 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:16.559+0000 7f4712b6e640 1 --2- 172.21.15.196:0/485276079 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f470c154310 0x7f470c15cb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:16.564 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:16.559+0000 7f4712b6e640 1 -- 172.21.15.196:0/485276079 >> 172.21.15.196:0/485276079 conn(0x7f470c06c350 msgr2=0x7f470c0cea30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-17T23:56:16.564 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:16.559+0000 7f4712b6e640 1 -- 172.21.15.196:0/485276079 shutdown_connections 2024-03-17T23:56:16.565 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:16.559+0000 7f4712b6e640 1 -- 172.21.15.196:0/485276079 wait complete. 2024-03-17T23:56:16.583 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-17T23:56:16.687 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:16.683+0000 7f8e0b776640 1 Processor -- start 2024-03-17T23:56:16.687 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:16.683+0000 7f8e0b776640 1 -- start start 2024-03-17T23:56:16.688 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:16.683+0000 7f8e0b776640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f8e04150ff0 0x7f8e04156c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:16.688 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:16.683+0000 7f8e0b776640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8e041513d0 con 0x7f8e040c7910 2024-03-17T23:56:16.688 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:16.683+0000 7f8e0b776640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8e040c7da0 con 0x7f8e04072330 2024-03-17T23:56:16.688 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:16.683+0000 7f8e0b776640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7f8e040c2ac0 con 0x7f8e04150ff0 2024-03-17T23:56:16.688 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:16.683+0000 7f8e09512640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f8e04150ff0 0x7f8e04156c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:16.688 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:16.683+0000 7f8e09d13640 1 --1- >> v1:172.21.15.196:6789/0 conn(0x7f8e040c7910 0x7f8e041614e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.196:6789/0 says I am v1:172.21.15.196:57306/0 (socket says 172.21.15.196:57306) 2024-03-17T23:56:16.688 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:16.683+0000 7f8e09d13640 1 -- 172.21.15.196:0/529697140 learned_addr learned my addr 172.21.15.196:0/529697140 (peer_addr_for_me v1:172.21.15.196:0/0) 2024-03-17T23:56:16.689 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:16.687+0000 7f8e09512640 1 -- 172.21.15.196:0/529697140 >> v1:172.21.15.204:6789/0 conn(0x7f8e04072330 legacy=0x7f8e040c2d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:16.689 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:16.687+0000 7f8e09512640 1 -- 172.21.15.196:0/529697140 >> v1:172.21.15.196:6789/0 conn(0x7f8e040c7910 legacy=0x7f8e041614e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:16.689 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:16.687+0000 7f8e09512640 1 -- 172.21.15.196:0/529697140 --> v2:172.21.15.196:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e04071920 con 0x7f8e04150ff0 2024-03-17T23:56:16.689 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:16.687+0000 7f8dfbfff640 1 -- 172.21.15.196:0/529697140 <== mon.0 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3977570244 0 0) 0x7f8dfc0014a0 con 0x7f8e040c7910 2024-03-17T23:56:16.691 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:16.687+0000 7f8e09512640 1 --2- 172.21.15.196:0/529697140 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8e04150ff0 0x7f8e04156c40 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f8e000097c0 tx=0x7f8e0001ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=989753fe8bbbeb21 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:56:16.692 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:16.687+0000 7f8dfbfff640 1 -- 172.21.15.196:0/529697140 <== mon.0 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e000b5070 con 0x7f8e04150ff0 2024-03-17T23:56:16.692 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:16.687+0000 7f8dfbfff640 1 -- 172.21.15.196:0/529697140 <== mon.0 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e000a8990 con 0x7f8e04150ff0 2024-03-17T23:56:16.692 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:16.687+0000 7f8dfbfff640 1 -- 172.21.15.196:0/529697140 <== mon.0 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e000a8d60 con 0x7f8e04150ff0 2024-03-17T23:56:16.693 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:16.687+0000 7f8e0b776640 1 -- 172.21.15.196:0/529697140 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8e04150ff0 msgr2=0x7f8e04156c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:16.693 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:16.687+0000 7f8e0b776640 1 --2- 172.21.15.196:0/529697140 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8e04150ff0 0x7f8e04156c40 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f8e000097c0 tx=0x7f8e0001ec90 comp rx=0 tx=0).stop 2024-03-17T23:56:16.693 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:16.687+0000 7f8e0b776640 1 -- 172.21.15.196:0/529697140 shutdown_connections 2024-03-17T23:56:16.693 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:16.687+0000 7f8e0b776640 1 --2- 172.21.15.196:0/529697140 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8e04150ff0 0x7f8e04156c40 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:16.693 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:16.687+0000 7f8e0b776640 1 -- 172.21.15.196:0/529697140 >> 172.21.15.196:0/529697140 conn(0x7f8e040c8340 msgr2=0x7f8e040c8750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-17T23:56:16.693 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:16.687+0000 7f8e0b776640 1 -- 172.21.15.196:0/529697140 shutdown_connections 2024-03-17T23:56:16.693 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:16.691+0000 7f8e0b776640 1 -- 172.21.15.196:0/529697140 wait complete. 2024-03-17T23:56:16.694 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:16.691+0000 7f8e0b776640 1 Processor -- start 2024-03-17T23:56:16.694 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:16.691+0000 7f8e0b776640 1 -- start start 2024-03-17T23:56:16.696 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:16.691+0000 7f8e0b776640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8e04072330 0x7f8e041ee8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:16.697 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:16.691+0000 7f8e0b776640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8e040c7910 0x7f8e04152ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:16.697 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:16.691+0000 7f8e0b776640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8e04150ff0 0x7f8e040ca1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:16.697 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:16.691+0000 7f8e0b776640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f8e040c73f0 con 0x7f8e040c7910 2024-03-17T23:56:16.697 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:16.691+0000 7f8e0b776640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f8e04071bc0 con 0x7f8e04072330 2024-03-17T23:56:16.697 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:16.691+0000 7f8e0b776640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f8e0406e140 con 0x7f8e04150ff0 2024-03-17T23:56:16.697 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:16.691+0000 7f8e08d11640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8e040c7910 0x7f8e04152ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:16.697 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:16.691+0000 7f8e08d11640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8e040c7910 0x7f8e04152ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.196:38202/0 (socket says 172.21.15.196:38202) 2024-03-17T23:56:16.697 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:16.691+0000 7f8e08d11640 1 -- 172.21.15.196:0/2201900810 learned_addr learned my addr 172.21.15.196:0/2201900810 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-03-17T23:56:16.697 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:16.691+0000 7f8e09512640 1 --2- 172.21.15.196:0/2201900810 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8e04072330 0x7f8e041ee8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:16.697 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:16.691+0000 7f8e09d13640 1 --2- 172.21.15.196:0/2201900810 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8e04150ff0 0x7f8e040ca1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:16.697 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:16.691+0000 7f8e08d11640 1 -- 172.21.15.196:0/2201900810 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8e04150ff0 msgr2=0x7f8e040ca1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:16.697 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:16.691+0000 7f8e08d11640 1 --2- 172.21.15.196:0/2201900810 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8e04150ff0 0x7f8e040ca1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:16.698 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:16.691+0000 7f8e08d11640 1 -- 172.21.15.196:0/2201900810 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8e04072330 msgr2=0x7f8e041ee8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:16.698 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:16.691+0000 7f8e08d11640 1 --2- 172.21.15.196:0/2201900810 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8e04072330 0x7f8e041ee8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:16.698 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:16.691+0000 7f8e08d11640 1 -- 172.21.15.196:0/2201900810 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e04156220 con 0x7f8e040c7910 2024-03-17T23:56:16.698 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:16.691+0000 7f8e08d11640 1 --2- 172.21.15.196:0/2201900810 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8e040c7910 0x7f8e04152ba0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f8df400c530 tx=0x7f8df400c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:56:16.698 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:16.691+0000 7f8df9ffb640 1 -- 172.21.15.196:0/2201900810 <== mon.0 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8df4016020 con 0x7f8e040c7910 2024-03-17T23:56:16.698 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:16.691+0000 7f8df9ffb640 1 -- 172.21.15.196:0/2201900810 <== mon.0 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8df4005220 con 0x7f8e040c7910 2024-03-17T23:56:16.698 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:16.691+0000 7f8e0b776640 1 -- 172.21.15.196:0/2201900810 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e04156f30 con 0x7f8e040c7910 2024-03-17T23:56:16.698 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:16.691+0000 7f8df9ffb640 1 -- 172.21.15.196:0/2201900810 <== mon.0 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8df4007030 con 0x7f8e040c7910 2024-03-17T23:56:16.698 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:16.691+0000 7f8e0b776640 1 -- 172.21.15.196:0/2201900810 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e04156970 con 0x7f8e040c7910 2024-03-17T23:56:16.699 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:16.695+0000 7f8def7fe640 1 -- 172.21.15.196:0/2201900810 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8ddc0052a0 con 0x7f8e040c7910 2024-03-17T23:56:16.699 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:16.695+0000 7f8df9ffb640 1 -- 172.21.15.196:0/2201900810 <== mon.0 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 5) ==== 87083+0+0 (secure 0 0 0) 0x7f8df40071d0 con 0x7f8e040c7910 2024-03-17T23:56:16.699 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:16.695+0000 7f8df9ffb640 1 --2- 172.21.15.196:0/2201900810 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f8de8067660 0x7f8de8069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:16.699 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:16.695+0000 7f8df9ffb640 1 -- 172.21.15.196:0/2201900810 <== mon.0 v2:172.21.15.196:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f8df4085ec0 con 0x7f8e040c7910 2024-03-17T23:56:16.699 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:16.695+0000 7f8e09512640 1 --2- 172.21.15.196:0/2201900810 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f8de8067660 0x7f8de8069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:16.700 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:16.695+0000 7f8e09512640 1 --2- 172.21.15.196:0/2201900810 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f8de8067660 0x7f8de8069b20 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f8e000b2000 tx=0x7f8e000aa070 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:56:16.703 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:16.699+0000 7f8df9ffb640 1 -- 172.21.15.196:0/2201900810 <== mon.0 v2:172.21.15.196:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177849 (secure 0 0 0) 0x7f8df4020020 con 0x7f8e040c7910 2024-03-17T23:56:17.086 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:17.083+0000 7f8def7fe640 1 -- 172.21.15.196:0/2201900810 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8ddc005590 con 0x7f8e040c7910 2024-03-17T23:56:17.086 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:17.083+0000 7f8df9ffb640 1 -- 172.21.15.196:0/2201900810 <== mon.0 v2:172.21.15.196:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) ==== 94+0+6922 (secure 0 0 0) 0x7f8df40074c0 con 0x7f8e040c7910 2024-03-17T23:56:17.087 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-03-17T23:56:17.087 INFO:teuthology.orchestra.run.smithi196.stdout:{"epoch":14,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4211,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6835/1901351791","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6834","nonce":1901351791},{"type":"v1","addr":"172.21.15.204:6835","nonce":1901351791}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-17T23:56:01.019247+0000","modified":"2024-03-17T23:56:07.696894+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4284,"mds_1":4281,"mds_2":4275,"mds_3":4264,"mds_4":4261},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4261":{"gid":4261,"name":"d","rank":4,"incarnation":13,"state":"up:active","state_seq":5,"addr":"172.21.15.204:6837/3888512151","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6836","nonce":3888512151},{"type":"v1","addr":"172.21.15.204:6837","nonce":3888512151}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4264":{"gid":4264,"name":"f","rank":3,"incarnation":11,"state":"up:active","state_seq":4,"addr":"172.21.15.204:6839/2849161202","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6838","nonce":2849161202},{"type":"v1","addr":"172.21.15.204:6839","nonce":2849161202}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4275":{"gid":4275,"name":"a","rank":2,"incarnation":9,"state":"up:active","state_seq":4,"addr":"172.21.15.196:6833/2075619627","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6832","nonce":2075619627},{"type":"v1","addr":"172.21.15.196:6833","nonce":2075619627}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4281":{"gid":4281,"name":"e","rank":1,"incarnation":7,"state":"up:active","state_seq":4,"addr":"172.21.15.196:6835/1837184297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6834","nonce":1837184297},{"type":"v1","addr":"172.21.15.196:6835","nonce":1837184297}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4284":{"gid":4284,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.196:6837/2436120950","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6836","nonce":2436120950},{"type":"v1","addr":"172.21.15.196:6837","nonce":2436120950}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4284,"qdb_cluster":[4261,4264,4275,4281,4284]},"id":1}]} 2024-03-17T23:56:17.087 INFO:teuthology.orchestra.run.smithi196.stderr:dumped fsmap epoch 14 2024-03-17T23:56:17.089 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:17.083+0000 7f8def7fe640 1 -- 172.21.15.196:0/2201900810 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f8de8067660 msgr2=0x7f8de8069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:17.089 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:17.083+0000 7f8def7fe640 1 --2- 172.21.15.196:0/2201900810 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f8de8067660 0x7f8de8069b20 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f8e000b2000 tx=0x7f8e000aa070 comp rx=0 tx=0).stop 2024-03-17T23:56:17.089 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:17.087+0000 7f8def7fe640 1 -- 172.21.15.196:0/2201900810 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8e040c7910 msgr2=0x7f8e04152ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:17.089 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:17.087+0000 7f8def7fe640 1 --2- 172.21.15.196:0/2201900810 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8e040c7910 0x7f8e04152ba0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f8df400c530 tx=0x7f8df400c9f0 comp rx=0 tx=0).stop 2024-03-17T23:56:17.089 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:17.087+0000 7f8def7fe640 1 -- 172.21.15.196:0/2201900810 shutdown_connections 2024-03-17T23:56:17.089 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:17.087+0000 7f8def7fe640 1 --2- 172.21.15.196:0/2201900810 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f8de8067660 0x7f8de8069b20 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:17.089 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:17.087+0000 7f8def7fe640 1 --2- 172.21.15.196:0/2201900810 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8e04150ff0 0x7f8e040ca1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:17.089 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:17.087+0000 7f8def7fe640 1 --2- 172.21.15.196:0/2201900810 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8e040c7910 0x7f8e04152ba0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:17.089 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:17.087+0000 7f8def7fe640 1 --2- 172.21.15.196:0/2201900810 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8e04072330 0x7f8e041ee8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:17.089 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:17.087+0000 7f8def7fe640 1 -- 172.21.15.196:0/2201900810 >> 172.21.15.196:0/2201900810 conn(0x7f8e040c8340 msgr2=0x7f8e04072c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-17T23:56:17.090 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:17.087+0000 7f8def7fe640 1 -- 172.21.15.196:0/2201900810 shutdown_connections 2024-03-17T23:56:17.090 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:17.087+0000 7f8def7fe640 1 -- 172.21.15.196:0/2201900810 wait complete. 2024-03-17T23:56:17.707 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 14, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-03-17T23:56:01.019247+0000', 'modified': '2024-03-17T23:56:07.696894+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 5, 'in': [0, 1, 2, 3, 4], 'up': {'mds_0': 4284, 'mds_1': 4281, 'mds_2': 4275, 'mds_3': 4264, 'mds_4': 4261}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4261': {'gid': 4261, 'name': 'd', 'rank': 4, 'incarnation': 13, 'state': 'up:active', 'state_seq': 5, 'addr': '172.21.15.204:6837/3888512151', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.204:6836', 'nonce': 3888512151}, {'type': 'v1', 'addr': '172.21.15.204:6837', 'nonce': 3888512151}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_4264': {'gid': 4264, 'name': 'f', 'rank': 3, 'incarnation': 11, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.204:6839/2849161202', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.204:6838', 'nonce': 2849161202}, {'type': 'v1', 'addr': '172.21.15.204:6839', 'nonce': 2849161202}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_4275': {'gid': 4275, 'name': 'a', 'rank': 2, 'incarnation': 9, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.196:6833/2075619627', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.196:6832', 'nonce': 2075619627}, {'type': 'v1', 'addr': '172.21.15.196:6833', 'nonce': 2075619627}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_4281': {'gid': 4281, 'name': 'e', 'rank': 1, 'incarnation': 7, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.196:6835/1837184297', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.196:6834', 'nonce': 1837184297}, {'type': 'v1', 'addr': '172.21.15.196:6835', 'nonce': 1837184297}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_4284': {'gid': 4284, 'name': 'c', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.196:6837/2436120950', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.196:6836', 'nonce': 2436120950}, {'type': 'v1', 'addr': '172.21.15.196:6837', 'nonce': 2436120950}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4284, 'qdb_cluster': [4261, 4264, 4275, 4281, 4284]} 2024-03-17T23:56:17.707 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 5/5 2024-03-17T23:56:17.708 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2024-03-17T23:56:17.820 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:17.815+0000 7f8486fb4640 1 Processor -- start 2024-03-17T23:56:17.820 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:17.815+0000 7f8486fb4640 1 -- start start 2024-03-17T23:56:17.822 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:17.819+0000 7f8486fb4640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f84800c8310 0x7f84801624c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:17.823 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:17.819+0000 7f8486fb4640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f84800c44c0 con 0x7f8480150e80 2024-03-17T23:56:17.823 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:17.819+0000 7f8486fb4640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f84800c3f00 con 0x7f84800c6fe0 2024-03-17T23:56:17.823 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:17.819+0000 7f8486fb4640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 -- 0x7f84801573b0 con 0x7f84800c8310 2024-03-17T23:56:17.823 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:17.819+0000 7f8484d50640 1 --1- >> v1:172.21.15.196:6789/0 conn(0x7f8480150e80 0x7f848015a120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.196:6789/0 says I am v1:172.21.15.196:57320/0 (socket says 172.21.15.196:57320) 2024-03-17T23:56:17.823 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:17.819+0000 7f8484d50640 1 -- 172.21.15.196:0/4008945907 learned_addr learned my addr 172.21.15.196:0/4008945907 (peer_addr_for_me v1:172.21.15.196:0/0) 2024-03-17T23:56:17.823 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:17.819+0000 7f8485551640 1 --2- 172.21.15.196:0/4008945907 >> v2:172.21.15.204:3300/0 conn(0x7f84800c8310 0x7f84801624c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:17.823 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:17.819+0000 7f847f7fe640 1 -- 172.21.15.196:0/4008945907 <== mon.1 v1:172.21.15.204:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1322445420 0 0) 0x7f84800c3f00 con 0x7f84800c6fe0 2024-03-17T23:56:17.823 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:17.819+0000 7f847f7fe640 1 -- 172.21.15.196:0/4008945907 --> v1:172.21.15.204:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8470003530 con 0x7f84800c6fe0 2024-03-17T23:56:17.823 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:17.819+0000 7f847f7fe640 1 -- 172.21.15.196:0/4008945907 <== mon.0 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 251270633 0 0) 0x7f84800c44c0 con 0x7f8480150e80 2024-03-17T23:56:17.823 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:17.819+0000 7f847f7fe640 1 -- 172.21.15.196:0/4008945907 --> v1:172.21.15.196:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f84800c3f00 con 0x7f8480150e80 2024-03-17T23:56:17.823 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:17.819+0000 7f8485551640 1 -- 172.21.15.196:0/4008945907 >> v1:172.21.15.204:6789/0 conn(0x7f84800c6fe0 legacy=0x7f8480072b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:17.823 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:17.819+0000 7f8485551640 1 -- 172.21.15.196:0/4008945907 >> v1:172.21.15.196:6789/0 conn(0x7f8480150e80 legacy=0x7f848015a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:17.823 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:17.819+0000 7f8485551640 1 -- 172.21.15.196:0/4008945907 --> v2:172.21.15.204:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84800c41e0 con 0x7f84800c8310 2024-03-17T23:56:17.826 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:17.823+0000 7f8485551640 1 --2- 172.21.15.196:0/4008945907 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f84800c8310 0x7f84801624c0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f8480157530 tx=0x7f847801f130 comp rx=0 tx=0).ready entity=mon.1 client_cookie=980630d11cc776e5 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:56:17.826 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:17.823+0000 7f847f7fe640 1 -- 172.21.15.196:0/4008945907 <== mon.1 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84780b4070 con 0x7f84800c8310 2024-03-17T23:56:17.826 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:17.823+0000 7f847f7fe640 1 -- 172.21.15.196:0/4008945907 <== mon.1 v2:172.21.15.204:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f84780af600 con 0x7f84800c8310 2024-03-17T23:56:17.826 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:17.823+0000 7f847f7fe640 1 -- 172.21.15.196:0/4008945907 <== mon.1 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84780af9d0 con 0x7f84800c8310 2024-03-17T23:56:17.827 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:17.823+0000 7f8486fb4640 1 -- 172.21.15.196:0/4008945907 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f84800c8310 msgr2=0x7f84801624c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:17.827 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:17.823+0000 7f8486fb4640 1 --2- 172.21.15.196:0/4008945907 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f84800c8310 0x7f84801624c0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f8480157530 tx=0x7f847801f130 comp rx=0 tx=0).stop 2024-03-17T23:56:17.827 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:17.823+0000 7f8486fb4640 1 -- 172.21.15.196:0/4008945907 shutdown_connections 2024-03-17T23:56:17.827 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:17.823+0000 7f8486fb4640 1 --2- 172.21.15.196:0/4008945907 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f84800c8310 0x7f84801624c0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:17.827 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:17.823+0000 7f8486fb4640 1 -- 172.21.15.196:0/4008945907 >> 172.21.15.196:0/4008945907 conn(0x7f848006c3c0 msgr2=0x7f848006c7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-17T23:56:17.828 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:17.823+0000 7f8486fb4640 1 -- 172.21.15.196:0/4008945907 shutdown_connections 2024-03-17T23:56:17.828 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:17.823+0000 7f8486fb4640 1 -- 172.21.15.196:0/4008945907 wait complete. 2024-03-17T23:56:17.828 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:17.823+0000 7f8486fb4640 1 Processor -- start 2024-03-17T23:56:17.828 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:17.823+0000 7f8486fb4640 1 -- start start 2024-03-17T23:56:17.830 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:17.827+0000 7f8486fb4640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f84800c6fe0 0x7f84800cb560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:17.830 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:17.827+0000 7f8486fb4640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f84800c8310 0x7f84800cbaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:17.830 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:17.827+0000 7f8486fb4640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8480150e80 0x7f8480155190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:17.830 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:17.827+0000 7f8486fb4640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f8480151260 con 0x7f84800c6fe0 2024-03-17T23:56:17.830 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:17.827+0000 7f8486fb4640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f8480157040 con 0x7f8480150e80 2024-03-17T23:56:17.830 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:17.827+0000 7f8486fb4640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f84800c3610 con 0x7f84800c8310 2024-03-17T23:56:17.830 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:17.827+0000 7f8484d50640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f84800c6fe0 0x7f84800cb560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:17.831 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:17.827+0000 7f8484d50640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f84800c6fe0 0x7f84800cb560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.196:38210/0 (socket says 172.21.15.196:38210) 2024-03-17T23:56:17.831 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:17.827+0000 7f8484d50640 1 -- 172.21.15.196:0/3123254582 learned_addr learned my addr 172.21.15.196:0/3123254582 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-03-17T23:56:17.831 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:17.827+0000 7f8485551640 1 --2- 172.21.15.196:0/3123254582 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8480150e80 0x7f8480155190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:17.831 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:17.827+0000 7f847ffff640 1 --2- 172.21.15.196:0/3123254582 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f84800c8310 0x7f84800cbaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:17.831 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:17.827+0000 7f8484d50640 1 -- 172.21.15.196:0/3123254582 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f84800c8310 msgr2=0x7f84800cbaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:17.831 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:17.827+0000 7f8484d50640 1 --2- 172.21.15.196:0/3123254582 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f84800c8310 0x7f84800cbaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:17.831 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:17.827+0000 7f8484d50640 1 -- 172.21.15.196:0/3123254582 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8480150e80 msgr2=0x7f8480155190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:17.831 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:17.827+0000 7f8484d50640 1 --2- 172.21.15.196:0/3123254582 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8480150e80 0x7f8480155190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:17.831 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:17.827+0000 7f8484d50640 1 -- 172.21.15.196:0/3123254582 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84801567c0 con 0x7f84800c6fe0 2024-03-17T23:56:17.831 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:17.827+0000 7f8484d50640 1 --2- 172.21.15.196:0/3123254582 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f84800c6fe0 0x7f84800cb560 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f847400c3c0 tx=0x7f847400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:56:17.831 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:17.827+0000 7f847d7fa640 1 -- 172.21.15.196:0/3123254582 <== mon.0 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8474017070 con 0x7f84800c6fe0 2024-03-17T23:56:17.832 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:17.827+0000 7f847d7fa640 1 -- 172.21.15.196:0/3123254582 <== mon.0 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8474005cf0 con 0x7f84800c6fe0 2024-03-17T23:56:17.832 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:17.827+0000 7f8486fb4640 1 -- 172.21.15.196:0/3123254582 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f848013d6d0 con 0x7f84800c6fe0 2024-03-17T23:56:17.832 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:17.827+0000 7f847d7fa640 1 -- 172.21.15.196:0/3123254582 <== mon.0 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84740072f0 con 0x7f84800c6fe0 2024-03-17T23:56:17.832 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:17.827+0000 7f8486fb4640 1 -- 172.21.15.196:0/3123254582 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f848013dcb0 con 0x7f84800c6fe0 2024-03-17T23:56:17.832 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:17.827+0000 7f848a136000 1 Processor -- start 2024-03-17T23:56:17.832 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:17.831+0000 7f848a136000 1 -- start start 2024-03-17T23:56:17.833 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:17.831+0000 7f848a136000 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56083e6514a0 0x56083e651880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:17.833 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:17.831+0000 7f848a136000 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x56083e651dc0 0x56083e68ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:17.833 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:17.831+0000 7f848a136000 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x56083e68d210 0x56083e68d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:17.833 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:17.831+0000 7f848a136000 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x56083e49a540 con 0x56083e6514a0 2024-03-17T23:56:17.834 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:17.831+0000 7f848a136000 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x56083e421b00 con 0x56083e68d210 2024-03-17T23:56:17.834 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:17.831+0000 7f848a136000 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x56083e4965e0 con 0x56083e651dc0 2024-03-17T23:56:17.834 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:17.831+0000 7f8485551640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56083e6514a0 0x56083e651880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:17.834 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:17.831+0000 7f8485551640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56083e6514a0 0x56083e651880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.196:38218/0 (socket says 172.21.15.196:38218) 2024-03-17T23:56:17.834 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:17.831+0000 7f8485551640 1 -- 172.21.15.196:0/3356985581 learned_addr learned my addr 172.21.15.196:0/3356985581 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-03-17T23:56:17.834 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:17.831+0000 7f847ffff640 1 --2- 172.21.15.196:0/3356985581 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x56083e68d210 0x56083e68d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:17.834 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:17.831+0000 7f8485551640 1 -- 172.21.15.196:0/3356985581 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x56083e651dc0 msgr2=0x56083e68ccd0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-17T23:56:17.834 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:17.831+0000 7f8485551640 1 --2- 172.21.15.196:0/3356985581 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x56083e651dc0 0x56083e68ccd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:17.834 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:17.831+0000 7f8485551640 1 -- 172.21.15.196:0/3356985581 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x56083e68d210 msgr2=0x56083e68d5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-17T23:56:17.834 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:17.831+0000 7f8485551640 1 --2- 172.21.15.196:0/3356985581 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x56083e68d210 0x56083e68d5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:17.834 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:17.831+0000 7f8485551640 1 -- 172.21.15.196:0/3356985581 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56083e4576a0 con 0x56083e6514a0 2024-03-17T23:56:17.836 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:17.831+0000 7f8485551640 1 --2- 172.21.15.196:0/3356985581 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56083e6514a0 0x56083e651880 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f847801f170 tx=0x7f8478004ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9bb5f23b1dc0a2d server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:56:17.836 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:17.831+0000 7f847d7fa640 1 -- 172.21.15.196:0/3123254582 <== mon.0 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 5) ==== 87083+0+0 (secure 0 0 0) 0x7f847401a070 con 0x7f84800c6fe0 2024-03-17T23:56:17.836 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:17.831+0000 7f846a7fc640 1 -- 172.21.15.196:0/3356985581 <== mon.0 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84780c1070 con 0x56083e6514a0 2024-03-17T23:56:17.836 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:17.831+0000 7f846a7fc640 1 -- 172.21.15.196:0/3356985581 <== mon.0 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f84780af700 con 0x56083e6514a0 2024-03-17T23:56:17.836 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:17.831+0000 7f846a7fc640 1 -- 172.21.15.196:0/3356985581 <== mon.0 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84780b4040 con 0x56083e6514a0 2024-03-17T23:56:17.836 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:17.831+0000 7f847d7fa640 1 --2- 172.21.15.196:0/3123254582 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f8464067660 0x7f8464069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:17.836 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:17.831+0000 7f848a136000 1 -- 172.21.15.196:0/3356985581 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56083e6514a0 msgr2=0x56083e651880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:17.836 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:17.831+0000 7f848a136000 1 --2- 172.21.15.196:0/3356985581 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56083e6514a0 0x56083e651880 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f847801f170 tx=0x7f8478004ac0 comp rx=0 tx=0).stop 2024-03-17T23:56:17.836 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:17.831+0000 7f847d7fa640 1 -- 172.21.15.196:0/3123254582 <== mon.0 v2:172.21.15.196:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f8474084b80 con 0x7f84800c6fe0 2024-03-17T23:56:17.836 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:17.831+0000 7f848a136000 1 -- 172.21.15.196:0/3356985581 shutdown_connections 2024-03-17T23:56:17.837 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:17.831+0000 7f848a136000 1 --2- 172.21.15.196:0/3356985581 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x56083e651dc0 0x56083e68ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:17.837 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:17.831+0000 7f848a136000 1 --2- 172.21.15.196:0/3356985581 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x56083e68d210 0x56083e68d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:17.837 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:17.831+0000 7f848a136000 1 --2- 172.21.15.196:0/3356985581 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56083e6514a0 0x56083e651880 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:17.837 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:17.831+0000 7f848a136000 1 -- 172.21.15.196:0/3356985581 >> 172.21.15.196:0/3356985581 conn(0x56083e642e70 msgr2=0x56083e68aa90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-17T23:56:17.837 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:17.831+0000 7f8484d50640 1 --2- 172.21.15.196:0/3123254582 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f8464067660 0x7f8464069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:17.837 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:17.831+0000 7f848a136000 1 -- 172.21.15.196:0/3356985581 shutdown_connections 2024-03-17T23:56:17.837 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:17.831+0000 7f848a136000 1 -- 172.21.15.196:0/3356985581 wait complete. 2024-03-17T23:56:17.837 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:17.831+0000 7f8484d50640 1 --2- 172.21.15.196:0/3123254582 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f8464067660 0x7f8464069b20 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f847400cd80 tx=0x7f847401e040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:56:17.837 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:17.831+0000 7f848a136000 1 -- start start 2024-03-17T23:56:17.837 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:17.831+0000 7f848a136000 1 Processor -- start 2024-03-17T23:56:17.840 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:17.835+0000 7f848a136000 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x56083e6514a0 0x56083e685eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:17.840 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:17.835+0000 7f848a136000 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x56083e651dc0 0x56083e6863f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:17.840 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:17.835+0000 7f848a136000 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56083e68d210 0x56083e649ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:17.840 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:17.835+0000 7f848a136000 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x56083e458850 con 0x56083e68d210 2024-03-17T23:56:17.840 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:17.835+0000 7f848a136000 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x56083e499850 con 0x56083e651dc0 2024-03-17T23:56:17.840 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:17.835+0000 7f848a136000 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x56083e4327b0 con 0x56083e6514a0 2024-03-17T23:56:17.840 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:17.835+0000 7f848a136000 10 client.0 _ll_register_callbacks cb 0x56083e637220 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-17T23:56:17.841 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:17.835+0000 7f8485551640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56083e68d210 0x56083e649ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:17.841 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:17.835+0000 7f8485551640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56083e68d210 0x56083e649ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.196:38230/0 (socket says 172.21.15.196:38230) 2024-03-17T23:56:17.841 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:17.835+0000 7f8485551640 1 -- 172.21.15.196:0/4195935 learned_addr learned my addr 172.21.15.196:0/4195935 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-03-17T23:56:17.841 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:17.835+0000 7f847ffff640 1 --2- 172.21.15.196:0/4195935 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x56083e651dc0 0x56083e6863f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:17.841 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:17.835+0000 7f8485551640 1 --2- 172.21.15.196:0/4195935 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x56083e6514a0 0x56083e685eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:17.841 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:17.835+0000 7f8485551640 1 -- 172.21.15.196:0/4195935 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x56083e6514a0 msgr2=0x56083e685eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-17T23:56:17.841 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:17.835+0000 7f8485551640 1 --2- 172.21.15.196:0/4195935 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x56083e6514a0 0x56083e685eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:17.841 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:17.835+0000 7f8485551640 1 -- 172.21.15.196:0/4195935 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x56083e651dc0 msgr2=0x56083e6863f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-17T23:56:17.841 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:17.835+0000 7f8485551640 1 --2- 172.21.15.196:0/4195935 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x56083e651dc0 0x56083e6863f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:17.841 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:17.835+0000 7f8485551640 1 -- 172.21.15.196:0/4195935 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56083e455900 con 0x56083e68d210 2024-03-17T23:56:17.841 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:17.835+0000 7f8485551640 1 --2- 172.21.15.196:0/4195935 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56083e68d210 0x56083e649ea0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f847801f170 tx=0x7f84780ac000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e899f0a802b1bfb server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:56:17.841 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:17.835+0000 7f845f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.196:3300/0 2024-03-17T23:56:17.842 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:17.835+0000 7f845f7fe640 1 -- 172.21.15.196:0/4195935 <== mon.0 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84780b4070 con 0x56083e68d210 2024-03-17T23:56:17.842 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:17.835+0000 7f845f7fe640 1 -- 172.21.15.196:0/4195935 <== mon.0 v2:172.21.15.196:3300/0 2 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f84780bb460 con 0x56083e68d210 2024-03-17T23:56:17.842 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:17.835+0000 7f848a136000 1 -- 172.21.15.196:0/4195935 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f84780af700 con 0x56083e68d210 2024-03-17T23:56:17.842 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:17.835+0000 7f845f7fe640 1 -- 172.21.15.196:0/4195935 <== mon.0 v2:172.21.15.196:3300/0 3 ==== mon_get_version_reply(handle=1 version=14) ==== 24+0+0 (secure 0 0 0) 0x7f84780d6050 con 0x56083e68d210 2024-03-17T23:56:17.842 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:17.835+0000 7f848a136000 10 client.4722 fetch_fsmap learned FSMap version 14 2024-03-17T23:56:17.842 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:17.835+0000 7f848a136000 1 -- 172.21.15.196:0/4195935 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,fsmap=14,monmap=2+}) -- 0x56083e51b940 con 0x56083e68d210 2024-03-17T23:56:17.842 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:17.835+0000 7f845f7fe640 1 -- 172.21.15.196:0/4195935 <== mon.0 v2:172.21.15.196:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f84780af700 con 0x56083e68d210 2024-03-17T23:56:17.842 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:17.835+0000 7f845f7fe640 1 -- 172.21.15.196:0/4195935 <== mon.0 v2:172.21.15.196:3300/0 5 ==== fsmap(e 14) ==== 4784+0+0 (secure 0 0 0) 0x7f84780d9020 con 0x56083e68d210 2024-03-17T23:56:17.842 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:17.835+0000 7f848a136000 10 client.4722 fetch_fsmap finished waiting for FSMap version 14 2024-03-17T23:56:17.842 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:17.835+0000 7f848a136000 10 client.4722 resolve_mds: resolved name 'd' to daemon mds.d 2024-03-17T23:56:17.842 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:17.835+0000 7f848a136000 20 client.4722 populate_metadata read hostname 'smithi196' 2024-03-17T23:56:17.842 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:17.835+0000 7f848a136000 1 --2- 172.21.15.196:0/4195935 >> [v2:172.21.15.204:6836/3888512151,v1:172.21.15.204:6837/3888512151] conn(0x56083e64ad10 0x56083e64b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:17.842 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:17.835+0000 7f848a136000 4 client.4722 mds_command: new command op to 4261 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-17T23:56:17.842 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:17.835+0000 7f848a136000 1 -- 172.21.15.196:0/4195935 --> [v2:172.21.15.204:6836/3888512151,v1:172.21.15.204:6837/3888512151] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56083e435bc0 con 0x56083e64ad10 2024-03-17T23:56:17.843 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:17.835+0000 7f847ffff640 1 --2- 172.21.15.196:0/4195935 >> [v2:172.21.15.204:6836/3888512151,v1:172.21.15.204:6837/3888512151] conn(0x56083e64ad10 0x56083e64b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:17.843 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:17.835+0000 7f847ffff640 1 --2- 172.21.15.196:0/4195935 >> [v2:172.21.15.204:6836/3888512151,v1:172.21.15.204:6837/3888512151] conn(0x56083e64ad10 0x56083e64b0f0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=2c6a8af5dbe8bdf8 server_cookie=4510a26879ebb926 in_seq=0 out_seq=0 2024-03-17T23:56:17.843 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:17.835+0000 7f845f7fe640 10 client.4722 ms_handle_connect on v2:172.21.15.204:6836/3888512151 2024-03-17T23:56:17.844 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:17.839+0000 7f845f7fe640 1 -- 172.21.15.196:0/4195935 <== mds.4 v2:172.21.15.204:6836/3888512151 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x56083e435bc0 con 0x56083e64ad10 2024-03-17T23:56:17.844 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:17.839+0000 7f845f7fe640 10 client.4722 handle_command_reply: tid=0 2024-03-17T23:56:17.844 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:17.839+0000 7f848a136000 1 client.4722 shutdown 2024-03-17T23:56:17.844 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:17.839+0000 7f848a136000 1 -- 172.21.15.196:0/4195935 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56083e68d210 msgr2=0x56083e649ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:17.844 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:17.839+0000 7f848a136000 1 --2- 172.21.15.196:0/4195935 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56083e68d210 0x56083e649ea0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f847801f170 tx=0x7f84780ac000 comp rx=0 tx=0).stop 2024-03-17T23:56:17.844 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:17.839+0000 7f848a136000 1 -- 172.21.15.196:0/4195935 shutdown_connections 2024-03-17T23:56:17.844 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:17.839+0000 7f848a136000 1 --2- 172.21.15.196:0/4195935 >> [v2:172.21.15.204:6836/3888512151,v1:172.21.15.204:6837/3888512151] conn(0x56083e64ad10 0x56083e64b0f0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:17.844 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:17.839+0000 7f848a136000 1 --2- 172.21.15.196:0/4195935 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56083e68d210 0x56083e649ea0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:17.845 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:17.839+0000 7f848a136000 1 --2- 172.21.15.196:0/4195935 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x56083e651dc0 0x56083e6863f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:17.845 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:17.839+0000 7f848a136000 1 --2- 172.21.15.196:0/4195935 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x56083e6514a0 0x56083e685eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:17.845 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:17.839+0000 7f845f7fe640 0 client.4722 ms_handle_reset on v2:172.21.15.204:6836/3888512151 2024-03-17T23:56:17.845 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:17.839+0000 7f848a136000 1 -- 172.21.15.196:0/4195935 >> 172.21.15.196:0/4195935 conn(0x56083e642e70 msgr2=0x56083e68a670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-17T23:56:17.845 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:17.839+0000 7f848a136000 1 -- 172.21.15.196:0/4195935 shutdown_connections 2024-03-17T23:56:17.845 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:17.839+0000 7f848a136000 1 -- 172.21.15.196:0/4195935 wait complete. 2024-03-17T23:56:17.845 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:17.839+0000 7f848a136000 20 client.4722 trim_cache size 0 max 16384 2024-03-17T23:56:17.858 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:17.855+0000 7f848a136000 1 Processor -- start 2024-03-17T23:56:17.858 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:17.855+0000 7f848a136000 1 -- start start 2024-03-17T23:56:17.860 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:17.855+0000 7f848a136000 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56083e64ad10 0x56083e650130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:17.860 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:17.855+0000 7f848a136000 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x56083e6514a0 0x56083e68a460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:17.860 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:17.855+0000 7f848a136000 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x56083e651dc0 0x56083e68a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:17.860 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:17.855+0000 7f848a136000 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f84801fba10 con 0x56083e64ad10 2024-03-17T23:56:17.860 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:17.855+0000 7f848a136000 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f84801fc0e0 con 0x56083e6514a0 2024-03-17T23:56:17.860 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:17.855+0000 7f848a136000 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f848014cef0 con 0x56083e651dc0 2024-03-17T23:56:17.860 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:17.855+0000 7f8485551640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56083e64ad10 0x56083e650130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:17.860 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:17.855+0000 7f8485551640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56083e64ad10 0x56083e650130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.196:38238/0 (socket says 172.21.15.196:38238) 2024-03-17T23:56:17.861 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:17.855+0000 7f8485551640 1 -- 172.21.15.196:0/2184284048 learned_addr learned my addr 172.21.15.196:0/2184284048 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-03-17T23:56:17.861 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:17.855+0000 7f847ffff640 1 --2- 172.21.15.196:0/2184284048 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x56083e6514a0 0x56083e68a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:17.861 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:17.855+0000 7f8485551640 1 --2- 172.21.15.196:0/2184284048 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x56083e651dc0 0x56083e68a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:17.861 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:17.855+0000 7f8485551640 1 -- 172.21.15.196:0/2184284048 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x56083e651dc0 msgr2=0x56083e68a9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-17T23:56:17.861 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:17.855+0000 7f8485551640 1 --2- 172.21.15.196:0/2184284048 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x56083e651dc0 0x56083e68a9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:17.861 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:17.855+0000 7f8485551640 1 -- 172.21.15.196:0/2184284048 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x56083e6514a0 msgr2=0x56083e68a460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-17T23:56:17.861 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:17.855+0000 7f8485551640 1 --2- 172.21.15.196:0/2184284048 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x56083e6514a0 0x56083e68a460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:17.861 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:17.855+0000 7f8485551640 1 -- 172.21.15.196:0/2184284048 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56083e4f2870 con 0x56083e64ad10 2024-03-17T23:56:17.861 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:17.855+0000 7f847ffff640 1 --2- 172.21.15.196:0/2184284048 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x56083e6514a0 0x56083e68a460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-17T23:56:17.861 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:17.855+0000 7f8485551640 1 --2- 172.21.15.196:0/2184284048 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56083e64ad10 0x56083e650130 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f8478009d10 tx=0x7f84780b4000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16ea801d9f587a2f server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:56:17.861 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:17.855+0000 7f8469ffb640 1 -- 172.21.15.196:0/2184284048 <== mon.0 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84780c1040 con 0x56083e64ad10 2024-03-17T23:56:17.861 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:17.855+0000 7f8469ffb640 1 -- 172.21.15.196:0/2184284048 <== mon.0 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f84780ce070 con 0x56083e64ad10 2024-03-17T23:56:17.862 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:17.855+0000 7f8469ffb640 1 -- 172.21.15.196:0/2184284048 <== mon.0 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84780afbd0 con 0x56083e64ad10 2024-03-17T23:56:17.866 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:17.859+0000 7f848a136000 1 -- 172.21.15.196:0/2184284048 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56083e64ad10 msgr2=0x56083e650130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:17.866 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:17.859+0000 7f848a136000 1 --2- 172.21.15.196:0/2184284048 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56083e64ad10 0x56083e650130 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f8478009d10 tx=0x7f84780b4000 comp rx=0 tx=0).stop 2024-03-17T23:56:17.866 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:17.859+0000 7f848a136000 1 -- 172.21.15.196:0/2184284048 shutdown_connections 2024-03-17T23:56:17.866 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:17.859+0000 7f848a136000 1 --2- 172.21.15.196:0/2184284048 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x56083e651dc0 0x56083e68a9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:17.866 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:17.859+0000 7f848a136000 1 --2- 172.21.15.196:0/2184284048 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x56083e6514a0 0x56083e68a460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:17.866 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:17.859+0000 7f848a136000 1 --2- 172.21.15.196:0/2184284048 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56083e64ad10 0x56083e650130 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:17.866 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:17.859+0000 7f848a136000 1 -- 172.21.15.196:0/2184284048 >> 172.21.15.196:0/2184284048 conn(0x56083e642e70 msgr2=0x56083e686ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-17T23:56:17.866 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:17.859+0000 7f848a136000 1 -- 172.21.15.196:0/2184284048 shutdown_connections 2024-03-17T23:56:17.866 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:17.859+0000 7f848a136000 1 -- 172.21.15.196:0/2184284048 wait complete. 2024-03-17T23:56:17.867 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:17.859+0000 7f848a136000 1 -- start start 2024-03-17T23:56:17.867 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:17.859+0000 7f848a136000 1 Processor -- start 2024-03-17T23:56:17.867 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:17.859+0000 7f848a136000 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56083e64ad10 0x56083e6fe070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:17.867 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:17.859+0000 7f848a136000 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x56083e6514a0 0x56083e6fe5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:17.867 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:17.859+0000 7f848a136000 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x56083e651dc0 0x56083e64eac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:17.867 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:17.859+0000 7f848a136000 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x56083e434af0 con 0x56083e64ad10 2024-03-17T23:56:17.867 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:17.859+0000 7f848a136000 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x56083e4a60e0 con 0x56083e6514a0 2024-03-17T23:56:17.867 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:17.859+0000 7f848a136000 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x56083e6872b0 con 0x56083e651dc0 2024-03-17T23:56:17.867 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:17.859+0000 7f848a136000 10 client.0 _ll_register_callbacks cb 0x7f8470003700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-17T23:56:17.867 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:17.859+0000 7f8485551640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56083e64ad10 0x56083e6fe070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:17.867 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:17.859+0000 7f8485551640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56083e64ad10 0x56083e6fe070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.196:38254/0 (socket says 172.21.15.196:38254) 2024-03-17T23:56:17.867 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:17.859+0000 7f8485551640 1 -- 172.21.15.196:0/3313251342 learned_addr learned my addr 172.21.15.196:0/3313251342 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-03-17T23:56:17.867 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:17.859+0000 7f847ffff640 1 --2- 172.21.15.196:0/3313251342 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x56083e6514a0 0x56083e6fe5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:17.868 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:17.859+0000 7f8485551640 1 --2- 172.21.15.196:0/3313251342 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x56083e651dc0 0x56083e64eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:17.868 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:17.859+0000 7f8485551640 1 -- 172.21.15.196:0/3313251342 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x56083e651dc0 msgr2=0x56083e64eac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-17T23:56:17.868 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:17.859+0000 7f8485551640 1 --2- 172.21.15.196:0/3313251342 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x56083e651dc0 0x56083e64eac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:17.868 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:17.859+0000 7f8485551640 1 -- 172.21.15.196:0/3313251342 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x56083e6514a0 msgr2=0x56083e6fe5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-17T23:56:17.868 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:17.859+0000 7f8485551640 1 --2- 172.21.15.196:0/3313251342 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x56083e6514a0 0x56083e6fe5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:17.868 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:17.859+0000 7f8485551640 1 -- 172.21.15.196:0/3313251342 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56083e44a070 con 0x56083e64ad10 2024-03-17T23:56:17.868 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:17.859+0000 7f8485551640 1 --2- 172.21.15.196:0/3313251342 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56083e64ad10 0x56083e6fe070 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f847809ba60 tx=0x7f84780ac000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6606299ca514cda2 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:56:17.868 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:17.859+0000 7f845f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.196:3300/0 2024-03-17T23:56:17.868 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:17.859+0000 7f845f7fe640 1 -- 172.21.15.196:0/3313251342 <== mon.0 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84780c1070 con 0x56083e64ad10 2024-03-17T23:56:17.868 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:17.859+0000 7f845f7fe640 1 -- 172.21.15.196:0/3313251342 <== mon.0 v2:172.21.15.196:3300/0 2 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f84780039a0 con 0x56083e64ad10 2024-03-17T23:56:17.868 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:17.859+0000 7f848a136000 1 -- 172.21.15.196:0/3313251342 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f84780ce070 con 0x56083e64ad10 2024-03-17T23:56:17.868 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:17.859+0000 7f845f7fe640 1 -- 172.21.15.196:0/3313251342 <== mon.0 v2:172.21.15.196:3300/0 3 ==== mon_get_version_reply(handle=1 version=14) ==== 24+0+0 (secure 0 0 0) 0x7f84780eb050 con 0x56083e64ad10 2024-03-17T23:56:17.868 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:17.859+0000 7f848a136000 10 client.4728 fetch_fsmap learned FSMap version 14 2024-03-17T23:56:17.868 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:17.859+0000 7f848a136000 1 -- 172.21.15.196:0/3313251342 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,fsmap=14,monmap=2+}) -- 0x56083e42e370 con 0x56083e64ad10 2024-03-17T23:56:17.868 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:17.859+0000 7f845f7fe640 1 -- 172.21.15.196:0/3313251342 <== mon.0 v2:172.21.15.196:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f84780ce070 con 0x56083e64ad10 2024-03-17T23:56:17.869 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:17.859+0000 7f845f7fe640 1 -- 172.21.15.196:0/3313251342 <== mon.0 v2:172.21.15.196:3300/0 5 ==== fsmap(e 14) ==== 4784+0+0 (secure 0 0 0) 0x7f84780d9040 con 0x56083e64ad10 2024-03-17T23:56:17.869 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:17.859+0000 7f848a136000 10 client.4728 fetch_fsmap finished waiting for FSMap version 14 2024-03-17T23:56:17.869 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:17.859+0000 7f848a136000 10 client.4728 resolve_mds: resolved name 'd' to daemon mds.d 2024-03-17T23:56:17.869 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:17.859+0000 7f848a136000 20 client.4728 populate_metadata read hostname 'smithi196' 2024-03-17T23:56:17.869 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:17.859+0000 7f848a136000 1 --2- 172.21.15.196:0/3313251342 >> [v2:172.21.15.204:6836/3888512151,v1:172.21.15.204:6837/3888512151] conn(0x56083e68d210 0x56083e64f480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:17.869 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:17.859+0000 7f848a136000 4 client.4728 mds_command: new command op to 4261 tid=0 multi_id=0 [{"prefix": "status"}] 2024-03-17T23:56:17.869 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:17.859+0000 7f848a136000 1 -- 172.21.15.196:0/3313251342 --> [v2:172.21.15.204:6836/3888512151,v1:172.21.15.204:6837/3888512151] -- command(tid 0: {"prefix": "status"}) -- 0x56083e4a7a80 con 0x56083e68d210 2024-03-17T23:56:17.869 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:17.863+0000 7f847ffff640 1 --2- 172.21.15.196:0/3313251342 >> [v2:172.21.15.204:6836/3888512151,v1:172.21.15.204:6837/3888512151] conn(0x56083e68d210 0x56083e64f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:17.869 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:17.863+0000 7f847ffff640 1 --2- 172.21.15.196:0/3313251342 >> [v2:172.21.15.204:6836/3888512151,v1:172.21.15.204:6837/3888512151] conn(0x56083e68d210 0x56083e64f480 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=53ce63e2d6c7652e server_cookie=fbbac53856ecc02e in_seq=0 out_seq=0 2024-03-17T23:56:17.869 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:17.863+0000 7f845f7fe640 10 client.4728 ms_handle_connect on v2:172.21.15.204:6836/3888512151 2024-03-17T23:56:17.869 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:17.863+0000 7f845f7fe640 1 -- 172.21.15.196:0/3313251342 <== mds.4 v2:172.21.15.204:6836/3888512151 1 ==== command_reply(tid 0: 0 ) ==== 8+0+319 (crc 0 0 0) 0x56083e4a7a80 con 0x56083e68d210 2024-03-17T23:56:17.869 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:17.863+0000 7f845f7fe640 10 client.4728 handle_command_reply: tid=0 2024-03-17T23:56:17.869 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:17.863+0000 7f848a136000 1 client.4728 shutdown 2024-03-17T23:56:17.869 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:17.863+0000 7f848a136000 1 -- 172.21.15.196:0/3313251342 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56083e64ad10 msgr2=0x56083e6fe070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:17.869 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:17.863+0000 7f848a136000 1 --2- 172.21.15.196:0/3313251342 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56083e64ad10 0x56083e6fe070 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f847809ba60 tx=0x7f84780ac000 comp rx=0 tx=0).stop 2024-03-17T23:56:17.870 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:17.863+0000 7f848a136000 1 -- 172.21.15.196:0/3313251342 shutdown_connections 2024-03-17T23:56:17.870 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:17.863+0000 7f848a136000 1 --2- 172.21.15.196:0/3313251342 >> [v2:172.21.15.204:6836/3888512151,v1:172.21.15.204:6837/3888512151] conn(0x56083e68d210 0x56083e64f480 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:17.870 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:17.863+0000 7f848a136000 1 --2- 172.21.15.196:0/3313251342 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x56083e651dc0 0x56083e64eac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:17.870 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:17.863+0000 7f845f7fe640 0 client.4728 ms_handle_reset on v2:172.21.15.204:6836/3888512151 2024-03-17T23:56:17.870 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:17.863+0000 7f848a136000 1 --2- 172.21.15.196:0/3313251342 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x56083e6514a0 0x56083e6fe5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:17.870 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:17.863+0000 7f848a136000 1 --2- 172.21.15.196:0/3313251342 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56083e64ad10 0x56083e6fe070 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:17.870 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:17.863+0000 7f848a136000 1 -- 172.21.15.196:0/3313251342 >> 172.21.15.196:0/3313251342 conn(0x56083e642e70 msgr2=0x56083e6a86d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-17T23:56:17.870 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:17.863+0000 7f848a136000 1 -- 172.21.15.196:0/3313251342 shutdown_connections 2024-03-17T23:56:17.870 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:17.863+0000 7f848a136000 1 -- 172.21.15.196:0/3313251342 wait complete. 2024-03-17T23:56:17.870 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:17.863+0000 7f848a136000 20 client.4728 trim_cache size 0 max 16384 2024-03-17T23:56:17.871 INFO:teuthology.orchestra.run.smithi196.stdout:{ 2024-03-17T23:56:17.871 INFO:teuthology.orchestra.run.smithi196.stdout: "cluster_fsid": "b80f9c80-17ad-4126-8957-4c0c46f5b803", 2024-03-17T23:56:17.871 INFO:teuthology.orchestra.run.smithi196.stdout: "whoami": 4, 2024-03-17T23:56:17.871 INFO:teuthology.orchestra.run.smithi196.stdout: "id": 4261, 2024-03-17T23:56:17.871 INFO:teuthology.orchestra.run.smithi196.stdout: "want_state": "up:active", 2024-03-17T23:56:17.871 INFO:teuthology.orchestra.run.smithi196.stdout: "state": "up:active", 2024-03-17T23:56:17.871 INFO:teuthology.orchestra.run.smithi196.stdout: "fs_name": "cephfs", 2024-03-17T23:56:17.871 INFO:teuthology.orchestra.run.smithi196.stdout: "rank_uptime": 11.170294339, 2024-03-17T23:56:17.871 INFO:teuthology.orchestra.run.smithi196.stdout: "mdsmap_epoch": 14, 2024-03-17T23:56:17.871 INFO:teuthology.orchestra.run.smithi196.stdout: "osdmap_epoch": 21, 2024-03-17T23:56:17.871 INFO:teuthology.orchestra.run.smithi196.stdout: "osdmap_epoch_barrier": 21, 2024-03-17T23:56:17.871 INFO:teuthology.orchestra.run.smithi196.stdout: "uptime": 23.265942703 2024-03-17T23:56:17.871 INFO:teuthology.orchestra.run.smithi196.stdout:} 2024-03-17T23:56:17.872 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:17.863+0000 7f8486fb4640 1 -- 172.21.15.196:0/3123254582 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f8464067660 msgr2=0x7f8464069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:17.872 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:17.863+0000 7f8486fb4640 1 --2- 172.21.15.196:0/3123254582 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f8464067660 0x7f8464069b20 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f847400cd80 tx=0x7f847401e040 comp rx=0 tx=0).stop 2024-03-17T23:56:17.872 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:17.863+0000 7f8486fb4640 1 -- 172.21.15.196:0/3123254582 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f84800c6fe0 msgr2=0x7f84800cb560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:17.872 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:17.863+0000 7f8486fb4640 1 --2- 172.21.15.196:0/3123254582 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f84800c6fe0 0x7f84800cb560 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f847400c3c0 tx=0x7f847400c880 comp rx=0 tx=0).stop 2024-03-17T23:56:17.873 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:17.863+0000 7f8486fb4640 1 -- 172.21.15.196:0/3123254582 shutdown_connections 2024-03-17T23:56:17.873 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:17.863+0000 7f8486fb4640 1 --2- 172.21.15.196:0/3123254582 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f8464067660 0x7f8464069b20 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:17.873 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:17.863+0000 7f8486fb4640 1 --2- 172.21.15.196:0/3123254582 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f84800c8310 0x7f84800cbaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:17.873 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:17.863+0000 7f8486fb4640 1 --2- 172.21.15.196:0/3123254582 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8480150e80 0x7f8480155190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:17.873 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:17.863+0000 7f8486fb4640 1 --2- 172.21.15.196:0/3123254582 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f84800c6fe0 0x7f84800cb560 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:17.873 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:17.863+0000 7f8486fb4640 1 -- 172.21.15.196:0/3123254582 >> 172.21.15.196:0/3123254582 conn(0x7f848006c3c0 msgr2=0x7f848006b2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-17T23:56:17.873 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:17.863+0000 7f8486fb4640 1 -- 172.21.15.196:0/3123254582 shutdown_connections 2024-03-17T23:56:17.873 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:17.863+0000 7f8486fb4640 1 -- 172.21.15.196:0/3123254582 wait complete. 2024-03-17T23:56:17.881 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.f status 2024-03-17T23:56:17.996 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:17.991+0000 7f788c6ea640 1 Processor -- start 2024-03-17T23:56:17.996 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:17.991+0000 7f788c6ea640 1 -- start start 2024-03-17T23:56:17.997 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:17.995+0000 7f788c6ea640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f78841504a0 0x7f78840b1ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:17.997 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:17.995+0000 7f788c6ea640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f788406e330 0x7f788406e760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:17.997 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:17.995+0000 7f788c6ea640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7884159ea0 con 0x7f78840c6d80 2024-03-17T23:56:17.997 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:17.995+0000 7f788c6ea640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 -- 0x7f788406c5e0 con 0x7f78841504a0 2024-03-17T23:56:17.997 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:17.995+0000 7f788c6ea640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f78840b1ff0 con 0x7f788406e330 2024-03-17T23:56:17.997 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:17.995+0000 7f7889c85640 1 --1- >> v1:172.21.15.204:6789/0 conn(0x7f78840c6d80 0x7f7884159790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.204:6789/0 says I am v1:172.21.15.196:57806/0 (socket says 172.21.15.196:57806) 2024-03-17T23:56:17.997 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:17.995+0000 7f7889c85640 1 -- 172.21.15.196:0/634646492 learned_addr learned my addr 172.21.15.196:0/634646492 (peer_addr_for_me v1:172.21.15.196:0/0) 2024-03-17T23:56:17.997 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:17.995+0000 7f788a486640 1 --2- 172.21.15.196:0/634646492 >> v2:172.21.15.204:3300/0 conn(0x7f78841504a0 0x7f78840b1ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:17.997 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:17.995+0000 7f788ac87640 1 --2- 172.21.15.196:0/634646492 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f788406e330 0x7f788406e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:17.998 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:17.995+0000 7f7889484640 1 -- 172.21.15.196:0/634646492 <== mon.1 v1:172.21.15.204:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3742557459 0 0) 0x7f7884159ea0 con 0x7f78840c6d80 2024-03-17T23:56:17.998 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:17.995+0000 7f788ac87640 1 -- 172.21.15.196:0/634646492 >> v2:172.21.15.204:3300/0 conn(0x7f78841504a0 msgr2=0x7f78840b1ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-17T23:56:17.998 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:17.995+0000 7f788ac87640 1 --2- 172.21.15.196:0/634646492 >> v2:172.21.15.204:3300/0 conn(0x7f78841504a0 0x7f78840b1ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:17.998 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:17.995+0000 7f788ac87640 1 -- 172.21.15.196:0/634646492 >> v1:172.21.15.204:6789/0 conn(0x7f78840c6d80 legacy=0x7f7884159790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:17.998 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:17.995+0000 7f788ac87640 1 -- 172.21.15.196:0/634646492 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78840c23d0 con 0x7f788406e330 2024-03-17T23:56:18.000 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:17.999+0000 7f788ac87640 1 --2- 172.21.15.196:0/634646492 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f788406e330 0x7f788406e760 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f787c009d90 tx=0x7f787c01c970 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aefc71a2c321c127 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:56:18.001 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:17.999+0000 7f7889484640 1 -- 172.21.15.196:0/634646492 <== mon.2 v2:172.21.15.204:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f787c0b2070 con 0x7f788406e330 2024-03-17T23:56:18.001 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:17.999+0000 7f7889484640 1 -- 172.21.15.196:0/634646492 <== mon.2 v2:172.21.15.204:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f787c0a58c0 con 0x7f788406e330 2024-03-17T23:56:18.001 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:17.999+0000 7f7889484640 1 -- 172.21.15.196:0/634646492 <== mon.2 v2:172.21.15.204:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f787c0a5c90 con 0x7f788406e330 2024-03-17T23:56:18.002 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:17.999+0000 7f788c6ea640 1 -- 172.21.15.196:0/634646492 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f788406e330 msgr2=0x7f788406e760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:18.002 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:17.999+0000 7f788c6ea640 1 --2- 172.21.15.196:0/634646492 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f788406e330 0x7f788406e760 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f787c009d90 tx=0x7f787c01c970 comp rx=0 tx=0).stop 2024-03-17T23:56:18.002 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:17.999+0000 7f788c6ea640 1 -- 172.21.15.196:0/634646492 shutdown_connections 2024-03-17T23:56:18.002 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:17.999+0000 7f788c6ea640 1 --2- 172.21.15.196:0/634646492 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f788406e330 0x7f788406e760 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:18.002 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:17.999+0000 7f788c6ea640 1 --2- 172.21.15.196:0/634646492 >> v2:172.21.15.204:3300/0 conn(0x7f78841504a0 0x7f78840b1ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:18.002 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:17.999+0000 7f788c6ea640 1 -- 172.21.15.196:0/634646492 >> 172.21.15.196:0/634646492 conn(0x7f788406b2b0 msgr2=0x7f788406b6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-17T23:56:18.002 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:17.999+0000 7f788c6ea640 1 -- 172.21.15.196:0/634646492 shutdown_connections 2024-03-17T23:56:18.002 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:17.999+0000 7f788c6ea640 1 -- 172.21.15.196:0/634646492 wait complete. 2024-03-17T23:56:18.003 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:17.999+0000 7f788c6ea640 1 Processor -- start 2024-03-17T23:56:18.003 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:17.999+0000 7f788c6ea640 1 -- start start 2024-03-17T23:56:18.006 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.003+0000 7f788c6ea640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f788406e330 0x7f78840cb480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:18.006 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.003+0000 7f788c6ea640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f78840c6d80 0x7f7884155450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:18.006 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.003+0000 7f788c6ea640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f78841504a0 0x7f7884155990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:18.006 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.003+0000 7f788c6ea640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f78840c29e0 con 0x7f78841504a0 2024-03-17T23:56:18.006 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.003+0000 7f788c6ea640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f788406bdd0 con 0x7f788406e330 2024-03-17T23:56:18.006 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.003+0000 7f788c6ea640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f78840c2670 con 0x7f78840c6d80 2024-03-17T23:56:18.006 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.003+0000 7f788ac87640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f78841504a0 0x7f7884155990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:18.006 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.003+0000 7f788ac87640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f78841504a0 0x7f7884155990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.196:38258/0 (socket says 172.21.15.196:38258) 2024-03-17T23:56:18.007 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.003+0000 7f788ac87640 1 -- 172.21.15.196:0/621870396 learned_addr learned my addr 172.21.15.196:0/621870396 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-03-17T23:56:18.007 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.003+0000 7f788a486640 1 --2- 172.21.15.196:0/621870396 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f788406e330 0x7f78840cb480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:18.007 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.003+0000 7f7889c85640 1 --2- 172.21.15.196:0/621870396 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f78840c6d80 0x7f7884155450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:18.007 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.003+0000 7f788ac87640 1 -- 172.21.15.196:0/621870396 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f78840c6d80 msgr2=0x7f7884155450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:18.007 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.003+0000 7f788ac87640 1 --2- 172.21.15.196:0/621870396 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f78840c6d80 0x7f7884155450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:18.007 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.003+0000 7f788ac87640 1 -- 172.21.15.196:0/621870396 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f788406e330 msgr2=0x7f78840cb480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:18.007 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.003+0000 7f788ac87640 1 --2- 172.21.15.196:0/621870396 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f788406e330 0x7f78840cb480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:18.007 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.003+0000 7f788ac87640 1 -- 172.21.15.196:0/621870396 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78841594e0 con 0x7f78841504a0 2024-03-17T23:56:18.007 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.003+0000 7f788ac87640 1 --2- 172.21.15.196:0/621870396 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f78841504a0 0x7f7884155990 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f787c0b0040 tx=0x7f787c019710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:56:18.007 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.003+0000 7f787affd640 1 -- 172.21.15.196:0/621870396 <== mon.0 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f787c0b2050 con 0x7f78841504a0 2024-03-17T23:56:18.007 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.003+0000 7f787affd640 1 -- 172.21.15.196:0/621870396 <== mon.0 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f787c0b3040 con 0x7f78841504a0 2024-03-17T23:56:18.007 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.003+0000 7f787affd640 1 -- 172.21.15.196:0/621870396 <== mon.0 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f787c0ad850 con 0x7f78841504a0 2024-03-17T23:56:18.007 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.003+0000 7f788c6ea640 1 -- 172.21.15.196:0/621870396 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7884153a30 con 0x7f78841504a0 2024-03-17T23:56:18.008 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.003+0000 7f788c6ea640 1 -- 172.21.15.196:0/621870396 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7884151bc0 con 0x7f78841504a0 2024-03-17T23:56:18.008 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.003+0000 7f787affd640 1 -- 172.21.15.196:0/621870396 <== mon.0 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 5) ==== 87083+0+0 (secure 0 0 0) 0x7f787c0c0020 con 0x7f78841504a0 2024-03-17T23:56:18.008 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.007+0000 7f787affd640 1 --2- 172.21.15.196:0/621870396 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f7868067660 0x7f7868069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:18.008 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.007+0000 7f787affd640 1 -- 172.21.15.196:0/621870396 <== mon.0 v2:172.21.15.196:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f787c11fea0 con 0x7f78841504a0 2024-03-17T23:56:18.009 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.007+0000 7f788a486640 1 --2- 172.21.15.196:0/621870396 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f7868067660 0x7f7868069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:18.009 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.007+0000 7f788a486640 1 --2- 172.21.15.196:0/621870396 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f7868067660 0x7f7868069b20 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f7880009ac0 tx=0x7f7880009190 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:56:18.009 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.007+0000 7f788f86c000 1 Processor -- start 2024-03-17T23:56:18.009 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.007+0000 7f788f86c000 1 -- start start 2024-03-17T23:56:18.011 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.007+0000 7f788f86c000 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x555e89fc74a0 0x555e89fc7880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:18.011 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.007+0000 7f788f86c000 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x555e89fc7dc0 0x555e8a002cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:18.011 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.007+0000 7f788f86c000 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x555e8a003210 0x555e8a0035f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:18.011 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.007+0000 7f788f86c000 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x555e89e10540 con 0x555e89fc7dc0 2024-03-17T23:56:18.012 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.007+0000 7f788f86c000 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x555e89d97b00 con 0x555e8a003210 2024-03-17T23:56:18.012 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.007+0000 7f788f86c000 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x555e89e0c5e0 con 0x555e89fc74a0 2024-03-17T23:56:18.012 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.007+0000 7f7889c85640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x555e89fc7dc0 0x555e8a002cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:18.012 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.007+0000 7f7889c85640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x555e89fc7dc0 0x555e8a002cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.196:38272/0 (socket says 172.21.15.196:38272) 2024-03-17T23:56:18.012 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.007+0000 7f7889c85640 1 -- 172.21.15.196:0/1509130400 learned_addr learned my addr 172.21.15.196:0/1509130400 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-03-17T23:56:18.012 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.007+0000 7f788a486640 1 --2- 172.21.15.196:0/1509130400 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x555e89fc74a0 0x555e89fc7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:18.012 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.007+0000 7f788ac87640 1 --2- 172.21.15.196:0/1509130400 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x555e8a003210 0x555e8a0035f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:18.012 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.007+0000 7f7889c85640 1 -- 172.21.15.196:0/1509130400 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x555e89fc74a0 msgr2=0x555e89fc7880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-17T23:56:18.012 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.007+0000 7f7889c85640 1 --2- 172.21.15.196:0/1509130400 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x555e89fc74a0 0x555e89fc7880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:18.012 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.007+0000 7f7889c85640 1 -- 172.21.15.196:0/1509130400 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x555e8a003210 msgr2=0x555e8a0035f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-17T23:56:18.012 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.007+0000 7f7889c85640 1 --2- 172.21.15.196:0/1509130400 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x555e8a003210 0x555e8a0035f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:18.012 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.007+0000 7f7889c85640 1 -- 172.21.15.196:0/1509130400 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555e89dcd6a0 con 0x555e89fc7dc0 2024-03-17T23:56:18.012 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.007+0000 7f7889c85640 1 --2- 172.21.15.196:0/1509130400 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x555e89fc7dc0 0x555e8a002cd0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f7874000f70 tx=0x7f7874004bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce352cf5d164451e server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:56:18.013 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.007+0000 7f7867fff640 1 -- 172.21.15.196:0/1509130400 <== mon.0 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f787401a070 con 0x555e89fc7dc0 2024-03-17T23:56:18.013 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.007+0000 7f7867fff640 1 -- 172.21.15.196:0/1509130400 <== mon.0 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f78740018b0 con 0x555e89fc7dc0 2024-03-17T23:56:18.013 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.007+0000 7f7867fff640 1 -- 172.21.15.196:0/1509130400 <== mon.0 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7874001ca0 con 0x555e89fc7dc0 2024-03-17T23:56:18.014 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.007+0000 7f788f86c000 1 -- 172.21.15.196:0/1509130400 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x555e89fc7dc0 msgr2=0x555e8a002cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:18.014 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.007+0000 7f788f86c000 1 --2- 172.21.15.196:0/1509130400 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x555e89fc7dc0 0x555e8a002cd0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f7874000f70 tx=0x7f7874004bc0 comp rx=0 tx=0).stop 2024-03-17T23:56:18.014 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.007+0000 7f788f86c000 1 -- 172.21.15.196:0/1509130400 shutdown_connections 2024-03-17T23:56:18.014 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.007+0000 7f788f86c000 1 --2- 172.21.15.196:0/1509130400 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x555e8a003210 0x555e8a0035f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:18.014 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.007+0000 7f788f86c000 1 --2- 172.21.15.196:0/1509130400 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x555e89fc7dc0 0x555e8a002cd0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:18.014 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.007+0000 7f788f86c000 1 --2- 172.21.15.196:0/1509130400 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x555e89fc74a0 0x555e89fc7880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:18.014 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.007+0000 7f788f86c000 1 -- 172.21.15.196:0/1509130400 >> 172.21.15.196:0/1509130400 conn(0x555e89fb8e70 msgr2=0x555e8a000a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-17T23:56:18.014 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.007+0000 7f788f86c000 1 -- 172.21.15.196:0/1509130400 shutdown_connections 2024-03-17T23:56:18.014 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.007+0000 7f788f86c000 1 -- 172.21.15.196:0/1509130400 wait complete. 2024-03-17T23:56:18.014 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.011+0000 7f788f86c000 1 -- start start 2024-03-17T23:56:18.014 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.011+0000 7f788f86c000 1 Processor -- start 2024-03-17T23:56:18.017 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.011+0000 7f788f86c000 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x555e89fc74a0 0x555e89ffc050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:18.017 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.011+0000 7f788f86c000 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x555e89fc7dc0 0x555e89ffc590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:18.017 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.011+0000 7f788f86c000 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x555e8a003210 0x555e89fbfea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:18.018 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.011+0000 7f788f86c000 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x555e89dce850 con 0x555e89fc74a0 2024-03-17T23:56:18.018 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.011+0000 7f788f86c000 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x555e89e914b0 con 0x555e8a003210 2024-03-17T23:56:18.018 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.011+0000 7f788f86c000 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x555e89dcaf50 con 0x555e89fc7dc0 2024-03-17T23:56:18.018 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.011+0000 7f788f86c000 10 client.0 _ll_register_callbacks cb 0x555e89fad220 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-17T23:56:18.018 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.011+0000 7f788a486640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x555e89fc74a0 0x555e89ffc050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:18.018 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.011+0000 7f788a486640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x555e89fc74a0 0x555e89ffc050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.196:38282/0 (socket says 172.21.15.196:38282) 2024-03-17T23:56:18.018 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.011+0000 7f788a486640 1 -- 172.21.15.196:0/3089983544 learned_addr learned my addr 172.21.15.196:0/3089983544 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-03-17T23:56:18.018 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.011+0000 7f7889c85640 1 --2- 172.21.15.196:0/3089983544 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x555e89fc7dc0 0x555e89ffc590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:18.018 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.011+0000 7f788ac87640 1 --2- 172.21.15.196:0/3089983544 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x555e8a003210 0x555e89fbfea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:18.018 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.011+0000 7f788a486640 1 -- 172.21.15.196:0/3089983544 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x555e89fc7dc0 msgr2=0x555e89ffc590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-17T23:56:18.018 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.011+0000 7f788a486640 1 --2- 172.21.15.196:0/3089983544 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x555e89fc7dc0 0x555e89ffc590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:18.019 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.011+0000 7f788a486640 1 -- 172.21.15.196:0/3089983544 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x555e8a003210 msgr2=0x555e89fbfea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-17T23:56:18.019 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.011+0000 7f788a486640 1 --2- 172.21.15.196:0/3089983544 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x555e8a003210 0x555e89fbfea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:18.019 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.011+0000 7f788a486640 1 -- 172.21.15.196:0/3089983544 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555e89dcb900 con 0x555e89fc74a0 2024-03-17T23:56:18.019 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.011+0000 7f788a486640 1 --2- 172.21.15.196:0/3089983544 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x555e89fc74a0 0x555e89ffc050 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f7880003620 tx=0x7f78800046d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3480526bd745d05f server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:56:18.019 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.011+0000 7f78657fa640 10 client.0 ms_handle_connect on v2:172.21.15.196:3300/0 2024-03-17T23:56:18.019 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.011+0000 7f78657fa640 1 -- 172.21.15.196:0/3089983544 <== mon.0 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7880027070 con 0x555e89fc74a0 2024-03-17T23:56:18.019 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.011+0000 7f78657fa640 1 -- 172.21.15.196:0/3089983544 <== mon.0 v2:172.21.15.196:3300/0 2 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f7880014650 con 0x555e89fc74a0 2024-03-17T23:56:18.019 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.011+0000 7f788f86c000 1 -- 172.21.15.196:0/3089983544 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f78740018b0 con 0x555e89fc74a0 2024-03-17T23:56:18.019 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.011+0000 7f78657fa640 1 -- 172.21.15.196:0/3089983544 <== mon.0 v2:172.21.15.196:3300/0 3 ==== mon_get_version_reply(handle=1 version=14) ==== 24+0+0 (secure 0 0 0) 0x7f7880032050 con 0x555e89fc74a0 2024-03-17T23:56:18.019 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.011+0000 7f788f86c000 10 client.4737 fetch_fsmap learned FSMap version 14 2024-03-17T23:56:18.019 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.011+0000 7f788f86c000 1 -- 172.21.15.196:0/3089983544 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,fsmap=14,monmap=2+}) -- 0x555e89e91940 con 0x555e89fc74a0 2024-03-17T23:56:18.019 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.011+0000 7f78657fa640 1 -- 172.21.15.196:0/3089983544 <== mon.0 v2:172.21.15.196:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f78740018b0 con 0x555e89fc74a0 2024-03-17T23:56:18.019 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.011+0000 7f78657fa640 1 -- 172.21.15.196:0/3089983544 <== mon.0 v2:172.21.15.196:3300/0 5 ==== fsmap(e 14) ==== 4784+0+0 (secure 0 0 0) 0x7f7880035020 con 0x555e89fc74a0 2024-03-17T23:56:18.020 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.011+0000 7f788f86c000 10 client.4737 fetch_fsmap finished waiting for FSMap version 14 2024-03-17T23:56:18.020 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.011+0000 7f788f86c000 10 client.4737 resolve_mds: resolved name 'f' to daemon mds.f 2024-03-17T23:56:18.020 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.011+0000 7f788f86c000 20 client.4737 populate_metadata read hostname 'smithi196' 2024-03-17T23:56:18.020 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.011+0000 7f788f86c000 1 --2- 172.21.15.196:0/3089983544 >> [v2:172.21.15.204:6838/2849161202,v1:172.21.15.204:6839/2849161202] conn(0x555e89fc0fc0 0x555e89fc13a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:18.020 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.011+0000 7f788f86c000 4 client.4737 mds_command: new command op to 4264 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-17T23:56:18.020 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.011+0000 7f788f86c000 1 -- 172.21.15.196:0/3089983544 --> [v2:172.21.15.204:6838/2849161202,v1:172.21.15.204:6839/2849161202] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555e89dabbc0 con 0x555e89fc0fc0 2024-03-17T23:56:18.020 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.011+0000 7f7889c85640 1 --2- 172.21.15.196:0/3089983544 >> [v2:172.21.15.204:6838/2849161202,v1:172.21.15.204:6839/2849161202] conn(0x555e89fc0fc0 0x555e89fc13a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:18.020 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.015+0000 7f78657fa640 10 client.4737 ms_handle_connect on v2:172.21.15.204:6838/2849161202 2024-03-17T23:56:18.020 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.015+0000 7f7889c85640 1 --2- 172.21.15.196:0/3089983544 >> [v2:172.21.15.204:6838/2849161202,v1:172.21.15.204:6839/2849161202] conn(0x555e89fc0fc0 0x555e89fc13a0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=d0e18edb4d5104b3 server_cookie=ff3fc65eeaf5cc6b in_seq=0 out_seq=0 2024-03-17T23:56:18.021 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.015+0000 7f78657fa640 1 -- 172.21.15.196:0/3089983544 <== mds.3 v2:172.21.15.204:6838/2849161202 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x555e89dabbc0 con 0x555e89fc0fc0 2024-03-17T23:56:18.022 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.015+0000 7f78657fa640 10 client.4737 handle_command_reply: tid=0 2024-03-17T23:56:18.022 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.015+0000 7f788f86c000 1 client.4737 shutdown 2024-03-17T23:56:18.022 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.015+0000 7f788f86c000 1 -- 172.21.15.196:0/3089983544 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x555e89fc74a0 msgr2=0x555e89ffc050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:18.022 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.015+0000 7f788f86c000 1 --2- 172.21.15.196:0/3089983544 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x555e89fc74a0 0x555e89ffc050 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f7880003620 tx=0x7f78800046d0 comp rx=0 tx=0).stop 2024-03-17T23:56:18.022 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.015+0000 7f788f86c000 1 -- 172.21.15.196:0/3089983544 shutdown_connections 2024-03-17T23:56:18.022 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.015+0000 7f788f86c000 1 --2- 172.21.15.196:0/3089983544 >> [v2:172.21.15.204:6838/2849161202,v1:172.21.15.204:6839/2849161202] conn(0x555e89fc0fc0 0x555e89fc13a0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:18.022 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.015+0000 7f788f86c000 1 --2- 172.21.15.196:0/3089983544 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x555e89fc7dc0 0x555e89ffc590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:18.022 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.015+0000 7f788f86c000 1 --2- 172.21.15.196:0/3089983544 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x555e8a003210 0x555e89fbfea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:18.022 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.015+0000 7f788f86c000 1 --2- 172.21.15.196:0/3089983544 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x555e89fc74a0 0x555e89ffc050 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:18.022 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.015+0000 7f788f86c000 1 -- 172.21.15.196:0/3089983544 >> 172.21.15.196:0/3089983544 conn(0x555e89fb8e70 msgr2=0x555e8a000670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-17T23:56:18.022 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.015+0000 7f78657fa640 0 client.4737 ms_handle_reset on v2:172.21.15.204:6838/2849161202 2024-03-17T23:56:18.022 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.015+0000 7f788f86c000 1 -- 172.21.15.196:0/3089983544 shutdown_connections 2024-03-17T23:56:18.023 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.015+0000 7f788f86c000 1 -- 172.21.15.196:0/3089983544 wait complete. 2024-03-17T23:56:18.023 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.015+0000 7f788f86c000 20 client.4737 trim_cache size 0 max 16384 2024-03-17T23:56:18.035 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.031+0000 7f788f86c000 1 Processor -- start 2024-03-17T23:56:18.035 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.031+0000 7f788f86c000 1 -- start start 2024-03-17T23:56:18.036 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.031+0000 7f788f86c000 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x555e89fc74a0 0x555e8a000cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:18.037 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.031+0000 7f788f86c000 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x555e89fc7dc0 0x555e8a001230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:18.037 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.031+0000 7f788f86c000 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x555e8a003210 0x555e8a001cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:18.037 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.031+0000 7f788f86c000 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f78841fcd80 con 0x555e8a003210 2024-03-17T23:56:18.037 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.031+0000 7f788f86c000 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f78841fafd0 con 0x555e89fc74a0 2024-03-17T23:56:18.037 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.031+0000 7f788f86c000 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x555e89e0f850 con 0x555e89fc7dc0 2024-03-17T23:56:18.037 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.031+0000 7f788ac87640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x555e8a003210 0x555e8a001cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:18.037 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.031+0000 7f788ac87640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x555e8a003210 0x555e8a001cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.196:38292/0 (socket says 172.21.15.196:38292) 2024-03-17T23:56:18.037 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.031+0000 7f788ac87640 1 -- 172.21.15.196:0/2832636906 learned_addr learned my addr 172.21.15.196:0/2832636906 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-03-17T23:56:18.037 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.031+0000 7f7889c85640 1 --2- 172.21.15.196:0/2832636906 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x555e89fc7dc0 0x555e8a001230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:18.037 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.031+0000 7f788a486640 1 --2- 172.21.15.196:0/2832636906 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x555e89fc74a0 0x555e8a000cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:18.037 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.035+0000 7f788ac87640 1 -- 172.21.15.196:0/2832636906 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x555e89fc7dc0 msgr2=0x555e8a001230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-17T23:56:18.037 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.035+0000 7f788ac87640 1 --2- 172.21.15.196:0/2832636906 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x555e89fc7dc0 0x555e8a001230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:18.038 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.035+0000 7f788ac87640 1 -- 172.21.15.196:0/2832636906 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x555e89fc74a0 msgr2=0x555e8a000cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-17T23:56:18.038 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.035+0000 7f788ac87640 1 --2- 172.21.15.196:0/2832636906 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x555e89fc74a0 0x555e8a000cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:18.038 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.035+0000 7f788ac87640 1 -- 172.21.15.196:0/2832636906 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555e89e68870 con 0x555e8a003210 2024-03-17T23:56:18.038 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.035+0000 7f788ac87640 1 --2- 172.21.15.196:0/2832636906 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x555e8a003210 0x555e8a001cc0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f787c0f0380 tx=0x7f787c0a7000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6bd8e0492777e6f8 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:56:18.038 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.035+0000 7f78677fe640 1 -- 172.21.15.196:0/2832636906 <== mon.0 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f787c0f8ce0 con 0x555e8a003210 2024-03-17T23:56:18.038 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.035+0000 7f78677fe640 1 -- 172.21.15.196:0/2832636906 <== mon.0 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f787c0ee720 con 0x555e8a003210 2024-03-17T23:56:18.038 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.035+0000 7f78677fe640 1 -- 172.21.15.196:0/2832636906 <== mon.0 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f787c0a5740 con 0x555e8a003210 2024-03-17T23:56:18.042 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.035+0000 7f788f86c000 1 -- 172.21.15.196:0/2832636906 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x555e8a003210 msgr2=0x555e8a001cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:18.042 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.035+0000 7f788f86c000 1 --2- 172.21.15.196:0/2832636906 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x555e8a003210 0x555e8a001cc0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f787c0f0380 tx=0x7f787c0a7000 comp rx=0 tx=0).stop 2024-03-17T23:56:18.042 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.035+0000 7f788f86c000 1 -- 172.21.15.196:0/2832636906 shutdown_connections 2024-03-17T23:56:18.042 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.035+0000 7f788f86c000 1 --2- 172.21.15.196:0/2832636906 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x555e89fc7dc0 0x555e8a001230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:18.042 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.035+0000 7f788f86c000 1 --2- 172.21.15.196:0/2832636906 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x555e8a003210 0x555e8a001cc0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:18.043 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.035+0000 7f788f86c000 1 --2- 172.21.15.196:0/2832636906 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x555e89fc74a0 0x555e8a000cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:18.043 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.035+0000 7f788f86c000 1 -- 172.21.15.196:0/2832636906 >> 172.21.15.196:0/2832636906 conn(0x555e89fb8e70 msgr2=0x555e89fc6030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-17T23:56:18.043 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.035+0000 7f788f86c000 1 -- 172.21.15.196:0/2832636906 shutdown_connections 2024-03-17T23:56:18.043 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.035+0000 7f788f86c000 1 -- 172.21.15.196:0/2832636906 wait complete. 2024-03-17T23:56:18.043 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.035+0000 7f788f86c000 1 -- start start 2024-03-17T23:56:18.043 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.035+0000 7f788f86c000 1 Processor -- start 2024-03-17T23:56:18.043 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.035+0000 7f788f86c000 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x555e89fc74a0 0x555e8a07ba50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:18.043 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.035+0000 7f788f86c000 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x555e89fc7dc0 0x555e89fc5d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:18.043 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.035+0000 7f788f86c000 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x555e8a003210 0x555e89fc6240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:18.043 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.035+0000 7f788f86c000 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x555e89ffcad0 con 0x555e8a003210 2024-03-17T23:56:18.043 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.035+0000 7f788f86c000 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x555e89e1c0e0 con 0x555e89fc74a0 2024-03-17T23:56:18.043 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.035+0000 7f788f86c000 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x555e89ffd320 con 0x555e89fc7dc0 2024-03-17T23:56:18.043 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.035+0000 7f788f86c000 10 client.0 _ll_register_callbacks cb 0x7f78800041a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-17T23:56:18.044 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.035+0000 7f788ac87640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x555e8a003210 0x555e89fc6240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:18.044 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.035+0000 7f788ac87640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x555e8a003210 0x555e89fc6240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.196:38308/0 (socket says 172.21.15.196:38308) 2024-03-17T23:56:18.044 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.035+0000 7f788ac87640 1 -- 172.21.15.196:0/1472298075 learned_addr learned my addr 172.21.15.196:0/1472298075 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-03-17T23:56:18.044 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.035+0000 7f788a486640 1 --2- 172.21.15.196:0/1472298075 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x555e89fc74a0 0x555e8a07ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:18.044 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.035+0000 7f7889c85640 1 --2- 172.21.15.196:0/1472298075 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x555e89fc7dc0 0x555e89fc5d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:18.044 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.035+0000 7f788ac87640 1 -- 172.21.15.196:0/1472298075 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x555e89fc7dc0 msgr2=0x555e89fc5d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-17T23:56:18.044 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.035+0000 7f788ac87640 1 --2- 172.21.15.196:0/1472298075 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x555e89fc7dc0 0x555e89fc5d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:18.044 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.035+0000 7f788ac87640 1 -- 172.21.15.196:0/1472298075 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x555e89fc74a0 msgr2=0x555e8a07ba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-17T23:56:18.044 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.035+0000 7f788ac87640 1 --2- 172.21.15.196:0/1472298075 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x555e89fc74a0 0x555e8a07ba50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:18.044 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.035+0000 7f788ac87640 1 -- 172.21.15.196:0/1472298075 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555e89dc0070 con 0x555e8a003210 2024-03-17T23:56:18.044 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.035+0000 7f788ac87640 1 --2- 172.21.15.196:0/1472298075 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x555e8a003210 0x555e89fc6240 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f787c009d90 tx=0x7f787c009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd1bd8cbe9ffde3 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:56:18.044 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.035+0000 7f78657fa640 10 client.0 ms_handle_connect on v2:172.21.15.196:3300/0 2024-03-17T23:56:18.044 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.035+0000 7f78657fa640 1 -- 172.21.15.196:0/1472298075 <== mon.0 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f787c0fd020 con 0x555e8a003210 2024-03-17T23:56:18.044 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.035+0000 7f78657fa640 1 -- 172.21.15.196:0/1472298075 <== mon.0 v2:172.21.15.196:3300/0 2 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f787c0eccf0 con 0x555e8a003210 2024-03-17T23:56:18.045 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.035+0000 7f788f86c000 1 -- 172.21.15.196:0/1472298075 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f787c0ee720 con 0x555e8a003210 2024-03-17T23:56:18.045 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.035+0000 7f78657fa640 1 -- 172.21.15.196:0/1472298075 <== mon.0 v2:172.21.15.196:3300/0 3 ==== mon_get_version_reply(handle=1 version=14) ==== 24+0+0 (secure 0 0 0) 0x7f787c0f8ce0 con 0x555e8a003210 2024-03-17T23:56:18.045 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.035+0000 7f788f86c000 10 client.4743 fetch_fsmap learned FSMap version 14 2024-03-17T23:56:18.045 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.035+0000 7f788f86c000 1 -- 172.21.15.196:0/1472298075 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,fsmap=14,monmap=2+}) -- 0x555e89da4370 con 0x555e8a003210 2024-03-17T23:56:18.045 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.035+0000 7f78657fa640 1 -- 172.21.15.196:0/1472298075 <== mon.0 v2:172.21.15.196:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f787c0ee720 con 0x555e8a003210 2024-03-17T23:56:18.045 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.035+0000 7f78657fa640 1 -- 172.21.15.196:0/1472298075 <== mon.0 v2:172.21.15.196:3300/0 5 ==== fsmap(e 14) ==== 4784+0+0 (secure 0 0 0) 0x7f787c0f8850 con 0x555e8a003210 2024-03-17T23:56:18.045 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.035+0000 7f788f86c000 10 client.4743 fetch_fsmap finished waiting for FSMap version 14 2024-03-17T23:56:18.045 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.035+0000 7f788f86c000 10 client.4743 resolve_mds: resolved name 'f' to daemon mds.f 2024-03-17T23:56:18.045 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.035+0000 7f788f86c000 20 client.4743 populate_metadata read hostname 'smithi196' 2024-03-17T23:56:18.045 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.035+0000 7f788f86c000 1 --2- 172.21.15.196:0/1472298075 >> [v2:172.21.15.204:6838/2849161202,v1:172.21.15.204:6839/2849161202] conn(0x555e8a078300 0x555e8a0786e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:18.045 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.035+0000 7f788f86c000 4 client.4743 mds_command: new command op to 4264 tid=0 multi_id=0 [{"prefix": "status"}] 2024-03-17T23:56:18.045 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.035+0000 7f788f86c000 1 -- 172.21.15.196:0/1472298075 --> [v2:172.21.15.204:6838/2849161202,v1:172.21.15.204:6839/2849161202] -- command(tid 0: {"prefix": "status"}) -- 0x555e89e1da80 con 0x555e8a078300 2024-03-17T23:56:18.045 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.039+0000 7f788a486640 1 --2- 172.21.15.196:0/1472298075 >> [v2:172.21.15.204:6838/2849161202,v1:172.21.15.204:6839/2849161202] conn(0x555e8a078300 0x555e8a0786e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:18.046 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.039+0000 7f788a486640 1 --2- 172.21.15.196:0/1472298075 >> [v2:172.21.15.204:6838/2849161202,v1:172.21.15.204:6839/2849161202] conn(0x555e8a078300 0x555e8a0786e0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=faeb5680f54ed7ce server_cookie=a86e1c44884df342 in_seq=0 out_seq=0 2024-03-17T23:56:18.046 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.039+0000 7f78657fa640 10 client.4743 ms_handle_connect on v2:172.21.15.204:6838/2849161202 2024-03-17T23:56:18.046 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.039+0000 7f78657fa640 1 -- 172.21.15.196:0/1472298075 <== mds.3 v2:172.21.15.204:6838/2849161202 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x555e89e1da80 con 0x555e8a078300 2024-03-17T23:56:18.046 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.039+0000 7f78657fa640 10 client.4743 handle_command_reply: tid=0 2024-03-17T23:56:18.046 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.039+0000 7f788f86c000 1 client.4743 shutdown 2024-03-17T23:56:18.046 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.039+0000 7f788f86c000 1 -- 172.21.15.196:0/1472298075 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x555e8a003210 msgr2=0x555e89fc6240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:18.046 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.039+0000 7f788f86c000 1 --2- 172.21.15.196:0/1472298075 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x555e8a003210 0x555e89fc6240 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f787c009d90 tx=0x7f787c009750 comp rx=0 tx=0).stop 2024-03-17T23:56:18.046 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.039+0000 7f788f86c000 1 -- 172.21.15.196:0/1472298075 shutdown_connections 2024-03-17T23:56:18.046 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.039+0000 7f788f86c000 1 --2- 172.21.15.196:0/1472298075 >> [v2:172.21.15.204:6838/2849161202,v1:172.21.15.204:6839/2849161202] conn(0x555e8a078300 0x555e8a0786e0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:18.046 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.039+0000 7f788f86c000 1 --2- 172.21.15.196:0/1472298075 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x555e89fc7dc0 0x555e89fc5d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:18.046 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.039+0000 7f788f86c000 1 --2- 172.21.15.196:0/1472298075 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x555e8a003210 0x555e89fc6240 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:18.046 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.039+0000 7f78657fa640 0 client.4743 ms_handle_reset on v2:172.21.15.204:6838/2849161202 2024-03-17T23:56:18.046 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.039+0000 7f788f86c000 1 --2- 172.21.15.196:0/1472298075 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x555e89fc74a0 0x555e8a07ba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:18.047 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.039+0000 7f788f86c000 1 -- 172.21.15.196:0/1472298075 >> 172.21.15.196:0/1472298075 conn(0x555e89fb8e70 msgr2=0x555e8a001cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-17T23:56:18.047 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.039+0000 7f788f86c000 1 -- 172.21.15.196:0/1472298075 shutdown_connections 2024-03-17T23:56:18.047 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.039+0000 7f788f86c000 1 -- 172.21.15.196:0/1472298075 wait complete. 2024-03-17T23:56:18.047 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.039+0000 7f788f86c000 20 client.4743 trim_cache size 0 max 16384 2024-03-17T23:56:18.047 INFO:teuthology.orchestra.run.smithi196.stdout:{ 2024-03-17T23:56:18.047 INFO:teuthology.orchestra.run.smithi196.stdout: "cluster_fsid": "b80f9c80-17ad-4126-8957-4c0c46f5b803", 2024-03-17T23:56:18.047 INFO:teuthology.orchestra.run.smithi196.stdout: "whoami": 3, 2024-03-17T23:56:18.047 INFO:teuthology.orchestra.run.smithi196.stdout: "id": 4264, 2024-03-17T23:56:18.047 INFO:teuthology.orchestra.run.smithi196.stdout: "want_state": "up:active", 2024-03-17T23:56:18.047 INFO:teuthology.orchestra.run.smithi196.stdout: "state": "up:active", 2024-03-17T23:56:18.047 INFO:teuthology.orchestra.run.smithi196.stdout: "fs_name": "cephfs", 2024-03-17T23:56:18.048 INFO:teuthology.orchestra.run.smithi196.stdout: "rank_uptime": 12.356385635000001, 2024-03-17T23:56:18.048 INFO:teuthology.orchestra.run.smithi196.stdout: "mdsmap_epoch": 14, 2024-03-17T23:56:18.048 INFO:teuthology.orchestra.run.smithi196.stdout: "osdmap_epoch": 21, 2024-03-17T23:56:18.048 INFO:teuthology.orchestra.run.smithi196.stdout: "osdmap_epoch_barrier": 21, 2024-03-17T23:56:18.048 INFO:teuthology.orchestra.run.smithi196.stdout: "uptime": 23.438508049999999 2024-03-17T23:56:18.048 INFO:teuthology.orchestra.run.smithi196.stdout:} 2024-03-17T23:56:18.048 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.039+0000 7f788c6ea640 1 -- 172.21.15.196:0/621870396 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f7868067660 msgr2=0x7f7868069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:18.049 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.039+0000 7f788c6ea640 1 --2- 172.21.15.196:0/621870396 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f7868067660 0x7f7868069b20 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f7880009ac0 tx=0x7f7880009190 comp rx=0 tx=0).stop 2024-03-17T23:56:18.049 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.039+0000 7f788c6ea640 1 -- 172.21.15.196:0/621870396 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f78841504a0 msgr2=0x7f7884155990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:18.049 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.039+0000 7f788c6ea640 1 --2- 172.21.15.196:0/621870396 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f78841504a0 0x7f7884155990 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f787c0b0040 tx=0x7f787c019710 comp rx=0 tx=0).stop 2024-03-17T23:56:18.049 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.039+0000 7f788c6ea640 1 -- 172.21.15.196:0/621870396 shutdown_connections 2024-03-17T23:56:18.049 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.039+0000 7f788c6ea640 1 --2- 172.21.15.196:0/621870396 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f7868067660 0x7f7868069b20 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:18.049 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.039+0000 7f788c6ea640 1 --2- 172.21.15.196:0/621870396 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f78840c6d80 0x7f7884155450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:18.049 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.039+0000 7f788c6ea640 1 --2- 172.21.15.196:0/621870396 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f78841504a0 0x7f7884155990 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:18.049 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.039+0000 7f788c6ea640 1 --2- 172.21.15.196:0/621870396 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f788406e330 0x7f78840cb480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:18.049 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.039+0000 7f788c6ea640 1 -- 172.21.15.196:0/621870396 >> 172.21.15.196:0/621870396 conn(0x7f788406b2b0 msgr2=0x7f7884072ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-17T23:56:18.049 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.039+0000 7f788c6ea640 1 -- 172.21.15.196:0/621870396 shutdown_connections 2024-03-17T23:56:18.049 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.039+0000 7f788c6ea640 1 -- 172.21.15.196:0/621870396 wait complete. 2024-03-17T23:56:18.057 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-03-17T23:56:18.160 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.159+0000 7fca67880640 1 Processor -- start 2024-03-17T23:56:18.161 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.159+0000 7fca67880640 1 -- start start 2024-03-17T23:56:18.162 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.159+0000 7fca67880640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fca60153f60 0x7fca600705f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:18.163 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.159+0000 7fca67880640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fca60154340 0x7fca600c8d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:18.163 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.159+0000 7fca67880640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fca6015aa70 0x7fca600c92a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:18.163 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.159+0000 7fca67880640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7fca60072770 con 0x7fca60153f60 2024-03-17T23:56:18.163 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.159+0000 7fca67880640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 -- 0x7fca6015d380 con 0x7fca60154340 2024-03-17T23:56:18.163 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.159+0000 7fca67880640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7fca6015d5d0 con 0x7fca6015aa70 2024-03-17T23:56:18.163 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.159+0000 7fca6561c640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fca60153f60 0x7fca600705f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:18.163 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.159+0000 7fca6561c640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fca60153f60 0x7fca600705f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.196:38318/0 (socket says 172.21.15.196:38318) 2024-03-17T23:56:18.163 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.159+0000 7fca6561c640 1 -- 172.21.15.196:0/3847601136 learned_addr learned my addr 172.21.15.196:0/3847601136 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-03-17T23:56:18.163 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.159+0000 7fca64e1b640 1 --2- 172.21.15.196:0/3847601136 >> v2:172.21.15.204:3300/0 conn(0x7fca60154340 0x7fca600c8d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:18.163 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.159+0000 7fca65e1d640 1 --2- 172.21.15.196:0/3847601136 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fca6015aa70 0x7fca600c92a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:18.163 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.159+0000 7fca6561c640 1 -- 172.21.15.196:0/3847601136 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fca6015aa70 msgr2=0x7fca600c92a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-17T23:56:18.163 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.159+0000 7fca6561c640 1 --2- 172.21.15.196:0/3847601136 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fca6015aa70 0x7fca600c92a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:18.163 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.159+0000 7fca6561c640 1 -- 172.21.15.196:0/3847601136 >> v2:172.21.15.204:3300/0 conn(0x7fca60154340 msgr2=0x7fca600c8d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-17T23:56:18.163 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.159+0000 7fca6561c640 1 --2- 172.21.15.196:0/3847601136 >> v2:172.21.15.204:3300/0 conn(0x7fca60154340 0x7fca600c8d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:18.164 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.159+0000 7fca6561c640 1 -- 172.21.15.196:0/3847601136 --> v2:172.21.15.196:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca6015d8b0 con 0x7fca60153f60 2024-03-17T23:56:18.164 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.159+0000 7fca65e1d640 1 --2- 172.21.15.196:0/3847601136 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fca6015aa70 0x7fca600c92a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-17T23:56:18.165 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.163+0000 7fca6561c640 1 --2- 172.21.15.196:0/3847601136 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fca60153f60 0x7fca600705f0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fca60073a10 tx=0x7fca5c01ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9934a52839e7ee4 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:56:18.165 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.163+0000 7fca57fff640 1 -- 172.21.15.196:0/3847601136 <== mon.0 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca5c0b5070 con 0x7fca60153f60 2024-03-17T23:56:18.165 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.163+0000 7fca57fff640 1 -- 172.21.15.196:0/3847601136 <== mon.0 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca5c0a89d0 con 0x7fca60153f60 2024-03-17T23:56:18.165 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.163+0000 7fca57fff640 1 -- 172.21.15.196:0/3847601136 <== mon.0 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca5c0a8da0 con 0x7fca60153f60 2024-03-17T23:56:18.166 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.163+0000 7fca67880640 1 -- 172.21.15.196:0/3847601136 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fca60153f60 msgr2=0x7fca600705f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:18.166 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.163+0000 7fca67880640 1 --2- 172.21.15.196:0/3847601136 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fca60153f60 0x7fca600705f0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fca60073a10 tx=0x7fca5c01ed10 comp rx=0 tx=0).stop 2024-03-17T23:56:18.166 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.163+0000 7fca67880640 1 -- 172.21.15.196:0/3847601136 shutdown_connections 2024-03-17T23:56:18.167 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.163+0000 7fca67880640 1 --2- 172.21.15.196:0/3847601136 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fca6015aa70 0x7fca600c92a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:18.167 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.163+0000 7fca67880640 1 --2- 172.21.15.196:0/3847601136 >> v2:172.21.15.204:3300/0 conn(0x7fca60154340 0x7fca600c8d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:18.167 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.163+0000 7fca67880640 1 --2- 172.21.15.196:0/3847601136 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fca60153f60 0x7fca600705f0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:18.167 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.163+0000 7fca67880640 1 -- 172.21.15.196:0/3847601136 >> 172.21.15.196:0/3847601136 conn(0x7fca6006c3c0 msgr2=0x7fca6006c7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-17T23:56:18.167 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.163+0000 7fca67880640 1 -- 172.21.15.196:0/3847601136 shutdown_connections 2024-03-17T23:56:18.167 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.163+0000 7fca67880640 1 -- 172.21.15.196:0/3847601136 wait complete. 2024-03-17T23:56:18.168 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.163+0000 7fca67880640 1 Processor -- start 2024-03-17T23:56:18.168 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.163+0000 7fca67880640 1 -- start start 2024-03-17T23:56:18.170 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.167+0000 7fca67880640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fca60153f60 0x7fca60158030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:18.170 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.167+0000 7fca67880640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fca60154340 0x7fca6015c2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:18.170 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.167+0000 7fca67880640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fca6015aa70 0x7fca60152240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:18.170 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.167+0000 7fca67880640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fca6015e150 con 0x7fca6015aa70 2024-03-17T23:56:18.171 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.167+0000 7fca67880640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7fca6015de70 con 0x7fca60153f60 2024-03-17T23:56:18.171 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.167+0000 7fca67880640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7fca60070b30 con 0x7fca60154340 2024-03-17T23:56:18.171 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.167+0000 7fca65e1d640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fca6015aa70 0x7fca60152240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:18.171 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.167+0000 7fca65e1d640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fca6015aa70 0x7fca60152240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.196:38324/0 (socket says 172.21.15.196:38324) 2024-03-17T23:56:18.171 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.167+0000 7fca65e1d640 1 -- 172.21.15.196:0/346331855 learned_addr learned my addr 172.21.15.196:0/346331855 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-03-17T23:56:18.171 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.167+0000 7fca6561c640 1 --2- 172.21.15.196:0/346331855 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fca60153f60 0x7fca60158030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:18.171 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.167+0000 7fca64e1b640 1 --2- 172.21.15.196:0/346331855 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fca60154340 0x7fca6015c2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:18.171 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.167+0000 7fca65e1d640 1 -- 172.21.15.196:0/346331855 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fca60154340 msgr2=0x7fca6015c2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:18.171 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.167+0000 7fca65e1d640 1 --2- 172.21.15.196:0/346331855 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fca60154340 0x7fca6015c2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:18.171 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.167+0000 7fca65e1d640 1 -- 172.21.15.196:0/346331855 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fca60153f60 msgr2=0x7fca60158030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:18.171 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.167+0000 7fca65e1d640 1 --2- 172.21.15.196:0/346331855 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fca60153f60 0x7fca60158030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:18.171 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.167+0000 7fca65e1d640 1 -- 172.21.15.196:0/346331855 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca60159c10 con 0x7fca6015aa70 2024-03-17T23:56:18.171 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.167+0000 7fca6561c640 1 --2- 172.21.15.196:0/346331855 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fca60153f60 0x7fca60158030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-17T23:56:18.171 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.167+0000 7fca65e1d640 1 --2- 172.21.15.196:0/346331855 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fca6015aa70 0x7fca60152240 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fca58007ea0 tx=0x7fca58007f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:56:18.172 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.167+0000 7fca55ffb640 1 -- 172.21.15.196:0/346331855 <== mon.0 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca5801a070 con 0x7fca6015aa70 2024-03-17T23:56:18.172 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.167+0000 7fca55ffb640 1 -- 172.21.15.196:0/346331855 <== mon.0 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca58003bc0 con 0x7fca6015aa70 2024-03-17T23:56:18.172 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.167+0000 7fca67880640 1 -- 172.21.15.196:0/346331855 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca6015cb90 con 0x7fca6015aa70 2024-03-17T23:56:18.172 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.167+0000 7fca55ffb640 1 -- 172.21.15.196:0/346331855 <== mon.0 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca5800de70 con 0x7fca6015aa70 2024-03-17T23:56:18.172 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.167+0000 7fca67880640 1 -- 172.21.15.196:0/346331855 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca600cc910 con 0x7fca6015aa70 2024-03-17T23:56:18.172 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.167+0000 7fca55ffb640 1 -- 172.21.15.196:0/346331855 <== mon.0 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 5) ==== 87083+0+0 (secure 0 0 0) 0x7fca5801d070 con 0x7fca6015aa70 2024-03-17T23:56:18.173 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.171+0000 7fca55ffb640 1 --2- 172.21.15.196:0/346331855 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7fca44067660 0x7fca44069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:18.173 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.171+0000 7fca55ffb640 1 -- 172.21.15.196:0/346331855 <== mon.0 v2:172.21.15.196:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fca58085b20 con 0x7fca6015aa70 2024-03-17T23:56:18.173 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.171+0000 7fca6aa02000 1 Processor -- start 2024-03-17T23:56:18.173 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.171+0000 7fca6aa02000 1 -- start start 2024-03-17T23:56:18.173 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.171+0000 7fca6561c640 1 --2- 172.21.15.196:0/346331855 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7fca44067660 0x7fca44069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:18.176 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.171+0000 7fca6561c640 1 --2- 172.21.15.196:0/346331855 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7fca44067660 0x7fca44069b20 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fca5c0b2000 tx=0x7fca5c008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:56:18.176 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.171+0000 7fca6aa02000 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x562be27c14a0 0x562be27c1880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:18.176 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.171+0000 7fca6aa02000 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x562be27c1dc0 0x562be27fccd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:18.176 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.171+0000 7fca6aa02000 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562be27fd210 0x562be27fd5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:18.176 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.171+0000 7fca6aa02000 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x562be260a540 con 0x562be27fd210 2024-03-17T23:56:18.176 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.171+0000 7fca6aa02000 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x562be2591b00 con 0x562be27c14a0 2024-03-17T23:56:18.176 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.171+0000 7fca6aa02000 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x562be26065e0 con 0x562be27c1dc0 2024-03-17T23:56:18.176 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.171+0000 7fca65e1d640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562be27fd210 0x562be27fd5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:18.176 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.171+0000 7fca6561c640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x562be27c14a0 0x562be27c1880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:18.176 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.171+0000 7fca65e1d640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562be27fd210 0x562be27fd5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.196:38340/0 (socket says 172.21.15.196:38340) 2024-03-17T23:56:18.176 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.171+0000 7fca65e1d640 1 -- 172.21.15.196:0/2805028513 learned_addr learned my addr 172.21.15.196:0/2805028513 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-03-17T23:56:18.177 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.171+0000 7fca64e1b640 1 --2- 172.21.15.196:0/2805028513 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x562be27c1dc0 0x562be27fccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:18.177 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.171+0000 7fca65e1d640 1 -- 172.21.15.196:0/2805028513 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x562be27c1dc0 msgr2=0x562be27fccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-17T23:56:18.177 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.171+0000 7fca65e1d640 1 --2- 172.21.15.196:0/2805028513 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x562be27c1dc0 0x562be27fccd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:18.177 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.171+0000 7fca65e1d640 1 -- 172.21.15.196:0/2805028513 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x562be27c14a0 msgr2=0x562be27c1880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-17T23:56:18.177 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.171+0000 7fca65e1d640 1 --2- 172.21.15.196:0/2805028513 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x562be27c14a0 0x562be27c1880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:18.177 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.171+0000 7fca65e1d640 1 -- 172.21.15.196:0/2805028513 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562be25c76a0 con 0x562be27fd210 2024-03-17T23:56:18.177 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.171+0000 7fca64e1b640 1 --2- 172.21.15.196:0/2805028513 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x562be27c1dc0 0x562be27fccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-17T23:56:18.177 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.171+0000 7fca65e1d640 1 --2- 172.21.15.196:0/2805028513 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562be27fd210 0x562be27fd5f0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fca58084070 tx=0x7fca580561e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73ec8c678e3b4b92 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:56:18.177 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.171+0000 7fca4affd640 1 -- 172.21.15.196:0/2805028513 <== mon.0 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca580543a0 con 0x562be27fd210 2024-03-17T23:56:18.177 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.171+0000 7fca4affd640 1 -- 172.21.15.196:0/2805028513 <== mon.0 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca58052710 con 0x562be27fd210 2024-03-17T23:56:18.177 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.171+0000 7fca4affd640 1 -- 172.21.15.196:0/2805028513 <== mon.0 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca58056520 con 0x562be27fd210 2024-03-17T23:56:18.177 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.171+0000 7fca6aa02000 1 -- 172.21.15.196:0/2805028513 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562be27fd210 msgr2=0x562be27fd5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:18.178 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.171+0000 7fca6aa02000 1 --2- 172.21.15.196:0/2805028513 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562be27fd210 0x562be27fd5f0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fca58084070 tx=0x7fca580561e0 comp rx=0 tx=0).stop 2024-03-17T23:56:18.178 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.171+0000 7fca6aa02000 1 -- 172.21.15.196:0/2805028513 shutdown_connections 2024-03-17T23:56:18.178 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.171+0000 7fca6aa02000 1 --2- 172.21.15.196:0/2805028513 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x562be27c1dc0 0x562be27fccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:18.178 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.171+0000 7fca6aa02000 1 --2- 172.21.15.196:0/2805028513 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562be27fd210 0x562be27fd5f0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:18.178 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.171+0000 7fca6aa02000 1 --2- 172.21.15.196:0/2805028513 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x562be27c14a0 0x562be27c1880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:18.178 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.171+0000 7fca6aa02000 1 -- 172.21.15.196:0/2805028513 >> 172.21.15.196:0/2805028513 conn(0x562be27b2e70 msgr2=0x562be27faa90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-17T23:56:18.178 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.171+0000 7fca6aa02000 1 -- 172.21.15.196:0/2805028513 shutdown_connections 2024-03-17T23:56:18.178 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.171+0000 7fca6aa02000 1 -- 172.21.15.196:0/2805028513 wait complete. 2024-03-17T23:56:18.178 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.171+0000 7fca6aa02000 1 -- start start 2024-03-17T23:56:18.178 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.171+0000 7fca6aa02000 1 Processor -- start 2024-03-17T23:56:18.181 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.175+0000 7fca6aa02000 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562be27c14a0 0x562be2807f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:18.181 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.175+0000 7fca6aa02000 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x562be27c1dc0 0x562be2805a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:18.181 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.175+0000 7fca6aa02000 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x562be27fd210 0x562be2805fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:18.182 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.175+0000 7fca6aa02000 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x562be25c8850 con 0x562be27c14a0 2024-03-17T23:56:18.182 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.175+0000 7fca6aa02000 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x562be25c4f50 con 0x562be27fd210 2024-03-17T23:56:18.182 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.175+0000 7fca6aa02000 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x562be2609850 con 0x562be27c1dc0 2024-03-17T23:56:18.182 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.175+0000 7fca6561c640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562be27c14a0 0x562be2807f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:18.182 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.175+0000 7fca6561c640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562be27c14a0 0x562be2807f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.196:38352/0 (socket says 172.21.15.196:38352) 2024-03-17T23:56:18.182 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.175+0000 7fca6561c640 1 -- 172.21.15.196:0/615849725 learned_addr learned my addr 172.21.15.196:0/615849725 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-03-17T23:56:18.182 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.175+0000 7fca6aa02000 10 client.0 _ll_register_callbacks cb 0x562be27a7220 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-17T23:56:18.182 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.175+0000 7fca65e1d640 1 --2- 172.21.15.196:0/615849725 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x562be27fd210 0x562be2805fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:18.182 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.175+0000 7fca64e1b640 1 --2- 172.21.15.196:0/615849725 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x562be27c1dc0 0x562be2805a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:18.182 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.175+0000 7fca6561c640 1 -- 172.21.15.196:0/615849725 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x562be27c1dc0 msgr2=0x562be2805a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-17T23:56:18.182 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.175+0000 7fca6561c640 1 --2- 172.21.15.196:0/615849725 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x562be27c1dc0 0x562be2805a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:18.182 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.175+0000 7fca6561c640 1 -- 172.21.15.196:0/615849725 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x562be27fd210 msgr2=0x562be2805fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-17T23:56:18.182 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.175+0000 7fca6561c640 1 --2- 172.21.15.196:0/615849725 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x562be27fd210 0x562be2805fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:18.183 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.175+0000 7fca6561c640 1 -- 172.21.15.196:0/615849725 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562be25c5900 con 0x562be27c14a0 2024-03-17T23:56:18.183 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.175+0000 7fca64e1b640 1 --2- 172.21.15.196:0/615849725 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x562be27c1dc0 0x562be2805a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-17T23:56:18.183 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.175+0000 7fca6561c640 1 --2- 172.21.15.196:0/615849725 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562be27c14a0 0x562be2807f60 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fca5c008010 tx=0x7fca5c004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9cb1a458b2757900 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:56:18.183 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.175+0000 7fca3ffff640 10 client.0 ms_handle_connect on v2:172.21.15.196:3300/0 2024-03-17T23:56:18.183 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.175+0000 7fca3ffff640 1 -- 172.21.15.196:0/615849725 <== mon.0 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca5c0cd060 con 0x562be27c14a0 2024-03-17T23:56:18.183 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.175+0000 7fca3ffff640 1 -- 172.21.15.196:0/615849725 <== mon.0 v2:172.21.15.196:3300/0 2 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fca5c0b0c10 con 0x562be27c14a0 2024-03-17T23:56:18.183 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.175+0000 7fca6aa02000 1 -- 172.21.15.196:0/615849725 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fca58052710 con 0x562be27c14a0 2024-03-17T23:56:18.183 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.175+0000 7fca3ffff640 1 -- 172.21.15.196:0/615849725 <== mon.0 v2:172.21.15.196:3300/0 3 ==== mon_get_version_reply(handle=1 version=14) ==== 24+0+0 (secure 0 0 0) 0x7fca5c0d3050 con 0x562be27c14a0 2024-03-17T23:56:18.183 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.175+0000 7fca6aa02000 10 client.4755 fetch_fsmap learned FSMap version 14 2024-03-17T23:56:18.183 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.175+0000 7fca6aa02000 1 -- 172.21.15.196:0/615849725 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,fsmap=14,monmap=2+}) -- 0x562be268b940 con 0x562be27c14a0 2024-03-17T23:56:18.183 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.175+0000 7fca3ffff640 1 -- 172.21.15.196:0/615849725 <== mon.0 v2:172.21.15.196:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca58052710 con 0x562be27c14a0 2024-03-17T23:56:18.183 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.175+0000 7fca3ffff640 1 -- 172.21.15.196:0/615849725 <== mon.0 v2:172.21.15.196:3300/0 5 ==== fsmap(e 14) ==== 4784+0+0 (secure 0 0 0) 0x7fca5c0d6020 con 0x562be27c14a0 2024-03-17T23:56:18.183 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.175+0000 7fca6aa02000 10 client.4755 fetch_fsmap finished waiting for FSMap version 14 2024-03-17T23:56:18.183 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.175+0000 7fca6aa02000 10 client.4755 resolve_mds: resolved name 'a' to daemon mds.a 2024-03-17T23:56:18.184 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.175+0000 7fca6aa02000 20 client.4755 populate_metadata read hostname 'smithi196' 2024-03-17T23:56:18.184 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.175+0000 7fca6aa02000 1 --2- 172.21.15.196:0/615849725 >> [v2:172.21.15.196:6832/2075619627,v1:172.21.15.196:6833/2075619627] conn(0x562be27f7060 0x562be27f7440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:18.184 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.175+0000 7fca6aa02000 4 client.4755 mds_command: new command op to 4275 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-17T23:56:18.184 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.175+0000 7fca6aa02000 1 -- 172.21.15.196:0/615849725 --> [v2:172.21.15.196:6832/2075619627,v1:172.21.15.196:6833/2075619627] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562be25a5bc0 con 0x562be27f7060 2024-03-17T23:56:18.184 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.175+0000 7fca64e1b640 1 --2- 172.21.15.196:0/615849725 >> [v2:172.21.15.196:6832/2075619627,v1:172.21.15.196:6833/2075619627] conn(0x562be27f7060 0x562be27f7440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:18.184 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.175+0000 7fca3ffff640 10 client.4755 ms_handle_connect on v2:172.21.15.196:6832/2075619627 2024-03-17T23:56:18.184 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.175+0000 7fca64e1b640 1 --2- 172.21.15.196:0/615849725 >> [v2:172.21.15.196:6832/2075619627,v1:172.21.15.196:6833/2075619627] conn(0x562be27f7060 0x562be27f7440 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=b4b6dac5ced155cb server_cookie=c1e3ec042dab9c87 in_seq=0 out_seq=0 2024-03-17T23:56:18.184 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.175+0000 7fca3ffff640 1 -- 172.21.15.196:0/615849725 <== mds.2 v2:172.21.15.196:6832/2075619627 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x562be25a5bc0 con 0x562be27f7060 2024-03-17T23:56:18.184 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.175+0000 7fca3ffff640 10 client.4755 handle_command_reply: tid=0 2024-03-17T23:56:18.184 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.175+0000 7fca6aa02000 1 client.4755 shutdown 2024-03-17T23:56:18.184 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.175+0000 7fca6aa02000 1 -- 172.21.15.196:0/615849725 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562be27c14a0 msgr2=0x562be2807f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:18.184 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.175+0000 7fca6aa02000 1 --2- 172.21.15.196:0/615849725 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562be27c14a0 0x562be2807f60 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fca5c008010 tx=0x7fca5c004740 comp rx=0 tx=0).stop 2024-03-17T23:56:18.184 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.175+0000 7fca6aa02000 1 -- 172.21.15.196:0/615849725 shutdown_connections 2024-03-17T23:56:18.184 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.175+0000 7fca6aa02000 1 --2- 172.21.15.196:0/615849725 >> [v2:172.21.15.196:6832/2075619627,v1:172.21.15.196:6833/2075619627] conn(0x562be27f7060 0x562be27f7440 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:18.185 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.175+0000 7fca3ffff640 0 client.4755 ms_handle_reset on v2:172.21.15.196:6832/2075619627 2024-03-17T23:56:18.185 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.175+0000 7fca6aa02000 1 --2- 172.21.15.196:0/615849725 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x562be27c1dc0 0x562be2805a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:18.185 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.175+0000 7fca6aa02000 1 --2- 172.21.15.196:0/615849725 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x562be27fd210 0x562be2805fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:18.185 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.175+0000 7fca6aa02000 1 --2- 172.21.15.196:0/615849725 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562be27c14a0 0x562be2807f60 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:18.185 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.175+0000 7fca6aa02000 1 -- 172.21.15.196:0/615849725 >> 172.21.15.196:0/615849725 conn(0x562be27b2e70 msgr2=0x562be27fa670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-17T23:56:18.185 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.175+0000 7fca6aa02000 1 -- 172.21.15.196:0/615849725 shutdown_connections 2024-03-17T23:56:18.185 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.175+0000 7fca6aa02000 1 -- 172.21.15.196:0/615849725 wait complete. 2024-03-17T23:56:18.185 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.175+0000 7fca6aa02000 20 client.4755 trim_cache size 0 max 16384 2024-03-17T23:56:18.196 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.195+0000 7fca6aa02000 1 Processor -- start 2024-03-17T23:56:18.197 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.195+0000 7fca6aa02000 1 -- start start 2024-03-17T23:56:18.199 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.195+0000 7fca6aa02000 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x562be27c14a0 0x562be280dc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:18.199 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.195+0000 7fca6aa02000 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562be27c1dc0 0x562be27fbcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:18.199 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.195+0000 7fca6aa02000 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x562be27f7060 0x562be27fc200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:18.199 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.195+0000 7fca6aa02000 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fca601fbe40 con 0x562be27c1dc0 2024-03-17T23:56:18.199 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.195+0000 7fca6aa02000 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7fca601fc510 con 0x562be27f7060 2024-03-17T23:56:18.199 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.195+0000 7fca6aa02000 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7fca601f31c0 con 0x562be27c14a0 2024-03-17T23:56:18.199 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.195+0000 7fca64e1b640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562be27c1dc0 0x562be27fbcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:18.199 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.195+0000 7fca64e1b640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562be27c1dc0 0x562be27fbcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.196:38362/0 (socket says 172.21.15.196:38362) 2024-03-17T23:56:18.199 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.195+0000 7fca64e1b640 1 -- 172.21.15.196:0/1834786393 learned_addr learned my addr 172.21.15.196:0/1834786393 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-03-17T23:56:18.199 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.195+0000 7fca65e1d640 1 --2- 172.21.15.196:0/1834786393 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x562be27f7060 0x562be27fc200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:18.199 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.195+0000 7fca6561c640 1 --2- 172.21.15.196:0/1834786393 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x562be27c14a0 0x562be280dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:18.199 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.195+0000 7fca64e1b640 1 -- 172.21.15.196:0/1834786393 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x562be27c14a0 msgr2=0x562be280dc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-17T23:56:18.200 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.195+0000 7fca64e1b640 1 --2- 172.21.15.196:0/1834786393 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x562be27c14a0 0x562be280dc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:18.200 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.195+0000 7fca64e1b640 1 -- 172.21.15.196:0/1834786393 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x562be27f7060 msgr2=0x562be27fc200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-17T23:56:18.200 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.195+0000 7fca64e1b640 1 --2- 172.21.15.196:0/1834786393 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x562be27f7060 0x562be27fc200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:18.200 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.195+0000 7fca64e1b640 1 -- 172.21.15.196:0/1834786393 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562be2662870 con 0x562be27c1dc0 2024-03-17T23:56:18.200 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.195+0000 7fca64e1b640 1 --2- 172.21.15.196:0/1834786393 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562be27c1dc0 0x562be27fbcc0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fca60152b00 tx=0x7fca50008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85789f1c4e4ba68b server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:56:18.200 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.195+0000 7fca4a7fc640 1 -- 172.21.15.196:0/1834786393 <== mon.0 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca50004030 con 0x562be27c1dc0 2024-03-17T23:56:18.200 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.195+0000 7fca4a7fc640 1 -- 172.21.15.196:0/1834786393 <== mon.0 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca500041d0 con 0x562be27c1dc0 2024-03-17T23:56:18.200 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.195+0000 7fca4a7fc640 1 -- 172.21.15.196:0/1834786393 <== mon.0 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca5001e250 con 0x562be27c1dc0 2024-03-17T23:56:18.200 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.195+0000 7fca6aa02000 1 -- 172.21.15.196:0/1834786393 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562be27c1dc0 msgr2=0x562be27fbcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:18.200 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.195+0000 7fca6aa02000 1 --2- 172.21.15.196:0/1834786393 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562be27c1dc0 0x562be27fbcc0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fca60152b00 tx=0x7fca50008040 comp rx=0 tx=0).stop 2024-03-17T23:56:18.200 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.195+0000 7fca6aa02000 1 -- 172.21.15.196:0/1834786393 shutdown_connections 2024-03-17T23:56:18.200 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.195+0000 7fca6aa02000 1 --2- 172.21.15.196:0/1834786393 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x562be27f7060 0x562be27fc200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:18.200 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.195+0000 7fca6aa02000 1 --2- 172.21.15.196:0/1834786393 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562be27c1dc0 0x562be27fbcc0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:18.200 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.195+0000 7fca6aa02000 1 --2- 172.21.15.196:0/1834786393 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x562be27c14a0 0x562be280dc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:18.200 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.195+0000 7fca6aa02000 1 -- 172.21.15.196:0/1834786393 >> 172.21.15.196:0/1834786393 conn(0x562be27b2e70 msgr2=0x562be27bfbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-17T23:56:18.201 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.195+0000 7fca6aa02000 1 -- 172.21.15.196:0/1834786393 shutdown_connections 2024-03-17T23:56:18.201 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.195+0000 7fca6aa02000 1 -- 172.21.15.196:0/1834786393 wait complete. 2024-03-17T23:56:18.203 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.195+0000 7fca6aa02000 1 -- start start 2024-03-17T23:56:18.203 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.195+0000 7fca6aa02000 1 Processor -- start 2024-03-17T23:56:18.203 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.199+0000 7fca6aa02000 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x562be27c14a0 0x562be2818320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:18.203 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.199+0000 7fca6aa02000 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x562be27c1dc0 0x562be286fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:18.203 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.199+0000 7fca6aa02000 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562be27f7060 0x562be2870300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:18.203 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.199+0000 7fca6aa02000 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x562be25ca8a0 con 0x562be27f7060 2024-03-17T23:56:18.203 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.199+0000 7fca6aa02000 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x562be25a27b0 con 0x562be27c1dc0 2024-03-17T23:56:18.203 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.199+0000 7fca6aa02000 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x562be25cc4a0 con 0x562be27c14a0 2024-03-17T23:56:18.203 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.199+0000 7fca6aa02000 10 client.0 _ll_register_callbacks cb 0x7fca50009060 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-17T23:56:18.203 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.199+0000 7fca65e1d640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562be27f7060 0x562be2870300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:18.204 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.199+0000 7fca64e1b640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x562be27c1dc0 0x562be286fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:18.204 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.199+0000 7fca65e1d640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562be27f7060 0x562be2870300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.196:38372/0 (socket says 172.21.15.196:38372) 2024-03-17T23:56:18.204 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.199+0000 7fca65e1d640 1 -- 172.21.15.196:0/3247803267 learned_addr learned my addr 172.21.15.196:0/3247803267 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-03-17T23:56:18.204 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.199+0000 7fca6561c640 1 --2- 172.21.15.196:0/3247803267 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x562be27c14a0 0x562be2818320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:18.204 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.199+0000 7fca65e1d640 1 -- 172.21.15.196:0/3247803267 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x562be27c14a0 msgr2=0x562be2818320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-17T23:56:18.204 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.199+0000 7fca65e1d640 1 --2- 172.21.15.196:0/3247803267 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x562be27c14a0 0x562be2818320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:18.204 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.199+0000 7fca65e1d640 1 -- 172.21.15.196:0/3247803267 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x562be27c1dc0 msgr2=0x562be286fdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-17T23:56:18.204 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.199+0000 7fca65e1d640 1 --2- 172.21.15.196:0/3247803267 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x562be27c1dc0 0x562be286fdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:18.204 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.199+0000 7fca65e1d640 1 -- 172.21.15.196:0/3247803267 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562be25ba070 con 0x562be27f7060 2024-03-17T23:56:18.204 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.199+0000 7fca65e1d640 1 --2- 172.21.15.196:0/3247803267 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562be27f7060 0x562be2870300 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fca5805a3b0 tx=0x7fca58017070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b2767c3037d24df server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:56:18.204 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.199+0000 7fca3ffff640 10 client.0 ms_handle_connect on v2:172.21.15.196:3300/0 2024-03-17T23:56:18.204 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.199+0000 7fca3ffff640 1 -- 172.21.15.196:0/3247803267 <== mon.0 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca58056500 con 0x562be27f7060 2024-03-17T23:56:18.204 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.199+0000 7fca3ffff640 1 -- 172.21.15.196:0/3247803267 <== mon.0 v2:172.21.15.196:3300/0 2 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fca5805e320 con 0x562be27f7060 2024-03-17T23:56:18.204 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.199+0000 7fca6aa02000 1 -- 172.21.15.196:0/3247803267 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fca500041d0 con 0x562be27f7060 2024-03-17T23:56:18.205 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.199+0000 7fca3ffff640 1 -- 172.21.15.196:0/3247803267 <== mon.0 v2:172.21.15.196:3300/0 3 ==== mon_get_version_reply(handle=1 version=14) ==== 24+0+0 (secure 0 0 0) 0x7fca5805e520 con 0x562be27f7060 2024-03-17T23:56:18.205 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.199+0000 7fca6aa02000 10 client.4761 fetch_fsmap learned FSMap version 14 2024-03-17T23:56:18.205 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.199+0000 7fca6aa02000 1 -- 172.21.15.196:0/3247803267 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,fsmap=14,monmap=2+}) -- 0x562be259e370 con 0x562be27f7060 2024-03-17T23:56:18.205 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.199+0000 7fca3ffff640 1 -- 172.21.15.196:0/3247803267 <== mon.0 v2:172.21.15.196:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca500041d0 con 0x562be27f7060 2024-03-17T23:56:18.205 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.199+0000 7fca3ffff640 1 -- 172.21.15.196:0/3247803267 <== mon.0 v2:172.21.15.196:3300/0 5 ==== fsmap(e 14) ==== 4784+0+0 (secure 0 0 0) 0x7fca58075b80 con 0x562be27f7060 2024-03-17T23:56:18.205 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.199+0000 7fca6aa02000 10 client.4761 fetch_fsmap finished waiting for FSMap version 14 2024-03-17T23:56:18.205 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.199+0000 7fca6aa02000 10 client.4761 resolve_mds: resolved name 'a' to daemon mds.a 2024-03-17T23:56:18.205 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.199+0000 7fca6aa02000 20 client.4761 populate_metadata read hostname 'smithi196' 2024-03-17T23:56:18.205 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.199+0000 7fca6aa02000 1 --2- 172.21.15.196:0/3247803267 >> [v2:172.21.15.196:6832/2075619627,v1:172.21.15.196:6833/2075619627] conn(0x562be27fd210 0x562be286eba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:18.205 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.199+0000 7fca6aa02000 4 client.4761 mds_command: new command op to 4275 tid=0 multi_id=0 [{"prefix": "status"}] 2024-03-17T23:56:18.205 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.199+0000 7fca6aa02000 1 -- 172.21.15.196:0/3247803267 --> [v2:172.21.15.196:6832/2075619627,v1:172.21.15.196:6833/2075619627] -- command(tid 0: {"prefix": "status"}) -- 0x562be2617a80 con 0x562be27fd210 2024-03-17T23:56:18.206 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.199+0000 7fca6561c640 1 --2- 172.21.15.196:0/3247803267 >> [v2:172.21.15.196:6832/2075619627,v1:172.21.15.196:6833/2075619627] conn(0x562be27fd210 0x562be286eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:18.206 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.199+0000 7fca3ffff640 10 client.4761 ms_handle_connect on v2:172.21.15.196:6832/2075619627 2024-03-17T23:56:18.206 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.199+0000 7fca6561c640 1 --2- 172.21.15.196:0/3247803267 >> [v2:172.21.15.196:6832/2075619627,v1:172.21.15.196:6833/2075619627] conn(0x562be27fd210 0x562be286eba0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=11880d3fb01ba67d server_cookie=a9b94a51e09a2cfd in_seq=0 out_seq=0 2024-03-17T23:56:18.206 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.199+0000 7fca3ffff640 1 -- 172.21.15.196:0/3247803267 <== mds.2 v2:172.21.15.196:6832/2075619627 1 ==== command_reply(tid 0: 0 ) ==== 8+0+319 (crc 0 0 0) 0x562be2617a80 con 0x562be27fd210 2024-03-17T23:56:18.206 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.199+0000 7fca3ffff640 10 client.4761 handle_command_reply: tid=0 2024-03-17T23:56:18.206 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.199+0000 7fca6aa02000 1 client.4761 shutdown 2024-03-17T23:56:18.207 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.199+0000 7fca6aa02000 1 -- 172.21.15.196:0/3247803267 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562be27f7060 msgr2=0x562be2870300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:18.207 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.199+0000 7fca6aa02000 1 --2- 172.21.15.196:0/3247803267 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562be27f7060 0x562be2870300 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fca5805a3b0 tx=0x7fca58017070 comp rx=0 tx=0).stop 2024-03-17T23:56:18.207 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.199+0000 7fca6aa02000 1 -- 172.21.15.196:0/3247803267 shutdown_connections 2024-03-17T23:56:18.207 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.199+0000 7fca6aa02000 1 --2- 172.21.15.196:0/3247803267 >> [v2:172.21.15.196:6832/2075619627,v1:172.21.15.196:6833/2075619627] conn(0x562be27fd210 0x562be286eba0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:18.207 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.199+0000 7fca6aa02000 1 --2- 172.21.15.196:0/3247803267 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562be27f7060 0x562be2870300 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:18.207 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.199+0000 7fca6aa02000 1 --2- 172.21.15.196:0/3247803267 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x562be27c1dc0 0x562be286fdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:18.207 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.199+0000 7fca6aa02000 1 --2- 172.21.15.196:0/3247803267 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x562be27c14a0 0x562be2818320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:18.207 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.199+0000 7fca6aa02000 1 -- 172.21.15.196:0/3247803267 >> 172.21.15.196:0/3247803267 conn(0x562be27b2e70 msgr2=0x562be27fab70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-17T23:56:18.207 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.199+0000 7fca3ffff640 0 client.4761 ms_handle_reset on v2:172.21.15.196:6832/2075619627 2024-03-17T23:56:18.207 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.199+0000 7fca6aa02000 1 -- 172.21.15.196:0/3247803267 shutdown_connections 2024-03-17T23:56:18.207 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.199+0000 7fca6aa02000 1 -- 172.21.15.196:0/3247803267 wait complete. 2024-03-17T23:56:18.207 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.203+0000 7fca6aa02000 20 client.4761 trim_cache size 0 max 16384 2024-03-17T23:56:18.208 INFO:teuthology.orchestra.run.smithi196.stdout:{ 2024-03-17T23:56:18.208 INFO:teuthology.orchestra.run.smithi196.stdout: "cluster_fsid": "b80f9c80-17ad-4126-8957-4c0c46f5b803", 2024-03-17T23:56:18.208 INFO:teuthology.orchestra.run.smithi196.stdout: "whoami": 2, 2024-03-17T23:56:18.208 INFO:teuthology.orchestra.run.smithi196.stdout: "id": 4275, 2024-03-17T23:56:18.208 INFO:teuthology.orchestra.run.smithi196.stdout: "want_state": "up:active", 2024-03-17T23:56:18.208 INFO:teuthology.orchestra.run.smithi196.stdout: "state": "up:active", 2024-03-17T23:56:18.208 INFO:teuthology.orchestra.run.smithi196.stdout: "fs_name": "cephfs", 2024-03-17T23:56:18.208 INFO:teuthology.orchestra.run.smithi196.stdout: "rank_uptime": 13.529399388, 2024-03-17T23:56:18.208 INFO:teuthology.orchestra.run.smithi196.stdout: "mdsmap_epoch": 14, 2024-03-17T23:56:18.208 INFO:teuthology.orchestra.run.smithi196.stdout: "osdmap_epoch": 21, 2024-03-17T23:56:18.208 INFO:teuthology.orchestra.run.smithi196.stdout: "osdmap_epoch_barrier": 21, 2024-03-17T23:56:18.208 INFO:teuthology.orchestra.run.smithi196.stdout: "uptime": 23.530333703 2024-03-17T23:56:18.208 INFO:teuthology.orchestra.run.smithi196.stdout:} 2024-03-17T23:56:18.209 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.203+0000 7fca67880640 1 -- 172.21.15.196:0/346331855 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7fca44067660 msgr2=0x7fca44069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:18.209 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.203+0000 7fca67880640 1 --2- 172.21.15.196:0/346331855 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7fca44067660 0x7fca44069b20 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fca5c0b2000 tx=0x7fca5c008040 comp rx=0 tx=0).stop 2024-03-17T23:56:18.209 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.203+0000 7fca67880640 1 -- 172.21.15.196:0/346331855 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fca6015aa70 msgr2=0x7fca60152240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:18.209 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.203+0000 7fca67880640 1 --2- 172.21.15.196:0/346331855 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fca6015aa70 0x7fca60152240 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fca58007ea0 tx=0x7fca58007f90 comp rx=0 tx=0).stop 2024-03-17T23:56:18.209 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.203+0000 7fca67880640 1 -- 172.21.15.196:0/346331855 shutdown_connections 2024-03-17T23:56:18.209 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.203+0000 7fca67880640 1 --2- 172.21.15.196:0/346331855 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7fca44067660 0x7fca44069b20 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:18.210 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.203+0000 7fca67880640 1 --2- 172.21.15.196:0/346331855 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fca60154340 0x7fca6015c2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:18.210 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.203+0000 7fca67880640 1 --2- 172.21.15.196:0/346331855 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fca6015aa70 0x7fca60152240 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:18.210 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.203+0000 7fca67880640 1 --2- 172.21.15.196:0/346331855 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fca60153f60 0x7fca60158030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:18.210 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.203+0000 7fca67880640 1 -- 172.21.15.196:0/346331855 >> 172.21.15.196:0/346331855 conn(0x7fca6006c3c0 msgr2=0x7fca600c80d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-17T23:56:18.210 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.203+0000 7fca67880640 1 -- 172.21.15.196:0/346331855 shutdown_connections 2024-03-17T23:56:18.210 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.203+0000 7fca67880640 1 -- 172.21.15.196:0/346331855 wait complete. 2024-03-17T23:56:18.226 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.e status 2024-03-17T23:56:18.332 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.327+0000 7fc394fc3640 1 Processor -- start 2024-03-17T23:56:18.332 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.327+0000 7fc394fc3640 1 -- start start 2024-03-17T23:56:18.334 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.331+0000 7fc394fc3640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fc39015a260 0x7fc39015a660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:18.334 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.331+0000 7fc394fc3640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fc390072430 0x7fc3900728c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:18.334 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.331+0000 7fc394fc3640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc390154620 con 0x7fc390154240 2024-03-17T23:56:18.334 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.331+0000 7fc394fc3640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7fc3900c7830 con 0x7fc39015a260 2024-03-17T23:56:18.334 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.331+0000 7fc394fc3640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 -- 0x7fc3900c7b10 con 0x7fc390072430 2024-03-17T23:56:18.334 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.331+0000 7fc38dd9b640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fc39015a260 0x7fc39015a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:18.334 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.331+0000 7fc38dd9b640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fc39015a260 0x7fc39015a660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.196:38382/0 (socket says 172.21.15.196:38382) 2024-03-17T23:56:18.334 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.331+0000 7fc38dd9b640 1 -- 172.21.15.196:0/419903659 learned_addr learned my addr 172.21.15.196:0/419903659 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-03-17T23:56:18.334 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.331+0000 7fc38ed9d640 1 --2- 172.21.15.196:0/419903659 >> v2:172.21.15.204:3300/0 conn(0x7fc390072430 0x7fc3900728c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:18.334 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.331+0000 7fc38dd9b640 1 -- 172.21.15.196:0/419903659 >> v2:172.21.15.204:3300/0 conn(0x7fc390072430 msgr2=0x7fc3900728c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-17T23:56:18.335 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.331+0000 7fc38dd9b640 1 --2- 172.21.15.196:0/419903659 >> v2:172.21.15.204:3300/0 conn(0x7fc390072430 0x7fc3900728c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:18.335 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.331+0000 7fc38dd9b640 1 -- 172.21.15.196:0/419903659 >> v1:172.21.15.204:6789/0 conn(0x7fc390154240 legacy=0x7fc39006fca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:18.335 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.331+0000 7fc38dd9b640 1 -- 172.21.15.196:0/419903659 --> v2:172.21.15.196:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3900c7df0 con 0x7fc39015a260 2024-03-17T23:56:18.337 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.335+0000 7fc38dd9b640 1 --2- 172.21.15.196:0/419903659 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc39015a260 0x7fc39015a660 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fc390072100 tx=0x7fc38401ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35dcc65a8b526035 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:56:18.337 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.335+0000 7fc38d59a640 1 -- 172.21.15.196:0/419903659 <== mon.0 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3840b5070 con 0x7fc39015a260 2024-03-17T23:56:18.337 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.335+0000 7fc38d59a640 1 -- 172.21.15.196:0/419903659 <== mon.0 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc3840a8a10 con 0x7fc39015a260 2024-03-17T23:56:18.338 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.335+0000 7fc38d59a640 1 -- 172.21.15.196:0/419903659 <== mon.0 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3840a8de0 con 0x7fc39015a260 2024-03-17T23:56:18.338 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.335+0000 7fc394fc3640 1 -- 172.21.15.196:0/419903659 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc39015a260 msgr2=0x7fc39015a660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:18.338 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.335+0000 7fc394fc3640 1 --2- 172.21.15.196:0/419903659 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc39015a260 0x7fc39015a660 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fc390072100 tx=0x7fc38401ed10 comp rx=0 tx=0).stop 2024-03-17T23:56:18.339 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.335+0000 7fc394fc3640 1 -- 172.21.15.196:0/419903659 shutdown_connections 2024-03-17T23:56:18.339 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.335+0000 7fc394fc3640 1 --2- 172.21.15.196:0/419903659 >> v2:172.21.15.204:3300/0 conn(0x7fc390072430 0x7fc3900728c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:18.339 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.335+0000 7fc394fc3640 1 --2- 172.21.15.196:0/419903659 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc39015a260 0x7fc39015a660 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:18.339 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.335+0000 7fc394fc3640 1 -- 172.21.15.196:0/419903659 >> 172.21.15.196:0/419903659 conn(0x7fc3900cc420 msgr2=0x7fc3900cc830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-17T23:56:18.339 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.335+0000 7fc394fc3640 1 -- 172.21.15.196:0/419903659 shutdown_connections 2024-03-17T23:56:18.339 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.335+0000 7fc394fc3640 1 -- 172.21.15.196:0/419903659 wait complete. 2024-03-17T23:56:18.340 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.335+0000 7fc394fc3640 1 Processor -- start 2024-03-17T23:56:18.340 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.335+0000 7fc394fc3640 1 -- start start 2024-03-17T23:56:18.342 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.339+0000 7fc394fc3640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc390072430 0x7fc390157d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:18.342 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.339+0000 7fc394fc3640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc390154240 0x7fc3900c55e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:18.342 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.339+0000 7fc394fc3640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc39015a260 0x7fc3900c5e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:18.342 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.339+0000 7fc394fc3640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fc3900c8720 con 0x7fc390072430 2024-03-17T23:56:18.342 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.339+0000 7fc394fc3640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7fc3900c83b0 con 0x7fc39015a260 2024-03-17T23:56:18.343 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.339+0000 7fc394fc3640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7fc39015aba0 con 0x7fc390154240 2024-03-17T23:56:18.343 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.339+0000 7fc38e59c640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc390072430 0x7fc390157d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:18.343 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.339+0000 7fc38e59c640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc390072430 0x7fc390157d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.196:38392/0 (socket says 172.21.15.196:38392) 2024-03-17T23:56:18.343 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.339+0000 7fc38e59c640 1 -- 172.21.15.196:0/2832868242 learned_addr learned my addr 172.21.15.196:0/2832868242 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-03-17T23:56:18.343 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.339+0000 7fc38ed9d640 1 --2- 172.21.15.196:0/2832868242 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc39015a260 0x7fc3900c5e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:18.343 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.339+0000 7fc38dd9b640 1 --2- 172.21.15.196:0/2832868242 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc390154240 0x7fc3900c55e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:18.343 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.339+0000 7fc38e59c640 1 -- 172.21.15.196:0/2832868242 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc390154240 msgr2=0x7fc3900c55e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:18.343 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.339+0000 7fc38e59c640 1 --2- 172.21.15.196:0/2832868242 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc390154240 0x7fc3900c55e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:18.343 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.339+0000 7fc38e59c640 1 -- 172.21.15.196:0/2832868242 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc39015a260 msgr2=0x7fc3900c5e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:18.343 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.339+0000 7fc38e59c640 1 --2- 172.21.15.196:0/2832868242 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc39015a260 0x7fc3900c5e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:18.343 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.339+0000 7fc38e59c640 1 -- 172.21.15.196:0/2832868242 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc39015de70 con 0x7fc390072430 2024-03-17T23:56:18.343 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.339+0000 7fc38ed9d640 1 --2- 172.21.15.196:0/2832868242 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc39015a260 0x7fc3900c5e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-17T23:56:18.344 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.339+0000 7fc38e59c640 1 --2- 172.21.15.196:0/2832868242 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc390072430 0x7fc390157d80 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fc38000c450 tx=0x7fc38000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:56:18.344 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.339+0000 7fc37effd640 1 -- 172.21.15.196:0/2832868242 <== mon.0 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc380016020 con 0x7fc390072430 2024-03-17T23:56:18.344 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.339+0000 7fc37effd640 1 -- 172.21.15.196:0/2832868242 <== mon.0 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc3800052d0 con 0x7fc390072430 2024-03-17T23:56:18.344 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.339+0000 7fc37effd640 1 -- 172.21.15.196:0/2832868242 <== mon.0 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc380007260 con 0x7fc390072430 2024-03-17T23:56:18.344 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.339+0000 7fc394fc3640 1 -- 172.21.15.196:0/2832868242 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc39015e0f0 con 0x7fc390072430 2024-03-17T23:56:18.344 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.339+0000 7fc394fc3640 1 -- 172.21.15.196:0/2832868242 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3900c4b00 con 0x7fc390072430 2024-03-17T23:56:18.345 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.339+0000 7fc37effd640 1 -- 172.21.15.196:0/2832868242 <== mon.0 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 5) ==== 87083+0+0 (secure 0 0 0) 0x7fc380007400 con 0x7fc390072430 2024-03-17T23:56:18.345 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.339+0000 7fc37effd640 1 --2- 172.21.15.196:0/2832868242 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7fc370067690 0x7fc370069b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:18.345 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.339+0000 7fc37effd640 1 -- 172.21.15.196:0/2832868242 <== mon.0 v2:172.21.15.196:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fc380085280 con 0x7fc390072430 2024-03-17T23:56:18.345 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.339+0000 7fc38dd9b640 1 --2- 172.21.15.196:0/2832868242 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7fc370067690 0x7fc370069b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:18.345 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.343+0000 7fc38dd9b640 1 --2- 172.21.15.196:0/2832868242 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7fc370067690 0x7fc370069b50 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fc3840b2000 tx=0x7fc3840aa070 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:56:18.345 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.343+0000 7fc398145000 1 Processor -- start 2024-03-17T23:56:18.345 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.343+0000 7fc398145000 1 -- start start 2024-03-17T23:56:18.348 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.343+0000 7fc398145000 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55aa2833f4a0 0x55aa2833f880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:18.348 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.343+0000 7fc398145000 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55aa2833fdc0 0x55aa2837acd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:18.348 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.343+0000 7fc398145000 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55aa2837b210 0x55aa2837b5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:18.348 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.343+0000 7fc398145000 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x55aa28188540 con 0x55aa2833fdc0 2024-03-17T23:56:18.348 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.343+0000 7fc398145000 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x55aa2810fb00 con 0x55aa2833f4a0 2024-03-17T23:56:18.348 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.343+0000 7fc398145000 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x55aa281845e0 con 0x55aa2837b210 2024-03-17T23:56:18.348 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.343+0000 7fc38dd9b640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55aa2833fdc0 0x55aa2837acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:18.348 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.343+0000 7fc38dd9b640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55aa2833fdc0 0x55aa2837acd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.196:38394/0 (socket says 172.21.15.196:38394) 2024-03-17T23:56:18.348 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.343+0000 7fc38e59c640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55aa2833f4a0 0x55aa2833f880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:18.349 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.343+0000 7fc38dd9b640 1 -- 172.21.15.196:0/354921393 learned_addr learned my addr 172.21.15.196:0/354921393 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-03-17T23:56:18.349 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.343+0000 7fc38ed9d640 1 --2- 172.21.15.196:0/354921393 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55aa2837b210 0x55aa2837b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:18.349 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.343+0000 7fc38dd9b640 1 -- 172.21.15.196:0/354921393 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55aa2837b210 msgr2=0x55aa2837b5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-17T23:56:18.349 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.343+0000 7fc38dd9b640 1 --2- 172.21.15.196:0/354921393 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55aa2837b210 0x55aa2837b5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:18.349 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.343+0000 7fc38dd9b640 1 -- 172.21.15.196:0/354921393 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55aa2833f4a0 msgr2=0x55aa2833f880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-17T23:56:18.349 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.343+0000 7fc38dd9b640 1 --2- 172.21.15.196:0/354921393 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55aa2833f4a0 0x55aa2833f880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:18.349 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.343+0000 7fc38dd9b640 1 -- 172.21.15.196:0/354921393 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aa281456a0 con 0x55aa2833fdc0 2024-03-17T23:56:18.349 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.343+0000 7fc38dd9b640 1 --2- 172.21.15.196:0/354921393 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55aa2833fdc0 0x55aa2837acd0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fc3840b3040 tx=0x7fc384004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4955104739ec5b57 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:56:18.349 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.343+0000 7fc36ffff640 1 -- 172.21.15.196:0/354921393 <== mon.0 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3840cc070 con 0x55aa2833fdc0 2024-03-17T23:56:18.349 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.343+0000 7fc36ffff640 1 -- 172.21.15.196:0/354921393 <== mon.0 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc3840b6040 con 0x55aa2833fdc0 2024-03-17T23:56:18.349 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.343+0000 7fc36ffff640 1 -- 172.21.15.196:0/354921393 <== mon.0 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3840bc650 con 0x55aa2833fdc0 2024-03-17T23:56:18.349 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.343+0000 7fc398145000 1 -- 172.21.15.196:0/354921393 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55aa2833fdc0 msgr2=0x55aa2837acd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:18.349 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.343+0000 7fc398145000 1 --2- 172.21.15.196:0/354921393 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55aa2833fdc0 0x55aa2837acd0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fc3840b3040 tx=0x7fc384004740 comp rx=0 tx=0).stop 2024-03-17T23:56:18.350 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.343+0000 7fc398145000 1 -- 172.21.15.196:0/354921393 shutdown_connections 2024-03-17T23:56:18.350 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.343+0000 7fc398145000 1 --2- 172.21.15.196:0/354921393 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55aa2837b210 0x55aa2837b5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:18.350 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.343+0000 7fc398145000 1 --2- 172.21.15.196:0/354921393 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55aa2833fdc0 0x55aa2837acd0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:18.350 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.343+0000 7fc398145000 1 --2- 172.21.15.196:0/354921393 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55aa2833f4a0 0x55aa2833f880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:18.350 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.343+0000 7fc398145000 1 -- 172.21.15.196:0/354921393 >> 172.21.15.196:0/354921393 conn(0x55aa28330e70 msgr2=0x55aa28378a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-17T23:56:18.350 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.343+0000 7fc398145000 1 -- 172.21.15.196:0/354921393 shutdown_connections 2024-03-17T23:56:18.350 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.343+0000 7fc398145000 1 -- 172.21.15.196:0/354921393 wait complete. 2024-03-17T23:56:18.350 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.343+0000 7fc398145000 1 -- start start 2024-03-17T23:56:18.350 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.343+0000 7fc398145000 1 Processor -- start 2024-03-17T23:56:18.353 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.347+0000 7fc398145000 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55aa2833f4a0 0x55aa28373f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:18.354 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.347+0000 7fc398145000 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55aa2833fdc0 0x55aa28374480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:18.354 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.347+0000 7fc398145000 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55aa2837b210 0x55aa28337ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:18.354 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.347+0000 7fc398145000 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x55aa28146850 con 0x55aa2837b210 2024-03-17T23:56:18.354 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.347+0000 7fc398145000 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x55aa28374bd0 con 0x55aa2833fdc0 2024-03-17T23:56:18.354 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.347+0000 7fc398145000 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x55aa281207b0 con 0x55aa2833f4a0 2024-03-17T23:56:18.354 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.347+0000 7fc398145000 10 client.0 _ll_register_callbacks cb 0x55aa28325220 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-17T23:56:18.354 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.347+0000 7fc38ed9d640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55aa2837b210 0x55aa28337ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:18.354 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.347+0000 7fc38dd9b640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55aa2833fdc0 0x55aa28374480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:18.354 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.347+0000 7fc38ed9d640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55aa2837b210 0x55aa28337ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.196:38398/0 (socket says 172.21.15.196:38398) 2024-03-17T23:56:18.354 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.347+0000 7fc38ed9d640 1 -- 172.21.15.196:0/4247815165 learned_addr learned my addr 172.21.15.196:0/4247815165 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-03-17T23:56:18.354 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.347+0000 7fc38e59c640 1 --2- 172.21.15.196:0/4247815165 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55aa2833f4a0 0x55aa28373f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:18.355 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.347+0000 7fc38ed9d640 1 -- 172.21.15.196:0/4247815165 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55aa2833f4a0 msgr2=0x55aa28373f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-17T23:56:18.355 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.347+0000 7fc38ed9d640 1 --2- 172.21.15.196:0/4247815165 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55aa2833f4a0 0x55aa28373f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:18.355 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.347+0000 7fc38ed9d640 1 -- 172.21.15.196:0/4247815165 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55aa2833fdc0 msgr2=0x55aa28374480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-17T23:56:18.355 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.347+0000 7fc38ed9d640 1 --2- 172.21.15.196:0/4247815165 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55aa2833fdc0 0x55aa28374480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:18.355 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.347+0000 7fc38ed9d640 1 -- 172.21.15.196:0/4247815165 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55aa28143900 con 0x55aa2837b210 2024-03-17T23:56:18.355 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.347+0000 7fc38e59c640 1 --2- 172.21.15.196:0/4247815165 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55aa2833f4a0 0x55aa28373f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-17T23:56:18.355 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.347+0000 7fc38ed9d640 1 --2- 172.21.15.196:0/4247815165 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55aa2837b210 0x55aa28337ea0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fc388007da0 tx=0x7fc388012610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b54d7d8f0fe335 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:56:18.355 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.347+0000 7fc36d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.196:3300/0 2024-03-17T23:56:18.355 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.347+0000 7fc36d7fa640 1 -- 172.21.15.196:0/4247815165 <== mon.0 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc38801a070 con 0x55aa2837b210 2024-03-17T23:56:18.355 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.347+0000 7fc36d7fa640 1 -- 172.21.15.196:0/4247815165 <== mon.0 v2:172.21.15.196:3300/0 2 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fc388016440 con 0x55aa2837b210 2024-03-17T23:56:18.355 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.347+0000 7fc398145000 1 -- 172.21.15.196:0/4247815165 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc3840b6040 con 0x55aa2837b210 2024-03-17T23:56:18.355 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.347+0000 7fc36d7fa640 1 -- 172.21.15.196:0/4247815165 <== mon.0 v2:172.21.15.196:3300/0 3 ==== mon_get_version_reply(handle=1 version=14) ==== 24+0+0 (secure 0 0 0) 0x7fc388025050 con 0x55aa2837b210 2024-03-17T23:56:18.355 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.347+0000 7fc398145000 10 client.4773 fetch_fsmap learned FSMap version 14 2024-03-17T23:56:18.356 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.347+0000 7fc398145000 1 -- 172.21.15.196:0/4247815165 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,fsmap=14,monmap=2+}) -- 0x55aa28209940 con 0x55aa2837b210 2024-03-17T23:56:18.356 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.347+0000 7fc36d7fa640 1 -- 172.21.15.196:0/4247815165 <== mon.0 v2:172.21.15.196:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc3840b6040 con 0x55aa2837b210 2024-03-17T23:56:18.356 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.347+0000 7fc36d7fa640 1 -- 172.21.15.196:0/4247815165 <== mon.0 v2:172.21.15.196:3300/0 5 ==== fsmap(e 14) ==== 4784+0+0 (secure 0 0 0) 0x7fc388028020 con 0x55aa2837b210 2024-03-17T23:56:18.356 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.347+0000 7fc398145000 10 client.4773 fetch_fsmap finished waiting for FSMap version 14 2024-03-17T23:56:18.356 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.347+0000 7fc398145000 10 client.4773 resolve_mds: resolved name 'e' to daemon mds.e 2024-03-17T23:56:18.356 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.347+0000 7fc398145000 20 client.4773 populate_metadata read hostname 'smithi196' 2024-03-17T23:56:18.356 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.347+0000 7fc398145000 1 --2- 172.21.15.196:0/4247815165 >> [v2:172.21.15.196:6834/1837184297,v1:172.21.15.196:6835/1837184297] conn(0x55aa28338fc0 0x55aa283393a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:18.356 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.347+0000 7fc398145000 4 client.4773 mds_command: new command op to 4281 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-17T23:56:18.356 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.347+0000 7fc398145000 1 -- 172.21.15.196:0/4247815165 --> [v2:172.21.15.196:6834/1837184297,v1:172.21.15.196:6835/1837184297] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55aa28123bc0 con 0x55aa28338fc0 2024-03-17T23:56:18.356 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.347+0000 7fc38e59c640 1 --2- 172.21.15.196:0/4247815165 >> [v2:172.21.15.196:6834/1837184297,v1:172.21.15.196:6835/1837184297] conn(0x55aa28338fc0 0x55aa283393a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:18.356 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.347+0000 7fc38e59c640 1 --2- 172.21.15.196:0/4247815165 >> [v2:172.21.15.196:6834/1837184297,v1:172.21.15.196:6835/1837184297] conn(0x55aa28338fc0 0x55aa283393a0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=da3fa7f6295d211d server_cookie=cf510986e5503b2b in_seq=0 out_seq=0 2024-03-17T23:56:18.356 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.347+0000 7fc36d7fa640 10 client.4773 ms_handle_connect on v2:172.21.15.196:6834/1837184297 2024-03-17T23:56:18.356 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.347+0000 7fc36d7fa640 1 -- 172.21.15.196:0/4247815165 <== mds.1 v2:172.21.15.196:6834/1837184297 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x55aa28123bc0 con 0x55aa28338fc0 2024-03-17T23:56:18.357 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.347+0000 7fc36d7fa640 10 client.4773 handle_command_reply: tid=0 2024-03-17T23:56:18.357 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.347+0000 7fc398145000 1 client.4773 shutdown 2024-03-17T23:56:18.357 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.347+0000 7fc398145000 1 -- 172.21.15.196:0/4247815165 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55aa2837b210 msgr2=0x55aa28337ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:18.357 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.347+0000 7fc398145000 1 --2- 172.21.15.196:0/4247815165 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55aa2837b210 0x55aa28337ea0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fc388007da0 tx=0x7fc388012610 comp rx=0 tx=0).stop 2024-03-17T23:56:18.357 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.347+0000 7fc398145000 1 -- 172.21.15.196:0/4247815165 shutdown_connections 2024-03-17T23:56:18.357 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.347+0000 7fc398145000 1 --2- 172.21.15.196:0/4247815165 >> [v2:172.21.15.196:6834/1837184297,v1:172.21.15.196:6835/1837184297] conn(0x55aa28338fc0 0x55aa283393a0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:18.357 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.347+0000 7fc398145000 1 --2- 172.21.15.196:0/4247815165 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55aa2837b210 0x55aa28337ea0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:18.357 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.347+0000 7fc398145000 1 --2- 172.21.15.196:0/4247815165 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55aa2833fdc0 0x55aa28374480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:18.357 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.347+0000 7fc398145000 1 --2- 172.21.15.196:0/4247815165 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55aa2833f4a0 0x55aa28373f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:18.357 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.347+0000 7fc36d7fa640 0 client.4773 ms_handle_reset on v2:172.21.15.196:6834/1837184297 2024-03-17T23:56:18.357 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.347+0000 7fc398145000 1 -- 172.21.15.196:0/4247815165 >> 172.21.15.196:0/4247815165 conn(0x55aa28330e70 msgr2=0x55aa28378670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-17T23:56:18.357 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.347+0000 7fc398145000 1 -- 172.21.15.196:0/4247815165 shutdown_connections 2024-03-17T23:56:18.358 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.347+0000 7fc398145000 1 -- 172.21.15.196:0/4247815165 wait complete. 2024-03-17T23:56:18.358 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.347+0000 7fc398145000 20 client.4773 trim_cache size 0 max 16384 2024-03-17T23:56:18.386 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.383+0000 7fc398145000 1 Processor -- start 2024-03-17T23:56:18.386 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.383+0000 7fc398145000 1 -- start start 2024-03-17T23:56:18.388 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.383+0000 7fc398145000 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55aa28330e70 0x55aa2833e800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:18.388 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.383+0000 7fc398145000 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55aa28338fc0 0x55aa28378460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:18.388 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.383+0000 7fc398145000 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55aa2833f4a0 0x55aa283789a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:18.388 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.383+0000 7fc398145000 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fc3901fc380 con 0x55aa28330e70 2024-03-17T23:56:18.388 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.383+0000 7fc398145000 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7fc390149a00 con 0x55aa2833f4a0 2024-03-17T23:56:18.388 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.383+0000 7fc398145000 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x55aa28187850 con 0x55aa28338fc0 2024-03-17T23:56:18.388 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.383+0000 7fc38e59c640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55aa28330e70 0x55aa2833e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:18.388 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.383+0000 7fc38e59c640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55aa28330e70 0x55aa2833e800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.196:38406/0 (socket says 172.21.15.196:38406) 2024-03-17T23:56:18.388 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.383+0000 7fc38e59c640 1 -- 172.21.15.196:0/4072200359 learned_addr learned my addr 172.21.15.196:0/4072200359 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-03-17T23:56:18.388 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.383+0000 7fc38ed9d640 1 --2- 172.21.15.196:0/4072200359 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55aa2833f4a0 0x55aa283789a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:18.388 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.383+0000 7fc38dd9b640 1 --2- 172.21.15.196:0/4072200359 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55aa28338fc0 0x55aa28378460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:18.389 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.383+0000 7fc38e59c640 1 -- 172.21.15.196:0/4072200359 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55aa28338fc0 msgr2=0x55aa28378460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-17T23:56:18.389 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.383+0000 7fc38e59c640 1 --2- 172.21.15.196:0/4072200359 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55aa28338fc0 0x55aa28378460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:18.389 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.383+0000 7fc38e59c640 1 -- 172.21.15.196:0/4072200359 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55aa2833f4a0 msgr2=0x55aa283789a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-17T23:56:18.389 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.383+0000 7fc38e59c640 1 --2- 172.21.15.196:0/4072200359 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55aa2833f4a0 0x55aa283789a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:18.389 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.383+0000 7fc38e59c640 1 -- 172.21.15.196:0/4072200359 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aa281e0870 con 0x55aa28330e70 2024-03-17T23:56:18.389 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.383+0000 7fc38e59c640 1 --2- 172.21.15.196:0/4072200359 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55aa28330e70 0x55aa2833e800 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fc380055790 tx=0x7fc380083680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd334ecc322ae000 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:56:18.389 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.383+0000 7fc36f7fe640 1 -- 172.21.15.196:0/4072200359 <== mon.0 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc38005df10 con 0x55aa28330e70 2024-03-17T23:56:18.389 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.383+0000 7fc36f7fe640 1 -- 172.21.15.196:0/4072200359 <== mon.0 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc38007f070 con 0x55aa28330e70 2024-03-17T23:56:18.389 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.383+0000 7fc36f7fe640 1 -- 172.21.15.196:0/4072200359 <== mon.0 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc380085020 con 0x55aa28330e70 2024-03-17T23:56:18.393 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.383+0000 7fc398145000 1 -- 172.21.15.196:0/4072200359 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55aa28330e70 msgr2=0x55aa2833e800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:18.393 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.383+0000 7fc398145000 1 --2- 172.21.15.196:0/4072200359 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55aa28330e70 0x55aa2833e800 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fc380055790 tx=0x7fc380083680 comp rx=0 tx=0).stop 2024-03-17T23:56:18.393 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.387+0000 7fc398145000 1 -- 172.21.15.196:0/4072200359 shutdown_connections 2024-03-17T23:56:18.394 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.387+0000 7fc398145000 1 --2- 172.21.15.196:0/4072200359 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55aa28338fc0 0x55aa28378460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:18.394 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.387+0000 7fc398145000 1 --2- 172.21.15.196:0/4072200359 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55aa2833f4a0 0x55aa283789a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:18.394 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.387+0000 7fc398145000 1 --2- 172.21.15.196:0/4072200359 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55aa28330e70 0x55aa2833e800 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:18.394 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.387+0000 7fc398145000 1 -- 172.21.15.196:0/4072200359 >> 172.21.15.196:0/4072200359 conn(0x55aa2837bde0 msgr2=0x55aa283966d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-17T23:56:18.394 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.387+0000 7fc398145000 1 -- 172.21.15.196:0/4072200359 shutdown_connections 2024-03-17T23:56:18.394 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.387+0000 7fc398145000 1 -- 172.21.15.196:0/4072200359 wait complete. 2024-03-17T23:56:18.394 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.387+0000 7fc398145000 1 -- start start 2024-03-17T23:56:18.394 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.387+0000 7fc398145000 1 Processor -- start 2024-03-17T23:56:18.394 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.387+0000 7fc398145000 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55aa28330e70 0x55aa2833dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:18.394 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.387+0000 7fc398145000 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55aa28338fc0 0x55aa283b08d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:18.394 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.387+0000 7fc398145000 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55aa2833f4a0 0x55aa283b0e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:18.394 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.387+0000 7fc398145000 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x55aa283749c0 con 0x55aa28338fc0 2024-03-17T23:56:18.395 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.387+0000 7fc398145000 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x55aa28187510 con 0x55aa28330e70 2024-03-17T23:56:18.395 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.387+0000 7fc398145000 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x55aa28184b20 con 0x55aa2833f4a0 2024-03-17T23:56:18.395 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.387+0000 7fc398145000 10 client.0 _ll_register_callbacks cb 0x7fc388009c90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-17T23:56:18.395 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.387+0000 7fc38dd9b640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55aa28338fc0 0x55aa283b08d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:18.395 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.387+0000 7fc38dd9b640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55aa28338fc0 0x55aa283b08d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.196:38422/0 (socket says 172.21.15.196:38422) 2024-03-17T23:56:18.395 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.387+0000 7fc38dd9b640 1 -- 172.21.15.196:0/2706006359 learned_addr learned my addr 172.21.15.196:0/2706006359 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-03-17T23:56:18.395 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.387+0000 7fc38e59c640 1 --2- 172.21.15.196:0/2706006359 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55aa28330e70 0x55aa2833dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:18.395 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.387+0000 7fc38ed9d640 1 --2- 172.21.15.196:0/2706006359 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55aa2833f4a0 0x55aa283b0e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:18.395 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.387+0000 7fc38dd9b640 1 -- 172.21.15.196:0/2706006359 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55aa2833f4a0 msgr2=0x55aa283b0e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-17T23:56:18.396 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.387+0000 7fc38dd9b640 1 --2- 172.21.15.196:0/2706006359 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55aa2833f4a0 0x55aa283b0e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:18.396 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.387+0000 7fc38dd9b640 1 -- 172.21.15.196:0/2706006359 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55aa28330e70 msgr2=0x55aa2833dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-17T23:56:18.396 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.387+0000 7fc38dd9b640 1 --2- 172.21.15.196:0/2706006359 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55aa28330e70 0x55aa2833dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:18.396 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.387+0000 7fc38dd9b640 1 -- 172.21.15.196:0/2706006359 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55aa28138070 con 0x55aa28338fc0 2024-03-17T23:56:18.396 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.387+0000 7fc38e59c640 1 --2- 172.21.15.196:0/2706006359 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55aa28330e70 0x55aa2833dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-17T23:56:18.396 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.387+0000 7fc38ed9d640 1 --2- 172.21.15.196:0/2706006359 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55aa2833f4a0 0x55aa283b0e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-17T23:56:18.396 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.387+0000 7fc38dd9b640 1 --2- 172.21.15.196:0/2706006359 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55aa28338fc0 0x55aa283b08d0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fc38401c940 tx=0x7fc38401d550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=792859eaabb04bc server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:56:18.396 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.387+0000 7fc36d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.196:3300/0 2024-03-17T23:56:18.396 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.387+0000 7fc36d7fa640 1 -- 172.21.15.196:0/2706006359 <== mon.0 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3840d4060 con 0x55aa28338fc0 2024-03-17T23:56:18.396 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.387+0000 7fc36d7fa640 1 -- 172.21.15.196:0/2706006359 <== mon.0 v2:172.21.15.196:3300/0 2 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fc3840bc940 con 0x55aa28338fc0 2024-03-17T23:56:18.396 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.387+0000 7fc398145000 1 -- 172.21.15.196:0/2706006359 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc38007f070 con 0x55aa28338fc0 2024-03-17T23:56:18.396 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.387+0000 7fc36d7fa640 1 -- 172.21.15.196:0/2706006359 <== mon.0 v2:172.21.15.196:3300/0 3 ==== mon_get_version_reply(handle=1 version=14) ==== 24+0+0 (secure 0 0 0) 0x7fc3840da050 con 0x55aa28338fc0 2024-03-17T23:56:18.397 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.387+0000 7fc398145000 10 client.4779 fetch_fsmap learned FSMap version 14 2024-03-17T23:56:18.397 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.387+0000 7fc398145000 1 -- 172.21.15.196:0/2706006359 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,fsmap=14,monmap=2+}) -- 0x55aa2811c370 con 0x55aa28338fc0 2024-03-17T23:56:18.397 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.387+0000 7fc36d7fa640 1 -- 172.21.15.196:0/2706006359 <== mon.0 v2:172.21.15.196:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc38007f070 con 0x55aa28338fc0 2024-03-17T23:56:18.397 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.387+0000 7fc36d7fa640 1 -- 172.21.15.196:0/2706006359 <== mon.0 v2:172.21.15.196:3300/0 5 ==== fsmap(e 14) ==== 4784+0+0 (secure 0 0 0) 0x7fc3840dd020 con 0x55aa28338fc0 2024-03-17T23:56:18.397 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.387+0000 7fc398145000 10 client.4779 fetch_fsmap finished waiting for FSMap version 14 2024-03-17T23:56:18.397 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.387+0000 7fc398145000 10 client.4779 resolve_mds: resolved name 'e' to daemon mds.e 2024-03-17T23:56:18.397 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.387+0000 7fc398145000 20 client.4779 populate_metadata read hostname 'smithi196' 2024-03-17T23:56:18.397 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.387+0000 7fc398145000 1 --2- 172.21.15.196:0/2706006359 >> [v2:172.21.15.196:6834/1837184297,v1:172.21.15.196:6835/1837184297] conn(0x55aa2833fdc0 0x55aa283efcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:18.397 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.387+0000 7fc398145000 4 client.4779 mds_command: new command op to 4281 tid=0 multi_id=0 [{"prefix": "status"}] 2024-03-17T23:56:18.397 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.387+0000 7fc398145000 1 -- 172.21.15.196:0/2706006359 --> [v2:172.21.15.196:6834/1837184297,v1:172.21.15.196:6835/1837184297] -- command(tid 0: {"prefix": "status"}) -- 0x55aa28195a80 con 0x55aa2833fdc0 2024-03-17T23:56:18.397 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.387+0000 7fc38e59c640 1 --2- 172.21.15.196:0/2706006359 >> [v2:172.21.15.196:6834/1837184297,v1:172.21.15.196:6835/1837184297] conn(0x55aa2833fdc0 0x55aa283efcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:18.397 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.387+0000 7fc38e59c640 1 --2- 172.21.15.196:0/2706006359 >> [v2:172.21.15.196:6834/1837184297,v1:172.21.15.196:6835/1837184297] conn(0x55aa2833fdc0 0x55aa283efcc0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=335875861bb642b3 server_cookie=9dd56ca1564a78a0 in_seq=0 out_seq=0 2024-03-17T23:56:18.397 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.387+0000 7fc36d7fa640 10 client.4779 ms_handle_connect on v2:172.21.15.196:6834/1837184297 2024-03-17T23:56:18.398 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.387+0000 7fc36d7fa640 1 -- 172.21.15.196:0/2706006359 <== mds.1 v2:172.21.15.196:6834/1837184297 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x55aa28195a80 con 0x55aa2833fdc0 2024-03-17T23:56:18.398 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.387+0000 7fc36d7fa640 10 client.4779 handle_command_reply: tid=0 2024-03-17T23:56:18.398 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.387+0000 7fc398145000 1 client.4779 shutdown 2024-03-17T23:56:18.398 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.387+0000 7fc398145000 1 -- 172.21.15.196:0/2706006359 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55aa28338fc0 msgr2=0x55aa283b08d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:18.398 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.387+0000 7fc398145000 1 --2- 172.21.15.196:0/2706006359 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55aa28338fc0 0x55aa283b08d0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fc38401c940 tx=0x7fc38401d550 comp rx=0 tx=0).stop 2024-03-17T23:56:18.398 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.387+0000 7fc398145000 1 -- 172.21.15.196:0/2706006359 shutdown_connections 2024-03-17T23:56:18.398 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.387+0000 7fc398145000 1 --2- 172.21.15.196:0/2706006359 >> [v2:172.21.15.196:6834/1837184297,v1:172.21.15.196:6835/1837184297] conn(0x55aa2833fdc0 0x55aa283efcc0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:18.398 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.387+0000 7fc398145000 1 --2- 172.21.15.196:0/2706006359 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55aa2833f4a0 0x55aa283b0e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:18.398 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.387+0000 7fc36d7fa640 0 client.4779 ms_handle_reset on v2:172.21.15.196:6834/1837184297 2024-03-17T23:56:18.398 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.387+0000 7fc398145000 1 --2- 172.21.15.196:0/2706006359 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55aa28338fc0 0x55aa283b08d0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:18.398 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.387+0000 7fc398145000 1 --2- 172.21.15.196:0/2706006359 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55aa28330e70 0x55aa2833dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:18.399 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.387+0000 7fc398145000 1 -- 172.21.15.196:0/2706006359 >> 172.21.15.196:0/2706006359 conn(0x55aa2837bde0 msgr2=0x55aa28379cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-17T23:56:18.399 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.387+0000 7fc398145000 1 -- 172.21.15.196:0/2706006359 shutdown_connections 2024-03-17T23:56:18.399 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.387+0000 7fc398145000 1 -- 172.21.15.196:0/2706006359 wait complete. 2024-03-17T23:56:18.399 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.391+0000 7fc398145000 20 client.4779 trim_cache size 0 max 16384 2024-03-17T23:56:18.399 INFO:teuthology.orchestra.run.smithi196.stdout:{ 2024-03-17T23:56:18.399 INFO:teuthology.orchestra.run.smithi196.stdout: "cluster_fsid": "b80f9c80-17ad-4126-8957-4c0c46f5b803", 2024-03-17T23:56:18.399 INFO:teuthology.orchestra.run.smithi196.stdout: "whoami": 1, 2024-03-17T23:56:18.399 INFO:teuthology.orchestra.run.smithi196.stdout: "id": 4281, 2024-03-17T23:56:18.399 INFO:teuthology.orchestra.run.smithi196.stdout: "want_state": "up:active", 2024-03-17T23:56:18.399 INFO:teuthology.orchestra.run.smithi196.stdout: "state": "up:active", 2024-03-17T23:56:18.399 INFO:teuthology.orchestra.run.smithi196.stdout: "fs_name": "cephfs", 2024-03-17T23:56:18.400 INFO:teuthology.orchestra.run.smithi196.stdout: "rank_uptime": 14.727278671000001, 2024-03-17T23:56:18.400 INFO:teuthology.orchestra.run.smithi196.stdout: "mdsmap_epoch": 14, 2024-03-17T23:56:18.400 INFO:teuthology.orchestra.run.smithi196.stdout: "osdmap_epoch": 21, 2024-03-17T23:56:18.400 INFO:teuthology.orchestra.run.smithi196.stdout: "osdmap_epoch_barrier": 21, 2024-03-17T23:56:18.400 INFO:teuthology.orchestra.run.smithi196.stdout: "uptime": 23.714642900000001 2024-03-17T23:56:18.400 INFO:teuthology.orchestra.run.smithi196.stdout:} 2024-03-17T23:56:18.401 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.391+0000 7fc394fc3640 1 -- 172.21.15.196:0/2832868242 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7fc370067690 msgr2=0x7fc370069b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:18.401 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.391+0000 7fc394fc3640 1 --2- 172.21.15.196:0/2832868242 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7fc370067690 0x7fc370069b50 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fc3840b2000 tx=0x7fc3840aa070 comp rx=0 tx=0).stop 2024-03-17T23:56:18.401 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.391+0000 7fc394fc3640 1 -- 172.21.15.196:0/2832868242 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc390072430 msgr2=0x7fc390157d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:18.401 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.391+0000 7fc394fc3640 1 --2- 172.21.15.196:0/2832868242 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc390072430 0x7fc390157d80 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fc38000c450 tx=0x7fc38000c910 comp rx=0 tx=0).stop 2024-03-17T23:56:18.401 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.391+0000 7fc394fc3640 1 -- 172.21.15.196:0/2832868242 shutdown_connections 2024-03-17T23:56:18.401 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.391+0000 7fc394fc3640 1 --2- 172.21.15.196:0/2832868242 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7fc370067690 0x7fc370069b50 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:18.401 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.391+0000 7fc394fc3640 1 --2- 172.21.15.196:0/2832868242 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc390154240 0x7fc3900c55e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:18.401 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.391+0000 7fc394fc3640 1 --2- 172.21.15.196:0/2832868242 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc39015a260 0x7fc3900c5e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:18.401 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.391+0000 7fc394fc3640 1 --2- 172.21.15.196:0/2832868242 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc390072430 0x7fc390157d80 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:18.401 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.391+0000 7fc394fc3640 1 -- 172.21.15.196:0/2832868242 >> 172.21.15.196:0/2832868242 conn(0x7fc3900cc420 msgr2=0x7fc390152f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-17T23:56:18.401 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.391+0000 7fc394fc3640 1 -- 172.21.15.196:0/2832868242 shutdown_connections 2024-03-17T23:56:18.402 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.391+0000 7fc394fc3640 1 -- 172.21.15.196:0/2832868242 wait complete. 2024-03-17T23:56:18.407 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-03-17T23:56:18.512 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.507+0000 7f7ad9b51640 1 Processor -- start 2024-03-17T23:56:18.512 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.507+0000 7f7ad9b51640 1 -- start start 2024-03-17T23:56:18.514 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.511+0000 7f7ad9b51640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f7ad4153f60 0x7f7ad40705f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:18.514 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.511+0000 7f7ad9b51640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7ad4154340 0x7f7ad40c8d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:18.514 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.511+0000 7f7ad9b51640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7ad415d5d0 con 0x7f7ad415aa70 2024-03-17T23:56:18.514 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.511+0000 7f7ad9b51640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7f7ad4072770 con 0x7f7ad4153f60 2024-03-17T23:56:18.514 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.511+0000 7f7ad9b51640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f7ad415d380 con 0x7f7ad4154340 2024-03-17T23:56:18.514 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.511+0000 7f7ad37fe640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f7ad4153f60 0x7f7ad40705f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:18.514 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.511+0000 7f7ad37fe640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f7ad4153f60 0x7f7ad40705f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.196:38438/0 (socket says 172.21.15.196:38438) 2024-03-17T23:56:18.514 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.511+0000 7f7ad37fe640 1 -- 172.21.15.196:0/707386996 learned_addr learned my addr 172.21.15.196:0/707386996 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-03-17T23:56:18.514 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.511+0000 7f7ad2ffd640 1 --2- 172.21.15.196:0/707386996 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7ad4154340 0x7f7ad40c8d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:18.514 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.511+0000 7f7ad37fe640 1 -- 172.21.15.196:0/707386996 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7ad4154340 msgr2=0x7f7ad40c8d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-17T23:56:18.514 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.511+0000 7f7ad37fe640 1 --2- 172.21.15.196:0/707386996 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7ad4154340 0x7f7ad40c8d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:18.515 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.511+0000 7f7ad37fe640 1 -- 172.21.15.196:0/707386996 >> v1:172.21.15.204:6789/0 conn(0x7f7ad415aa70 legacy=0x7f7ad4072c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:18.515 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.511+0000 7f7ad37fe640 1 -- 172.21.15.196:0/707386996 --> v2:172.21.15.196:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ad415d8b0 con 0x7f7ad4153f60 2024-03-17T23:56:18.516 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.511+0000 7f7ad37fe640 1 --2- 172.21.15.196:0/707386996 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7ad4153f60 0x7f7ad40705f0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f7ac4009870 tx=0x7f7ac401ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1cfa72628918690 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:56:18.516 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.515+0000 7f7ad27fc640 1 -- 172.21.15.196:0/707386996 <== mon.0 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ac40b5070 con 0x7f7ad4153f60 2024-03-17T23:56:18.516 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.515+0000 7f7ad27fc640 1 -- 172.21.15.196:0/707386996 <== mon.0 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ac40a8a50 con 0x7f7ad4153f60 2024-03-17T23:56:18.516 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.515+0000 7f7ad27fc640 1 -- 172.21.15.196:0/707386996 <== mon.0 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ac40a8e20 con 0x7f7ad4153f60 2024-03-17T23:56:18.517 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.515+0000 7f7ad9b51640 1 -- 172.21.15.196:0/707386996 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7ad4153f60 msgr2=0x7f7ad40705f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:18.517 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.515+0000 7f7ad9b51640 1 --2- 172.21.15.196:0/707386996 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7ad4153f60 0x7f7ad40705f0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f7ac4009870 tx=0x7f7ac401ed50 comp rx=0 tx=0).stop 2024-03-17T23:56:18.517 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.515+0000 7f7ad9b51640 1 -- 172.21.15.196:0/707386996 shutdown_connections 2024-03-17T23:56:18.517 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.515+0000 7f7ad9b51640 1 --2- 172.21.15.196:0/707386996 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7ad4154340 0x7f7ad40c8d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:18.517 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.515+0000 7f7ad9b51640 1 --2- 172.21.15.196:0/707386996 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7ad4153f60 0x7f7ad40705f0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:18.518 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.515+0000 7f7ad9b51640 1 -- 172.21.15.196:0/707386996 >> 172.21.15.196:0/707386996 conn(0x7f7ad406c3c0 msgr2=0x7f7ad406c7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-17T23:56:18.518 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.515+0000 7f7ad9b51640 1 -- 172.21.15.196:0/707386996 shutdown_connections 2024-03-17T23:56:18.518 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.515+0000 7f7ad9b51640 1 -- 172.21.15.196:0/707386996 wait complete. 2024-03-17T23:56:18.518 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.515+0000 7f7ad9b51640 1 Processor -- start 2024-03-17T23:56:18.518 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.515+0000 7f7ad9b51640 1 -- start start 2024-03-17T23:56:18.520 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.515+0000 7f7ad9b51640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7ad4153f60 0x7f7ad414d7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:18.520 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.515+0000 7f7ad9b51640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7ad4154340 0x7f7ad4158ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:18.520 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.515+0000 7f7ad9b51640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7ad415aa70 0x7f7ad4149010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:18.520 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.515+0000 7f7ad9b51640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f7ad415e150 con 0x7f7ad415aa70 2024-03-17T23:56:18.521 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.515+0000 7f7ad9b51640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f7ad415de70 con 0x7f7ad4154340 2024-03-17T23:56:18.521 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.515+0000 7f7ad9b51640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f7ad4073310 con 0x7f7ad4153f60 2024-03-17T23:56:18.521 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.515+0000 7f7ad3fff640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7ad415aa70 0x7f7ad4149010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:18.521 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.515+0000 7f7ad3fff640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7ad415aa70 0x7f7ad4149010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.196:38454/0 (socket says 172.21.15.196:38454) 2024-03-17T23:56:18.521 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.515+0000 7f7ad3fff640 1 -- 172.21.15.196:0/3211614947 learned_addr learned my addr 172.21.15.196:0/3211614947 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-03-17T23:56:18.521 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.515+0000 7f7ad2ffd640 1 --2- 172.21.15.196:0/3211614947 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7ad4154340 0x7f7ad4158ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:18.521 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.515+0000 7f7ad37fe640 1 --2- 172.21.15.196:0/3211614947 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7ad4153f60 0x7f7ad414d7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:18.521 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.515+0000 7f7ad3fff640 1 -- 172.21.15.196:0/3211614947 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7ad4153f60 msgr2=0x7f7ad414d7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:18.521 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.515+0000 7f7ad3fff640 1 --2- 172.21.15.196:0/3211614947 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7ad4153f60 0x7f7ad414d7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:18.521 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.515+0000 7f7ad3fff640 1 -- 172.21.15.196:0/3211614947 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7ad4154340 msgr2=0x7f7ad4158ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:18.521 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.515+0000 7f7ad3fff640 1 --2- 172.21.15.196:0/3211614947 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7ad4154340 0x7f7ad4158ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:18.521 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.515+0000 7f7ad3fff640 1 -- 172.21.15.196:0/3211614947 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ad40cbe60 con 0x7f7ad415aa70 2024-03-17T23:56:18.521 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.515+0000 7f7ad3fff640 1 --2- 172.21.15.196:0/3211614947 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7ad415aa70 0x7f7ad4149010 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f7acc00c760 tx=0x7f7acc00cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:56:18.522 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.515+0000 7f7abbfff640 1 -- 172.21.15.196:0/3211614947 <== mon.0 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7acc003b80 con 0x7f7ad415aa70 2024-03-17T23:56:18.522 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.515+0000 7f7abbfff640 1 -- 172.21.15.196:0/3211614947 <== mon.0 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7acc003d20 con 0x7f7ad415aa70 2024-03-17T23:56:18.522 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.515+0000 7f7ad9b51640 1 -- 172.21.15.196:0/3211614947 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ad40cc140 con 0x7f7ad415aa70 2024-03-17T23:56:18.522 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.515+0000 7f7abbfff640 1 -- 172.21.15.196:0/3211614947 <== mon.0 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7acc00aa30 con 0x7f7ad415aa70 2024-03-17T23:56:18.522 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.515+0000 7f7ad9b51640 1 -- 172.21.15.196:0/3211614947 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ad414ecb0 con 0x7f7ad415aa70 2024-03-17T23:56:18.524 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.519+0000 7f7abbfff640 1 -- 172.21.15.196:0/3211614947 <== mon.0 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 5) ==== 87083+0+0 (secure 0 0 0) 0x7f7acc00abd0 con 0x7f7ad415aa70 2024-03-17T23:56:18.524 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.519+0000 7f7abbfff640 1 --2- 172.21.15.196:0/3211614947 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f7ac0067690 0x7f7ac0069b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:18.524 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.519+0000 7f7abbfff640 1 -- 172.21.15.196:0/3211614947 <== mon.0 v2:172.21.15.196:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f7acc085760 con 0x7f7ad415aa70 2024-03-17T23:56:18.524 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.519+0000 7f7ad37fe640 1 --2- 172.21.15.196:0/3211614947 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f7ac0067690 0x7f7ac0069b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:18.524 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.519+0000 7f7adccd3000 1 Processor -- start 2024-03-17T23:56:18.524 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.519+0000 7f7adccd3000 1 -- start start 2024-03-17T23:56:18.524 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.519+0000 7f7ad37fe640 1 --2- 172.21.15.196:0/3211614947 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f7ac0067690 0x7f7ac0069b50 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f7ac40b2000 tx=0x7f7ac4008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:56:18.524 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.519+0000 7f7adccd3000 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55be637f44a0 0x55be637f4880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:18.524 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.519+0000 7f7adccd3000 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55be637f4dc0 0x55be6382fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:18.524 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.519+0000 7f7adccd3000 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55be63830210 0x55be638305f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:18.525 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.519+0000 7f7adccd3000 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x55be6363d540 con 0x55be63830210 2024-03-17T23:56:18.525 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.519+0000 7f7adccd3000 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x55be635c4b00 con 0x55be637f4dc0 2024-03-17T23:56:18.525 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.519+0000 7f7adccd3000 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x55be636395e0 con 0x55be637f44a0 2024-03-17T23:56:18.525 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.519+0000 7f7ad2ffd640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55be637f4dc0 0x55be6382fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:18.525 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.519+0000 7f7ad37fe640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55be637f44a0 0x55be637f4880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:18.525 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.519+0000 7f7ad3fff640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55be63830210 0x55be638305f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:18.525 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.519+0000 7f7ad37fe640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55be637f44a0 0x55be637f4880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3301/0 says I am v2:172.21.15.196:40838/0 (socket says 172.21.15.196:40838) 2024-03-17T23:56:18.525 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.519+0000 7f7ad2ffd640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55be637f4dc0 0x55be6382fcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3300/0 says I am v2:172.21.15.196:59996/0 (socket says 172.21.15.196:59996) 2024-03-17T23:56:18.525 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.519+0000 7f7ad3fff640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55be63830210 0x55be638305f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.196:38458/0 (socket says 172.21.15.196:38458) 2024-03-17T23:56:18.525 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.519+0000 7f7ad37fe640 1 -- 172.21.15.196:0/4142355217 learned_addr learned my addr 172.21.15.196:0/4142355217 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-03-17T23:56:18.525 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.519+0000 7f7ad3fff640 1 -- 172.21.15.196:0/4142355217 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55be637f44a0 msgr2=0x55be637f4880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-17T23:56:18.525 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.519+0000 7f7ad3fff640 1 --2- 172.21.15.196:0/4142355217 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55be637f44a0 0x55be637f4880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:18.525 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.519+0000 7f7ad3fff640 1 -- 172.21.15.196:0/4142355217 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55be637f4dc0 msgr2=0x55be6382fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-17T23:56:18.526 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.519+0000 7f7ad3fff640 1 --2- 172.21.15.196:0/4142355217 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55be637f4dc0 0x55be6382fcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:18.526 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.519+0000 7f7ad3fff640 1 -- 172.21.15.196:0/4142355217 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55be635fa6a0 con 0x55be63830210 2024-03-17T23:56:18.526 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.519+0000 7f7ad3fff640 1 --2- 172.21.15.196:0/4142355217 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55be63830210 0x55be638305f0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f7acc083ce0 tx=0x7f7acc0558e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68d37eba86fdc52e server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:56:18.530 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.523+0000 7f7ab97fa640 1 -- 172.21.15.196:0/4142355217 <== mon.0 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7acc082070 con 0x55be63830210 2024-03-17T23:56:18.530 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.523+0000 7f7ab97fa640 1 -- 172.21.15.196:0/4142355217 <== mon.0 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7acc059e30 con 0x55be63830210 2024-03-17T23:56:18.531 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.523+0000 7f7ab97fa640 1 -- 172.21.15.196:0/4142355217 <== mon.0 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7acc05e3f0 con 0x55be63830210 2024-03-17T23:56:18.531 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.523+0000 7f7adccd3000 1 -- 172.21.15.196:0/4142355217 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55be63830210 msgr2=0x55be638305f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:18.531 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.523+0000 7f7adccd3000 1 --2- 172.21.15.196:0/4142355217 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55be63830210 0x55be638305f0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f7acc083ce0 tx=0x7f7acc0558e0 comp rx=0 tx=0).stop 2024-03-17T23:56:18.531 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.523+0000 7f7adccd3000 1 -- 172.21.15.196:0/4142355217 shutdown_connections 2024-03-17T23:56:18.531 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.523+0000 7f7adccd3000 1 --2- 172.21.15.196:0/4142355217 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55be63830210 0x55be638305f0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:18.531 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.523+0000 7f7adccd3000 1 --2- 172.21.15.196:0/4142355217 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55be637f4dc0 0x55be6382fcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:18.531 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.523+0000 7f7adccd3000 1 --2- 172.21.15.196:0/4142355217 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55be637f44a0 0x55be637f4880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:18.531 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.523+0000 7f7adccd3000 1 -- 172.21.15.196:0/4142355217 >> 172.21.15.196:0/4142355217 conn(0x55be637e5e70 msgr2=0x55be6382da90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-17T23:56:18.531 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.523+0000 7f7adccd3000 1 -- 172.21.15.196:0/4142355217 shutdown_connections 2024-03-17T23:56:18.531 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.523+0000 7f7adccd3000 1 -- 172.21.15.196:0/4142355217 wait complete. 2024-03-17T23:56:18.531 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.523+0000 7f7adccd3000 1 -- start start 2024-03-17T23:56:18.531 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.523+0000 7f7adccd3000 1 Processor -- start 2024-03-17T23:56:18.532 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.523+0000 7f7adccd3000 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55be637f44a0 0x55be63828eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:18.532 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.523+0000 7f7adccd3000 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55be637f4dc0 0x55be638293f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:18.532 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.523+0000 7f7adccd3000 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55be63830210 0x55be637ecea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:18.532 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.523+0000 7f7adccd3000 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x55be635fb850 con 0x55be637f44a0 2024-03-17T23:56:18.532 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.523+0000 7f7adccd3000 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x55be636be4b0 con 0x55be637f4dc0 2024-03-17T23:56:18.532 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.523+0000 7f7adccd3000 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x55be635f7f50 con 0x55be63830210 2024-03-17T23:56:18.532 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.523+0000 7f7ad37fe640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55be637f44a0 0x55be63828eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:18.532 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.523+0000 7f7adccd3000 10 client.0 _ll_register_callbacks cb 0x55be637da220 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-17T23:56:18.532 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.523+0000 7f7ad37fe640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55be637f44a0 0x55be63828eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.196:38460/0 (socket says 172.21.15.196:38460) 2024-03-17T23:56:18.532 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.523+0000 7f7ad37fe640 1 -- 172.21.15.196:0/784133244 learned_addr learned my addr 172.21.15.196:0/784133244 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-03-17T23:56:18.532 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.523+0000 7f7ad2ffd640 1 --2- 172.21.15.196:0/784133244 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55be637f4dc0 0x55be638293f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:18.532 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.523+0000 7f7ad3fff640 1 --2- 172.21.15.196:0/784133244 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55be63830210 0x55be637ecea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:18.532 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.523+0000 7f7ad37fe640 1 -- 172.21.15.196:0/784133244 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55be63830210 msgr2=0x55be637ecea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-17T23:56:18.533 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.523+0000 7f7ad37fe640 1 --2- 172.21.15.196:0/784133244 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55be63830210 0x55be637ecea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:18.533 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.523+0000 7f7ad37fe640 1 -- 172.21.15.196:0/784133244 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55be637f4dc0 msgr2=0x55be638293f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-17T23:56:18.533 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.523+0000 7f7ad37fe640 1 --2- 172.21.15.196:0/784133244 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55be637f4dc0 0x55be638293f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:18.533 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.523+0000 7f7ad37fe640 1 -- 172.21.15.196:0/784133244 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55be635f8900 con 0x55be637f44a0 2024-03-17T23:56:18.533 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.523+0000 7f7ad2ffd640 1 --2- 172.21.15.196:0/784133244 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55be637f4dc0 0x55be638293f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-17T23:56:18.533 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.523+0000 7f7ad3fff640 1 --2- 172.21.15.196:0/784133244 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55be63830210 0x55be637ecea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-17T23:56:18.533 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.523+0000 7f7ad37fe640 1 --2- 172.21.15.196:0/784133244 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55be637f44a0 0x55be63828eb0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f7ac4009960 tx=0x7f7ac401d590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ab0cc2acf967977 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:56:18.533 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.523+0000 7f7ab27fc640 10 client.0 ms_handle_connect on v2:172.21.15.196:3300/0 2024-03-17T23:56:18.533 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.523+0000 7f7ab27fc640 1 -- 172.21.15.196:0/784133244 <== mon.0 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ac40b5040 con 0x55be637f44a0 2024-03-17T23:56:18.533 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.523+0000 7f7ab27fc640 1 -- 172.21.15.196:0/784133244 <== mon.0 v2:172.21.15.196:3300/0 2 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f7ac40c7680 con 0x55be637f44a0 2024-03-17T23:56:18.533 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.523+0000 7f7adccd3000 1 -- 172.21.15.196:0/784133244 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7acc059e30 con 0x55be637f44a0 2024-03-17T23:56:18.533 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.523+0000 7f7ab27fc640 1 -- 172.21.15.196:0/784133244 <== mon.0 v2:172.21.15.196:3300/0 3 ==== mon_get_version_reply(handle=1 version=14) ==== 24+0+0 (secure 0 0 0) 0x7f7ac40d4050 con 0x55be637f44a0 2024-03-17T23:56:18.533 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.523+0000 7f7adccd3000 10 client.4791 fetch_fsmap learned FSMap version 14 2024-03-17T23:56:18.533 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.523+0000 7f7adccd3000 1 -- 172.21.15.196:0/784133244 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,fsmap=14,monmap=2+}) -- 0x55be636be940 con 0x55be637f44a0 2024-03-17T23:56:18.534 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.523+0000 7f7ab27fc640 1 -- 172.21.15.196:0/784133244 <== mon.0 v2:172.21.15.196:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7acc059e30 con 0x55be637f44a0 2024-03-17T23:56:18.534 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.527+0000 7f7ab27fc640 1 -- 172.21.15.196:0/784133244 <== mon.0 v2:172.21.15.196:3300/0 5 ==== fsmap(e 14) ==== 4784+0+0 (secure 0 0 0) 0x7f7ac40d7020 con 0x55be637f44a0 2024-03-17T23:56:18.534 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.527+0000 7f7adccd3000 10 client.4791 fetch_fsmap finished waiting for FSMap version 14 2024-03-17T23:56:18.534 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.527+0000 7f7adccd3000 10 client.4791 resolve_mds: resolved name 'c' to daemon mds.c 2024-03-17T23:56:18.534 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.527+0000 7f7adccd3000 20 client.4791 populate_metadata read hostname 'smithi196' 2024-03-17T23:56:18.534 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.527+0000 7f7adccd3000 1 --2- 172.21.15.196:0/784133244 >> [v2:172.21.15.196:6836/2436120950,v1:172.21.15.196:6837/2436120950] conn(0x55be637edf00 0x55be637ee2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:18.534 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.527+0000 7f7adccd3000 4 client.4791 mds_command: new command op to 4284 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-17T23:56:18.534 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.527+0000 7f7adccd3000 1 -- 172.21.15.196:0/784133244 --> [v2:172.21.15.196:6836/2436120950,v1:172.21.15.196:6837/2436120950] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55be635d8bc0 con 0x55be637edf00 2024-03-17T23:56:18.534 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.527+0000 7f7ad2ffd640 1 --2- 172.21.15.196:0/784133244 >> [v2:172.21.15.196:6836/2436120950,v1:172.21.15.196:6837/2436120950] conn(0x55be637edf00 0x55be637ee2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:18.534 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.527+0000 7f7ab27fc640 10 client.4791 ms_handle_connect on v2:172.21.15.196:6836/2436120950 2024-03-17T23:56:18.534 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.527+0000 7f7ad2ffd640 1 --2- 172.21.15.196:0/784133244 >> [v2:172.21.15.196:6836/2436120950,v1:172.21.15.196:6837/2436120950] conn(0x55be637edf00 0x55be637ee2e0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=228c0444a2a8f009 server_cookie=c98ca9903d7112da in_seq=0 out_seq=0 2024-03-17T23:56:18.534 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.527+0000 7f7ab27fc640 1 -- 172.21.15.196:0/784133244 <== mds.0 v2:172.21.15.196:6836/2436120950 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x55be635d8bc0 con 0x55be637edf00 2024-03-17T23:56:18.534 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.527+0000 7f7ab27fc640 10 client.4791 handle_command_reply: tid=0 2024-03-17T23:56:18.535 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.527+0000 7f7adccd3000 1 client.4791 shutdown 2024-03-17T23:56:18.535 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.527+0000 7f7adccd3000 1 -- 172.21.15.196:0/784133244 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55be637f44a0 msgr2=0x55be63828eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:18.535 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.527+0000 7f7adccd3000 1 --2- 172.21.15.196:0/784133244 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55be637f44a0 0x55be63828eb0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f7ac4009960 tx=0x7f7ac401d590 comp rx=0 tx=0).stop 2024-03-17T23:56:18.535 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.527+0000 7f7adccd3000 1 -- 172.21.15.196:0/784133244 shutdown_connections 2024-03-17T23:56:18.535 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.527+0000 7f7adccd3000 1 --2- 172.21.15.196:0/784133244 >> [v2:172.21.15.196:6836/2436120950,v1:172.21.15.196:6837/2436120950] conn(0x55be637edf00 0x55be637ee2e0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:18.535 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.527+0000 7f7adccd3000 1 --2- 172.21.15.196:0/784133244 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55be63830210 0x55be637ecea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:18.535 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.527+0000 7f7adccd3000 1 --2- 172.21.15.196:0/784133244 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55be637f4dc0 0x55be638293f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:18.535 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.527+0000 7f7adccd3000 1 --2- 172.21.15.196:0/784133244 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55be637f44a0 0x55be63828eb0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:18.535 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.527+0000 7f7adccd3000 1 -- 172.21.15.196:0/784133244 >> 172.21.15.196:0/784133244 conn(0x55be637e5e70 msgr2=0x55be6382d670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-17T23:56:18.535 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.527+0000 7f7ab27fc640 0 client.4791 ms_handle_reset on v2:172.21.15.196:6836/2436120950 2024-03-17T23:56:18.535 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.527+0000 7f7adccd3000 1 -- 172.21.15.196:0/784133244 shutdown_connections 2024-03-17T23:56:18.535 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.527+0000 7f7adccd3000 1 -- 172.21.15.196:0/784133244 wait complete. 2024-03-17T23:56:18.535 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.527+0000 7f7adccd3000 20 client.4791 trim_cache size 0 max 16384 2024-03-17T23:56:18.547 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.543+0000 7f7adccd3000 1 Processor -- start 2024-03-17T23:56:18.547 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.543+0000 7f7adccd3000 1 -- start start 2024-03-17T23:56:18.548 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.543+0000 7f7adccd3000 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55be637f44a0 0x55be6382d460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:18.548 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.543+0000 7f7adccd3000 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55be637f4dc0 0x55be6382d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:18.548 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.543+0000 7f7adccd3000 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55be63830210 0x55be637f2df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:18.548 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.543+0000 7f7adccd3000 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f7ad41fbe50 con 0x55be637f44a0 2024-03-17T23:56:18.549 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.543+0000 7f7adccd3000 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f7ad41fc520 con 0x55be63830210 2024-03-17T23:56:18.549 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.543+0000 7f7adccd3000 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f7ad40ca5d0 con 0x55be637f4dc0 2024-03-17T23:56:18.549 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.543+0000 7f7ad37fe640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55be637f44a0 0x55be6382d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:18.549 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.543+0000 7f7ad37fe640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55be637f44a0 0x55be6382d460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.196:38470/0 (socket says 172.21.15.196:38470) 2024-03-17T23:56:18.549 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.543+0000 7f7ad37fe640 1 -- 172.21.15.196:0/1806570722 learned_addr learned my addr 172.21.15.196:0/1806570722 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-03-17T23:56:18.549 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.543+0000 7f7ad3fff640 1 --2- 172.21.15.196:0/1806570722 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55be63830210 0x55be637f2df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:18.549 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.543+0000 7f7ad2ffd640 1 --2- 172.21.15.196:0/1806570722 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55be637f4dc0 0x55be6382d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:18.549 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.543+0000 7f7ad37fe640 1 -- 172.21.15.196:0/1806570722 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55be637f4dc0 msgr2=0x55be6382d9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-17T23:56:18.549 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.543+0000 7f7ad37fe640 1 --2- 172.21.15.196:0/1806570722 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55be637f4dc0 0x55be6382d9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:18.549 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.543+0000 7f7ad37fe640 1 -- 172.21.15.196:0/1806570722 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55be63830210 msgr2=0x55be637f2df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-17T23:56:18.549 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.543+0000 7f7ad37fe640 1 --2- 172.21.15.196:0/1806570722 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55be63830210 0x55be637f2df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:18.549 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.543+0000 7f7ad37fe640 1 -- 172.21.15.196:0/1806570722 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55be63695870 con 0x55be637f44a0 2024-03-17T23:56:18.549 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.543+0000 7f7ad37fe640 1 --2- 172.21.15.196:0/1806570722 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55be637f44a0 0x55be6382d460 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f7ac40b3040 tx=0x7f7ac40c2000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74683873fb056d2e server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:56:18.550 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.547+0000 7f7ab8ff9640 1 -- 172.21.15.196:0/1806570722 <== mon.0 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ac40b5070 con 0x55be637f44a0 2024-03-17T23:56:18.550 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.547+0000 7f7ab8ff9640 1 -- 172.21.15.196:0/1806570722 <== mon.0 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ac40cc070 con 0x55be637f44a0 2024-03-17T23:56:18.550 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.547+0000 7f7ab8ff9640 1 -- 172.21.15.196:0/1806570722 <== mon.0 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ac40b07e0 con 0x55be637f44a0 2024-03-17T23:56:18.554 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.547+0000 7f7adccd3000 1 -- 172.21.15.196:0/1806570722 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55be637f44a0 msgr2=0x55be6382d460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:18.554 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.547+0000 7f7adccd3000 1 --2- 172.21.15.196:0/1806570722 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55be637f44a0 0x55be6382d460 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f7ac40b3040 tx=0x7f7ac40c2000 comp rx=0 tx=0).stop 2024-03-17T23:56:18.554 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.547+0000 7f7adccd3000 1 -- 172.21.15.196:0/1806570722 shutdown_connections 2024-03-17T23:56:18.554 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.547+0000 7f7adccd3000 1 --2- 172.21.15.196:0/1806570722 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55be637f4dc0 0x55be6382d9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:18.554 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.547+0000 7f7adccd3000 1 --2- 172.21.15.196:0/1806570722 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55be63830210 0x55be637f2df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:18.554 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.547+0000 7f7adccd3000 1 --2- 172.21.15.196:0/1806570722 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55be637f44a0 0x55be6382d460 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:18.554 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.547+0000 7f7adccd3000 1 -- 172.21.15.196:0/1806570722 >> 172.21.15.196:0/1806570722 conn(0x55be637e5e70 msgr2=0x55be638280f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-17T23:56:18.554 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.547+0000 7f7adccd3000 1 -- 172.21.15.196:0/1806570722 shutdown_connections 2024-03-17T23:56:18.554 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.547+0000 7f7adccd3000 1 -- 172.21.15.196:0/1806570722 wait complete. 2024-03-17T23:56:18.554 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.547+0000 7f7adccd3000 1 -- start start 2024-03-17T23:56:18.554 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.547+0000 7f7adccd3000 1 Processor -- start 2024-03-17T23:56:18.555 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.547+0000 7f7adccd3000 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55be637f44a0 0x55be638a4070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:18.555 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.547+0000 7f7adccd3000 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55be637f4dc0 0x55be637f1750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:18.555 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.547+0000 7f7adccd3000 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55be63830210 0x55be637f1c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:18.555 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.547+0000 7f7adccd3000 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x55be635c1b10 con 0x55be637f44a0 2024-03-17T23:56:18.555 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.547+0000 7f7adccd3000 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x55be63829b40 con 0x55be63830210 2024-03-17T23:56:18.555 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.547+0000 7f7adccd3000 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x55be63829de0 con 0x55be637f4dc0 2024-03-17T23:56:18.555 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.547+0000 7f7adccd3000 10 client.0 _ll_register_callbacks cb 0x7f7ac40096f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-17T23:56:18.555 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.547+0000 7f7ad37fe640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55be637f44a0 0x55be638a4070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:18.555 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.547+0000 7f7ad37fe640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55be637f44a0 0x55be638a4070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.196:38478/0 (socket says 172.21.15.196:38478) 2024-03-17T23:56:18.555 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.547+0000 7f7ad37fe640 1 -- 172.21.15.196:0/1903635367 learned_addr learned my addr 172.21.15.196:0/1903635367 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-03-17T23:56:18.555 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.547+0000 7f7ad3fff640 1 --2- 172.21.15.196:0/1903635367 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55be63830210 0x55be637f1c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:18.555 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.547+0000 7f7ad2ffd640 1 --2- 172.21.15.196:0/1903635367 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55be637f4dc0 0x55be637f1750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:18.555 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.547+0000 7f7ad37fe640 1 -- 172.21.15.196:0/1903635367 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55be637f4dc0 msgr2=0x55be637f1750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-17T23:56:18.556 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.547+0000 7f7ad37fe640 1 --2- 172.21.15.196:0/1903635367 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55be637f4dc0 0x55be637f1750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:18.556 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.547+0000 7f7ad37fe640 1 -- 172.21.15.196:0/1903635367 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55be63830210 msgr2=0x55be637f1c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-17T23:56:18.556 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.547+0000 7f7ad37fe640 1 --2- 172.21.15.196:0/1903635367 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55be63830210 0x55be637f1c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:18.556 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.547+0000 7f7ad37fe640 1 -- 172.21.15.196:0/1903635367 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55be635ed070 con 0x55be637f44a0 2024-03-17T23:56:18.556 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.547+0000 7f7ad3fff640 1 --2- 172.21.15.196:0/1903635367 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55be63830210 0x55be637f1c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-17T23:56:18.556 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.547+0000 7f7ad37fe640 1 --2- 172.21.15.196:0/1903635367 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55be637f44a0 0x55be638a4070 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f7ac40b0fd0 tx=0x7f7ac4009240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93c50dc38d036821 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:56:18.556 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.547+0000 7f7ab27fc640 10 client.0 ms_handle_connect on v2:172.21.15.196:3300/0 2024-03-17T23:56:18.556 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.547+0000 7f7ab27fc640 1 -- 172.21.15.196:0/1903635367 <== mon.0 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ac40b5040 con 0x55be637f44a0 2024-03-17T23:56:18.556 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.547+0000 7f7ab27fc640 1 -- 172.21.15.196:0/1903635367 <== mon.0 v2:172.21.15.196:3300/0 2 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f7ac40d03f0 con 0x55be637f44a0 2024-03-17T23:56:18.556 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.547+0000 7f7adccd3000 1 -- 172.21.15.196:0/1903635367 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7ac40cc070 con 0x55be637f44a0 2024-03-17T23:56:18.556 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.547+0000 7f7ab27fc640 1 -- 172.21.15.196:0/1903635367 <== mon.0 v2:172.21.15.196:3300/0 3 ==== mon_get_version_reply(handle=1 version=14) ==== 24+0+0 (secure 0 0 0) 0x7f7ac40d0630 con 0x55be637f44a0 2024-03-17T23:56:18.556 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.547+0000 7f7adccd3000 10 client.4797 fetch_fsmap learned FSMap version 14 2024-03-17T23:56:18.556 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.547+0000 7f7adccd3000 1 -- 172.21.15.196:0/1903635367 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,fsmap=14,monmap=2+}) -- 0x55be635d1370 con 0x55be637f44a0 2024-03-17T23:56:18.556 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.547+0000 7f7ab27fc640 1 -- 172.21.15.196:0/1903635367 <== mon.0 v2:172.21.15.196:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ac40cc070 con 0x55be637f44a0 2024-03-17T23:56:18.557 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.547+0000 7f7ab27fc640 1 -- 172.21.15.196:0/1903635367 <== mon.0 v2:172.21.15.196:3300/0 5 ==== fsmap(e 14) ==== 4784+0+0 (secure 0 0 0) 0x7f7ac40d7040 con 0x55be637f44a0 2024-03-17T23:56:18.557 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.547+0000 7f7adccd3000 10 client.4797 fetch_fsmap finished waiting for FSMap version 14 2024-03-17T23:56:18.557 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.547+0000 7f7adccd3000 10 client.4797 resolve_mds: resolved name 'c' to daemon mds.c 2024-03-17T23:56:18.557 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.547+0000 7f7adccd3000 20 client.4797 populate_metadata read hostname 'smithi196' 2024-03-17T23:56:18.557 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.547+0000 7f7adccd3000 1 --2- 172.21.15.196:0/1903635367 >> [v2:172.21.15.196:6836/2436120950,v1:172.21.15.196:6837/2436120950] conn(0x55be637f21d0 0x55be637f25b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:18.557 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.547+0000 7f7adccd3000 4 client.4797 mds_command: new command op to 4284 tid=0 multi_id=0 [{"prefix": "status"}] 2024-03-17T23:56:18.557 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.547+0000 7f7adccd3000 1 -- 172.21.15.196:0/1903635367 --> [v2:172.21.15.196:6836/2436120950,v1:172.21.15.196:6837/2436120950] -- command(tid 0: {"prefix": "status"}) -- 0x55be6364aa80 con 0x55be637f21d0 2024-03-17T23:56:18.557 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.547+0000 7f7ad2ffd640 1 --2- 172.21.15.196:0/1903635367 >> [v2:172.21.15.196:6836/2436120950,v1:172.21.15.196:6837/2436120950] conn(0x55be637f21d0 0x55be637f25b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:18.557 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.551+0000 7f7ad2ffd640 1 --2- 172.21.15.196:0/1903635367 >> [v2:172.21.15.196:6836/2436120950,v1:172.21.15.196:6837/2436120950] conn(0x55be637f21d0 0x55be637f25b0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d35766ebd0f1ed7e server_cookie=bf991c2abbaf7a8 in_seq=0 out_seq=0 2024-03-17T23:56:18.557 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.551+0000 7f7ab27fc640 10 client.4797 ms_handle_connect on v2:172.21.15.196:6836/2436120950 2024-03-17T23:56:18.557 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.551+0000 7f7ab27fc640 1 -- 172.21.15.196:0/1903635367 <== mds.0 v2:172.21.15.196:6836/2436120950 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x55be6364aa80 con 0x55be637f21d0 2024-03-17T23:56:18.557 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.551+0000 7f7ab27fc640 10 client.4797 handle_command_reply: tid=0 2024-03-17T23:56:18.557 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.551+0000 7f7adccd3000 1 client.4797 shutdown 2024-03-17T23:56:18.558 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.551+0000 7f7adccd3000 1 -- 172.21.15.196:0/1903635367 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55be637f44a0 msgr2=0x55be638a4070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:18.558 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.551+0000 7f7adccd3000 1 --2- 172.21.15.196:0/1903635367 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55be637f44a0 0x55be638a4070 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f7ac40b0fd0 tx=0x7f7ac4009240 comp rx=0 tx=0).stop 2024-03-17T23:56:18.558 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.551+0000 7f7adccd3000 1 -- 172.21.15.196:0/1903635367 shutdown_connections 2024-03-17T23:56:18.558 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.551+0000 7f7adccd3000 1 --2- 172.21.15.196:0/1903635367 >> [v2:172.21.15.196:6836/2436120950,v1:172.21.15.196:6837/2436120950] conn(0x55be637f21d0 0x55be637f25b0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:18.558 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.551+0000 7f7adccd3000 1 --2- 172.21.15.196:0/1903635367 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55be637f4dc0 0x55be637f1750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:18.558 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.551+0000 7f7adccd3000 1 --2- 172.21.15.196:0/1903635367 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55be63830210 0x55be637f1c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:18.558 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.551+0000 7f7ab27fc640 0 client.4797 ms_handle_reset on v2:172.21.15.196:6836/2436120950 2024-03-17T23:56:18.558 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.551+0000 7f7adccd3000 1 --2- 172.21.15.196:0/1903635367 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55be637f44a0 0x55be638a4070 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:18.558 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.551+0000 7f7adccd3000 1 -- 172.21.15.196:0/1903635367 >> 172.21.15.196:0/1903635367 conn(0x55be637e5e70 msgr2=0x55be6384ad40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-17T23:56:18.558 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.551+0000 7f7adccd3000 1 -- 172.21.15.196:0/1903635367 shutdown_connections 2024-03-17T23:56:18.558 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.551+0000 7f7adccd3000 1 -- 172.21.15.196:0/1903635367 wait complete. 2024-03-17T23:56:18.558 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.551+0000 7f7adccd3000 20 client.4797 trim_cache size 0 max 16384 2024-03-17T23:56:18.559 INFO:teuthology.orchestra.run.smithi196.stdout:{ 2024-03-17T23:56:18.559 INFO:teuthology.orchestra.run.smithi196.stdout: "cluster_fsid": "b80f9c80-17ad-4126-8957-4c0c46f5b803", 2024-03-17T23:56:18.559 INFO:teuthology.orchestra.run.smithi196.stdout: "whoami": 0, 2024-03-17T23:56:18.559 INFO:teuthology.orchestra.run.smithi196.stdout: "id": 4284, 2024-03-17T23:56:18.559 INFO:teuthology.orchestra.run.smithi196.stdout: "want_state": "up:active", 2024-03-17T23:56:18.559 INFO:teuthology.orchestra.run.smithi196.stdout: "state": "up:active", 2024-03-17T23:56:18.559 INFO:teuthology.orchestra.run.smithi196.stdout: "fs_name": "cephfs", 2024-03-17T23:56:18.559 INFO:teuthology.orchestra.run.smithi196.stdout: "rank_uptime": 16.906563425000002, 2024-03-17T23:56:18.559 INFO:teuthology.orchestra.run.smithi196.stdout: "mdsmap_epoch": 14, 2024-03-17T23:56:18.559 INFO:teuthology.orchestra.run.smithi196.stdout: "osdmap_epoch": 21, 2024-03-17T23:56:18.559 INFO:teuthology.orchestra.run.smithi196.stdout: "osdmap_epoch_barrier": 21, 2024-03-17T23:56:18.560 INFO:teuthology.orchestra.run.smithi196.stdout: "uptime": 23.872772999999999 2024-03-17T23:56:18.560 INFO:teuthology.orchestra.run.smithi196.stdout:} 2024-03-17T23:56:18.560 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.551+0000 7f7ad9b51640 1 -- 172.21.15.196:0/3211614947 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f7ac0067690 msgr2=0x7f7ac0069b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:18.560 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.551+0000 7f7ad9b51640 1 --2- 172.21.15.196:0/3211614947 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f7ac0067690 0x7f7ac0069b50 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f7ac40b2000 tx=0x7f7ac4008040 comp rx=0 tx=0).stop 2024-03-17T23:56:18.560 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.551+0000 7f7ad9b51640 1 -- 172.21.15.196:0/3211614947 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7ad415aa70 msgr2=0x7f7ad4149010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:18.561 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.551+0000 7f7ad9b51640 1 --2- 172.21.15.196:0/3211614947 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7ad415aa70 0x7f7ad4149010 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f7acc00c760 tx=0x7f7acc00cc20 comp rx=0 tx=0).stop 2024-03-17T23:56:18.561 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.551+0000 7f7ad9b51640 1 -- 172.21.15.196:0/3211614947 shutdown_connections 2024-03-17T23:56:18.561 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.551+0000 7f7ad9b51640 1 --2- 172.21.15.196:0/3211614947 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f7ac0067690 0x7f7ac0069b50 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:18.561 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.551+0000 7f7ad9b51640 1 --2- 172.21.15.196:0/3211614947 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7ad415aa70 0x7f7ad4149010 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:18.561 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.551+0000 7f7ad9b51640 1 --2- 172.21.15.196:0/3211614947 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7ad4154340 0x7f7ad4158ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:18.561 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.551+0000 7f7ad9b51640 1 --2- 172.21.15.196:0/3211614947 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7ad4153f60 0x7f7ad414d7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:18.561 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.551+0000 7f7ad9b51640 1 -- 172.21.15.196:0/3211614947 >> 172.21.15.196:0/3211614947 conn(0x7f7ad406c3c0 msgr2=0x7f7ad40c5280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-17T23:56:18.561 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.551+0000 7f7ad9b51640 1 -- 172.21.15.196:0/3211614947 shutdown_connections 2024-03-17T23:56:18.561 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.551+0000 7f7ad9b51640 1 -- 172.21.15.196:0/3211614947 wait complete. 2024-03-17T23:56:18.569 INFO:teuthology.run_tasks:Running task ceph-fuse... 2024-03-17T23:56:18.592 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2024-03-17T23:56:18.593 INFO:tasks.ceph_fuse:config is {'client.0': {}} 2024-03-17T23:56:18.593 INFO:tasks.ceph_fuse:client.0 config is {} 2024-03-17T23:56:18.593 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-03-17T23:56:18.593 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-03-17T23:56:18.593 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-17T23:56:18.593 DEBUG:teuthology.orchestra.run.smithi196:> ip netns list 2024-03-17T23:56:18.598 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-17T23:56:18.598 DEBUG:teuthology.orchestra.run.smithi196:> sudo ip link delete ceph-brx 2024-03-17T23:56:18.649 INFO:teuthology.orchestra.run.smithi196.stderr:Cannot find device "ceph-brx" 2024-03-17T23:56:18.650 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-17T23:56:18.651 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2024-03-17T23:56:18.651 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-03-17T23:56:18.796 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.791+0000 7f90662ac640 1 Processor -- start 2024-03-17T23:56:18.796 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.791+0000 7f90662ac640 1 -- start start 2024-03-17T23:56:18.797 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.795+0000 7f90662ac640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f906015a260 0x7f906015a660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:18.797 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.795+0000 7f90662ac640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f9060072430 0x7f90600728c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:18.797 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.795+0000 7f90662ac640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9060154620 con 0x7f9060154240 2024-03-17T23:56:18.797 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.795+0000 7f90662ac640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7f90600c7830 con 0x7f9060072430 2024-03-17T23:56:18.797 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.795+0000 7f90662ac640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f90600c7b10 con 0x7f906015a260 2024-03-17T23:56:18.797 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.795+0000 7f9064849640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f9060072430 0x7f90600728c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:18.798 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.795+0000 7f9064849640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f9060072430 0x7f90600728c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.196:38492/0 (socket says 172.21.15.196:38492) 2024-03-17T23:56:18.798 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.795+0000 7f9064849640 1 -- 172.21.15.196:0/3520038751 learned_addr learned my addr 172.21.15.196:0/3520038751 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-03-17T23:56:18.798 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.795+0000 7f905f7fe640 1 --2- 172.21.15.196:0/3520038751 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f906015a260 0x7f906015a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:18.798 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.795+0000 7f9064849640 1 -- 172.21.15.196:0/3520038751 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f906015a260 msgr2=0x7f906015a660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-17T23:56:18.798 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.795+0000 7f9064849640 1 --2- 172.21.15.196:0/3520038751 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f906015a260 0x7f906015a660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:18.798 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.795+0000 7f9064849640 1 -- 172.21.15.196:0/3520038751 >> v1:172.21.15.204:6789/0 conn(0x7f9060154240 legacy=0x7f906006fca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:18.798 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.795+0000 7f9064849640 1 -- 172.21.15.196:0/3520038751 --> v2:172.21.15.196:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90600c7df0 con 0x7f9060072430 2024-03-17T23:56:18.800 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.795+0000 7f9064849640 1 --2- 172.21.15.196:0/3520038751 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9060072430 0x7f90600728c0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f9058009e50 tx=0x7f905801f210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5833154fa2e7f21 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:56:18.800 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.795+0000 7f905effd640 1 -- 172.21.15.196:0/3520038751 <== mon.0 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90580b4070 con 0x7f9060072430 2024-03-17T23:56:18.800 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.795+0000 7f905effd640 1 -- 172.21.15.196:0/3520038751 <== mon.0 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f90580af400 con 0x7f9060072430 2024-03-17T23:56:18.800 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.795+0000 7f905effd640 1 -- 172.21.15.196:0/3520038751 <== mon.0 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90580af7d0 con 0x7f9060072430 2024-03-17T23:56:18.800 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.795+0000 7f90662ac640 1 -- 172.21.15.196:0/3520038751 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9060072430 msgr2=0x7f90600728c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:18.800 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.795+0000 7f90662ac640 1 --2- 172.21.15.196:0/3520038751 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9060072430 0x7f90600728c0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f9058009e50 tx=0x7f905801f210 comp rx=0 tx=0).stop 2024-03-17T23:56:18.800 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.795+0000 7f90662ac640 1 -- 172.21.15.196:0/3520038751 shutdown_connections 2024-03-17T23:56:18.800 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.795+0000 7f90662ac640 1 --2- 172.21.15.196:0/3520038751 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9060072430 0x7f90600728c0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:18.800 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.795+0000 7f90662ac640 1 --2- 172.21.15.196:0/3520038751 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f906015a260 0x7f906015a660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:18.800 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.795+0000 7f90662ac640 1 -- 172.21.15.196:0/3520038751 >> 172.21.15.196:0/3520038751 conn(0x7f90600cc420 msgr2=0x7f90600cc830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-17T23:56:18.800 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.795+0000 7f90662ac640 1 -- 172.21.15.196:0/3520038751 shutdown_connections 2024-03-17T23:56:18.800 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.795+0000 7f90662ac640 1 -- 172.21.15.196:0/3520038751 wait complete. 2024-03-17T23:56:18.801 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.799+0000 7f90662ac640 1 Processor -- start 2024-03-17T23:56:18.801 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.799+0000 7f90662ac640 1 -- start start 2024-03-17T23:56:18.804 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.799+0000 7f90662ac640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9060072430 0x7f90600c6490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:18.804 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.799+0000 7f90662ac640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9060154240 0x7f90600c5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:18.804 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.799+0000 7f90662ac640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f906015a260 0x7f90601512f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:18.804 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.799+0000 7f90662ac640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f90600c8720 con 0x7f906015a260 2024-03-17T23:56:18.804 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.799+0000 7f90662ac640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f90600c83b0 con 0x7f9060072430 2024-03-17T23:56:18.804 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.799+0000 7f90662ac640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f906015aba0 con 0x7f9060154240 2024-03-17T23:56:18.804 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.799+0000 7f9064849640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f906015a260 0x7f90601512f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:18.804 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.799+0000 7f9064849640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f906015a260 0x7f90601512f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.196:38500/0 (socket says 172.21.15.196:38500) 2024-03-17T23:56:18.805 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.799+0000 7f9064849640 1 -- 172.21.15.196:0/1070890370 learned_addr learned my addr 172.21.15.196:0/1070890370 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-03-17T23:56:18.805 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.799+0000 7f905f7fe640 1 --2- 172.21.15.196:0/1070890370 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9060154240 0x7f90600c5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:18.805 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.799+0000 7f905ffff640 1 --2- 172.21.15.196:0/1070890370 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9060072430 0x7f90600c6490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:18.805 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.799+0000 7f9064849640 1 -- 172.21.15.196:0/1070890370 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9060154240 msgr2=0x7f90600c5870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:18.805 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.799+0000 7f9064849640 1 --2- 172.21.15.196:0/1070890370 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9060154240 0x7f90600c5870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:18.805 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.799+0000 7f9064849640 1 -- 172.21.15.196:0/1070890370 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9060072430 msgr2=0x7f90600c6490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:18.805 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.799+0000 7f9064849640 1 --2- 172.21.15.196:0/1070890370 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9060072430 0x7f90600c6490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:18.805 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.799+0000 7f9064849640 1 -- 172.21.15.196:0/1070890370 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90601f3770 con 0x7f906015a260 2024-03-17T23:56:18.805 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.799+0000 7f9064849640 1 --2- 172.21.15.196:0/1070890370 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f906015a260 0x7f90601512f0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f905801ce40 tx=0x7f905801bfb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:56:18.805 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.799+0000 7f905cff9640 1 -- 172.21.15.196:0/1070890370 <== mon.0 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90580b4040 con 0x7f906015a260 2024-03-17T23:56:18.805 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.799+0000 7f905cff9640 1 -- 172.21.15.196:0/1070890370 <== mon.0 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f90580090d0 con 0x7f906015a260 2024-03-17T23:56:18.805 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.799+0000 7f90662ac640 1 -- 172.21.15.196:0/1070890370 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9060155ae0 con 0x7f906015a260 2024-03-17T23:56:18.805 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.799+0000 7f905cff9640 1 -- 172.21.15.196:0/1070890370 <== mon.0 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9058009510 con 0x7f906015a260 2024-03-17T23:56:18.805 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.799+0000 7f90662ac640 1 -- 172.21.15.196:0/1070890370 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90601560a0 con 0x7f906015a260 2024-03-17T23:56:18.806 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.803+0000 7f90662ac640 1 -- 172.21.15.196:0/1070890370 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f90600689a0 con 0x7f906015a260 2024-03-17T23:56:18.806 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.803+0000 7f905cff9640 1 -- 172.21.15.196:0/1070890370 <== mon.0 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 5) ==== 87083+0+0 (secure 0 0 0) 0x7f90580a8d10 con 0x7f906015a260 2024-03-17T23:56:18.806 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.803+0000 7f905cff9640 1 --2- 172.21.15.196:0/1070890370 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f904c067660 0x7f904c069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:56:18.806 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.803+0000 7f905cff9640 1 -- 172.21.15.196:0/1070890370 <== mon.0 v2:172.21.15.196:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f9058122d10 con 0x7f906015a260 2024-03-17T23:56:18.807 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.803+0000 7f905ffff640 1 --2- 172.21.15.196:0/1070890370 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f904c067660 0x7f904c069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:56:18.807 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.803+0000 7f905ffff640 1 --2- 172.21.15.196:0/1070890370 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f904c067660 0x7f904c069b20 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f9050001810 tx=0x7f9050009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:56:18.814 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.811+0000 7f905cff9640 1 -- 172.21.15.196:0/1070890370 <== mon.0 v2:172.21.15.196:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177849 (secure 0 0 0) 0x7f9058018d70 con 0x7f906015a260 2024-03-17T23:56:19.001 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.999+0000 7f90662ac640 1 -- 172.21.15.196:0/1070890370 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f906006fa80 con 0x7f906015a260 2024-03-17T23:56:19.001 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.999+0000 7f905cff9640 1 -- 172.21.15.196:0/1070890370 <== mon.0 v2:172.21.15.196:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v14) ==== 53+0+73 (secure 0 0 0) 0x7f90580f3400 con 0x7f906015a260 2024-03-17T23:56:19.001 INFO:teuthology.orchestra.run.smithi196.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-03-17T23:56:19.003 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.999+0000 7f90662ac640 1 -- 172.21.15.196:0/1070890370 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f904c067660 msgr2=0x7f904c069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:19.003 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.999+0000 7f90662ac640 1 --2- 172.21.15.196:0/1070890370 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f904c067660 0x7f904c069b20 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f9050001810 tx=0x7f9050009040 comp rx=0 tx=0).stop 2024-03-17T23:56:19.003 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.999+0000 7f90662ac640 1 -- 172.21.15.196:0/1070890370 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f906015a260 msgr2=0x7f90601512f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:56:19.003 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.999+0000 7f90662ac640 1 --2- 172.21.15.196:0/1070890370 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f906015a260 0x7f90601512f0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f905801ce40 tx=0x7f905801bfb0 comp rx=0 tx=0).stop 2024-03-17T23:56:19.003 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.999+0000 7f90662ac640 1 -- 172.21.15.196:0/1070890370 shutdown_connections 2024-03-17T23:56:19.004 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.999+0000 7f90662ac640 1 --2- 172.21.15.196:0/1070890370 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f904c067660 0x7f904c069b20 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:19.004 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.999+0000 7f90662ac640 1 --2- 172.21.15.196:0/1070890370 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9060154240 0x7f90600c5870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:19.004 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.999+0000 7f90662ac640 1 --2- 172.21.15.196:0/1070890370 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f906015a260 0x7f90601512f0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:19.004 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.999+0000 7f90662ac640 1 --2- 172.21.15.196:0/1070890370 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9060072430 0x7f90600c6490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:56:19.004 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.999+0000 7f90662ac640 1 -- 172.21.15.196:0/1070890370 >> 172.21.15.196:0/1070890370 conn(0x7f90600cc420 msgr2=0x7f90601534c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-17T23:56:19.004 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.999+0000 7f90662ac640 1 -- 172.21.15.196:0/1070890370 shutdown_connections 2024-03-17T23:56:19.004 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:18.999+0000 7f90662ac640 1 -- 172.21.15.196:0/1070890370 wait complete. 2024-03-17T23:56:19.018 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-03-17T23:56:19.018 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-03-17T23:56:19.019 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi196.front.sepia.ceph.com 2024-03-17T23:56:19.019 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-03-17T23:56:19.019 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-03-17T23:56:19.019 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-03-17T23:56:19.019 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-03-17T23:56:19.019 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-03-17T23:56:19.019 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-03-17T23:56:19.019 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-17T23:56:19.019 DEBUG:teuthology.orchestra.run.smithi196:> ip addr 2024-03-17T23:56:19.024 INFO:teuthology.orchestra.run.smithi196.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-03-17T23:56:19.024 INFO:teuthology.orchestra.run.smithi196.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-03-17T23:56:19.024 INFO:teuthology.orchestra.run.smithi196.stdout: inet 127.0.0.1/8 scope host lo 2024-03-17T23:56:19.024 INFO:teuthology.orchestra.run.smithi196.stdout: valid_lft forever preferred_lft forever 2024-03-17T23:56:19.024 INFO:teuthology.orchestra.run.smithi196.stdout: inet6 ::1/128 scope host 2024-03-17T23:56:19.024 INFO:teuthology.orchestra.run.smithi196.stdout: valid_lft forever preferred_lft forever 2024-03-17T23:56:19.024 INFO:teuthology.orchestra.run.smithi196.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-03-17T23:56:19.024 INFO:teuthology.orchestra.run.smithi196.stdout: link/ether 0c:c4:7a:d9:38:be brd ff:ff:ff:ff:ff:ff 2024-03-17T23:56:19.024 INFO:teuthology.orchestra.run.smithi196.stdout: altname enp7s0f0 2024-03-17T23:56:19.024 INFO:teuthology.orchestra.run.smithi196.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-03-17T23:56:19.025 INFO:teuthology.orchestra.run.smithi196.stdout: link/ether 0c:c4:7a:d9:38:bf brd ff:ff:ff:ff:ff:ff 2024-03-17T23:56:19.025 INFO:teuthology.orchestra.run.smithi196.stdout: altname enp7s0f1 2024-03-17T23:56:19.025 INFO:teuthology.orchestra.run.smithi196.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-03-17T23:56:19.025 INFO:teuthology.orchestra.run.smithi196.stdout: link/ether 0c:c4:7a:88:7f:46 brd ff:ff:ff:ff:ff:ff 2024-03-17T23:56:19.025 INFO:teuthology.orchestra.run.smithi196.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-03-17T23:56:19.025 INFO:teuthology.orchestra.run.smithi196.stdout: link/ether 0c:c4:7a:88:7f:47 brd ff:ff:ff:ff:ff:ff 2024-03-17T23:56:19.025 INFO:teuthology.orchestra.run.smithi196.stdout: inet 172.21.15.196/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-03-17T23:56:19.025 INFO:teuthology.orchestra.run.smithi196.stdout: valid_lft 42479sec preferred_lft 42479sec 2024-03-17T23:56:19.025 INFO:teuthology.orchestra.run.smithi196.stdout: inet6 fe80::ec4:7aff:fe88:7f47/64 scope link 2024-03-17T23:56:19.025 INFO:teuthology.orchestra.run.smithi196.stdout: valid_lft forever preferred_lft forever 2024-03-17T23:56:19.025 INFO:teuthology.orchestra.run.smithi196.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-03-17T23:56:19.025 INFO:teuthology.orchestra.run.smithi196.stdout: link/ether 02:42:6e:00:2e:c1 brd ff:ff:ff:ff:ff:ff 2024-03-17T23:56:19.025 INFO:teuthology.orchestra.run.smithi196.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-03-17T23:56:19.025 INFO:teuthology.orchestra.run.smithi196.stdout: valid_lft forever preferred_lft forever 2024-03-17T23:56:19.026 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-03-17T23:56:19.026 DEBUG:teuthology.orchestra.run.smithi196:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-03-17T23:56:19.026 DEBUG:teuthology.orchestra.run.smithi196:> set -e 2024-03-17T23:56:19.026 DEBUG:teuthology.orchestra.run.smithi196:> sudo ip link add name ceph-brx type bridge 2024-03-17T23:56:19.026 DEBUG:teuthology.orchestra.run.smithi196:> sudo ip addr flush dev ceph-brx 2024-03-17T23:56:19.026 DEBUG:teuthology.orchestra.run.smithi196:> sudo ip link set ceph-brx up 2024-03-17T23:56:19.026 DEBUG:teuthology.orchestra.run.smithi196:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-03-17T23:56:19.026 DEBUG:teuthology.orchestra.run.smithi196:> ') 2024-03-17T23:56:19.102 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:19 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-17T23:56:19.130 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:19 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-17T23:56:19.135 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-17T23:56:19.135 DEBUG:teuthology.orchestra.run.smithi196:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-03-17T23:56:19.188 INFO:teuthology.orchestra.run.smithi196.stdout:1 2024-03-17T23:56:19.189 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-17T23:56:19.189 DEBUG:teuthology.orchestra.run.smithi196:> route 2024-03-17T23:56:19.258 INFO:teuthology.orchestra.run.smithi196.stdout:Kernel IP routing table 2024-03-17T23:56:19.258 INFO:teuthology.orchestra.run.smithi196.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-03-17T23:56:19.258 INFO:teuthology.orchestra.run.smithi196.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-03-17T23:56:19.258 INFO:teuthology.orchestra.run.smithi196.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-03-17T23:56:19.258 INFO:teuthology.orchestra.run.smithi196.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-03-17T23:56:19.258 INFO:teuthology.orchestra.run.smithi196.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-03-17T23:56:19.258 INFO:teuthology.orchestra.run.smithi196.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-03-17T23:56:19.258 INFO:teuthology.orchestra.run.smithi196.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-03-17T23:56:19.258 INFO:teuthology.orchestra.run.smithi196.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-03-17T23:56:19.258 INFO:teuthology.orchestra.run.smithi196.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-03-17T23:56:19.258 INFO:teuthology.orchestra.run.smithi196.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-03-17T23:56:19.259 DEBUG:teuthology.orchestra.run.smithi196:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-03-17T23:56:19.259 DEBUG:teuthology.orchestra.run.smithi196:> set -e 2024-03-17T23:56:19.259 DEBUG:teuthology.orchestra.run.smithi196:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-03-17T23:56:19.259 DEBUG:teuthology.orchestra.run.smithi196:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-03-17T23:56:19.259 DEBUG:teuthology.orchestra.run.smithi196:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-03-17T23:56:19.259 DEBUG:teuthology.orchestra.run.smithi196:> ') 2024-03-17T23:56:19.340 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:19 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-17T23:56:19.360 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:19 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-17T23:56:19.365 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-17T23:56:19.365 DEBUG:teuthology.orchestra.run.smithi196:> ip netns list 2024-03-17T23:56:19.412 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-17T23:56:19.413 DEBUG:teuthology.orchestra.run.smithi196:> ip netns list-id 2024-03-17T23:56:19.459 DEBUG:teuthology.orchestra.run.smithi196:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-03-17T23:56:19.459 DEBUG:teuthology.orchestra.run.smithi196:> set -e 2024-03-17T23:56:19.460 DEBUG:teuthology.orchestra.run.smithi196:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-17T23:56:19.460 DEBUG:teuthology.orchestra.run.smithi196:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-03-17T23:56:19.460 DEBUG:teuthology.orchestra.run.smithi196:> ') 2024-03-17T23:56:19.539 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:19 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-17T23:56:19.554 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:19 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-17T23:56:19.561 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-03-17T23:56:19.561 DEBUG:teuthology.orchestra.run.smithi196:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-03-17T23:56:19.561 DEBUG:teuthology.orchestra.run.smithi196:> set -e 2024-03-17T23:56:19.561 DEBUG:teuthology.orchestra.run.smithi196:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-03-17T23:56:19.561 DEBUG:teuthology.orchestra.run.smithi196:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-03-17T23:56:19.561 DEBUG:teuthology.orchestra.run.smithi196:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-03-17T23:56:19.561 DEBUG:teuthology.orchestra.run.smithi196:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-03-17T23:56:19.561 DEBUG:teuthology.orchestra.run.smithi196:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-03-17T23:56:19.561 DEBUG:teuthology.orchestra.run.smithi196:> ') 2024-03-17T23:56:19.639 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:19 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-17T23:56:19.702 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:19 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-17T23:56:19.708 DEBUG:teuthology.orchestra.run.smithi196:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-03-17T23:56:19.708 DEBUG:teuthology.orchestra.run.smithi196:> set -e 2024-03-17T23:56:19.708 DEBUG:teuthology.orchestra.run.smithi196:> sudo ip link set brx.0 up 2024-03-17T23:56:19.708 DEBUG:teuthology.orchestra.run.smithi196:> sudo ip link set dev brx.0 master ceph-brx 2024-03-17T23:56:19.708 DEBUG:teuthology.orchestra.run.smithi196:> ') 2024-03-17T23:56:19.787 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:19 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-17T23:56:19.800 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:19 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-17T23:56:19.806 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-03-17T23:56:19.806 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-17T23:56:19.806 DEBUG:teuthology.orchestra.run.smithi196:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-03-17T23:56:19.852 INFO:teuthology.orchestra.run.smithi196.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-03-17T23:56:19.852 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-17T23:56:19.852 DEBUG:teuthology.orchestra.run.smithi196:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-03-17T23:56:19.895 DEBUG:teuthology.orchestra.run.smithi196:> sudo modprobe fuse 2024-03-17T23:56:19.946 DEBUG:teuthology.orchestra.run.smithi196:> cat /proc/self/mounts | awk '{print $2}' 2024-03-17T23:56:19.992 INFO:teuthology.orchestra.run.smithi196.stdout:/sys 2024-03-17T23:56:19.992 INFO:teuthology.orchestra.run.smithi196.stdout:/proc 2024-03-17T23:56:19.992 INFO:teuthology.orchestra.run.smithi196.stdout:/dev 2024-03-17T23:56:19.992 INFO:teuthology.orchestra.run.smithi196.stdout:/dev/pts 2024-03-17T23:56:19.992 INFO:teuthology.orchestra.run.smithi196.stdout:/run 2024-03-17T23:56:19.992 INFO:teuthology.orchestra.run.smithi196.stdout:/ 2024-03-17T23:56:19.993 INFO:teuthology.orchestra.run.smithi196.stdout:/sys/kernel/security 2024-03-17T23:56:19.993 INFO:teuthology.orchestra.run.smithi196.stdout:/dev/shm 2024-03-17T23:56:19.993 INFO:teuthology.orchestra.run.smithi196.stdout:/run/lock 2024-03-17T23:56:19.993 INFO:teuthology.orchestra.run.smithi196.stdout:/sys/fs/cgroup 2024-03-17T23:56:19.993 INFO:teuthology.orchestra.run.smithi196.stdout:/sys/fs/pstore 2024-03-17T23:56:19.993 INFO:teuthology.orchestra.run.smithi196.stdout:/sys/fs/bpf 2024-03-17T23:56:19.993 INFO:teuthology.orchestra.run.smithi196.stdout:/proc/sys/fs/binfmt_misc 2024-03-17T23:56:19.993 INFO:teuthology.orchestra.run.smithi196.stdout:/dev/hugepages 2024-03-17T23:56:19.993 INFO:teuthology.orchestra.run.smithi196.stdout:/dev/mqueue 2024-03-17T23:56:19.993 INFO:teuthology.orchestra.run.smithi196.stdout:/sys/kernel/debug 2024-03-17T23:56:19.993 INFO:teuthology.orchestra.run.smithi196.stdout:/sys/kernel/tracing 2024-03-17T23:56:19.993 INFO:teuthology.orchestra.run.smithi196.stdout:/proc/fs/nfsd 2024-03-17T23:56:19.993 INFO:teuthology.orchestra.run.smithi196.stdout:/sys/fs/fuse/connections 2024-03-17T23:56:19.993 INFO:teuthology.orchestra.run.smithi196.stdout:/sys/kernel/config 2024-03-17T23:56:19.994 INFO:teuthology.orchestra.run.smithi196.stdout:/run/credentials/systemd-sysusers.service 2024-03-17T23:56:19.994 INFO:teuthology.orchestra.run.smithi196.stdout:/run/rpc_pipefs 2024-03-17T23:56:19.994 INFO:teuthology.orchestra.run.smithi196.stdout:/run/user/1000 2024-03-17T23:56:19.994 INFO:teuthology.orchestra.run.smithi196.stdout:/var/lib/ceph 2024-03-17T23:56:19.994 INFO:teuthology.orchestra.run.smithi196.stdout:/var/lib/ceph/osd/ceph-0 2024-03-17T23:56:19.994 INFO:teuthology.orchestra.run.smithi196.stdout:/var/lib/ceph/osd/ceph-1 2024-03-17T23:56:19.994 INFO:teuthology.orchestra.run.smithi196.stdout:/var/lib/ceph/osd/ceph-2 2024-03-17T23:56:19.994 INFO:teuthology.orchestra.run.smithi196.stdout:/var/lib/ceph/osd/ceph-3 2024-03-17T23:56:19.994 INFO:teuthology.orchestra.run.smithi196.stdout:/run/netns 2024-03-17T23:56:19.994 INFO:teuthology.orchestra.run.smithi196.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-17T23:56:19.994 INFO:teuthology.orchestra.run.smithi196.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-17T23:56:19.994 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-17T23:56:19.995 DEBUG:teuthology.orchestra.run.smithi196:> ls /sys/fs/fuse/connections 2024-03-17T23:56:20.043 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-03-17T23:56:20.044 DEBUG:teuthology.orchestra.run.smithi196:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-03-17T23:56:20.085 DEBUG:teuthology.orchestra.run.smithi196:> sudo modprobe fuse 2024-03-17T23:56:20.094 DEBUG:teuthology.orchestra.run.smithi196:> cat /proc/self/mounts | awk '{print $2}' 2024-03-17T23:56:20.141 INFO:teuthology.orchestra.run.smithi196.stdout:/sys 2024-03-17T23:56:20.141 INFO:teuthology.orchestra.run.smithi196.stdout:/proc 2024-03-17T23:56:20.141 INFO:teuthology.orchestra.run.smithi196.stdout:/dev 2024-03-17T23:56:20.141 INFO:teuthology.orchestra.run.smithi196.stdout:/dev/pts 2024-03-17T23:56:20.142 INFO:teuthology.orchestra.run.smithi196.stdout:/run 2024-03-17T23:56:20.142 INFO:teuthology.orchestra.run.smithi196.stdout:/ 2024-03-17T23:56:20.142 INFO:teuthology.orchestra.run.smithi196.stdout:/sys/kernel/security 2024-03-17T23:56:20.142 INFO:teuthology.orchestra.run.smithi196.stdout:/dev/shm 2024-03-17T23:56:20.142 INFO:teuthology.orchestra.run.smithi196.stdout:/run/lock 2024-03-17T23:56:20.142 INFO:teuthology.orchestra.run.smithi196.stdout:/sys/fs/cgroup 2024-03-17T23:56:20.142 INFO:teuthology.orchestra.run.smithi196.stdout:/sys/fs/pstore 2024-03-17T23:56:20.142 INFO:teuthology.orchestra.run.smithi196.stdout:/sys/fs/bpf 2024-03-17T23:56:20.142 INFO:teuthology.orchestra.run.smithi196.stdout:/proc/sys/fs/binfmt_misc 2024-03-17T23:56:20.142 INFO:teuthology.orchestra.run.smithi196.stdout:/dev/hugepages 2024-03-17T23:56:20.142 INFO:teuthology.orchestra.run.smithi196.stdout:/dev/mqueue 2024-03-17T23:56:20.142 INFO:teuthology.orchestra.run.smithi196.stdout:/sys/kernel/debug 2024-03-17T23:56:20.142 INFO:teuthology.orchestra.run.smithi196.stdout:/sys/kernel/tracing 2024-03-17T23:56:20.143 INFO:teuthology.orchestra.run.smithi196.stdout:/proc/fs/nfsd 2024-03-17T23:56:20.143 INFO:teuthology.orchestra.run.smithi196.stdout:/sys/fs/fuse/connections 2024-03-17T23:56:20.143 INFO:teuthology.orchestra.run.smithi196.stdout:/sys/kernel/config 2024-03-17T23:56:20.143 INFO:teuthology.orchestra.run.smithi196.stdout:/run/credentials/systemd-sysusers.service 2024-03-17T23:56:20.143 INFO:teuthology.orchestra.run.smithi196.stdout:/run/rpc_pipefs 2024-03-17T23:56:20.143 INFO:teuthology.orchestra.run.smithi196.stdout:/run/user/1000 2024-03-17T23:56:20.143 INFO:teuthology.orchestra.run.smithi196.stdout:/var/lib/ceph 2024-03-17T23:56:20.143 INFO:teuthology.orchestra.run.smithi196.stdout:/var/lib/ceph/osd/ceph-0 2024-03-17T23:56:20.143 INFO:teuthology.orchestra.run.smithi196.stdout:/var/lib/ceph/osd/ceph-1 2024-03-17T23:56:20.143 INFO:teuthology.orchestra.run.smithi196.stdout:/var/lib/ceph/osd/ceph-2 2024-03-17T23:56:20.143 INFO:teuthology.orchestra.run.smithi196.stdout:/var/lib/ceph/osd/ceph-3 2024-03-17T23:56:20.143 INFO:teuthology.orchestra.run.smithi196.stdout:/run/netns 2024-03-17T23:56:20.144 INFO:teuthology.orchestra.run.smithi196.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-17T23:56:20.144 INFO:teuthology.orchestra.run.smithi196.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-17T23:56:20.144 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-17T23:56:20.144 DEBUG:teuthology.orchestra.run.smithi196:> ls /sys/fs/fuse/connections 2024-03-17T23:56:20.163 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi196.stderr:2024-03-17T23:56:20.159+0000 7f172fce3580 -1 init, newargv = 0x5643930f8040 newargc=15 2024-03-17T23:56:20.163 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi196.stderr:ceph-fuse[33383]: starting ceph client 2024-03-17T23:56:20.179 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi196.stderr:ceph-fuse[33383]: starting fuse 2024-03-17T23:56:21.267 DEBUG:teuthology.orchestra.run.smithi196:> sudo modprobe fuse 2024-03-17T23:56:21.279 DEBUG:teuthology.orchestra.run.smithi196:> cat /proc/self/mounts | awk '{print $2}' 2024-03-17T23:56:21.324 INFO:teuthology.orchestra.run.smithi196.stdout:/sys 2024-03-17T23:56:21.324 INFO:teuthology.orchestra.run.smithi196.stdout:/proc 2024-03-17T23:56:21.325 INFO:teuthology.orchestra.run.smithi196.stdout:/dev 2024-03-17T23:56:21.325 INFO:teuthology.orchestra.run.smithi196.stdout:/dev/pts 2024-03-17T23:56:21.325 INFO:teuthology.orchestra.run.smithi196.stdout:/run 2024-03-17T23:56:21.325 INFO:teuthology.orchestra.run.smithi196.stdout:/ 2024-03-17T23:56:21.325 INFO:teuthology.orchestra.run.smithi196.stdout:/sys/kernel/security 2024-03-17T23:56:21.325 INFO:teuthology.orchestra.run.smithi196.stdout:/dev/shm 2024-03-17T23:56:21.325 INFO:teuthology.orchestra.run.smithi196.stdout:/run/lock 2024-03-17T23:56:21.325 INFO:teuthology.orchestra.run.smithi196.stdout:/sys/fs/cgroup 2024-03-17T23:56:21.325 INFO:teuthology.orchestra.run.smithi196.stdout:/sys/fs/pstore 2024-03-17T23:56:21.325 INFO:teuthology.orchestra.run.smithi196.stdout:/sys/fs/bpf 2024-03-17T23:56:21.325 INFO:teuthology.orchestra.run.smithi196.stdout:/proc/sys/fs/binfmt_misc 2024-03-17T23:56:21.326 INFO:teuthology.orchestra.run.smithi196.stdout:/dev/hugepages 2024-03-17T23:56:21.326 INFO:teuthology.orchestra.run.smithi196.stdout:/dev/mqueue 2024-03-17T23:56:21.326 INFO:teuthology.orchestra.run.smithi196.stdout:/sys/kernel/debug 2024-03-17T23:56:21.326 INFO:teuthology.orchestra.run.smithi196.stdout:/sys/kernel/tracing 2024-03-17T23:56:21.326 INFO:teuthology.orchestra.run.smithi196.stdout:/proc/fs/nfsd 2024-03-17T23:56:21.326 INFO:teuthology.orchestra.run.smithi196.stdout:/sys/fs/fuse/connections 2024-03-17T23:56:21.326 INFO:teuthology.orchestra.run.smithi196.stdout:/sys/kernel/config 2024-03-17T23:56:21.326 INFO:teuthology.orchestra.run.smithi196.stdout:/run/credentials/systemd-sysusers.service 2024-03-17T23:56:21.326 INFO:teuthology.orchestra.run.smithi196.stdout:/run/rpc_pipefs 2024-03-17T23:56:21.327 INFO:teuthology.orchestra.run.smithi196.stdout:/run/user/1000 2024-03-17T23:56:21.327 INFO:teuthology.orchestra.run.smithi196.stdout:/var/lib/ceph 2024-03-17T23:56:21.327 INFO:teuthology.orchestra.run.smithi196.stdout:/var/lib/ceph/osd/ceph-0 2024-03-17T23:56:21.327 INFO:teuthology.orchestra.run.smithi196.stdout:/var/lib/ceph/osd/ceph-1 2024-03-17T23:56:21.327 INFO:teuthology.orchestra.run.smithi196.stdout:/var/lib/ceph/osd/ceph-2 2024-03-17T23:56:21.327 INFO:teuthology.orchestra.run.smithi196.stdout:/var/lib/ceph/osd/ceph-3 2024-03-17T23:56:21.327 INFO:teuthology.orchestra.run.smithi196.stdout:/run/netns 2024-03-17T23:56:21.327 INFO:teuthology.orchestra.run.smithi196.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-17T23:56:21.327 INFO:teuthology.orchestra.run.smithi196.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-17T23:56:21.327 INFO:teuthology.orchestra.run.smithi196.stdout:/home/ubuntu/cephtest/mnt.0 2024-03-17T23:56:21.328 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-17T23:56:21.328 DEBUG:teuthology.orchestra.run.smithi196:> ls /sys/fs/fuse/connections 2024-03-17T23:56:21.372 INFO:teuthology.orchestra.run.smithi196.stdout:45 2024-03-17T23:56:21.372 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45] 2024-03-17T23:56:21.372 DEBUG:teuthology.orchestra.run.smithi196:> sudo stdin-killer -- python3 -c ' 2024-03-17T23:56:21.372 DEBUG:teuthology.orchestra.run.smithi196:> import glob 2024-03-17T23:56:21.373 DEBUG:teuthology.orchestra.run.smithi196:> import re 2024-03-17T23:56:21.373 DEBUG:teuthology.orchestra.run.smithi196:> import os 2024-03-17T23:56:21.373 DEBUG:teuthology.orchestra.run.smithi196:> import subprocess 2024-03-17T23:56:21.373 DEBUG:teuthology.orchestra.run.smithi196:> 2024-03-17T23:56:21.373 DEBUG:teuthology.orchestra.run.smithi196:> def _find_admin_socket(client_name): 2024-03-17T23:56:21.373 DEBUG:teuthology.orchestra.run.smithi196:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-03-17T23:56:21.373 DEBUG:teuthology.orchestra.run.smithi196:> files = glob.glob(asok_path) 2024-03-17T23:56:21.373 DEBUG:teuthology.orchestra.run.smithi196:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-03-17T23:56:21.373 DEBUG:teuthology.orchestra.run.smithi196:> 2024-03-17T23:56:21.373 DEBUG:teuthology.orchestra.run.smithi196:> # Given a non-glob path, it better be there 2024-03-17T23:56:21.373 DEBUG:teuthology.orchestra.run.smithi196:> if "*" not in asok_path: 2024-03-17T23:56:21.373 DEBUG:teuthology.orchestra.run.smithi196:> assert(len(files) == 1) 2024-03-17T23:56:21.373 DEBUG:teuthology.orchestra.run.smithi196:> return files[0] 2024-03-17T23:56:21.373 DEBUG:teuthology.orchestra.run.smithi196:> 2024-03-17T23:56:21.373 DEBUG:teuthology.orchestra.run.smithi196:> for f in files: 2024-03-17T23:56:21.373 DEBUG:teuthology.orchestra.run.smithi196:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-03-17T23:56:21.374 DEBUG:teuthology.orchestra.run.smithi196:> if os.path.exists("/proc/{0}".format(pid)): 2024-03-17T23:56:21.374 DEBUG:teuthology.orchestra.run.smithi196:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-03-17T23:56:21.374 DEBUG:teuthology.orchestra.run.smithi196:> contents = proc_f.read() 2024-03-17T23:56:21.374 DEBUG:teuthology.orchestra.run.smithi196:> if mountpoint in contents: 2024-03-17T23:56:21.374 DEBUG:teuthology.orchestra.run.smithi196:> return f 2024-03-17T23:56:21.374 DEBUG:teuthology.orchestra.run.smithi196:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-03-17T23:56:21.374 DEBUG:teuthology.orchestra.run.smithi196:> 2024-03-17T23:56:21.374 DEBUG:teuthology.orchestra.run.smithi196:> print(_find_admin_socket("client.0")) 2024-03-17T23:56:21.374 DEBUG:teuthology.orchestra.run.smithi196:> ' 2024-03-17T23:56:21.486 INFO:teuthology.orchestra.run.smithi196.stdout:/var/run/ceph/ceph-client.0.33383.asok 2024-03-17T23:56:21.489 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:56:21 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-17T23:56:21.496 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.33383.asok 2024-03-17T23:56:21.496 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-17T23:56:21.496 DEBUG:teuthology.orchestra.run.smithi196:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.33383.asok status 2024-03-17T23:56:21.641 INFO:teuthology.orchestra.run.smithi196.stdout:{ 2024-03-17T23:56:21.641 INFO:teuthology.orchestra.run.smithi196.stdout: "metadata": { 2024-03-17T23:56:21.641 INFO:teuthology.orchestra.run.smithi196.stdout: "ceph_sha1": "3d78f5ba07bf18880172c07d4d7b4ac00c9d30af", 2024-03-17T23:56:21.641 INFO:teuthology.orchestra.run.smithi196.stdout: "ceph_version": "ceph version 19.0.0-2162-g3d78f5ba (3d78f5ba07bf18880172c07d4d7b4ac00c9d30af) squid (dev)", 2024-03-17T23:56:21.641 INFO:teuthology.orchestra.run.smithi196.stdout: "entity_id": "0", 2024-03-17T23:56:21.642 INFO:teuthology.orchestra.run.smithi196.stdout: "hostname": "smithi196", 2024-03-17T23:56:21.642 INFO:teuthology.orchestra.run.smithi196.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-03-17T23:56:21.642 INFO:teuthology.orchestra.run.smithi196.stdout: "pid": "33383", 2024-03-17T23:56:21.642 INFO:teuthology.orchestra.run.smithi196.stdout: "root": "/" 2024-03-17T23:56:21.642 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-03-17T23:56:21.642 INFO:teuthology.orchestra.run.smithi196.stdout: "dentry_count": 0, 2024-03-17T23:56:21.642 INFO:teuthology.orchestra.run.smithi196.stdout: "dentry_pinned_count": 0, 2024-03-17T23:56:21.642 INFO:teuthology.orchestra.run.smithi196.stdout: "id": 4812, 2024-03-17T23:56:21.642 INFO:teuthology.orchestra.run.smithi196.stdout: "inst": { 2024-03-17T23:56:21.642 INFO:teuthology.orchestra.run.smithi196.stdout: "name": { 2024-03-17T23:56:21.642 INFO:teuthology.orchestra.run.smithi196.stdout: "type": "client", 2024-03-17T23:56:21.643 INFO:teuthology.orchestra.run.smithi196.stdout: "num": 4812 2024-03-17T23:56:21.643 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-03-17T23:56:21.643 INFO:teuthology.orchestra.run.smithi196.stdout: "addr": { 2024-03-17T23:56:21.643 INFO:teuthology.orchestra.run.smithi196.stdout: "type": "v1", 2024-03-17T23:56:21.643 INFO:teuthology.orchestra.run.smithi196.stdout: "addr": "192.168.0.1:0", 2024-03-17T23:56:21.643 INFO:teuthology.orchestra.run.smithi196.stdout: "nonce": 952477843 2024-03-17T23:56:21.643 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-03-17T23:56:21.643 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-03-17T23:56:21.643 INFO:teuthology.orchestra.run.smithi196.stdout: "addr": { 2024-03-17T23:56:21.643 INFO:teuthology.orchestra.run.smithi196.stdout: "type": "v1", 2024-03-17T23:56:21.643 INFO:teuthology.orchestra.run.smithi196.stdout: "addr": "192.168.0.1:0", 2024-03-17T23:56:21.643 INFO:teuthology.orchestra.run.smithi196.stdout: "nonce": 952477843 2024-03-17T23:56:21.643 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-03-17T23:56:21.643 INFO:teuthology.orchestra.run.smithi196.stdout: "inst_str": "client.4812 192.168.0.1:0/952477843", 2024-03-17T23:56:21.644 INFO:teuthology.orchestra.run.smithi196.stdout: "addr_str": "192.168.0.1:0/952477843", 2024-03-17T23:56:21.644 INFO:teuthology.orchestra.run.smithi196.stdout: "inode_count": 1, 2024-03-17T23:56:21.644 INFO:teuthology.orchestra.run.smithi196.stdout: "mds_epoch": 14, 2024-03-17T23:56:21.644 INFO:teuthology.orchestra.run.smithi196.stdout: "osd_epoch": 21, 2024-03-17T23:56:21.644 INFO:teuthology.orchestra.run.smithi196.stdout: "osd_epoch_barrier": 0, 2024-03-17T23:56:21.644 INFO:teuthology.orchestra.run.smithi196.stdout: "blocklisted": false, 2024-03-17T23:56:21.644 INFO:teuthology.orchestra.run.smithi196.stdout: "fs_name": "cephfs" 2024-03-17T23:56:21.644 INFO:teuthology.orchestra.run.smithi196.stdout:} 2024-03-17T23:56:21.653 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-17T23:56:21.653 DEBUG:teuthology.orchestra.run.smithi196:> stat --file-system '--printf=%T 2024-03-17T23:56:21.654 DEBUG:teuthology.orchestra.run.smithi196:> ' -- /home/ubuntu/cephtest/mnt.0 2024-03-17T23:56:21.659 INFO:teuthology.orchestra.run.smithi196.stdout:fuseblk 2024-03-17T23:56:21.659 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-03-17T23:56:21.659 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-17T23:56:21.660 DEBUG:teuthology.orchestra.run.smithi196:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-03-17T23:56:21.712 INFO:teuthology.run_tasks:Running task workunit... 2024-03-17T23:56:21.724 INFO:tasks.workunit:Pulling workunits from ref c382027d5c66ef4e0aa1131ea3e8080c658d3184 2024-03-17T23:56:21.724 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-03-17T23:56:21.724 INFO:tasks.workunit:timeout=6h 2024-03-17T23:56:21.724 INFO:tasks.workunit:cleanup=True 2024-03-17T23:56:21.725 DEBUG:teuthology.orchestra.run.smithi196:> stat -- /home/ubuntu/cephtest/mnt.0 2024-03-17T23:56:21.762 INFO:teuthology.orchestra.run.smithi196.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-03-17T23:56:21.762 INFO:teuthology.orchestra.run.smithi196.stdout: Size: 0 Blocks: 1 IO Block: 4194304 directory 2024-03-17T23:56:21.762 INFO:teuthology.orchestra.run.smithi196.stdout:Device: 2dh/45d Inode: 1 Links: 2 2024-03-17T23:56:21.762 INFO:teuthology.orchestra.run.smithi196.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-17T23:56:21.762 INFO:teuthology.orchestra.run.smithi196.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-03-17T23:56:21.762 INFO:teuthology.orchestra.run.smithi196.stdout:Modify: 2024-03-17 23:56:01.649394985 +0000 2024-03-17T23:56:21.762 INFO:teuthology.orchestra.run.smithi196.stdout:Change: 2024-03-17 23:56:21.711409217 +0000 2024-03-17T23:56:21.762 INFO:teuthology.orchestra.run.smithi196.stdout: Birth: - 2024-03-17T23:56:21.762 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-03-17T23:56:21.762 DEBUG:teuthology.orchestra.run.smithi196:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-03-17T23:56:21.826 DEBUG:teuthology.orchestra.run.smithi196:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/batrick/ceph /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout c382027d5c66ef4e0aa1131ea3e8080c658d3184 2024-03-17T23:56:21.873 INFO:tasks.workunit.client.0.smithi196.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-03-17T23:56:36.677 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T23:56:36.679 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T23:57:06.741 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T23:57:06.743 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T23:57:21.987 INFO:tasks.workunit.client.0.smithi196.stderr:Note: switching to 'c382027d5c66ef4e0aa1131ea3e8080c658d3184'. 2024-03-17T23:57:21.987 INFO:tasks.workunit.client.0.smithi196.stderr: 2024-03-17T23:57:21.987 INFO:tasks.workunit.client.0.smithi196.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-03-17T23:57:21.987 INFO:tasks.workunit.client.0.smithi196.stderr:changes and commit them, and you can discard any commits you make in this 2024-03-17T23:57:21.987 INFO:tasks.workunit.client.0.smithi196.stderr:state without impacting any branches by switching back to a branch. 2024-03-17T23:57:21.987 INFO:tasks.workunit.client.0.smithi196.stderr: 2024-03-17T23:57:21.987 INFO:tasks.workunit.client.0.smithi196.stderr:If you want to create a new branch to retain commits you create, you may 2024-03-17T23:57:21.988 INFO:tasks.workunit.client.0.smithi196.stderr:do so (now or later) by using -c with the switch command. Example: 2024-03-17T23:57:21.988 INFO:tasks.workunit.client.0.smithi196.stderr: 2024-03-17T23:57:21.988 INFO:tasks.workunit.client.0.smithi196.stderr: git switch -c 2024-03-17T23:57:21.988 INFO:tasks.workunit.client.0.smithi196.stderr: 2024-03-17T23:57:21.988 INFO:tasks.workunit.client.0.smithi196.stderr:Or undo this operation with: 2024-03-17T23:57:21.988 INFO:tasks.workunit.client.0.smithi196.stderr: 2024-03-17T23:57:21.988 INFO:tasks.workunit.client.0.smithi196.stderr: git switch - 2024-03-17T23:57:21.988 INFO:tasks.workunit.client.0.smithi196.stderr: 2024-03-17T23:57:21.988 INFO:tasks.workunit.client.0.smithi196.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-03-17T23:57:21.988 INFO:tasks.workunit.client.0.smithi196.stderr: 2024-03-17T23:57:21.988 INFO:tasks.workunit.client.0.smithi196.stderr:HEAD is now at c382027d5c6 ignorelist mon down 2024-03-17T23:57:21.993 DEBUG:teuthology.orchestra.run.smithi196:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-03-17T23:57:22.000 INFO:tasks.workunit.client.0.smithi196.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-03-17T23:57:22.001 INFO:tasks.workunit.client.0.smithi196.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-03-17T23:57:22.001 INFO:tasks.workunit.client.0.smithi196.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-03-17T23:57:22.716 INFO:tasks.workunit.client.0.smithi196.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-03-17T23:57:22.786 INFO:tasks.workunit.client.0.smithi196.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-03-17T23:57:22.832 INFO:tasks.workunit.client.0.smithi196.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-03-17T23:57:22.833 INFO:tasks.workunit.client.0.smithi196.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-03-17T23:57:22.833 INFO:tasks.workunit.client.0.smithi196.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-03-17T23:57:22.870 INFO:tasks.workunit.client.0.smithi196.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-03-17T23:57:22.873 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2024-03-17T23:57:22.873 DEBUG:teuthology.orchestra.run.smithi196:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-03-17T23:57:22.922 INFO:tasks.workunit:Running workunits matching suites/fsstress.sh on client.0... 2024-03-17T23:57:22.924 INFO:tasks.workunit:Running workunit suites/fsstress.sh... 2024-03-17T23:57:22.924 DEBUG:teuthology.orchestra.run.smithi196:workunit test suites/fsstress.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=c382027d5c66ef4e0aa1131ea3e8080c658d3184 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/fsstress.sh 2024-03-17T23:57:22.977 INFO:tasks.workunit.client.0.smithi196.stderr:+ mkdir -p fsstress 2024-03-17T23:57:22.979 INFO:tasks.workunit.client.0.smithi196.stderr:+ pushd fsstress 2024-03-17T23:57:22.981 INFO:tasks.workunit.client.0.smithi196.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-03-17T23:57:22.981 INFO:tasks.workunit.client.0.smithi196.stderr:+ wget -q -O ltp-full.tgz http://download.ceph.com/qa/ltp-full-20091231.tgz 2024-03-17T23:57:23.540 INFO:tasks.workunit.client.0.smithi196.stderr:+ tar xzf ltp-full.tgz 2024-03-17T23:57:36.881 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T23:57:36.884 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T23:58:06.925 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T23:58:06.928 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T23:58:07.176 INFO:tasks.workunit.client.0.smithi196.stderr:+ pushd ltp-full-20091231/testcases/kernel/fs/fsstress 2024-03-17T23:58:07.182 INFO:tasks.workunit.client.0.smithi196.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress ~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-03-17T23:58:07.182 INFO:tasks.workunit.client.0.smithi196.stderr:+ make 2024-03-17T23:58:07.651 INFO:tasks.workunit.client.0.smithi196.stdout:cc -DNO_XFS -I/home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress -D_LARGEFILE64_SOURCE -D_GNU_SOURCE -I../../../../include -I../../../../include -L../../../../lib fsstress.c -o fsstress 2024-03-17T23:58:10.436 INFO:tasks.workunit.client.0.smithi196.stderr:++ readlink -f fsstress 2024-03-17T23:58:10.438 INFO:tasks.workunit.client.0.smithi196.stderr:+ BIN=/home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress 2024-03-17T23:58:10.438 INFO:tasks.workunit.client.0.smithi196.stderr:+ popd 2024-03-17T23:58:10.439 INFO:tasks.workunit.client.0.smithi196.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-03-17T23:58:10.439 INFO:tasks.workunit.client.0.smithi196.stderr:+ popd 2024-03-17T23:58:10.440 INFO:tasks.workunit.client.0.smithi196.stdout:~/cephtest/mnt.0/client.0/tmp 2024-03-17T23:58:10.440 INFO:tasks.workunit.client.0.smithi196.stderr:++ mktemp -d -p . 2024-03-17T23:58:10.442 INFO:tasks.workunit.client.0.smithi196.stderr:+ T=./tmp.6KLhVFM3Bq 2024-03-17T23:58:10.443 INFO:tasks.workunit.client.0.smithi196.stderr:+ /home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress -d ./tmp.6KLhVFM3Bq -l 1 -n 1000 -p 10 -v 2024-03-17T23:58:10.447 INFO:tasks.workunit.client.0.smithi196.stdout:seed = 1710316514 2024-03-17T23:58:10.451 INFO:tasks.workunit.client.0.smithi196.stdout:0/0: chown . 967315 1 2024-03-17T23:58:10.453 INFO:tasks.workunit.client.0.smithi196.stdout:1/0: dread - no filename 2024-03-17T23:58:10.453 INFO:tasks.workunit.client.0.smithi196.stdout:1/1: stat - no entries 2024-03-17T23:58:10.454 INFO:tasks.workunit.client.0.smithi196.stdout:0/1: symlink l0 0 2024-03-17T23:58:10.454 INFO:tasks.workunit.client.0.smithi196.stdout:2/0: write - no filename 2024-03-17T23:58:10.456 INFO:tasks.workunit.client.0.smithi196.stdout:1/2: creat f0 x:0 0 0 2024-03-17T23:58:10.457 INFO:tasks.workunit.client.0.smithi196.stdout:3/0: chown . 182632 1 2024-03-17T23:58:10.457 INFO:tasks.workunit.client.0.smithi196.stdout:3/1: readlink - no filename 2024-03-17T23:58:10.457 INFO:tasks.workunit.client.0.smithi196.stdout:3/2: write - no filename 2024-03-17T23:58:10.457 INFO:tasks.workunit.client.0.smithi196.stdout:3/3: link - no file 2024-03-17T23:58:10.457 INFO:tasks.workunit.client.0.smithi196.stdout:0/2: rename l0 to l1 0 2024-03-17T23:58:10.458 INFO:tasks.workunit.client.0.smithi196.stdout:0/3: write - no filename 2024-03-17T23:58:10.459 INFO:tasks.workunit.client.0.smithi196.stdout:2/1: creat f0 x:0 0 0 2024-03-17T23:58:10.460 INFO:tasks.workunit.client.0.smithi196.stdout:4/0: chown . 410431 1 2024-03-17T23:58:10.460 INFO:tasks.workunit.client.0.smithi196.stdout:4/1: write - no filename 2024-03-17T23:58:10.460 INFO:tasks.workunit.client.0.smithi196.stdout:4/2: dread - no filename 2024-03-17T23:58:10.461 INFO:tasks.workunit.client.0.smithi196.stdout:4/3: chown . 7721034 1 2024-03-17T23:58:10.461 INFO:tasks.workunit.client.0.smithi196.stdout:4/4: write - no filename 2024-03-17T23:58:10.463 INFO:tasks.workunit.client.0.smithi196.stdout:3/4: symlink l0 0 2024-03-17T23:58:10.463 INFO:tasks.workunit.client.0.smithi196.stdout:2/2: mknod c1 0 2024-03-17T23:58:10.463 INFO:tasks.workunit.client.0.smithi196.stdout:5/0: dread - no filename 2024-03-17T23:58:10.465 INFO:tasks.workunit.client.0.smithi196.stdout:7/0: truncate - no filename 2024-03-17T23:58:10.465 INFO:tasks.workunit.client.0.smithi196.stdout:7/1: write - no filename 2024-03-17T23:58:10.466 INFO:tasks.workunit.client.0.smithi196.stdout:4/5: creat f0 x:0 0 0 2024-03-17T23:58:10.469 INFO:tasks.workunit.client.0.smithi196.stdout:3/5: unlink l0 0 2024-03-17T23:58:10.475 INFO:tasks.workunit.client.0.smithi196.stdout:1/3: dwrite f0 [0,4194304] 0 2024-03-17T23:58:10.476 INFO:tasks.workunit.client.0.smithi196.stdout:1/4: rmdir - no directory 2024-03-17T23:58:10.479 INFO:tasks.workunit.client.0.smithi196.stdout:2/3: dwrite f0 [0,4194304] 0 2024-03-17T23:58:10.488 INFO:tasks.workunit.client.0.smithi196.stdout:5/1: creat f0 x:0 0 0 2024-03-17T23:58:10.488 INFO:tasks.workunit.client.0.smithi196.stdout:9/0: unlink - no file 2024-03-17T23:58:10.488 INFO:tasks.workunit.client.0.smithi196.stdout:9/1: chown . 972 1 2024-03-17T23:58:10.502 INFO:tasks.workunit.client.0.smithi196.stdout:4/6: mkdir d1 0 2024-03-17T23:58:10.503 INFO:tasks.workunit.client.0.smithi196.stdout:4/7: dread - f0 zero size 2024-03-17T23:58:10.504 INFO:tasks.workunit.client.0.smithi196.stdout:3/6: mknod c1 0 2024-03-17T23:58:10.505 INFO:tasks.workunit.client.0.smithi196.stdout:3/7: chown c1 55317 1 2024-03-17T23:58:10.505 INFO:tasks.workunit.client.0.smithi196.stdout:3/8: fsync - no filename 2024-03-17T23:58:10.506 INFO:tasks.workunit.client.0.smithi196.stdout:1/5: mkdir d1 0 2024-03-17T23:58:10.508 INFO:tasks.workunit.client.0.smithi196.stdout:2/4: creat f2 x:0 0 0 2024-03-17T23:58:10.510 INFO:tasks.workunit.client.0.smithi196.stdout:8/0: chown . 83 1 2024-03-17T23:58:10.510 INFO:tasks.workunit.client.0.smithi196.stdout:8/1: unlink - no file 2024-03-17T23:58:10.510 INFO:tasks.workunit.client.0.smithi196.stdout:8/2: readlink - no filename 2024-03-17T23:58:10.510 INFO:tasks.workunit.client.0.smithi196.stdout:8/3: truncate - no filename 2024-03-17T23:58:10.510 INFO:tasks.workunit.client.0.smithi196.stdout:8/4: rename - no filename 2024-03-17T23:58:10.510 INFO:tasks.workunit.client.0.smithi196.stdout:8/5: dread - no filename 2024-03-17T23:58:10.511 INFO:tasks.workunit.client.0.smithi196.stdout:5/2: creat f1 x:0 0 0 2024-03-17T23:58:10.511 INFO:tasks.workunit.client.0.smithi196.stdout:5/3: dread - f1 zero size 2024-03-17T23:58:10.512 INFO:tasks.workunit.client.0.smithi196.stdout:5/4: dread - f1 zero size 2024-03-17T23:58:10.513 INFO:tasks.workunit.client.0.smithi196.stdout:7/2: creat f0 x:0 0 0 2024-03-17T23:58:10.514 INFO:tasks.workunit.client.0.smithi196.stdout:7/3: write f0 [884294,40639] 0 2024-03-17T23:58:10.516 INFO:tasks.workunit.client.0.smithi196.stdout:7/4: read f0 [581308,98840] 0 2024-03-17T23:58:10.517 INFO:tasks.workunit.client.0.smithi196.stdout:3/9: creat f2 x:0 0 0 2024-03-17T23:58:10.518 INFO:tasks.workunit.client.0.smithi196.stdout:3/10: dread - f2 zero size 2024-03-17T23:58:10.518 INFO:tasks.workunit.client.0.smithi196.stdout:6/0: chown . 941352578 1 2024-03-17T23:58:10.519 INFO:tasks.workunit.client.0.smithi196.stdout:9/2: creat f0 x:0 0 0 2024-03-17T23:58:10.519 INFO:tasks.workunit.client.0.smithi196.stdout:3/11: write f2 [1022803,107893] 0 2024-03-17T23:58:10.521 INFO:tasks.workunit.client.0.smithi196.stdout:5/5: creat f2 x:0 0 0 2024-03-17T23:58:10.522 INFO:tasks.workunit.client.0.smithi196.stdout:4/8: symlink d1/l2 0 2024-03-17T23:58:10.522 INFO:tasks.workunit.client.0.smithi196.stdout:4/9: chown f0 109898863 1 2024-03-17T23:58:10.523 INFO:tasks.workunit.client.0.smithi196.stdout:4/10: chown f0 20241972 1 2024-03-17T23:58:10.523 INFO:tasks.workunit.client.0.smithi196.stdout:4/11: truncate f0 48321 0 2024-03-17T23:58:10.524 INFO:tasks.workunit.client.0.smithi196.stdout:1/6: mknod d1/c2 0 2024-03-17T23:58:10.525 INFO:tasks.workunit.client.0.smithi196.stdout:4/12: write f0 [362188,79839] 0 2024-03-17T23:58:10.526 INFO:tasks.workunit.client.0.smithi196.stdout:8/6: creat f0 x:0 0 0 2024-03-17T23:58:10.531 INFO:tasks.workunit.client.0.smithi196.stdout:9/3: creat f1 x:0 0 0 2024-03-17T23:58:10.532 INFO:tasks.workunit.client.0.smithi196.stdout:9/4: dread - f1 zero size 2024-03-17T23:58:10.533 INFO:tasks.workunit.client.0.smithi196.stdout:3/12: rename f2 to f3 0 2024-03-17T23:58:10.535 INFO:tasks.workunit.client.0.smithi196.stdout:3/13: chown c1 34301 1 2024-03-17T23:58:10.537 INFO:tasks.workunit.client.0.smithi196.stdout:8/7: dwrite f0 [0,4194304] 0 2024-03-17T23:58:10.538 INFO:tasks.workunit.client.0.smithi196.stdout:8/8: stat f0 0 2024-03-17T23:58:10.538 INFO:tasks.workunit.client.0.smithi196.stdout:5/6: creat f3 x:0 0 0 2024-03-17T23:58:10.538 INFO:tasks.workunit.client.0.smithi196.stdout:5/7: readlink - no filename 2024-03-17T23:58:10.539 INFO:tasks.workunit.client.0.smithi196.stdout:8/9: chown f0 85173626 1 2024-03-17T23:58:10.539 INFO:tasks.workunit.client.0.smithi196.stdout:7/5: rename f0 to f1 0 2024-03-17T23:58:10.539 INFO:tasks.workunit.client.0.smithi196.stdout:5/8: truncate f0 316606 0 2024-03-17T23:58:10.540 INFO:tasks.workunit.client.0.smithi196.stdout:8/10: write f0 [154232,95028] 0 2024-03-17T23:58:10.541 INFO:tasks.workunit.client.0.smithi196.stdout:5/9: chown f3 332910 1 2024-03-17T23:58:10.542 INFO:tasks.workunit.client.0.smithi196.stdout:5/10: fdatasync f2 0 2024-03-17T23:58:10.542 INFO:tasks.workunit.client.0.smithi196.stdout:4/13: unlink f0 0 2024-03-17T23:58:10.544 INFO:tasks.workunit.client.0.smithi196.stdout:6/1: creat f0 x:0 0 0 2024-03-17T23:58:10.551 INFO:tasks.workunit.client.0.smithi196.stdout:8/11: dread f0 [0,4194304] 0 2024-03-17T23:58:10.557 INFO:tasks.workunit.client.0.smithi196.stdout:5/11: dwrite f1 [0,4194304] 0 2024-03-17T23:58:10.559 INFO:tasks.workunit.client.0.smithi196.stdout:5/12: dread f0 [0,4194304] 0 2024-03-17T23:58:10.560 INFO:tasks.workunit.client.0.smithi196.stdout:5/13: chown f3 1 1 2024-03-17T23:58:10.563 INFO:tasks.workunit.client.0.smithi196.stdout:7/6: write f1 [642855,6542] 0 2024-03-17T23:58:10.566 INFO:tasks.workunit.client.0.smithi196.stdout:7/7: write f1 [725908,104788] 0 2024-03-17T23:58:10.566 INFO:tasks.workunit.client.0.smithi196.stdout:4/14: symlink d1/l3 0 2024-03-17T23:58:10.566 INFO:tasks.workunit.client.0.smithi196.stdout:4/15: write - no filename 2024-03-17T23:58:10.566 INFO:tasks.workunit.client.0.smithi196.stdout:4/16: dwrite - no filename 2024-03-17T23:58:10.566 INFO:tasks.workunit.client.0.smithi196.stdout:4/17: chown d1 81081 1 2024-03-17T23:58:10.570 INFO:tasks.workunit.client.0.smithi196.stdout:6/2: creat f1 x:0 0 0 2024-03-17T23:58:10.571 INFO:tasks.workunit.client.0.smithi196.stdout:8/12: creat f1 x:0 0 0 2024-03-17T23:58:10.571 INFO:tasks.workunit.client.0.smithi196.stdout:6/3: dread - f1 zero size 2024-03-17T23:58:10.573 INFO:tasks.workunit.client.0.smithi196.stdout:6/4: write f0 [713644,117625] 0 2024-03-17T23:58:10.575 INFO:tasks.workunit.client.0.smithi196.stdout:6/5: dread - f1 zero size 2024-03-17T23:58:10.578 INFO:tasks.workunit.client.0.smithi196.stdout:7/8: creat f2 x:0 0 0 2024-03-17T23:58:10.582 INFO:tasks.workunit.client.0.smithi196.stdout:8/13: dwrite f1 [0,4194304] 0 2024-03-17T23:58:10.583 INFO:tasks.workunit.client.0.smithi196.stdout:4/18: creat d1/f4 x:0 0 0 2024-03-17T23:58:10.588 INFO:tasks.workunit.client.0.smithi196.stdout:6/6: mkdir d2 0 2024-03-17T23:58:10.590 INFO:tasks.workunit.client.0.smithi196.stdout:0/4: stat l1 0 2024-03-17T23:58:10.591 INFO:tasks.workunit.client.0.smithi196.stdout:6/7: dread - f1 zero size 2024-03-17T23:58:10.591 INFO:tasks.workunit.client.0.smithi196.stdout:0/5: stat l1 0 2024-03-17T23:58:10.594 INFO:tasks.workunit.client.0.smithi196.stdout:7/9: dwrite f1 [0,4194304] 0 2024-03-17T23:58:10.595 INFO:tasks.workunit.client.0.smithi196.stdout:7/10: chown f1 30 1 2024-03-17T23:58:10.595 INFO:tasks.workunit.client.0.smithi196.stdout:0/6: symlink l2 0 2024-03-17T23:58:10.596 INFO:tasks.workunit.client.0.smithi196.stdout:0/7: stat l2 0 2024-03-17T23:58:10.605 INFO:tasks.workunit.client.0.smithi196.stdout:0/8: chown l1 28 1 2024-03-17T23:58:10.610 INFO:tasks.workunit.client.0.smithi196.stdout:6/8: dwrite f0 [0,4194304] 0 2024-03-17T23:58:10.612 INFO:tasks.workunit.client.0.smithi196.stdout:9/5: getdents . 0 2024-03-17T23:58:10.614 INFO:tasks.workunit.client.0.smithi196.stdout:3/14: rename f3 to f4 0 2024-03-17T23:58:10.614 INFO:tasks.workunit.client.0.smithi196.stdout:0/9: rename l2 to l3 0 2024-03-17T23:58:10.615 INFO:tasks.workunit.client.0.smithi196.stdout:8/14: write f0 [4758524,77125] 0 2024-03-17T23:58:10.620 INFO:tasks.workunit.client.0.smithi196.stdout:1/7: dwrite f0 [4194304,4194304] 0 2024-03-17T23:58:10.620 INFO:tasks.workunit.client.0.smithi196.stdout:9/6: rename f1 to f2 0 2024-03-17T23:58:10.622 INFO:tasks.workunit.client.0.smithi196.stdout:1/8: rename d1 to d1/d3 22 2024-03-17T23:58:10.624 INFO:tasks.workunit.client.0.smithi196.stdout:3/15: mknod c5 0 2024-03-17T23:58:10.626 INFO:tasks.workunit.client.0.smithi196.stdout:7/11: dwrite f1 [0,4194304] 0 2024-03-17T23:58:10.628 INFO:tasks.workunit.client.0.smithi196.stdout:0/10: creat f4 x:0 0 0 2024-03-17T23:58:10.628 INFO:tasks.workunit.client.0.smithi196.stdout:8/15: mknod c2 0 2024-03-17T23:58:10.629 INFO:tasks.workunit.client.0.smithi196.stdout:3/16: chown c1 64551 1 2024-03-17T23:58:10.631 INFO:tasks.workunit.client.0.smithi196.stdout:9/7: creat f3 x:0 0 0 2024-03-17T23:58:10.631 INFO:tasks.workunit.client.0.smithi196.stdout:6/9: dwrite f0 [0,4194304] 0 2024-03-17T23:58:10.633 INFO:tasks.workunit.client.0.smithi196.stdout:6/10: chown f0 20986 1 2024-03-17T23:58:10.634 INFO:tasks.workunit.client.0.smithi196.stdout:6/11: truncate f1 1008298 0 2024-03-17T23:58:10.636 INFO:tasks.workunit.client.0.smithi196.stdout:4/19: fsync d1/f4 0 2024-03-17T23:58:10.643 INFO:tasks.workunit.client.0.smithi196.stdout:1/9: fdatasync f0 0 2024-03-17T23:58:10.643 INFO:tasks.workunit.client.0.smithi196.stdout:4/20: fsync d1/f4 0 2024-03-17T23:58:10.644 INFO:tasks.workunit.client.0.smithi196.stdout:0/11: dwrite f4 [0,4194304] 0 2024-03-17T23:58:10.644 INFO:tasks.workunit.client.0.smithi196.stdout:3/17: creat f6 x:0 0 0 2024-03-17T23:58:10.649 INFO:tasks.workunit.client.0.smithi196.stdout:8/16: creat f3 x:0 0 0 2024-03-17T23:58:10.650 INFO:tasks.workunit.client.0.smithi196.stdout:9/8: creat f4 x:0 0 0 2024-03-17T23:58:10.651 INFO:tasks.workunit.client.0.smithi196.stdout:9/9: chown f4 25239 1 2024-03-17T23:58:10.652 INFO:tasks.workunit.client.0.smithi196.stdout:7/12: rename f1 to f3 0 2024-03-17T23:58:10.652 INFO:tasks.workunit.client.0.smithi196.stdout:4/21: mknod d1/c5 0 2024-03-17T23:58:10.653 INFO:tasks.workunit.client.0.smithi196.stdout:3/18: fdatasync f6 0 2024-03-17T23:58:10.654 INFO:tasks.workunit.client.0.smithi196.stdout:3/19: truncate f4 1984083 0 2024-03-17T23:58:10.654 INFO:tasks.workunit.client.0.smithi196.stdout:4/22: write d1/f4 [186637,58297] 0 2024-03-17T23:58:10.656 INFO:tasks.workunit.client.0.smithi196.stdout:7/13: truncate f2 128359 0 2024-03-17T23:58:10.656 INFO:tasks.workunit.client.0.smithi196.stdout:0/12: mkdir d5 0 2024-03-17T23:58:10.657 INFO:tasks.workunit.client.0.smithi196.stdout:1/10: creat d1/f4 x:0 0 0 2024-03-17T23:58:10.659 INFO:tasks.workunit.client.0.smithi196.stdout:9/10: rename f0 to f5 0 2024-03-17T23:58:10.659 INFO:tasks.workunit.client.0.smithi196.stdout:6/12: creat d2/f3 x:0 0 0 2024-03-17T23:58:10.660 INFO:tasks.workunit.client.0.smithi196.stdout:3/20: mkdir d7 0 2024-03-17T23:58:10.660 INFO:tasks.workunit.client.0.smithi196.stdout:9/11: dread - f4 zero size 2024-03-17T23:58:10.661 INFO:tasks.workunit.client.0.smithi196.stdout:7/14: symlink l4 0 2024-03-17T23:58:10.661 INFO:tasks.workunit.client.0.smithi196.stdout:3/21: fdatasync f6 0 2024-03-17T23:58:10.665 INFO:tasks.workunit.client.0.smithi196.stdout:1/11: dread f0 [0,4194304] 0 2024-03-17T23:58:10.667 INFO:tasks.workunit.client.0.smithi196.stdout:7/15: symlink l5 0 2024-03-17T23:58:10.668 INFO:tasks.workunit.client.0.smithi196.stdout:9/12: creat f6 x:0 0 0 2024-03-17T23:58:10.669 INFO:tasks.workunit.client.0.smithi196.stdout:6/13: dwrite f0 [0,4194304] 0 2024-03-17T23:58:10.669 INFO:tasks.workunit.client.0.smithi196.stdout:0/13: unlink l3 0 2024-03-17T23:58:10.671 INFO:tasks.workunit.client.0.smithi196.stdout:6/14: truncate d2/f3 484024 0 2024-03-17T23:58:10.673 INFO:tasks.workunit.client.0.smithi196.stdout:1/12: creat d1/f5 x:0 0 0 2024-03-17T23:58:10.675 INFO:tasks.workunit.client.0.smithi196.stdout:7/16: unlink l4 0 2024-03-17T23:58:10.676 INFO:tasks.workunit.client.0.smithi196.stdout:9/13: rename f2 to f7 0 2024-03-17T23:58:10.676 INFO:tasks.workunit.client.0.smithi196.stdout:7/17: dread f2 [0,4194304] 0 2024-03-17T23:58:10.676 INFO:tasks.workunit.client.0.smithi196.stdout:7/18: rmdir - no directory 2024-03-17T23:58:10.677 INFO:tasks.workunit.client.0.smithi196.stdout:7/19: chown f3 3 1 2024-03-17T23:58:10.678 INFO:tasks.workunit.client.0.smithi196.stdout:9/14: dread - f7 zero size 2024-03-17T23:58:10.678 INFO:tasks.workunit.client.0.smithi196.stdout:3/22: link f4 d7/f8 0 2024-03-17T23:58:10.679 INFO:tasks.workunit.client.0.smithi196.stdout:8/17: getdents . 0 2024-03-17T23:58:10.680 INFO:tasks.workunit.client.0.smithi196.stdout:6/15: mknod d2/c4 0 2024-03-17T23:58:10.680 INFO:tasks.workunit.client.0.smithi196.stdout:8/18: fdatasync f1 0 2024-03-17T23:58:10.681 INFO:tasks.workunit.client.0.smithi196.stdout:4/23: link d1/l3 d1/l6 0 2024-03-17T23:58:10.681 INFO:tasks.workunit.client.0.smithi196.stdout:6/16: write d2/f3 [560048,111166] 0 2024-03-17T23:58:10.684 INFO:tasks.workunit.client.0.smithi196.stdout:0/14: getdents d5 0 2024-03-17T23:58:10.685 INFO:tasks.workunit.client.0.smithi196.stdout:7/20: write f3 [1373091,110062] 0 2024-03-17T23:58:10.686 INFO:tasks.workunit.client.0.smithi196.stdout:9/15: mknod c8 0 2024-03-17T23:58:10.686 INFO:tasks.workunit.client.0.smithi196.stdout:9/16: read - f6 zero size 2024-03-17T23:58:10.686 INFO:tasks.workunit.client.0.smithi196.stdout:9/17: dread - f4 zero size 2024-03-17T23:58:10.687 INFO:tasks.workunit.client.0.smithi196.stdout:9/18: write f6 [848736,46637] 0 2024-03-17T23:58:10.688 INFO:tasks.workunit.client.0.smithi196.stdout:9/19: write f4 [2858,78968] 0 2024-03-17T23:58:10.690 INFO:tasks.workunit.client.0.smithi196.stdout:8/19: unlink f0 0 2024-03-17T23:58:10.699 INFO:tasks.workunit.client.0.smithi196.stdout:8/20: dwrite f3 [0,4194304] 0 2024-03-17T23:58:10.709 INFO:tasks.workunit.client.0.smithi196.stdout:9/20: write f5 [560113,5007] 0 2024-03-17T23:58:10.710 INFO:tasks.workunit.client.0.smithi196.stdout:9/21: write f3 [221976,8961] 0 2024-03-17T23:58:10.710 INFO:tasks.workunit.client.0.smithi196.stdout:9/22: rmdir - no directory 2024-03-17T23:58:10.710 INFO:tasks.workunit.client.0.smithi196.stdout:1/13: link d1/c2 d1/c6 0 2024-03-17T23:58:10.711 INFO:tasks.workunit.client.0.smithi196.stdout:1/14: dread - d1/f4 zero size 2024-03-17T23:58:10.711 INFO:tasks.workunit.client.0.smithi196.stdout:4/24: chown d1/l6 8 1 2024-03-17T23:58:10.711 INFO:tasks.workunit.client.0.smithi196.stdout:9/23: write f5 [515603,128312] 0 2024-03-17T23:58:10.713 INFO:tasks.workunit.client.0.smithi196.stdout:4/25: write d1/f4 [439360,11599] 0 2024-03-17T23:58:10.714 INFO:tasks.workunit.client.0.smithi196.stdout:4/26: readlink d1/l2 0 2024-03-17T23:58:10.715 INFO:tasks.workunit.client.0.smithi196.stdout:6/17: unlink d2/f3 0 2024-03-17T23:58:10.716 INFO:tasks.workunit.client.0.smithi196.stdout:0/15: mknod d5/c6 0 2024-03-17T23:58:10.717 INFO:tasks.workunit.client.0.smithi196.stdout:0/16: write f4 [3623832,12186] 0 2024-03-17T23:58:10.717 INFO:tasks.workunit.client.0.smithi196.stdout:0/17: read f4 [516445,75048] 0 2024-03-17T23:58:10.719 INFO:tasks.workunit.client.0.smithi196.stdout:1/15: rmdir d1 39 2024-03-17T23:58:10.720 INFO:tasks.workunit.client.0.smithi196.stdout:3/23: truncate f4 808854 0 2024-03-17T23:58:10.723 INFO:tasks.workunit.client.0.smithi196.stdout:8/21: unlink f1 0 2024-03-17T23:58:10.725 INFO:tasks.workunit.client.0.smithi196.stdout:6/18: rmdir d2 39 2024-03-17T23:58:10.729 INFO:tasks.workunit.client.0.smithi196.stdout:1/16: dread - d1/f5 zero size 2024-03-17T23:58:10.733 INFO:tasks.workunit.client.0.smithi196.stdout:9/24: dwrite f7 [0,4194304] 0 2024-03-17T23:58:10.736 INFO:tasks.workunit.client.0.smithi196.stdout:3/24: creat d7/f9 x:0 0 0 2024-03-17T23:58:10.736 INFO:tasks.workunit.client.0.smithi196.stdout:8/22: dwrite f3 [0,4194304] 0 2024-03-17T23:58:10.737 INFO:tasks.workunit.client.0.smithi196.stdout:3/25: dread - f6 zero size 2024-03-17T23:58:10.738 INFO:tasks.workunit.client.0.smithi196.stdout:3/26: dread - d7/f9 zero size 2024-03-17T23:58:10.738 INFO:tasks.workunit.client.0.smithi196.stdout:3/27: chown c1 258569799 1 2024-03-17T23:58:10.739 INFO:tasks.workunit.client.0.smithi196.stdout:3/28: chown d7 9150 1 2024-03-17T23:58:10.739 INFO:tasks.workunit.client.0.smithi196.stdout:3/29: dread - d7/f9 zero size 2024-03-17T23:58:10.739 INFO:tasks.workunit.client.0.smithi196.stdout:3/30: readlink - no filename 2024-03-17T23:58:10.740 INFO:tasks.workunit.client.0.smithi196.stdout:1/17: creat d1/f7 x:0 0 0 2024-03-17T23:58:10.741 INFO:tasks.workunit.client.0.smithi196.stdout:3/31: chown c1 1067 1 2024-03-17T23:58:10.741 INFO:tasks.workunit.client.0.smithi196.stdout:1/18: stat d1/f5 0 2024-03-17T23:58:10.745 INFO:tasks.workunit.client.0.smithi196.stdout:9/25: mkdir d9 0 2024-03-17T23:58:10.745 INFO:tasks.workunit.client.0.smithi196.stdout:0/18: getdents d5 0 2024-03-17T23:58:10.750 INFO:tasks.workunit.client.0.smithi196.stdout:3/32: creat d7/fa x:0 0 0 2024-03-17T23:58:10.750 INFO:tasks.workunit.client.0.smithi196.stdout:8/23: dwrite f3 [0,4194304] 0 2024-03-17T23:58:10.750 INFO:tasks.workunit.client.0.smithi196.stdout:1/19: creat d1/f8 x:0 0 0 2024-03-17T23:58:10.751 INFO:tasks.workunit.client.0.smithi196.stdout:8/24: chown c2 60316 1 2024-03-17T23:58:10.752 INFO:tasks.workunit.client.0.smithi196.stdout:8/25: write f3 [4980066,78423] 0 2024-03-17T23:58:10.753 INFO:tasks.workunit.client.0.smithi196.stdout:1/20: dread - d1/f4 zero size 2024-03-17T23:58:10.756 INFO:tasks.workunit.client.0.smithi196.stdout:0/19: truncate f4 3079019 0 2024-03-17T23:58:10.757 INFO:tasks.workunit.client.0.smithi196.stdout:9/26: mknod d9/ca 0 2024-03-17T23:58:10.760 INFO:tasks.workunit.client.0.smithi196.stdout:8/26: mknod c4 0 2024-03-17T23:58:10.765 INFO:tasks.workunit.client.0.smithi196.stdout:1/21: link f0 d1/f9 0 2024-03-17T23:58:10.766 INFO:tasks.workunit.client.0.smithi196.stdout:1/22: read - d1/f7 zero size 2024-03-17T23:58:10.767 INFO:tasks.workunit.client.0.smithi196.stdout:1/23: chown d1/f5 2978 1 2024-03-17T23:58:10.769 INFO:tasks.workunit.client.0.smithi196.stdout:3/33: dread d7/f8 [0,4194304] 0 2024-03-17T23:58:10.770 INFO:tasks.workunit.client.0.smithi196.stdout:9/27: dwrite f5 [0,4194304] 0 2024-03-17T23:58:10.770 INFO:tasks.workunit.client.0.smithi196.stdout:8/27: creat f5 x:0 0 0 2024-03-17T23:58:10.774 INFO:tasks.workunit.client.0.smithi196.stdout:9/28: dread f4 [0,4194304] 0 2024-03-17T23:58:10.775 INFO:tasks.workunit.client.0.smithi196.stdout:9/29: write f3 [454768,86105] 0 2024-03-17T23:58:10.776 INFO:tasks.workunit.client.0.smithi196.stdout:1/24: creat d1/fa x:0 0 0 2024-03-17T23:58:10.777 INFO:tasks.workunit.client.0.smithi196.stdout:1/25: readlink - no filename 2024-03-17T23:58:10.779 INFO:tasks.workunit.client.0.smithi196.stdout:3/34: rename f4 to d7/fb 0 2024-03-17T23:58:10.780 INFO:tasks.workunit.client.0.smithi196.stdout:3/35: readlink - no filename 2024-03-17T23:58:10.781 INFO:tasks.workunit.client.0.smithi196.stdout:3/36: read - d7/f9 zero size 2024-03-17T23:58:10.781 INFO:tasks.workunit.client.0.smithi196.stdout:8/28: dwrite f3 [4194304,4194304] 0 2024-03-17T23:58:10.784 INFO:tasks.workunit.client.0.smithi196.stdout:3/37: dread d7/fb [0,4194304] 0 2024-03-17T23:58:10.785 INFO:tasks.workunit.client.0.smithi196.stdout:8/29: dread - f5 zero size 2024-03-17T23:58:10.785 INFO:tasks.workunit.client.0.smithi196.stdout:3/38: chown c1 73 1 2024-03-17T23:58:10.786 INFO:tasks.workunit.client.0.smithi196.stdout:9/30: unlink f7 0 2024-03-17T23:58:10.786 INFO:tasks.workunit.client.0.smithi196.stdout:9/31: chown c8 1 1 2024-03-17T23:58:10.788 INFO:tasks.workunit.client.0.smithi196.stdout:0/20: write f4 [1297452,92268] 0 2024-03-17T23:58:10.789 INFO:tasks.workunit.client.0.smithi196.stdout:1/26: mkdir d1/db 0 2024-03-17T23:58:10.796 INFO:tasks.workunit.client.0.smithi196.stdout:8/30: dwrite f3 [4194304,4194304] 0 2024-03-17T23:58:10.797 INFO:tasks.workunit.client.0.smithi196.stdout:8/31: read f3 [7152305,93510] 0 2024-03-17T23:58:10.798 INFO:tasks.workunit.client.0.smithi196.stdout:3/39: unlink d7/f9 0 2024-03-17T23:58:10.801 INFO:tasks.workunit.client.0.smithi196.stdout:0/21: dwrite f4 [0,4194304] 0 2024-03-17T23:58:10.810 INFO:tasks.workunit.client.0.smithi196.stdout:1/27: symlink d1/db/lc 0 2024-03-17T23:58:10.810 INFO:tasks.workunit.client.0.smithi196.stdout:0/22: dwrite f4 [0,4194304] 0 2024-03-17T23:58:10.811 INFO:tasks.workunit.client.0.smithi196.stdout:8/32: rename f5 to f6 0 2024-03-17T23:58:10.811 INFO:tasks.workunit.client.0.smithi196.stdout:3/40: creat d7/fc x:0 0 0 2024-03-17T23:58:10.812 INFO:tasks.workunit.client.0.smithi196.stdout:0/23: read f4 [2171899,92097] 0 2024-03-17T23:58:10.817 INFO:tasks.workunit.client.0.smithi196.stdout:1/28: mkdir d1/db/dd 0 2024-03-17T23:58:10.819 INFO:tasks.workunit.client.0.smithi196.stdout:8/33: fdatasync f3 0 2024-03-17T23:58:10.820 INFO:tasks.workunit.client.0.smithi196.stdout:1/29: write d1/f7 [96399,121945] 0 2024-03-17T23:58:10.821 INFO:tasks.workunit.client.0.smithi196.stdout:1/30: read - d1/f4 zero size 2024-03-17T23:58:10.822 INFO:tasks.workunit.client.0.smithi196.stdout:9/32: truncate f5 256526 0 2024-03-17T23:58:10.823 INFO:tasks.workunit.client.0.smithi196.stdout:0/24: creat d5/f7 x:0 0 0 2024-03-17T23:58:10.823 INFO:tasks.workunit.client.0.smithi196.stdout:0/25: stat d5 0 2024-03-17T23:58:10.825 INFO:tasks.workunit.client.0.smithi196.stdout:1/31: creat d1/db/fe x:0 0 0 2024-03-17T23:58:10.826 INFO:tasks.workunit.client.0.smithi196.stdout:3/41: link f6 d7/fd 0 2024-03-17T23:58:10.829 INFO:tasks.workunit.client.0.smithi196.stdout:8/34: truncate f3 7291512 0 2024-03-17T23:58:10.829 INFO:tasks.workunit.client.0.smithi196.stdout:1/32: creat d1/db/ff x:0 0 0 2024-03-17T23:58:10.830 INFO:tasks.workunit.client.0.smithi196.stdout:3/42: mknod d7/ce 0 2024-03-17T23:58:10.831 INFO:tasks.workunit.client.0.smithi196.stdout:1/33: read - d1/f5 zero size 2024-03-17T23:58:10.833 INFO:tasks.workunit.client.0.smithi196.stdout:0/26: unlink f4 0 2024-03-17T23:58:10.834 INFO:tasks.workunit.client.0.smithi196.stdout:9/33: fsync f5 0 2024-03-17T23:58:10.835 INFO:tasks.workunit.client.0.smithi196.stdout:0/27: write d5/f7 [751734,75860] 0 2024-03-17T23:58:10.835 INFO:tasks.workunit.client.0.smithi196.stdout:0/28: readlink l1 0 2024-03-17T23:58:10.836 INFO:tasks.workunit.client.0.smithi196.stdout:0/29: chown d5/f7 2210758 1 2024-03-17T23:58:10.837 INFO:tasks.workunit.client.0.smithi196.stdout:0/30: readlink l1 0 2024-03-17T23:58:10.843 INFO:tasks.workunit.client.0.smithi196.stdout:1/34: mknod d1/db/dd/c10 0 2024-03-17T23:58:10.844 INFO:tasks.workunit.client.0.smithi196.stdout:1/35: write d1/db/ff [940767,105] 0 2024-03-17T23:58:10.844 INFO:tasks.workunit.client.0.smithi196.stdout:0/31: rmdir d5 39 2024-03-17T23:58:10.845 INFO:tasks.workunit.client.0.smithi196.stdout:3/43: write d7/f8 [1080900,122599] 0 2024-03-17T23:58:10.845 INFO:tasks.workunit.client.0.smithi196.stdout:3/44: truncate f6 1016878 0 2024-03-17T23:58:10.848 INFO:tasks.workunit.client.0.smithi196.stdout:3/45: dread f6 [0,4194304] 0 2024-03-17T23:58:10.849 INFO:tasks.workunit.client.0.smithi196.stdout:1/36: chown d1/c6 0 1 2024-03-17T23:58:10.851 INFO:tasks.workunit.client.0.smithi196.stdout:9/34: truncate f6 773990 0 2024-03-17T23:58:10.852 INFO:tasks.workunit.client.0.smithi196.stdout:9/35: chown d9/ca 1641101 1 2024-03-17T23:58:10.852 INFO:tasks.workunit.client.0.smithi196.stdout:0/32: symlink d5/l8 0 2024-03-17T23:58:10.856 INFO:tasks.workunit.client.0.smithi196.stdout:1/37: rename f0 to d1/db/dd/f11 0 2024-03-17T23:58:10.856 INFO:tasks.workunit.client.0.smithi196.stdout:3/46: write d7/fd [397200,53235] 0 2024-03-17T23:58:10.856 INFO:tasks.workunit.client.0.smithi196.stdout:9/36: creat d9/fb x:0 0 0 2024-03-17T23:58:10.859 INFO:tasks.workunit.client.0.smithi196.stdout:3/47: truncate d7/fa 577628 0 2024-03-17T23:58:10.859 INFO:tasks.workunit.client.0.smithi196.stdout:3/48: readlink - no filename 2024-03-17T23:58:10.860 INFO:tasks.workunit.client.0.smithi196.stdout:3/49: write d7/fa [634844,76986] 0 2024-03-17T23:58:10.865 INFO:tasks.workunit.client.0.smithi196.stdout:1/38: write d1/db/dd/f11 [9338182,13561] 0 2024-03-17T23:58:10.867 INFO:tasks.workunit.client.0.smithi196.stdout:0/33: dwrite d5/f7 [0,4194304] 0 2024-03-17T23:58:10.867 INFO:tasks.workunit.client.0.smithi196.stdout:1/39: fsync d1/f4 0 2024-03-17T23:58:10.868 INFO:tasks.workunit.client.0.smithi196.stdout:9/37: write f6 [561007,14395] 0 2024-03-17T23:58:10.869 INFO:tasks.workunit.client.0.smithi196.stdout:1/40: readlink d1/db/lc 0 2024-03-17T23:58:10.870 INFO:tasks.workunit.client.0.smithi196.stdout:9/38: dread - d9/fb zero size 2024-03-17T23:58:10.874 INFO:tasks.workunit.client.0.smithi196.stdout:9/39: fsync f4 0 2024-03-17T23:58:10.876 INFO:tasks.workunit.client.0.smithi196.stdout:3/50: dwrite d7/f8 [0,4194304] 0 2024-03-17T23:58:10.877 INFO:tasks.workunit.client.0.smithi196.stdout:9/40: mknod d9/cc 0 2024-03-17T23:58:10.878 INFO:tasks.workunit.client.0.smithi196.stdout:3/51: dread - d7/fc zero size 2024-03-17T23:58:10.884 INFO:tasks.workunit.client.0.smithi196.stdout:9/41: creat d9/fd x:0 0 0 2024-03-17T23:58:10.884 INFO:tasks.workunit.client.0.smithi196.stdout:9/42: readlink - no filename 2024-03-17T23:58:10.884 INFO:tasks.workunit.client.0.smithi196.stdout:9/43: readlink - no filename 2024-03-17T23:58:10.886 INFO:tasks.workunit.client.0.smithi196.stdout:1/41: dwrite d1/f9 [4194304,4194304] 0 2024-03-17T23:58:10.888 INFO:tasks.workunit.client.0.smithi196.stdout:3/52: rename d7/fa to d7/ff 0 2024-03-17T23:58:10.888 INFO:tasks.workunit.client.0.smithi196.stdout:3/53: rename d7 to d7/d10 22 2024-03-17T23:58:10.889 INFO:tasks.workunit.client.0.smithi196.stdout:9/44: fsync f4 0 2024-03-17T23:58:10.892 INFO:tasks.workunit.client.0.smithi196.stdout:0/34: truncate d5/f7 3818961 0 2024-03-17T23:58:10.892 INFO:tasks.workunit.client.0.smithi196.stdout:0/35: readlink d5/l8 0 2024-03-17T23:58:10.895 INFO:tasks.workunit.client.0.smithi196.stdout:1/42: dread d1/db/dd/f11 [4194304,4194304] 0 2024-03-17T23:58:10.897 INFO:tasks.workunit.client.0.smithi196.stdout:3/54: creat d7/f11 x:0 0 0 2024-03-17T23:58:10.900 INFO:tasks.workunit.client.0.smithi196.stdout:9/45: rename c8 to d9/ce 0 2024-03-17T23:58:10.900 INFO:tasks.workunit.client.0.smithi196.stdout:3/55: fdatasync d7/fb 0 2024-03-17T23:58:10.901 INFO:tasks.workunit.client.0.smithi196.stdout:9/46: fdatasync f6 0 2024-03-17T23:58:10.902 INFO:tasks.workunit.client.0.smithi196.stdout:1/43: creat d1/db/dd/f12 x:0 0 0 2024-03-17T23:58:10.902 INFO:tasks.workunit.client.0.smithi196.stdout:9/47: write d9/fb [364586,31675] 0 2024-03-17T23:58:10.905 INFO:tasks.workunit.client.0.smithi196.stdout:1/44: mkdir d1/d13 0 2024-03-17T23:58:10.907 INFO:tasks.workunit.client.0.smithi196.stdout:1/45: write d1/f8 [78103,122518] 0 2024-03-17T23:58:10.909 INFO:tasks.workunit.client.0.smithi196.stdout:3/56: dread d7/ff [0,4194304] 0 2024-03-17T23:58:10.910 INFO:tasks.workunit.client.0.smithi196.stdout:9/48: mkdir d9/df 0 2024-03-17T23:58:10.914 INFO:tasks.workunit.client.0.smithi196.stdout:3/57: fdatasync d7/ff 0 2024-03-17T23:58:10.914 INFO:tasks.workunit.client.0.smithi196.stdout:1/46: rename d1/f7 to d1/db/f14 0 2024-03-17T23:58:10.914 INFO:tasks.workunit.client.0.smithi196.stdout:9/49: dread d9/fb [0,4194304] 0 2024-03-17T23:58:10.914 INFO:tasks.workunit.client.0.smithi196.stdout:0/36: getdents d5 0 2024-03-17T23:58:10.917 INFO:tasks.workunit.client.0.smithi196.stdout:3/58: symlink d7/l12 0 2024-03-17T23:58:10.918 INFO:tasks.workunit.client.0.smithi196.stdout:0/37: mkdir d5/d9 0 2024-03-17T23:58:10.920 INFO:tasks.workunit.client.0.smithi196.stdout:9/50: creat d9/df/f10 x:0 0 0 2024-03-17T23:58:10.920 INFO:tasks.workunit.client.0.smithi196.stdout:3/59: mknod d7/c13 0 2024-03-17T23:58:10.921 INFO:tasks.workunit.client.0.smithi196.stdout:3/60: fdatasync d7/fd 0 2024-03-17T23:58:10.922 INFO:tasks.workunit.client.0.smithi196.stdout:9/51: dread f4 [0,4194304] 0 2024-03-17T23:58:10.924 INFO:tasks.workunit.client.0.smithi196.stdout:3/61: dread - d7/fc zero size 2024-03-17T23:58:10.926 INFO:tasks.workunit.client.0.smithi196.stdout:1/47: dwrite d1/f5 [0,4194304] 0 2024-03-17T23:58:10.926 INFO:tasks.workunit.client.0.smithi196.stdout:3/62: dread - d7/f11 zero size 2024-03-17T23:58:10.928 INFO:tasks.workunit.client.0.smithi196.stdout:3/63: fsync d7/fd 0 2024-03-17T23:58:10.929 INFO:tasks.workunit.client.0.smithi196.stdout:0/38: dread d5/f7 [0,4194304] 0 2024-03-17T23:58:10.931 INFO:tasks.workunit.client.0.smithi196.stdout:3/64: write d7/fd [1920313,123333] 0 2024-03-17T23:58:10.936 INFO:tasks.workunit.client.0.smithi196.stdout:1/48: creat d1/db/f15 x:0 0 0 2024-03-17T23:58:10.936 INFO:tasks.workunit.client.0.smithi196.stdout:9/52: dwrite d9/fd [0,4194304] 0 2024-03-17T23:58:10.939 INFO:tasks.workunit.client.0.smithi196.stdout:1/49: read d1/db/ff [808612,35483] 0 2024-03-17T23:58:10.940 INFO:tasks.workunit.client.0.smithi196.stdout:1/50: chown d1/c2 1 1 2024-03-17T23:58:10.941 INFO:tasks.workunit.client.0.smithi196.stdout:3/65: creat d7/f14 x:0 0 0 2024-03-17T23:58:10.943 INFO:tasks.workunit.client.0.smithi196.stdout:9/53: creat d9/f11 x:0 0 0 2024-03-17T23:58:10.943 INFO:tasks.workunit.client.0.smithi196.stdout:9/54: write f3 [1035487,35100] 0 2024-03-17T23:58:10.947 INFO:tasks.workunit.client.0.smithi196.stdout:3/66: rename d7/f14 to d7/f15 0 2024-03-17T23:58:10.950 INFO:tasks.workunit.client.0.smithi196.stdout:1/51: rename d1/db/dd/f11 to d1/f16 0 2024-03-17T23:58:10.952 INFO:tasks.workunit.client.0.smithi196.stdout:0/39: rmdir d5/d9 0 2024-03-17T23:58:10.954 INFO:tasks.workunit.client.0.smithi196.stdout:1/52: symlink d1/db/l17 0 2024-03-17T23:58:10.955 INFO:tasks.workunit.client.0.smithi196.stdout:0/40: truncate d5/f7 3866604 0 2024-03-17T23:58:10.957 INFO:tasks.workunit.client.0.smithi196.stdout:3/67: dwrite d7/ff [0,4194304] 0 2024-03-17T23:58:10.960 INFO:tasks.workunit.client.0.smithi196.stdout:0/41: creat d5/fa x:0 0 0 2024-03-17T23:58:10.960 INFO:tasks.workunit.client.0.smithi196.stdout:3/68: readlink d7/l12 0 2024-03-17T23:58:10.961 INFO:tasks.workunit.client.0.smithi196.stdout:9/55: dwrite d9/fd [0,4194304] 0 2024-03-17T23:58:10.963 INFO:tasks.workunit.client.0.smithi196.stdout:1/53: rename d1/f5 to d1/d13/f18 0 2024-03-17T23:58:10.965 INFO:tasks.workunit.client.0.smithi196.stdout:1/54: write d1/f4 [816979,30369] 0 2024-03-17T23:58:10.966 INFO:tasks.workunit.client.0.smithi196.stdout:0/42: rmdir d5 39 2024-03-17T23:58:10.968 INFO:tasks.workunit.client.0.smithi196.stdout:9/56: mkdir d9/d12 0 2024-03-17T23:58:10.970 INFO:tasks.workunit.client.0.smithi196.stdout:3/69: dread d7/ff [0,4194304] 0 2024-03-17T23:58:10.980 INFO:tasks.workunit.client.0.smithi196.stdout:0/43: creat d5/fb x:0 0 0 2024-03-17T23:58:10.981 INFO:tasks.workunit.client.0.smithi196.stdout:1/55: dwrite d1/d13/f18 [0,4194304] 0 2024-03-17T23:58:10.983 INFO:tasks.workunit.client.0.smithi196.stdout:9/57: rename d9/ce to d9/c13 0 2024-03-17T23:58:10.990 INFO:tasks.workunit.client.0.smithi196.stdout:0/44: rename d5/l8 to d5/lc 0 2024-03-17T23:58:10.990 INFO:tasks.workunit.client.0.smithi196.stdout:3/70: truncate f6 1160134 0 2024-03-17T23:58:10.991 INFO:tasks.workunit.client.0.smithi196.stdout:9/58: rmdir d9 39 2024-03-17T23:58:10.991 INFO:tasks.workunit.client.0.smithi196.stdout:1/56: rename d1/db/l17 to d1/db/l19 0 2024-03-17T23:58:10.991 INFO:tasks.workunit.client.0.smithi196.stdout:3/71: stat d7/l12 0 2024-03-17T23:58:10.991 INFO:tasks.workunit.client.0.smithi196.stdout:1/57: dread - d1/fa zero size 2024-03-17T23:58:11.012 INFO:tasks.workunit.client.0.smithi196.stdout:0/45: creat d5/fd x:0 0 0 2024-03-17T23:58:11.013 INFO:tasks.workunit.client.0.smithi196.stdout:3/72: creat d7/f16 x:0 0 0 2024-03-17T23:58:11.013 INFO:tasks.workunit.client.0.smithi196.stdout:1/58: creat d1/d13/f1a x:0 0 0 2024-03-17T23:58:11.014 INFO:tasks.workunit.client.0.smithi196.stdout:1/59: chown d1/f9 0 1 2024-03-17T23:58:11.130 INFO:tasks.workunit.client.0.smithi196.stdout:9/59: mkdir d9/df/d14 0 2024-03-17T23:58:11.130 INFO:tasks.workunit.client.0.smithi196.stdout:9/60: write f4 [688157,28940] 0 2024-03-17T23:58:11.131 INFO:tasks.workunit.client.0.smithi196.stdout:0/46: mkdir d5/de 0 2024-03-17T23:58:11.131 INFO:tasks.workunit.client.0.smithi196.stdout:0/47: dread - d5/fb zero size 2024-03-17T23:58:11.132 INFO:tasks.workunit.client.0.smithi196.stdout:3/73: creat d7/f17 x:0 0 0 2024-03-17T23:58:11.132 INFO:tasks.workunit.client.0.smithi196.stdout:9/61: rename d9/df to d9/df/d14/d15 22 2024-03-17T23:58:11.133 INFO:tasks.workunit.client.0.smithi196.stdout:1/60: symlink d1/db/l1b 0 2024-03-17T23:58:11.133 INFO:tasks.workunit.client.0.smithi196.stdout:9/62: fdatasync f6 0 2024-03-17T23:58:11.134 INFO:tasks.workunit.client.0.smithi196.stdout:3/74: write d7/f8 [4959480,65825] 0 2024-03-17T23:58:11.135 INFO:tasks.workunit.client.0.smithi196.stdout:9/63: chown d9/df 45855292 1 2024-03-17T23:58:11.135 INFO:tasks.workunit.client.0.smithi196.stdout:1/61: dread - d1/db/f15 zero size 2024-03-17T23:58:11.135 INFO:tasks.workunit.client.0.smithi196.stdout:0/48: rename d5/fb to d5/ff 0 2024-03-17T23:58:11.137 INFO:tasks.workunit.client.0.smithi196.stdout:3/75: mknod d7/c18 0 2024-03-17T23:58:11.138 INFO:tasks.workunit.client.0.smithi196.stdout:0/49: creat d5/f10 x:0 0 0 2024-03-17T23:58:11.140 INFO:tasks.workunit.client.0.smithi196.stdout:1/62: rename d1/db/l1b to d1/l1c 0 2024-03-17T23:58:11.141 INFO:tasks.workunit.client.0.smithi196.stdout:9/64: dread d9/fd [0,4194304] 0 2024-03-17T23:58:11.143 INFO:tasks.workunit.client.0.smithi196.stdout:3/76: dread d7/ff [0,4194304] 0 2024-03-17T23:58:11.144 INFO:tasks.workunit.client.0.smithi196.stdout:9/65: creat d9/d12/f16 x:0 0 0 2024-03-17T23:58:11.145 INFO:tasks.workunit.client.0.smithi196.stdout:3/77: write d7/fb [5034525,36948] 0 2024-03-17T23:58:11.146 INFO:tasks.workunit.client.0.smithi196.stdout:9/66: dread - d9/df/f10 zero size 2024-03-17T23:58:11.147 INFO:tasks.workunit.client.0.smithi196.stdout:3/78: rmdir d7 39 2024-03-17T23:58:11.149 INFO:tasks.workunit.client.0.smithi196.stdout:9/67: creat d9/d12/f17 x:0 0 0 2024-03-17T23:58:11.150 INFO:tasks.workunit.client.0.smithi196.stdout:0/50: dwrite d5/f7 [4194304,4194304] 0 2024-03-17T23:58:11.154 INFO:tasks.workunit.client.0.smithi196.stdout:9/68: dread f6 [0,4194304] 0 2024-03-17T23:58:11.156 INFO:tasks.workunit.client.0.smithi196.stdout:0/51: unlink d5/f7 0 2024-03-17T23:58:11.158 INFO:tasks.workunit.client.0.smithi196.stdout:0/52: fdatasync d5/ff 0 2024-03-17T23:58:11.167 INFO:tasks.workunit.client.0.smithi196.stdout:9/69: dwrite d9/fd [0,4194304] 0 2024-03-17T23:58:11.169 INFO:tasks.workunit.client.0.smithi196.stdout:3/79: read d7/fd [162412,115532] 0 2024-03-17T23:58:11.171 INFO:tasks.workunit.client.0.smithi196.stdout:3/80: chown d7/fc 60 1 2024-03-17T23:58:11.171 INFO:tasks.workunit.client.0.smithi196.stdout:0/53: dwrite d5/ff [0,4194304] 0 2024-03-17T23:58:11.172 INFO:tasks.workunit.client.0.smithi196.stdout:0/54: read - d5/f10 zero size 2024-03-17T23:58:11.174 INFO:tasks.workunit.client.0.smithi196.stdout:3/81: mkdir d7/d19 0 2024-03-17T23:58:11.179 INFO:tasks.workunit.client.0.smithi196.stdout:3/82: symlink d7/d19/l1a 0 2024-03-17T23:58:11.260 INFO:tasks.workunit.client.0.smithi196.stdout:0/55: truncate d5/ff 1297393 0 2024-03-17T23:58:11.260 INFO:tasks.workunit.client.0.smithi196.stdout:3/83: getdents d7/d19 0 2024-03-17T23:58:11.261 INFO:tasks.workunit.client.0.smithi196.stdout:0/56: fdatasync d5/fa 0 2024-03-17T23:58:11.261 INFO:tasks.workunit.client.0.smithi196.stdout:3/84: fsync d7/f11 0 2024-03-17T23:58:11.265 INFO:tasks.workunit.client.0.smithi196.stdout:0/57: rename l1 to d5/l11 0 2024-03-17T23:58:11.265 INFO:tasks.workunit.client.0.smithi196.stdout:3/85: dread f6 [0,4194304] 0 2024-03-17T23:58:11.265 INFO:tasks.workunit.client.0.smithi196.stdout:9/70: dwrite d9/fb [0,4194304] 0 2024-03-17T23:58:11.270 INFO:tasks.workunit.client.0.smithi196.stdout:0/58: dread d5/ff [0,4194304] 0 2024-03-17T23:58:11.274 INFO:tasks.workunit.client.0.smithi196.stdout:3/86: link d7/f15 d7/f1b 0 2024-03-17T23:58:11.274 INFO:tasks.workunit.client.0.smithi196.stdout:0/59: readlink d5/lc 0 2024-03-17T23:58:11.275 INFO:tasks.workunit.client.0.smithi196.stdout:0/60: stat d5/fd 0 2024-03-17T23:58:11.277 INFO:tasks.workunit.client.0.smithi196.stdout:9/71: dwrite d9/fb [0,4194304] 0 2024-03-17T23:58:11.278 INFO:tasks.workunit.client.0.smithi196.stdout:3/87: creat d7/d19/f1c x:0 0 0 2024-03-17T23:58:11.279 INFO:tasks.workunit.client.0.smithi196.stdout:9/72: write f4 [1580111,119324] 0 2024-03-17T23:58:11.280 INFO:tasks.workunit.client.0.smithi196.stdout:9/73: chown d9/fd 0 1 2024-03-17T23:58:11.280 INFO:tasks.workunit.client.0.smithi196.stdout:0/61: creat d5/f12 x:0 0 0 2024-03-17T23:58:11.284 INFO:tasks.workunit.client.0.smithi196.stdout:9/74: truncate d9/df/f10 273001 0 2024-03-17T23:58:11.284 INFO:tasks.workunit.client.0.smithi196.stdout:9/75: write f4 [892041,39888] 0 2024-03-17T23:58:11.286 INFO:tasks.workunit.client.0.smithi196.stdout:9/76: write d9/d12/f16 [660795,109201] 0 2024-03-17T23:58:11.286 INFO:tasks.workunit.client.0.smithi196.stdout:0/62: rename d5/ff to d5/f13 0 2024-03-17T23:58:11.288 INFO:tasks.workunit.client.0.smithi196.stdout:0/63: write d5/fa [59256,22606] 0 2024-03-17T23:58:11.289 INFO:tasks.workunit.client.0.smithi196.stdout:9/77: write d9/fd [2550767,100264] 0 2024-03-17T23:58:11.290 INFO:tasks.workunit.client.0.smithi196.stdout:0/64: fdatasync d5/f12 0 2024-03-17T23:58:11.294 INFO:tasks.workunit.client.0.smithi196.stdout:0/65: write d5/fa [467467,31723] 0 2024-03-17T23:58:11.297 INFO:tasks.workunit.client.0.smithi196.stdout:0/66: truncate d5/f12 102472 0 2024-03-17T23:58:11.300 INFO:tasks.workunit.client.0.smithi196.stdout:3/88: dwrite d7/f15 [0,4194304] 0 2024-03-17T23:58:11.301 INFO:tasks.workunit.client.0.smithi196.stdout:3/89: truncate d7/fc 252567 0 2024-03-17T23:58:11.302 INFO:tasks.workunit.client.0.smithi196.stdout:9/78: dwrite d9/d12/f16 [0,4194304] 0 2024-03-17T23:58:11.305 INFO:tasks.workunit.client.0.smithi196.stdout:0/67: rmdir d5/de 0 2024-03-17T23:58:11.308 INFO:tasks.workunit.client.0.smithi196.stdout:0/68: dread d5/f12 [0,4194304] 0 2024-03-17T23:58:11.309 INFO:tasks.workunit.client.0.smithi196.stdout:9/79: symlink d9/df/l18 0 2024-03-17T23:58:11.309 INFO:tasks.workunit.client.0.smithi196.stdout:0/69: stat d5/f13 0 2024-03-17T23:58:11.310 INFO:tasks.workunit.client.0.smithi196.stdout:0/70: write d5/f10 [841245,19806] 0 2024-03-17T23:58:11.311 INFO:tasks.workunit.client.0.smithi196.stdout:3/90: dread d7/fb [0,4194304] 0 2024-03-17T23:58:11.326 INFO:tasks.workunit.client.0.smithi196.stdout:9/80: truncate f3 1012764 0 2024-03-17T23:58:11.328 INFO:tasks.workunit.client.0.smithi196.stdout:3/91: dwrite d7/f16 [0,4194304] 0 2024-03-17T23:58:11.328 INFO:tasks.workunit.client.0.smithi196.stdout:9/81: rmdir d9/df 39 2024-03-17T23:58:11.330 INFO:tasks.workunit.client.0.smithi196.stdout:0/71: dwrite d5/f12 [0,4194304] 0 2024-03-17T23:58:11.333 INFO:tasks.workunit.client.0.smithi196.stdout:0/72: chown d5/l11 359918768 1 2024-03-17T23:58:11.337 INFO:tasks.workunit.client.0.smithi196.stdout:0/73: symlink d5/l14 0 2024-03-17T23:58:11.337 INFO:tasks.workunit.client.0.smithi196.stdout:3/92: getdents d7/d19 0 2024-03-17T23:58:11.337 INFO:tasks.workunit.client.0.smithi196.stdout:0/74: write d5/fa [798219,100418] 0 2024-03-17T23:58:11.338 INFO:tasks.workunit.client.0.smithi196.stdout:9/82: mknod d9/df/c19 0 2024-03-17T23:58:11.338 INFO:tasks.workunit.client.0.smithi196.stdout:3/93: readlink d7/d19/l1a 0 2024-03-17T23:58:11.339 INFO:tasks.workunit.client.0.smithi196.stdout:0/75: write d5/fa [996624,115866] 0 2024-03-17T23:58:11.340 INFO:tasks.workunit.client.0.smithi196.stdout:9/83: truncate f5 91313 0 2024-03-17T23:58:11.343 INFO:tasks.workunit.client.0.smithi196.stdout:0/76: rename d5/lc to d5/l15 0 2024-03-17T23:58:11.344 INFO:tasks.workunit.client.0.smithi196.stdout:0/77: chown d5/c6 513175 1 2024-03-17T23:58:11.346 INFO:tasks.workunit.client.0.smithi196.stdout:9/84: rename d9/fb to d9/df/f1a 0 2024-03-17T23:58:11.346 INFO:tasks.workunit.client.0.smithi196.stdout:3/94: dread d7/f8 [0,4194304] 0 2024-03-17T23:58:11.347 INFO:tasks.workunit.client.0.smithi196.stdout:3/95: chown c1 0 1 2024-03-17T23:58:11.347 INFO:tasks.workunit.client.0.smithi196.stdout:3/96: stat d7/f17 0 2024-03-17T23:58:11.348 INFO:tasks.workunit.client.0.smithi196.stdout:9/85: symlink d9/df/l1b 0 2024-03-17T23:58:11.351 INFO:tasks.workunit.client.0.smithi196.stdout:3/97: creat d7/d19/f1d x:0 0 0 2024-03-17T23:58:11.355 INFO:tasks.workunit.client.0.smithi196.stdout:0/78: readlink d5/l15 0 2024-03-17T23:58:11.358 INFO:tasks.workunit.client.0.smithi196.stdout:0/79: symlink d5/l16 0 2024-03-17T23:58:11.365 INFO:tasks.workunit.client.0.smithi196.stdout:9/86: rename f3 to d9/df/d14/f1c 0 2024-03-17T23:58:11.365 INFO:tasks.workunit.client.0.smithi196.stdout:0/80: link d5/c6 d5/c17 0 2024-03-17T23:58:11.365 INFO:tasks.workunit.client.0.smithi196.stdout:3/98: dwrite d7/f8 [0,4194304] 0 2024-03-17T23:58:11.366 INFO:tasks.workunit.client.0.smithi196.stdout:0/81: chown d5/f10 2 1 2024-03-17T23:58:11.367 INFO:tasks.workunit.client.0.smithi196.stdout:9/87: write d9/f11 [1032011,64775] 0 2024-03-17T23:58:11.378 INFO:tasks.workunit.client.0.smithi196.stdout:0/82: dwrite d5/f12 [0,4194304] 0 2024-03-17T23:58:11.381 INFO:tasks.workunit.client.0.smithi196.stdout:9/88: dwrite d9/d12/f16 [0,4194304] 0 2024-03-17T23:58:11.381 INFO:tasks.workunit.client.0.smithi196.stdout:3/99: dread d7/fb [0,4194304] 0 2024-03-17T23:58:11.383 INFO:tasks.workunit.client.0.smithi196.stdout:0/83: creat d5/f18 x:0 0 0 2024-03-17T23:58:11.386 INFO:tasks.workunit.client.0.smithi196.stdout:9/89: fsync f5 0 2024-03-17T23:58:11.389 INFO:tasks.workunit.client.0.smithi196.stdout:3/100: symlink d7/l1e 0 2024-03-17T23:58:11.396 INFO:tasks.workunit.client.0.smithi196.stdout:0/84: dwrite d5/fa [0,4194304] 0 2024-03-17T23:58:11.400 INFO:tasks.workunit.client.0.smithi196.stdout:9/90: dwrite d9/df/f10 [0,4194304] 0 2024-03-17T23:58:11.404 INFO:tasks.workunit.client.0.smithi196.stdout:3/101: getdents d7 0 2024-03-17T23:58:11.405 INFO:tasks.workunit.client.0.smithi196.stdout:3/102: chown d7 53965 1 2024-03-17T23:58:11.408 INFO:tasks.workunit.client.0.smithi196.stdout:3/103: write d7/f16 [1795415,65496] 0 2024-03-17T23:58:11.409 INFO:tasks.workunit.client.0.smithi196.stdout:3/104: readlink d7/d19/l1a 0 2024-03-17T23:58:11.410 INFO:tasks.workunit.client.0.smithi196.stdout:9/91: dread d9/df/f10 [0,4194304] 0 2024-03-17T23:58:11.414 INFO:tasks.workunit.client.0.smithi196.stdout:3/105: creat d7/f1f x:0 0 0 2024-03-17T23:58:11.414 INFO:tasks.workunit.client.0.smithi196.stdout:3/106: write d7/f16 [5194658,103528] 0 2024-03-17T23:58:11.414 INFO:tasks.workunit.client.0.smithi196.stdout:9/92: creat d9/df/f1d x:0 0 0 2024-03-17T23:58:11.422 INFO:tasks.workunit.client.0.smithi196.stdout:9/93: truncate d9/d12/f16 1126683 0 2024-03-17T23:58:11.422 INFO:tasks.workunit.client.0.smithi196.stdout:3/107: dwrite d7/d19/f1c [0,4194304] 0 2024-03-17T23:58:11.425 INFO:tasks.workunit.client.0.smithi196.stdout:9/94: mkdir d9/d1e 0 2024-03-17T23:58:11.426 INFO:tasks.workunit.client.0.smithi196.stdout:3/108: creat d7/f20 x:0 0 0 2024-03-17T23:58:11.427 INFO:tasks.workunit.client.0.smithi196.stdout:3/109: creat d7/f21 x:0 0 0 2024-03-17T23:58:11.431 INFO:tasks.workunit.client.0.smithi196.stdout:3/110: creat d7/f22 x:0 0 0 2024-03-17T23:58:11.442 INFO:tasks.workunit.client.0.smithi196.stdout:3/111: dwrite d7/d19/f1c [0,4194304] 0 2024-03-17T23:58:11.444 INFO:tasks.workunit.client.0.smithi196.stdout:9/95: dwrite f5 [0,4194304] 0 2024-03-17T23:58:11.446 INFO:tasks.workunit.client.0.smithi196.stdout:3/112: creat d7/d19/f23 x:0 0 0 2024-03-17T23:58:11.447 INFO:tasks.workunit.client.0.smithi196.stdout:9/96: mknod d9/d12/c1f 0 2024-03-17T23:58:11.448 INFO:tasks.workunit.client.0.smithi196.stdout:3/113: truncate f6 112966 0 2024-03-17T23:58:11.449 INFO:tasks.workunit.client.0.smithi196.stdout:3/114: truncate d7/f20 944245 0 2024-03-17T23:58:11.451 INFO:tasks.workunit.client.0.smithi196.stdout:3/115: symlink d7/d19/l24 0 2024-03-17T23:58:11.460 INFO:tasks.workunit.client.0.smithi196.stdout:3/116: getdents d7 0 2024-03-17T23:58:11.463 INFO:tasks.workunit.client.0.smithi196.stdout:3/117: mknod d7/d19/c25 0 2024-03-17T23:58:11.466 INFO:tasks.workunit.client.0.smithi196.stdout:9/97: dwrite d9/df/d14/f1c [0,4194304] 0 2024-03-17T23:58:11.467 INFO:tasks.workunit.client.0.smithi196.stdout:3/118: stat f6 0 2024-03-17T23:58:11.469 INFO:tasks.workunit.client.0.smithi196.stdout:3/119: chown d7/d19/f23 10713 1 2024-03-17T23:58:11.471 INFO:tasks.workunit.client.0.smithi196.stdout:3/120: mkdir d7/d19/d26 0 2024-03-17T23:58:11.472 INFO:tasks.workunit.client.0.smithi196.stdout:9/98: dread d9/df/f1a [0,4194304] 0 2024-03-17T23:58:11.476 INFO:tasks.workunit.client.0.smithi196.stdout:9/99: unlink d9/c13 0 2024-03-17T23:58:11.476 INFO:tasks.workunit.client.0.smithi196.stdout:3/121: dread d7/fb [0,4194304] 0 2024-03-17T23:58:11.479 INFO:tasks.workunit.client.0.smithi196.stdout:9/100: rename d9/df/f10 to d9/f20 0 2024-03-17T23:58:11.484 INFO:tasks.workunit.client.0.smithi196.stdout:3/122: dwrite d7/f15 [0,4194304] 0 2024-03-17T23:58:11.485 INFO:tasks.workunit.client.0.smithi196.stdout:3/123: stat d7/f16 0 2024-03-17T23:58:11.488 INFO:tasks.workunit.client.0.smithi196.stdout:3/124: dread d7/fc [0,4194304] 0 2024-03-17T23:58:11.490 INFO:tasks.workunit.client.0.smithi196.stdout:3/125: dread d7/fc [0,4194304] 0 2024-03-17T23:58:11.490 INFO:tasks.workunit.client.0.smithi196.stdout:9/101: dwrite d9/f11 [0,4194304] 0 2024-03-17T23:58:11.493 INFO:tasks.workunit.client.0.smithi196.stdout:3/126: write d7/f17 [803163,14581] 0 2024-03-17T23:58:11.494 INFO:tasks.workunit.client.0.smithi196.stdout:9/102: creat d9/d12/f21 x:0 0 0 2024-03-17T23:58:11.494 INFO:tasks.workunit.client.0.smithi196.stdout:3/127: read - d7/f11 zero size 2024-03-17T23:58:11.496 INFO:tasks.workunit.client.0.smithi196.stdout:3/128: symlink d7/d19/l27 0 2024-03-17T23:58:11.508 INFO:tasks.workunit.client.0.smithi196.stdout:9/103: dwrite d9/fd [4194304,4194304] 0 2024-03-17T23:58:11.519 INFO:tasks.workunit.client.0.smithi196.stdout:3/129: dwrite f6 [0,4194304] 0 2024-03-17T23:58:11.520 INFO:tasks.workunit.client.0.smithi196.stdout:3/130: write d7/f1b [1847622,64020] 0 2024-03-17T23:58:11.522 INFO:tasks.workunit.client.0.smithi196.stdout:3/131: creat d7/d19/f28 x:0 0 0 2024-03-17T23:58:11.523 INFO:tasks.workunit.client.0.smithi196.stdout:3/132: mkdir d7/d29 0 2024-03-17T23:58:11.524 INFO:tasks.workunit.client.0.smithi196.stdout:3/133: stat d7/f22 0 2024-03-17T23:58:11.530 INFO:tasks.workunit.client.0.smithi196.stdout:3/134: truncate d7/ff 3668514 0 2024-03-17T23:58:11.531 INFO:tasks.workunit.client.0.smithi196.stdout:3/135: symlink d7/l2a 0 2024-03-17T23:58:11.535 INFO:tasks.workunit.client.0.smithi196.stdout:3/136: write d7/fc [610863,16313] 0 2024-03-17T23:58:11.538 INFO:tasks.workunit.client.0.smithi196.stdout:3/137: mkdir d7/d19/d26/d2b 0 2024-03-17T23:58:11.543 INFO:tasks.workunit.client.0.smithi196.stdout:3/138: dread d7/f15 [0,4194304] 0 2024-03-17T23:58:11.543 INFO:tasks.workunit.client.0.smithi196.stdout:3/139: chown d7/f1b 3377 1 2024-03-17T23:58:11.545 INFO:tasks.workunit.client.0.smithi196.stdout:3/140: creat d7/f2c x:0 0 0 2024-03-17T23:58:11.547 INFO:tasks.workunit.client.0.smithi196.stdout:3/141: mknod d7/d19/d26/d2b/c2d 0 2024-03-17T23:58:11.554 INFO:tasks.workunit.client.0.smithi196.stdout:3/142: dread d7/ff [0,4194304] 0 2024-03-17T23:58:11.555 INFO:tasks.workunit.client.0.smithi196.stdout:3/143: chown d7 406040248 1 2024-03-17T23:58:11.559 INFO:tasks.workunit.client.0.smithi196.stdout:3/144: dread d7/f1b [0,4194304] 0 2024-03-17T23:58:11.561 INFO:tasks.workunit.client.0.smithi196.stdout:3/145: symlink d7/l2e 0 2024-03-17T23:58:11.563 INFO:tasks.workunit.client.0.smithi196.stdout:3/146: creat d7/d19/d26/f2f x:0 0 0 2024-03-17T23:58:16.936 INFO:tasks.workunit.client.0.smithi196.stdout:2/5: sync 2024-03-17T23:58:16.936 INFO:tasks.workunit.client.0.smithi196.stdout:2/6: stat f0 0 2024-03-17T23:58:16.949 INFO:tasks.workunit.client.0.smithi196.stdout:2/7: dwrite f2 [0,4194304] 0 2024-03-17T23:58:16.949 INFO:tasks.workunit.client.0.smithi196.stdout:2/8: chown f2 30 1 2024-03-17T23:58:16.952 INFO:tasks.workunit.client.0.smithi196.stdout:2/9: creat f3 x:0 0 0 2024-03-17T23:58:16.952 INFO:tasks.workunit.client.0.smithi196.stdout:2/10: dread - f3 zero size 2024-03-17T23:58:16.954 INFO:tasks.workunit.client.0.smithi196.stdout:2/11: creat f4 x:0 0 0 2024-03-17T23:58:16.954 INFO:tasks.workunit.client.0.smithi196.stdout:2/12: chown f4 169960 1 2024-03-17T23:58:16.955 INFO:tasks.workunit.client.0.smithi196.stdout:2/13: symlink l5 0 2024-03-17T23:58:16.957 INFO:tasks.workunit.client.0.smithi196.stdout:2/14: unlink f0 0 2024-03-17T23:58:16.960 INFO:tasks.workunit.client.0.smithi196.stdout:2/15: creat f6 x:0 0 0 2024-03-17T23:58:16.961 INFO:tasks.workunit.client.0.smithi196.stdout:2/16: mkdir d7 0 2024-03-17T23:58:16.969 INFO:tasks.workunit.client.0.smithi196.stdout:2/17: dwrite f6 [0,4194304] 0 2024-03-17T23:58:16.970 INFO:tasks.workunit.client.0.smithi196.stdout:2/18: chown l5 114277 1 2024-03-17T23:58:16.971 INFO:tasks.workunit.client.0.smithi196.stdout:2/19: read f6 [2479282,24399] 0 2024-03-17T23:58:16.978 INFO:tasks.workunit.client.0.smithi196.stdout:2/20: rmdir d7 0 2024-03-17T23:58:16.978 INFO:tasks.workunit.client.0.smithi196.stdout:2/21: dread - f4 zero size 2024-03-17T23:58:16.983 INFO:tasks.workunit.client.0.smithi196.stdout:2/22: dread f2 [0,4194304] 0 2024-03-17T23:58:16.986 INFO:tasks.workunit.client.0.smithi196.stdout:2/23: truncate f6 1453550 0 2024-03-17T23:58:16.987 INFO:tasks.workunit.client.0.smithi196.stdout:2/24: mknod c8 0 2024-03-17T23:58:16.988 INFO:tasks.workunit.client.0.smithi196.stdout:2/25: mknod c9 0 2024-03-17T23:58:16.989 INFO:tasks.workunit.client.0.smithi196.stdout:2/26: read - f3 zero size 2024-03-17T23:58:16.993 INFO:tasks.workunit.client.0.smithi196.stdout:2/27: fsync f6 0 2024-03-17T23:58:16.995 INFO:tasks.workunit.client.0.smithi196.stdout:2/28: symlink la 0 2024-03-17T23:58:16.996 INFO:tasks.workunit.client.0.smithi196.stdout:2/29: creat fb x:0 0 0 2024-03-17T23:58:16.998 INFO:tasks.workunit.client.0.smithi196.stdout:2/30: mknod cc 0 2024-03-17T23:58:17.000 INFO:tasks.workunit.client.0.smithi196.stdout:2/31: link f6 fd 0 2024-03-17T23:58:17.001 INFO:tasks.workunit.client.0.smithi196.stdout:2/32: creat fe x:0 0 0 2024-03-17T23:58:17.003 INFO:tasks.workunit.client.0.smithi196.stdout:2/33: creat ff x:0 0 0 2024-03-17T23:58:17.003 INFO:tasks.workunit.client.0.smithi196.stdout:2/34: fdatasync fb 0 2024-03-17T23:58:17.014 INFO:tasks.workunit.client.0.smithi196.stdout:2/35: dwrite fd [0,4194304] 0 2024-03-17T23:58:17.015 INFO:tasks.workunit.client.0.smithi196.stdout:2/36: dread - ff zero size 2024-03-17T23:58:17.019 INFO:tasks.workunit.client.0.smithi196.stdout:2/37: link c9 c10 0 2024-03-17T23:58:17.021 INFO:tasks.workunit.client.0.smithi196.stdout:2/38: rename f3 to f11 0 2024-03-17T23:58:17.023 INFO:tasks.workunit.client.0.smithi196.stdout:2/39: symlink l12 0 2024-03-17T23:58:17.023 INFO:tasks.workunit.client.0.smithi196.stdout:2/40: dread - f4 zero size 2024-03-17T23:58:17.024 INFO:tasks.workunit.client.0.smithi196.stdout:2/41: read f2 [2103280,97534] 0 2024-03-17T23:58:17.026 INFO:tasks.workunit.client.0.smithi196.stdout:2/42: rename fe to f13 0 2024-03-17T23:58:17.026 INFO:tasks.workunit.client.0.smithi196.stdout:2/43: truncate ff 581241 0 2024-03-17T23:58:17.029 INFO:tasks.workunit.client.0.smithi196.stdout:2/44: unlink la 0 2024-03-17T23:58:17.029 INFO:tasks.workunit.client.0.smithi196.stdout:2/45: read fd [1019355,37252] 0 2024-03-17T23:58:17.030 INFO:tasks.workunit.client.0.smithi196.stdout:2/46: dread - f13 zero size 2024-03-17T23:58:17.033 INFO:tasks.workunit.client.0.smithi196.stdout:2/47: creat f14 x:0 0 0 2024-03-17T23:58:17.033 INFO:tasks.workunit.client.0.smithi196.stdout:2/48: read f2 [3244416,8751] 0 2024-03-17T23:58:17.036 INFO:tasks.workunit.client.0.smithi196.stdout:2/49: rename c9 to c15 0 2024-03-17T23:58:17.037 INFO:tasks.workunit.client.0.smithi196.stdout:2/50: write ff [918951,52764] 0 2024-03-17T23:58:17.039 INFO:tasks.workunit.client.0.smithi196.stdout:2/51: creat f16 x:0 0 0 2024-03-17T23:58:17.041 INFO:tasks.workunit.client.0.smithi196.stdout:2/52: write fd [4485968,44317] 0 2024-03-17T23:58:17.042 INFO:tasks.workunit.client.0.smithi196.stdout:2/53: truncate f14 858386 0 2024-03-17T23:58:17.042 INFO:tasks.workunit.client.0.smithi196.stdout:2/54: fdatasync f14 0 2024-03-17T23:58:17.043 INFO:tasks.workunit.client.0.smithi196.stdout:2/55: chown f6 51262685 1 2024-03-17T23:58:17.047 INFO:tasks.workunit.client.0.smithi196.stdout:2/56: mkdir d17 0 2024-03-17T23:58:17.061 INFO:tasks.workunit.client.0.smithi196.stdout:2/57: creat d17/f18 x:0 0 0 2024-03-17T23:58:17.068 INFO:tasks.workunit.client.0.smithi196.stdout:2/58: truncate f14 427658 0 2024-03-17T23:58:17.069 INFO:tasks.workunit.client.0.smithi196.stdout:2/59: mkdir d17/d19 0 2024-03-17T23:58:17.078 INFO:tasks.workunit.client.0.smithi196.stdout:2/60: dwrite f2 [0,4194304] 0 2024-03-17T23:58:17.080 INFO:tasks.workunit.client.0.smithi196.stdout:2/61: rmdir d17 39 2024-03-17T23:58:17.087 INFO:tasks.workunit.client.0.smithi196.stdout:2/62: rename f14 to d17/d19/f1a 0 2024-03-17T23:58:17.092 INFO:tasks.workunit.client.0.smithi196.stdout:2/63: dread fd [0,4194304] 0 2024-03-17T23:58:17.101 INFO:tasks.workunit.client.0.smithi196.stdout:2/64: dwrite fb [0,4194304] 0 2024-03-17T23:58:17.104 INFO:tasks.workunit.client.0.smithi196.stdout:2/65: mkdir d17/d19/d1b 0 2024-03-17T23:58:17.106 INFO:tasks.workunit.client.0.smithi196.stdout:2/66: symlink d17/d19/l1c 0 2024-03-17T23:58:17.108 INFO:tasks.workunit.client.0.smithi196.stdout:2/67: read f2 [1755340,72454] 0 2024-03-17T23:58:17.108 INFO:tasks.workunit.client.0.smithi196.stdout:2/68: chown l12 39 1 2024-03-17T23:58:17.110 INFO:tasks.workunit.client.0.smithi196.stdout:2/69: creat d17/d19/f1d x:0 0 0 2024-03-17T23:58:17.111 INFO:tasks.workunit.client.0.smithi196.stdout:2/70: chown f16 550797 1 2024-03-17T23:58:17.112 INFO:tasks.workunit.client.0.smithi196.stdout:2/71: symlink d17/d19/l1e 0 2024-03-17T23:58:17.114 INFO:tasks.workunit.client.0.smithi196.stdout:2/72: rename d17/d19/d1b to d17/d1f 0 2024-03-17T23:58:17.115 INFO:tasks.workunit.client.0.smithi196.stdout:2/73: write fb [1817383,32124] 0 2024-03-17T23:58:17.119 INFO:tasks.workunit.client.0.smithi196.stdout:2/74: dread ff [0,4194304] 0 2024-03-17T23:58:17.120 INFO:tasks.workunit.client.0.smithi196.stdout:2/75: write fb [1542308,130242] 0 2024-03-17T23:58:17.131 INFO:tasks.workunit.client.0.smithi196.stdout:2/76: dwrite f2 [0,4194304] 0 2024-03-17T23:58:17.146 INFO:tasks.workunit.client.0.smithi196.stdout:2/77: dwrite d17/d19/f1a [0,4194304] 0 2024-03-17T23:58:17.148 INFO:tasks.workunit.client.0.smithi196.stdout:2/78: creat d17/d1f/f20 x:0 0 0 2024-03-17T23:58:17.149 INFO:tasks.workunit.client.0.smithi196.stdout:2/79: mknod d17/d1f/c21 0 2024-03-17T23:58:17.150 INFO:tasks.workunit.client.0.smithi196.stdout:2/80: read d17/d19/f1a [3182449,6875] 0 2024-03-17T23:58:17.152 INFO:tasks.workunit.client.0.smithi196.stdout:2/81: mkdir d17/d22 0 2024-03-17T23:58:17.152 INFO:tasks.workunit.client.0.smithi196.stdout:2/82: chown fb 235 1 2024-03-17T23:58:17.153 INFO:tasks.workunit.client.0.smithi196.stdout:2/83: chown d17/d1f/c21 3013 1 2024-03-17T23:58:17.154 INFO:tasks.workunit.client.0.smithi196.stdout:2/84: creat d17/d1f/f23 x:0 0 0 2024-03-17T23:58:17.156 INFO:tasks.workunit.client.0.smithi196.stdout:2/85: symlink d17/d1f/l24 0 2024-03-17T23:58:17.158 INFO:tasks.workunit.client.0.smithi196.stdout:2/86: creat d17/d19/f25 x:0 0 0 2024-03-17T23:58:17.167 INFO:tasks.workunit.client.0.smithi196.stdout:2/87: dwrite f13 [0,4194304] 0 2024-03-17T23:58:17.174 INFO:tasks.workunit.client.0.smithi196.stdout:2/88: dread d17/d19/f1a [0,4194304] 0 2024-03-17T23:58:17.183 INFO:tasks.workunit.client.0.smithi196.stdout:2/89: dwrite fd [0,4194304] 0 2024-03-17T23:58:17.185 INFO:tasks.workunit.client.0.smithi196.stdout:2/90: dread - d17/d19/f25 zero size 2024-03-17T23:58:17.191 INFO:tasks.workunit.client.0.smithi196.stdout:2/91: dread ff [0,4194304] 0 2024-03-17T23:58:17.192 INFO:tasks.workunit.client.0.smithi196.stdout:2/92: dread - d17/d1f/f20 zero size 2024-03-17T23:58:17.195 INFO:tasks.workunit.client.0.smithi196.stdout:2/93: unlink f6 0 2024-03-17T23:58:17.197 INFO:tasks.workunit.client.0.smithi196.stdout:2/94: symlink d17/d19/l26 0 2024-03-17T23:58:17.198 INFO:tasks.workunit.client.0.smithi196.stdout:2/95: write f11 [249346,17233] 0 2024-03-17T23:58:17.207 INFO:tasks.workunit.client.0.smithi196.stdout:2/96: dwrite f2 [4194304,4194304] 0 2024-03-17T23:58:17.215 INFO:tasks.workunit.client.0.smithi196.stdout:2/97: dwrite fb [0,4194304] 0 2024-03-17T23:58:17.216 INFO:tasks.workunit.client.0.smithi196.stdout:2/98: write f13 [1044174,103615] 0 2024-03-17T23:58:17.222 INFO:tasks.workunit.client.0.smithi196.stdout:2/99: link f11 d17/d22/f27 0 2024-03-17T23:58:17.226 INFO:tasks.workunit.client.0.smithi196.stdout:2/100: mkdir d17/d28 0 2024-03-17T23:58:17.229 INFO:tasks.workunit.client.0.smithi196.stdout:2/101: fdatasync fb 0 2024-03-17T23:58:17.239 INFO:tasks.workunit.client.0.smithi196.stdout:2/102: dwrite f16 [0,4194304] 0 2024-03-17T23:58:17.245 INFO:tasks.workunit.client.0.smithi196.stdout:2/103: write d17/d22/f27 [1274002,81610] 0 2024-03-17T23:58:17.246 INFO:tasks.workunit.client.0.smithi196.stdout:2/104: creat d17/d28/f29 x:0 0 0 2024-03-17T23:58:17.255 INFO:tasks.workunit.client.0.smithi196.stdout:2/105: dwrite f11 [0,4194304] 0 2024-03-17T23:58:17.257 INFO:tasks.workunit.client.0.smithi196.stdout:2/106: rmdir d17/d19 39 2024-03-17T23:58:17.257 INFO:tasks.workunit.client.0.smithi196.stdout:2/107: fdatasync d17/f18 0 2024-03-17T23:58:17.259 INFO:tasks.workunit.client.0.smithi196.stdout:2/108: creat d17/f2a x:0 0 0 2024-03-17T23:58:17.261 INFO:tasks.workunit.client.0.smithi196.stdout:2/109: chown fd 635555013 1 2024-03-17T23:58:17.262 INFO:tasks.workunit.client.0.smithi196.stdout:2/110: mknod d17/d22/c2b 0 2024-03-17T23:58:17.265 INFO:tasks.workunit.client.0.smithi196.stdout:2/111: link c1 d17/c2c 0 2024-03-17T23:58:17.266 INFO:tasks.workunit.client.0.smithi196.stdout:2/112: readlink d17/d1f/l24 0 2024-03-17T23:58:17.269 INFO:tasks.workunit.client.0.smithi196.stdout:2/113: link d17/d19/l1e d17/d1f/l2d 0 2024-03-17T23:58:17.270 INFO:tasks.workunit.client.0.smithi196.stdout:2/114: creat d17/d1f/f2e x:0 0 0 2024-03-17T23:58:17.271 INFO:tasks.workunit.client.0.smithi196.stdout:2/115: chown f11 25 1 2024-03-17T23:58:17.271 INFO:tasks.workunit.client.0.smithi196.stdout:2/116: fdatasync d17/d1f/f23 0 2024-03-17T23:58:17.278 INFO:tasks.workunit.client.0.smithi196.stdout:2/117: dwrite fd [0,4194304] 0 2024-03-17T23:58:17.280 INFO:tasks.workunit.client.0.smithi196.stdout:2/118: symlink d17/d22/l2f 0 2024-03-17T23:58:17.281 INFO:tasks.workunit.client.0.smithi196.stdout:2/119: readlink d17/d22/l2f 0 2024-03-17T23:58:17.282 INFO:tasks.workunit.client.0.smithi196.stdout:2/120: dread - d17/d28/f29 zero size 2024-03-17T23:58:17.283 INFO:tasks.workunit.client.0.smithi196.stdout:2/121: mkdir d17/d28/d30 0 2024-03-17T23:58:17.284 INFO:tasks.workunit.client.0.smithi196.stdout:2/122: read fd [2147683,55580] 0 2024-03-17T23:58:17.286 INFO:tasks.workunit.client.0.smithi196.stdout:2/123: rename f11 to d17/d19/f31 0 2024-03-17T23:58:17.288 INFO:tasks.workunit.client.0.smithi196.stdout:2/124: symlink d17/d22/l32 0 2024-03-17T23:58:17.298 INFO:tasks.workunit.client.0.smithi196.stdout:2/125: truncate d17/d22/f27 2477024 0 2024-03-17T23:58:17.299 INFO:tasks.workunit.client.0.smithi196.stdout:2/126: write f4 [935887,17926] 0 2024-03-17T23:58:17.307 INFO:tasks.workunit.client.0.smithi196.stdout:2/127: dwrite d17/d19/f1a [0,4194304] 0 2024-03-17T23:58:17.308 INFO:tasks.workunit.client.0.smithi196.stdout:2/128: symlink d17/d1f/l33 0 2024-03-17T23:58:17.310 INFO:tasks.workunit.client.0.smithi196.stdout:2/129: symlink d17/d1f/l34 0 2024-03-17T23:58:17.311 INFO:tasks.workunit.client.0.smithi196.stdout:2/130: creat d17/d19/f35 x:0 0 0 2024-03-17T23:58:17.320 INFO:tasks.workunit.client.0.smithi196.stdout:2/131: dread d17/d19/f31 [0,4194304] 0 2024-03-17T23:58:17.323 INFO:tasks.workunit.client.0.smithi196.stdout:2/132: write d17/d19/f31 [3209273,24866] 0 2024-03-17T23:58:17.324 INFO:tasks.workunit.client.0.smithi196.stdout:2/133: rmdir d17/d22 39 2024-03-17T23:58:17.326 INFO:tasks.workunit.client.0.smithi196.stdout:2/134: getdents d17/d28/d30 0 2024-03-17T23:58:17.326 INFO:tasks.workunit.client.0.smithi196.stdout:2/135: rmdir d17 39 2024-03-17T23:58:17.329 INFO:tasks.workunit.client.0.smithi196.stdout:2/136: symlink d17/d22/l36 0 2024-03-17T23:58:17.329 INFO:tasks.workunit.client.0.smithi196.stdout:2/137: write f4 [73564,118623] 0 2024-03-17T23:58:17.337 INFO:tasks.workunit.client.0.smithi196.stdout:2/138: dwrite f4 [0,4194304] 0 2024-03-17T23:58:17.339 INFO:tasks.workunit.client.0.smithi196.stdout:2/139: write d17/d22/f27 [596157,48469] 0 2024-03-17T23:58:17.349 INFO:tasks.workunit.client.0.smithi196.stdout:2/140: dwrite d17/d19/f25 [0,4194304] 0 2024-03-17T23:58:17.353 INFO:tasks.workunit.client.0.smithi196.stdout:2/141: mknod d17/d19/c37 0 2024-03-17T23:58:17.356 INFO:tasks.workunit.client.0.smithi196.stdout:2/142: link d17/f2a d17/f38 0 2024-03-17T23:58:17.356 INFO:tasks.workunit.client.0.smithi196.stdout:2/143: chown d17/d1f/f23 7125049 1 2024-03-17T23:58:17.358 INFO:tasks.workunit.client.0.smithi196.stdout:2/144: creat d17/d22/f39 x:0 0 0 2024-03-17T23:58:17.361 INFO:tasks.workunit.client.0.smithi196.stdout:2/145: link d17/d22/l32 d17/d22/l3a 0 2024-03-17T23:58:17.362 INFO:tasks.workunit.client.0.smithi196.stdout:2/146: dread - d17/d19/f1d zero size 2024-03-17T23:58:17.374 INFO:tasks.workunit.client.0.smithi196.stdout:2/147: dwrite d17/f2a [0,4194304] 0 2024-03-17T23:58:17.376 INFO:tasks.workunit.client.0.smithi196.stdout:2/148: dread ff [0,4194304] 0 2024-03-17T23:58:17.377 INFO:tasks.workunit.client.0.smithi196.stdout:2/149: fdatasync d17/d19/f1a 0 2024-03-17T23:58:17.379 INFO:tasks.workunit.client.0.smithi196.stdout:2/150: unlink ff 0 2024-03-17T23:58:17.382 INFO:tasks.workunit.client.0.smithi196.stdout:2/151: mkdir d17/d28/d30/d3b 0 2024-03-17T23:58:17.382 INFO:tasks.workunit.client.0.smithi196.stdout:2/152: fsync d17/d19/f1a 0 2024-03-17T23:58:17.534 INFO:tasks.workunit.client.0.smithi196.stdout:5/14: sync 2024-03-17T23:58:17.534 INFO:tasks.workunit.client.0.smithi196.stdout:7/21: sync 2024-03-17T23:58:17.535 INFO:tasks.workunit.client.0.smithi196.stdout:7/22: fsync f3 0 2024-03-17T23:58:17.538 INFO:tasks.workunit.client.0.smithi196.stdout:7/23: rename f2 to f6 0 2024-03-17T23:58:17.545 INFO:tasks.workunit.client.0.smithi196.stdout:7/24: getdents . 0 2024-03-17T23:58:17.545 INFO:tasks.workunit.client.0.smithi196.stdout:5/15: write f3 [1015905,106893] 0 2024-03-17T23:58:17.546 INFO:tasks.workunit.client.0.smithi196.stdout:7/25: chown l5 19107677 1 2024-03-17T23:58:17.548 INFO:tasks.workunit.client.0.smithi196.stdout:7/26: symlink l7 0 2024-03-17T23:58:17.551 INFO:tasks.workunit.client.0.smithi196.stdout:7/27: link f3 f8 0 2024-03-17T23:58:17.554 INFO:tasks.workunit.client.0.smithi196.stdout:7/28: link l5 l9 0 2024-03-17T23:58:17.556 INFO:tasks.workunit.client.0.smithi196.stdout:7/29: dread f6 [0,4194304] 0 2024-03-17T23:58:17.558 INFO:tasks.workunit.client.0.smithi196.stdout:5/16: dwrite f1 [0,4194304] 0 2024-03-17T23:58:17.558 INFO:tasks.workunit.client.0.smithi196.stdout:7/30: chown l5 2131602930 1 2024-03-17T23:58:17.560 INFO:tasks.workunit.client.0.smithi196.stdout:7/31: fsync f6 0 2024-03-17T23:58:17.563 INFO:tasks.workunit.client.0.smithi196.stdout:7/32: mkdir da 0 2024-03-17T23:58:17.564 INFO:tasks.workunit.client.0.smithi196.stdout:7/33: dread f6 [0,4194304] 0 2024-03-17T23:58:17.565 INFO:tasks.workunit.client.0.smithi196.stdout:5/17: link f3 f4 0 2024-03-17T23:58:17.569 INFO:tasks.workunit.client.0.smithi196.stdout:7/34: symlink da/lb 0 2024-03-17T23:58:17.571 INFO:tasks.workunit.client.0.smithi196.stdout:7/35: write f6 [680543,19513] 0 2024-03-17T23:58:17.571 INFO:tasks.workunit.client.0.smithi196.stdout:5/18: mknod c5 0 2024-03-17T23:58:17.573 INFO:tasks.workunit.client.0.smithi196.stdout:5/19: mkdir d6 0 2024-03-17T23:58:17.574 INFO:tasks.workunit.client.0.smithi196.stdout:5/20: chown c5 916787204 1 2024-03-17T23:58:17.576 INFO:tasks.workunit.client.0.smithi196.stdout:5/21: symlink d6/l7 0 2024-03-17T23:58:17.577 INFO:tasks.workunit.client.0.smithi196.stdout:5/22: chown f0 519098912 1 2024-03-17T23:58:17.578 INFO:tasks.workunit.client.0.smithi196.stdout:5/23: creat d6/f8 x:0 0 0 2024-03-17T23:58:17.579 INFO:tasks.workunit.client.0.smithi196.stdout:5/24: symlink d6/l9 0 2024-03-17T23:58:17.589 INFO:tasks.workunit.client.0.smithi196.stdout:5/25: dwrite f4 [0,4194304] 0 2024-03-17T23:58:17.593 INFO:tasks.workunit.client.0.smithi196.stdout:5/26: creat d6/fa x:0 0 0 2024-03-17T23:58:17.594 INFO:tasks.workunit.client.0.smithi196.stdout:5/27: chown f3 68 1 2024-03-17T23:58:17.595 INFO:tasks.workunit.client.0.smithi196.stdout:5/28: write d6/f8 [461596,116240] 0 2024-03-17T23:58:17.596 INFO:tasks.workunit.client.0.smithi196.stdout:5/29: truncate d6/f8 1180320 0 2024-03-17T23:58:17.597 INFO:tasks.workunit.client.0.smithi196.stdout:5/30: chown d6/fa 54 1 2024-03-17T23:58:17.599 INFO:tasks.workunit.client.0.smithi196.stdout:5/31: creat d6/fb x:0 0 0 2024-03-17T23:58:17.601 INFO:tasks.workunit.client.0.smithi196.stdout:5/32: creat d6/fc x:0 0 0 2024-03-17T23:58:17.607 INFO:tasks.workunit.client.0.smithi196.stdout:5/33: dread f4 [0,4194304] 0 2024-03-17T23:58:17.609 INFO:tasks.workunit.client.0.smithi196.stdout:5/34: link d6/fc d6/fd 0 2024-03-17T23:58:17.610 INFO:tasks.workunit.client.0.smithi196.stdout:5/35: readlink d6/l9 0 2024-03-17T23:58:17.610 INFO:tasks.workunit.client.0.smithi196.stdout:5/36: truncate d6/fa 869701 0 2024-03-17T23:58:17.611 INFO:tasks.workunit.client.0.smithi196.stdout:5/37: truncate d6/fd 34976 0 2024-03-17T23:58:17.619 INFO:tasks.workunit.client.0.smithi196.stdout:5/38: dwrite d6/f8 [0,4194304] 0 2024-03-17T23:58:17.621 INFO:tasks.workunit.client.0.smithi196.stdout:5/39: creat d6/fe x:0 0 0 2024-03-17T23:58:17.629 INFO:tasks.workunit.client.0.smithi196.stdout:5/40: fsync d6/fd 0 2024-03-17T23:58:17.630 INFO:tasks.workunit.client.0.smithi196.stdout:5/41: stat d6/fb 0 2024-03-17T23:58:17.630 INFO:tasks.workunit.client.0.smithi196.stdout:5/42: truncate d6/fb 570883 0 2024-03-17T23:58:17.631 INFO:tasks.workunit.client.0.smithi196.stdout:5/43: stat d6/fa 0 2024-03-17T23:58:17.633 INFO:tasks.workunit.client.0.smithi196.stdout:5/44: creat d6/ff x:0 0 0 2024-03-17T23:58:17.633 INFO:tasks.workunit.client.0.smithi196.stdout:5/45: chown d6/ff 27886 1 2024-03-17T23:58:17.634 INFO:tasks.workunit.client.0.smithi196.stdout:5/46: truncate d6/fd 1026334 0 2024-03-17T23:58:17.695 INFO:tasks.workunit.client.0.smithi196.stdout:8/35: sync 2024-03-17T23:58:17.695 INFO:tasks.workunit.client.0.smithi196.stdout:9/104: sync 2024-03-17T23:58:17.695 INFO:tasks.workunit.client.0.smithi196.stdout:6/19: sync 2024-03-17T23:58:17.695 INFO:tasks.workunit.client.0.smithi196.stdout:1/63: sync 2024-03-17T23:58:17.695 INFO:tasks.workunit.client.0.smithi196.stdout:3/147: sync 2024-03-17T23:58:17.695 INFO:tasks.workunit.client.0.smithi196.stdout:4/27: sync 2024-03-17T23:58:17.695 INFO:tasks.workunit.client.0.smithi196.stdout:0/85: sync 2024-03-17T23:58:17.699 INFO:tasks.workunit.client.0.smithi196.stdout:8/36: chown f3 19 1 2024-03-17T23:58:17.701 INFO:tasks.workunit.client.0.smithi196.stdout:6/20: truncate f1 1759293 0 2024-03-17T23:58:17.702 INFO:tasks.workunit.client.0.smithi196.stdout:9/105: rename d9/cc to d9/d1e/c22 0 2024-03-17T23:58:17.706 INFO:tasks.workunit.client.0.smithi196.stdout:0/86: write d5/fa [2124640,67625] 0 2024-03-17T23:58:17.706 INFO:tasks.workunit.client.0.smithi196.stdout:4/28: write d1/f4 [1028953,14624] 0 2024-03-17T23:58:17.707 INFO:tasks.workunit.client.0.smithi196.stdout:8/37: creat f7 x:0 0 0 2024-03-17T23:58:17.710 INFO:tasks.workunit.client.0.smithi196.stdout:8/38: truncate f7 115801 0 2024-03-17T23:58:17.711 INFO:tasks.workunit.client.0.smithi196.stdout:0/87: symlink d5/l19 0 2024-03-17T23:58:17.711 INFO:tasks.workunit.client.0.smithi196.stdout:4/29: rmdir d1 39 2024-03-17T23:58:17.712 INFO:tasks.workunit.client.0.smithi196.stdout:9/106: symlink d9/l23 0 2024-03-17T23:58:17.713 INFO:tasks.workunit.client.0.smithi196.stdout:8/39: chown c4 153906728 1 2024-03-17T23:58:17.714 INFO:tasks.workunit.client.0.smithi196.stdout:6/21: symlink d2/l5 0 2024-03-17T23:58:17.715 INFO:tasks.workunit.client.0.smithi196.stdout:9/107: readlink d9/df/l1b 0 2024-03-17T23:58:17.716 INFO:tasks.workunit.client.0.smithi196.stdout:6/22: readlink d2/l5 0 2024-03-17T23:58:17.717 INFO:tasks.workunit.client.0.smithi196.stdout:8/40: rename c4 to c8 0 2024-03-17T23:58:17.720 INFO:tasks.workunit.client.0.smithi196.stdout:3/148: dwrite d7/f8 [0,4194304] 0 2024-03-17T23:58:17.720 INFO:tasks.workunit.client.0.smithi196.stdout:4/30: rename d1/l6 to d1/l7 0 2024-03-17T23:58:17.723 INFO:tasks.workunit.client.0.smithi196.stdout:0/88: getdents d5 0 2024-03-17T23:58:17.726 INFO:tasks.workunit.client.0.smithi196.stdout:8/41: mknod c9 0 2024-03-17T23:58:17.726 INFO:tasks.workunit.client.0.smithi196.stdout:1/64: dwrite d1/db/dd/f12 [0,4194304] 0 2024-03-17T23:58:17.727 INFO:tasks.workunit.client.0.smithi196.stdout:8/42: stat f6 0 2024-03-17T23:58:17.729 INFO:tasks.workunit.client.0.smithi196.stdout:6/23: dread f1 [0,4194304] 0 2024-03-17T23:58:17.729 INFO:tasks.workunit.client.0.smithi196.stdout:8/43: write f7 [1084361,22642] 0 2024-03-17T23:58:17.732 INFO:tasks.workunit.client.0.smithi196.stdout:3/149: creat d7/d19/f30 x:0 0 0 2024-03-17T23:58:17.735 INFO:tasks.workunit.client.0.smithi196.stdout:8/44: write f7 [1092718,65658] 0 2024-03-17T23:58:17.736 INFO:tasks.workunit.client.0.smithi196.stdout:6/24: mknod d2/c6 0 2024-03-17T23:58:17.737 INFO:tasks.workunit.client.0.smithi196.stdout:8/45: write f7 [484782,96224] 0 2024-03-17T23:58:17.738 INFO:tasks.workunit.client.0.smithi196.stdout:1/65: rename d1/db/ff to d1/f1d 0 2024-03-17T23:58:17.741 INFO:tasks.workunit.client.0.smithi196.stdout:4/31: dwrite d1/f4 [0,4194304] 0 2024-03-17T23:58:17.742 INFO:tasks.workunit.client.0.smithi196.stdout:6/25: mkdir d2/d7 0 2024-03-17T23:58:17.742 INFO:tasks.workunit.client.0.smithi196.stdout:8/46: write f6 [117377,23908] 0 2024-03-17T23:58:17.743 INFO:tasks.workunit.client.0.smithi196.stdout:1/66: fdatasync d1/db/f15 0 2024-03-17T23:58:17.743 INFO:tasks.workunit.client.0.smithi196.stdout:1/67: stat d1/db/fe 0 2024-03-17T23:58:17.749 INFO:tasks.workunit.client.0.smithi196.stdout:1/68: rename d1/db/dd/c10 to d1/db/c1e 0 2024-03-17T23:58:17.751 INFO:tasks.workunit.client.0.smithi196.stdout:0/89: write d5/fd [209704,87233] 0 2024-03-17T23:58:17.752 INFO:tasks.workunit.client.0.smithi196.stdout:3/150: write d7/f17 [377815,100515] 0 2024-03-17T23:58:17.758 INFO:tasks.workunit.client.0.smithi196.stdout:6/26: rename d2/c4 to d2/c8 0 2024-03-17T23:58:17.758 INFO:tasks.workunit.client.0.smithi196.stdout:6/27: readlink d2/l5 0 2024-03-17T23:58:17.758 INFO:tasks.workunit.client.0.smithi196.stdout:0/90: dread d5/fd [0,4194304] 0 2024-03-17T23:58:17.760 INFO:tasks.workunit.client.0.smithi196.stdout:1/69: truncate d1/d13/f1a 368569 0 2024-03-17T23:58:17.760 INFO:tasks.workunit.client.0.smithi196.stdout:4/32: getdents d1 0 2024-03-17T23:58:17.761 INFO:tasks.workunit.client.0.smithi196.stdout:8/47: dwrite f6 [0,4194304] 0 2024-03-17T23:58:17.763 INFO:tasks.workunit.client.0.smithi196.stdout:4/33: write d1/f4 [657517,96649] 0 2024-03-17T23:58:17.766 INFO:tasks.workunit.client.0.smithi196.stdout:4/34: fsync d1/f4 0 2024-03-17T23:58:17.766 INFO:tasks.workunit.client.0.smithi196.stdout:3/151: dread d7/ff [0,4194304] 0 2024-03-17T23:58:17.767 INFO:tasks.workunit.client.0.smithi196.stdout:0/91: rename d5/l19 to d5/l1a 0 2024-03-17T23:58:17.768 INFO:tasks.workunit.client.0.smithi196.stdout:8/48: symlink la 0 2024-03-17T23:58:17.769 INFO:tasks.workunit.client.0.smithi196.stdout:8/49: write f7 [1812188,56779] 0 2024-03-17T23:58:17.769 INFO:tasks.workunit.client.0.smithi196.stdout:6/28: dread f0 [0,4194304] 0 2024-03-17T23:58:17.772 INFO:tasks.workunit.client.0.smithi196.stdout:8/50: chown f6 25114171 1 2024-03-17T23:58:17.775 INFO:tasks.workunit.client.0.smithi196.stdout:4/35: readlink d1/l7 0 2024-03-17T23:58:17.776 INFO:tasks.workunit.client.0.smithi196.stdout:0/92: symlink d5/l1b 0 2024-03-17T23:58:17.776 INFO:tasks.workunit.client.0.smithi196.stdout:4/36: fdatasync d1/f4 0 2024-03-17T23:58:17.777 INFO:tasks.workunit.client.0.smithi196.stdout:0/93: readlink d5/l14 0 2024-03-17T23:58:17.777 INFO:tasks.workunit.client.0.smithi196.stdout:3/152: rename d7/c13 to d7/d29/c31 0 2024-03-17T23:58:17.778 INFO:tasks.workunit.client.0.smithi196.stdout:8/51: fdatasync f7 0 2024-03-17T23:58:17.784 INFO:tasks.workunit.client.0.smithi196.stdout:0/94: truncate d5/fd 341090 0 2024-03-17T23:58:17.786 INFO:tasks.workunit.client.0.smithi196.stdout:4/37: getdents d1 0 2024-03-17T23:58:17.787 INFO:tasks.workunit.client.0.smithi196.stdout:3/153: write d7/f15 [3690382,112510] 0 2024-03-17T23:58:17.789 INFO:tasks.workunit.client.0.smithi196.stdout:4/38: creat d1/f8 x:0 0 0 2024-03-17T23:58:17.790 INFO:tasks.workunit.client.0.smithi196.stdout:8/52: link la lb 0 2024-03-17T23:58:17.791 INFO:tasks.workunit.client.0.smithi196.stdout:4/39: chown d1 9 1 2024-03-17T23:58:17.791 INFO:tasks.workunit.client.0.smithi196.stdout:1/70: dwrite d1/db/fe [0,4194304] 0 2024-03-17T23:58:17.793 INFO:tasks.workunit.client.0.smithi196.stdout:3/154: creat d7/d19/f32 x:0 0 0 2024-03-17T23:58:17.793 INFO:tasks.workunit.client.0.smithi196.stdout:0/95: stat d5/c17 0 2024-03-17T23:58:17.793 INFO:tasks.workunit.client.0.smithi196.stdout:4/40: symlink d1/l9 0 2024-03-17T23:58:17.796 INFO:tasks.workunit.client.0.smithi196.stdout:3/155: mkdir d7/d33 0 2024-03-17T23:58:17.799 INFO:tasks.workunit.client.0.smithi196.stdout:4/41: chown d1/f4 19438 1 2024-03-17T23:58:17.799 INFO:tasks.workunit.client.0.smithi196.stdout:0/96: creat d5/f1c x:0 0 0 2024-03-17T23:58:17.802 INFO:tasks.workunit.client.0.smithi196.stdout:6/29: dwrite f0 [4194304,4194304] 0 2024-03-17T23:58:17.802 INFO:tasks.workunit.client.0.smithi196.stdout:1/71: dread d1/d13/f18 [0,4194304] 0 2024-03-17T23:58:17.802 INFO:tasks.workunit.client.0.smithi196.stdout:8/53: write f3 [2994459,86461] 0 2024-03-17T23:58:17.802 INFO:tasks.workunit.client.0.smithi196.stdout:4/42: mknod d1/ca 0 2024-03-17T23:58:17.805 INFO:tasks.workunit.client.0.smithi196.stdout:3/156: rmdir d7/d29 39 2024-03-17T23:58:17.806 INFO:tasks.workunit.client.0.smithi196.stdout:1/72: dread - d1/db/f15 zero size 2024-03-17T23:58:17.811 INFO:tasks.workunit.client.0.smithi196.stdout:8/54: write f7 [618502,31597] 0 2024-03-17T23:58:17.816 INFO:tasks.workunit.client.0.smithi196.stdout:0/97: dwrite d5/fa [4194304,4194304] 0 2024-03-17T23:58:17.819 INFO:tasks.workunit.client.0.smithi196.stdout:8/55: symlink lc 0 2024-03-17T23:58:17.821 INFO:tasks.workunit.client.0.smithi196.stdout:1/73: rename d1/f1d to d1/db/f1f 0 2024-03-17T23:58:17.824 INFO:tasks.workunit.client.0.smithi196.stdout:3/157: write f6 [3525142,38462] 0 2024-03-17T23:58:17.826 INFO:tasks.workunit.client.0.smithi196.stdout:4/43: dwrite d1/f8 [0,4194304] 0 2024-03-17T23:58:17.833 INFO:tasks.workunit.client.0.smithi196.stdout:8/56: symlink ld 0 2024-03-17T23:58:17.833 INFO:tasks.workunit.client.0.smithi196.stdout:6/30: dwrite f0 [4194304,4194304] 0 2024-03-17T23:58:17.833 INFO:tasks.workunit.client.0.smithi196.stdout:1/74: symlink d1/db/l20 0 2024-03-17T23:58:17.833 INFO:tasks.workunit.client.0.smithi196.stdout:6/31: stat d2/c6 0 2024-03-17T23:58:17.833 INFO:tasks.workunit.client.0.smithi196.stdout:8/57: chown c9 1 1 2024-03-17T23:58:17.835 INFO:tasks.workunit.client.0.smithi196.stdout:4/44: truncate d1/f4 940030 0 2024-03-17T23:58:17.837 INFO:tasks.workunit.client.0.smithi196.stdout:0/98: getdents d5 0 2024-03-17T23:58:17.837 INFO:tasks.workunit.client.0.smithi196.stdout:3/158: mknod d7/d29/c34 0 2024-03-17T23:58:17.839 INFO:tasks.workunit.client.0.smithi196.stdout:2/153: sync 2024-03-17T23:58:17.844 INFO:tasks.workunit.client.0.smithi196.stdout:1/75: dread d1/f9 [4194304,4194304] 0 2024-03-17T23:58:17.844 INFO:tasks.workunit.client.0.smithi196.stdout:0/99: fsync d5/f12 0 2024-03-17T23:58:17.844 INFO:tasks.workunit.client.0.smithi196.stdout:0/100: dread - d5/f18 zero size 2024-03-17T23:58:17.844 INFO:tasks.workunit.client.0.smithi196.stdout:6/32: dwrite f0 [4194304,4194304] 0 2024-03-17T23:58:17.844 INFO:tasks.workunit.client.0.smithi196.stdout:2/154: symlink d17/d19/l3c 0 2024-03-17T23:58:17.844 INFO:tasks.workunit.client.0.smithi196.stdout:3/159: rename c5 to d7/d33/c35 0 2024-03-17T23:58:17.855 INFO:tasks.workunit.client.0.smithi196.stdout:2/155: write d17/d1f/f23 [245304,36019] 0 2024-03-17T23:58:17.855 INFO:tasks.workunit.client.0.smithi196.stdout:2/156: chown d17/d22/f27 56416242 1 2024-03-17T23:58:17.859 INFO:tasks.workunit.client.0.smithi196.stdout:1/76: creat d1/f21 x:0 0 0 2024-03-17T23:58:17.860 INFO:tasks.workunit.client.0.smithi196.stdout:8/58: truncate f3 4019672 0 2024-03-17T23:58:17.861 INFO:tasks.workunit.client.0.smithi196.stdout:3/160: mknod d7/d19/d26/c36 0 2024-03-17T23:58:17.862 INFO:tasks.workunit.client.0.smithi196.stdout:6/33: rename d2/l5 to d2/d7/l9 0 2024-03-17T23:58:17.864 INFO:tasks.workunit.client.0.smithi196.stdout:2/157: mkdir d17/d22/d3d 0 2024-03-17T23:58:17.866 INFO:tasks.workunit.client.0.smithi196.stdout:8/59: mkdir de 0 2024-03-17T23:58:17.867 INFO:tasks.workunit.client.0.smithi196.stdout:3/161: dread d7/ff [0,4194304] 0 2024-03-17T23:58:17.869 INFO:tasks.workunit.client.0.smithi196.stdout:6/34: mkdir d2/d7/da 0 2024-03-17T23:58:17.871 INFO:tasks.workunit.client.0.smithi196.stdout:2/158: mknod d17/d19/c3e 0 2024-03-17T23:58:17.874 INFO:tasks.workunit.client.0.smithi196.stdout:3/162: creat d7/d19/d26/f37 x:0 0 0 2024-03-17T23:58:17.874 INFO:tasks.workunit.client.0.smithi196.stdout:6/35: mknod d2/d7/cb 0 2024-03-17T23:58:17.875 INFO:tasks.workunit.client.0.smithi196.stdout:3/163: readlink d7/l2a 0 2024-03-17T23:58:17.876 INFO:tasks.workunit.client.0.smithi196.stdout:3/164: readlink d7/l2e 0 2024-03-17T23:58:17.876 INFO:tasks.workunit.client.0.smithi196.stdout:2/159: unlink d17/d22/l36 0 2024-03-17T23:58:17.877 INFO:tasks.workunit.client.0.smithi196.stdout:0/101: dwrite d5/f18 [0,4194304] 0 2024-03-17T23:58:17.878 INFO:tasks.workunit.client.0.smithi196.stdout:8/60: creat de/ff x:0 0 0 2024-03-17T23:58:17.880 INFO:tasks.workunit.client.0.smithi196.stdout:8/61: fsync f7 0 2024-03-17T23:58:17.882 INFO:tasks.workunit.client.0.smithi196.stdout:1/77: write d1/db/f1f [1260622,86661] 0 2024-03-17T23:58:17.886 INFO:tasks.workunit.client.0.smithi196.stdout:6/36: mknod d2/cc 0 2024-03-17T23:58:17.891 INFO:tasks.workunit.client.0.smithi196.stdout:6/37: dread f0 [0,4194304] 0 2024-03-17T23:58:17.892 INFO:tasks.workunit.client.0.smithi196.stdout:2/160: mkdir d17/d22/d3f 0 2024-03-17T23:58:17.893 INFO:tasks.workunit.client.0.smithi196.stdout:2/161: fsync d17/d1f/f2e 0 2024-03-17T23:58:17.893 INFO:tasks.workunit.client.0.smithi196.stdout:3/165: rmdir d7/d19/d26/d2b 39 2024-03-17T23:58:17.898 INFO:tasks.workunit.client.0.smithi196.stdout:1/78: fdatasync d1/f8 0 2024-03-17T23:58:17.900 INFO:tasks.workunit.client.0.smithi196.stdout:6/38: stat d2/d7/l9 0 2024-03-17T23:58:17.901 INFO:tasks.workunit.client.0.smithi196.stdout:3/166: mkdir d7/d29/d38 0 2024-03-17T23:58:17.905 INFO:tasks.workunit.client.0.smithi196.stdout:0/102: getdents d5 0 2024-03-17T23:58:17.906 INFO:tasks.workunit.client.0.smithi196.stdout:1/79: mknod d1/c22 0 2024-03-17T23:58:17.909 INFO:tasks.workunit.client.0.smithi196.stdout:1/80: fdatasync d1/db/f1f 0 2024-03-17T23:58:17.913 INFO:tasks.workunit.client.0.smithi196.stdout:3/167: dwrite d7/fb [0,4194304] 0 2024-03-17T23:58:17.915 INFO:tasks.workunit.client.0.smithi196.stdout:3/168: stat d7/d19 0 2024-03-17T23:58:17.920 INFO:tasks.workunit.client.0.smithi196.stdout:2/162: link d17/d28/f29 d17/d22/f40 0 2024-03-17T23:58:17.921 INFO:tasks.workunit.client.0.smithi196.stdout:6/39: dwrite f0 [0,4194304] 0 2024-03-17T23:58:17.923 INFO:tasks.workunit.client.0.smithi196.stdout:0/103: rename d5/c17 to d5/c1d 0 2024-03-17T23:58:17.924 INFO:tasks.workunit.client.0.smithi196.stdout:1/81: mkdir d1/d13/d23 0 2024-03-17T23:58:17.925 INFO:tasks.workunit.client.0.smithi196.stdout:3/169: rmdir d7/d19/d26 39 2024-03-17T23:58:17.927 INFO:tasks.workunit.client.0.smithi196.stdout:2/163: rename fd to d17/d19/f41 0 2024-03-17T23:58:17.931 INFO:tasks.workunit.client.0.smithi196.stdout:6/40: creat d2/fd x:0 0 0 2024-03-17T23:58:17.933 INFO:tasks.workunit.client.0.smithi196.stdout:3/170: dread - d7/f22 zero size 2024-03-17T23:58:17.938 INFO:tasks.workunit.client.0.smithi196.stdout:8/62: dwrite f3 [0,4194304] 0 2024-03-17T23:58:17.940 INFO:tasks.workunit.client.0.smithi196.stdout:1/82: dwrite d1/db/fe [0,4194304] 0 2024-03-17T23:58:17.949 INFO:tasks.workunit.client.0.smithi196.stdout:1/83: creat d1/d13/f24 x:0 0 0 2024-03-17T23:58:17.952 INFO:tasks.workunit.client.0.smithi196.stdout:8/63: write f6 [1092784,107287] 0 2024-03-17T23:58:17.954 INFO:tasks.workunit.client.0.smithi196.stdout:2/164: dwrite f2 [0,4194304] 0 2024-03-17T23:58:17.955 INFO:tasks.workunit.client.0.smithi196.stdout:6/41: dwrite d2/fd [0,4194304] 0 2024-03-17T23:58:17.955 INFO:tasks.workunit.client.0.smithi196.stdout:3/171: symlink d7/d19/d26/d2b/l39 0 2024-03-17T23:58:17.961 INFO:tasks.workunit.client.0.smithi196.stdout:3/172: chown d7/d19/c25 8766235 1 2024-03-17T23:58:17.962 INFO:tasks.workunit.client.0.smithi196.stdout:2/165: fdatasync d17/d19/f1a 0 2024-03-17T23:58:17.962 INFO:tasks.workunit.client.0.smithi196.stdout:0/104: dwrite d5/f12 [0,4194304] 0 2024-03-17T23:58:17.963 INFO:tasks.workunit.client.0.smithi196.stdout:1/84: rename d1/d13/f1a to d1/f25 0 2024-03-17T23:58:17.963 INFO:tasks.workunit.client.0.smithi196.stdout:6/42: mknod d2/d7/da/ce 0 2024-03-17T23:58:17.969 INFO:tasks.workunit.client.0.smithi196.stdout:3/173: unlink d7/d19/c25 0 2024-03-17T23:58:17.972 INFO:tasks.workunit.client.0.smithi196.stdout:8/64: dwrite de/ff [0,4194304] 0 2024-03-17T23:58:17.972 INFO:tasks.workunit.client.0.smithi196.stdout:3/174: truncate d7/d19/f32 836304 0 2024-03-17T23:58:17.974 INFO:tasks.workunit.client.0.smithi196.stdout:6/43: creat d2/ff x:0 0 0 2024-03-17T23:58:17.975 INFO:tasks.workunit.client.0.smithi196.stdout:2/166: mknod d17/c42 0 2024-03-17T23:58:17.975 INFO:tasks.workunit.client.0.smithi196.stdout:8/65: mkdir de/d10 0 2024-03-17T23:58:17.975 INFO:tasks.workunit.client.0.smithi196.stdout:8/66: stat de/ff 0 2024-03-17T23:58:17.976 INFO:tasks.workunit.client.0.smithi196.stdout:3/175: truncate d7/d19/f1c 1300830 0 2024-03-17T23:58:17.978 INFO:tasks.workunit.client.0.smithi196.stdout:2/167: write f13 [2961618,44360] 0 2024-03-17T23:58:17.979 INFO:tasks.workunit.client.0.smithi196.stdout:1/85: symlink d1/d13/d23/l26 0 2024-03-17T23:58:17.980 INFO:tasks.workunit.client.0.smithi196.stdout:6/44: symlink d2/d7/l10 0 2024-03-17T23:58:17.980 INFO:tasks.workunit.client.0.smithi196.stdout:6/45: rename d2 to d2/d7/da/d11 22 2024-03-17T23:58:17.981 INFO:tasks.workunit.client.0.smithi196.stdout:3/176: unlink d7/d19/l24 0 2024-03-17T23:58:17.982 INFO:tasks.workunit.client.0.smithi196.stdout:6/46: write d2/ff [300495,117493] 0 2024-03-17T23:58:17.982 INFO:tasks.workunit.client.0.smithi196.stdout:1/86: rmdir d1/d13 39 2024-03-17T23:58:17.983 INFO:tasks.workunit.client.0.smithi196.stdout:8/67: symlink de/d10/l11 0 2024-03-17T23:58:17.985 INFO:tasks.workunit.client.0.smithi196.stdout:8/68: write f3 [1448468,39756] 0 2024-03-17T23:58:17.990 INFO:tasks.workunit.client.0.smithi196.stdout:6/47: dread f1 [0,4194304] 0 2024-03-17T23:58:17.992 INFO:tasks.workunit.client.0.smithi196.stdout:6/48: write f0 [7323643,24904] 0 2024-03-17T23:58:17.994 INFO:tasks.workunit.client.0.smithi196.stdout:2/168: dwrite d17/d19/f1a [0,4194304] 0 2024-03-17T23:58:17.996 INFO:tasks.workunit.client.0.smithi196.stdout:0/105: dread d5/f10 [0,4194304] 0 2024-03-17T23:58:17.998 INFO:tasks.workunit.client.0.smithi196.stdout:1/87: creat d1/d13/d23/f27 x:0 0 0 2024-03-17T23:58:17.999 INFO:tasks.workunit.client.0.smithi196.stdout:3/177: creat d7/d19/d26/f3a x:0 0 0 2024-03-17T23:58:17.999 INFO:tasks.workunit.client.0.smithi196.stdout:3/178: chown d7/f2c 195259 1 2024-03-17T23:58:18.001 INFO:tasks.workunit.client.0.smithi196.stdout:0/106: fdatasync d5/f10 0 2024-03-17T23:58:18.007 INFO:tasks.workunit.client.0.smithi196.stdout:6/49: rename d2/c8 to d2/c12 0 2024-03-17T23:58:18.008 INFO:tasks.workunit.client.0.smithi196.stdout:3/179: creat d7/d19/d26/d2b/f3b x:0 0 0 2024-03-17T23:58:18.009 INFO:tasks.workunit.client.0.smithi196.stdout:3/180: chown d7/d19 2052445 1 2024-03-17T23:58:18.010 INFO:tasks.workunit.client.0.smithi196.stdout:0/107: symlink d5/l1e 0 2024-03-17T23:58:18.014 INFO:tasks.workunit.client.0.smithi196.stdout:3/181: rename d7/d29/d38 to d7/d19/d26/d2b/d3c 0 2024-03-17T23:58:18.018 INFO:tasks.workunit.client.0.smithi196.stdout:8/69: truncate f3 3361526 0 2024-03-17T23:58:18.018 INFO:tasks.workunit.client.0.smithi196.stdout:0/108: write d5/fd [839997,119865] 0 2024-03-17T23:58:18.018 INFO:tasks.workunit.client.0.smithi196.stdout:2/169: write d17/d28/f29 [1001038,58805] 0 2024-03-17T23:58:18.019 INFO:tasks.workunit.client.0.smithi196.stdout:1/88: write d1/f8 [503034,99940] 0 2024-03-17T23:58:18.020 INFO:tasks.workunit.client.0.smithi196.stdout:3/182: getdents d7/d19/d26/d2b/d3c 0 2024-03-17T23:58:18.021 INFO:tasks.workunit.client.0.smithi196.stdout:8/70: chown de/d10/l11 231853 1 2024-03-17T23:58:18.021 INFO:tasks.workunit.client.0.smithi196.stdout:3/183: dread - d7/d19/d26/d2b/f3b zero size 2024-03-17T23:58:18.022 INFO:tasks.workunit.client.0.smithi196.stdout:0/109: mknod d5/c1f 0 2024-03-17T23:58:18.023 INFO:tasks.workunit.client.0.smithi196.stdout:3/184: fsync d7/f8 0 2024-03-17T23:58:18.023 INFO:tasks.workunit.client.0.smithi196.stdout:2/170: creat d17/d1f/f43 x:0 0 0 2024-03-17T23:58:18.057 INFO:tasks.workunit.client.0.smithi196.stdout:7/36: sync 2024-03-17T23:58:18.060 INFO:tasks.workunit.client.0.smithi196.stdout:1/89: symlink d1/db/l28 0 2024-03-17T23:58:18.060 INFO:tasks.workunit.client.0.smithi196.stdout:8/71: rename c2 to de/c12 0 2024-03-17T23:58:18.061 INFO:tasks.workunit.client.0.smithi196.stdout:0/110: fdatasync d5/f13 0 2024-03-17T23:58:18.063 INFO:tasks.workunit.client.0.smithi196.stdout:3/185: mkdir d7/d19/d26/d2b/d3c/d3d 0 2024-03-17T23:58:18.063 INFO:tasks.workunit.client.0.smithi196.stdout:1/90: chown d1/f16 14 1 2024-03-17T23:58:18.068 INFO:tasks.workunit.client.0.smithi196.stdout:0/111: unlink d5/l1a 0 2024-03-17T23:58:18.069 INFO:tasks.workunit.client.0.smithi196.stdout:2/171: dread d17/d19/f41 [0,4194304] 0 2024-03-17T23:58:18.070 INFO:tasks.workunit.client.0.smithi196.stdout:3/186: dread - d7/f1f zero size 2024-03-17T23:58:18.071 INFO:tasks.workunit.client.0.smithi196.stdout:8/72: dread de/ff [0,4194304] 0 2024-03-17T23:58:18.074 INFO:tasks.workunit.client.0.smithi196.stdout:7/37: write f8 [44864,36393] 0 2024-03-17T23:58:18.077 INFO:tasks.workunit.client.0.smithi196.stdout:0/112: symlink d5/l20 0 2024-03-17T23:58:18.081 INFO:tasks.workunit.client.0.smithi196.stdout:0/113: rename d5/c1f to d5/c21 0 2024-03-17T23:58:18.094 INFO:tasks.workunit.client.0.smithi196.stdout:0/114: truncate d5/f12 4418788 0 2024-03-17T23:58:18.096 INFO:tasks.workunit.client.0.smithi196.stdout:7/38: dwrite f3 [0,4194304] 0 2024-03-17T23:58:18.099 INFO:tasks.workunit.client.0.smithi196.stdout:2/172: dwrite d17/d1f/f23 [0,4194304] 0 2024-03-17T23:58:18.099 INFO:tasks.workunit.client.0.smithi196.stdout:1/91: dwrite d1/db/f14 [0,4194304] 0 2024-03-17T23:58:18.100 INFO:tasks.workunit.client.0.smithi196.stdout:7/39: chown da 0 1 2024-03-17T23:58:18.101 INFO:tasks.workunit.client.0.smithi196.stdout:3/187: dwrite d7/fb [0,4194304] 0 2024-03-17T23:58:18.104 INFO:tasks.workunit.client.0.smithi196.stdout:8/73: dwrite f3 [0,4194304] 0 2024-03-17T23:58:18.104 INFO:tasks.workunit.client.0.smithi196.stdout:1/92: chown d1/c2 4341 1 2024-03-17T23:58:18.106 INFO:tasks.workunit.client.0.smithi196.stdout:3/188: fsync d7/f1b 0 2024-03-17T23:58:18.109 INFO:tasks.workunit.client.0.smithi196.stdout:0/115: mkdir d5/d22 0 2024-03-17T23:58:18.112 INFO:tasks.workunit.client.0.smithi196.stdout:7/40: rename l7 to da/lc 0 2024-03-17T23:58:18.113 INFO:tasks.workunit.client.0.smithi196.stdout:2/173: mkdir d17/d19/d44 0 2024-03-17T23:58:18.117 INFO:tasks.workunit.client.0.smithi196.stdout:1/93: creat d1/d13/d23/f29 x:0 0 0 2024-03-17T23:58:18.117 INFO:tasks.workunit.client.0.smithi196.stdout:3/189: mknod d7/d19/d26/d2b/c3e 0 2024-03-17T23:58:18.118 INFO:tasks.workunit.client.0.smithi196.stdout:0/116: mkdir d5/d23 0 2024-03-17T23:58:18.118 INFO:tasks.workunit.client.0.smithi196.stdout:7/41: mknod da/cd 0 2024-03-17T23:58:18.120 INFO:tasks.workunit.client.0.smithi196.stdout:7/42: write f8 [589932,18138] 0 2024-03-17T23:58:18.121 INFO:tasks.workunit.client.0.smithi196.stdout:8/74: unlink de/c12 0 2024-03-17T23:58:18.122 INFO:tasks.workunit.client.0.smithi196.stdout:8/75: chown f7 8024 1 2024-03-17T23:58:18.124 INFO:tasks.workunit.client.0.smithi196.stdout:3/190: rename c1 to d7/d19/d26/d2b/c3f 0 2024-03-17T23:58:18.125 INFO:tasks.workunit.client.0.smithi196.stdout:7/43: creat da/fe x:0 0 0 2024-03-17T23:58:18.126 INFO:tasks.workunit.client.0.smithi196.stdout:0/117: mkdir d5/d23/d24 0 2024-03-17T23:58:18.127 INFO:tasks.workunit.client.0.smithi196.stdout:2/174: getdents d17 0 2024-03-17T23:58:18.129 INFO:tasks.workunit.client.0.smithi196.stdout:3/191: symlink d7/d19/l40 0 2024-03-17T23:58:18.131 INFO:tasks.workunit.client.0.smithi196.stdout:7/44: chown l9 162 1 2024-03-17T23:58:18.133 INFO:tasks.workunit.client.0.smithi196.stdout:3/192: rename d7 to d7/d19/d26/d41 22 2024-03-17T23:58:18.133 INFO:tasks.workunit.client.0.smithi196.stdout:2/175: readlink d17/d22/l32 0 2024-03-17T23:58:18.134 INFO:tasks.workunit.client.0.smithi196.stdout:8/76: dwrite f7 [0,4194304] 0 2024-03-17T23:58:18.135 INFO:tasks.workunit.client.0.smithi196.stdout:3/193: chown d7/c18 6915745 1 2024-03-17T23:58:18.140 INFO:tasks.workunit.client.0.smithi196.stdout:0/118: dwrite d5/f12 [4194304,4194304] 0 2024-03-17T23:58:18.142 INFO:tasks.workunit.client.0.smithi196.stdout:1/94: truncate d1/db/f14 2980206 0 2024-03-17T23:58:18.150 INFO:tasks.workunit.client.0.smithi196.stdout:3/194: creat d7/d19/d26/d2b/f42 x:0 0 0 2024-03-17T23:58:18.150 INFO:tasks.workunit.client.0.smithi196.stdout:0/119: read d5/f18 [42501,83479] 0 2024-03-17T23:58:18.150 INFO:tasks.workunit.client.0.smithi196.stdout:0/120: stat d5/f18 0 2024-03-17T23:58:18.150 INFO:tasks.workunit.client.0.smithi196.stdout:0/121: write d5/fd [1245141,121617] 0 2024-03-17T23:58:18.153 INFO:tasks.workunit.client.0.smithi196.stdout:7/45: getdents da 0 2024-03-17T23:58:18.156 INFO:tasks.workunit.client.0.smithi196.stdout:0/122: symlink d5/d22/l25 0 2024-03-17T23:58:18.158 INFO:tasks.workunit.client.0.smithi196.stdout:3/195: dread d7/f15 [0,4194304] 0 2024-03-17T23:58:18.161 INFO:tasks.workunit.client.0.smithi196.stdout:0/123: rename d5/fd to d5/d22/f26 0 2024-03-17T23:58:18.162 INFO:tasks.workunit.client.0.smithi196.stdout:7/46: dread f3 [0,4194304] 0 2024-03-17T23:58:18.162 INFO:tasks.workunit.client.0.smithi196.stdout:3/196: dread - d7/d19/d26/f37 zero size 2024-03-17T23:58:18.164 INFO:tasks.workunit.client.0.smithi196.stdout:1/95: dwrite d1/d13/f24 [0,4194304] 0 2024-03-17T23:58:18.164 INFO:tasks.workunit.client.0.smithi196.stdout:3/197: stat d7/f15 0 2024-03-17T23:58:18.165 INFO:tasks.workunit.client.0.smithi196.stdout:1/96: write d1/f21 [665315,95678] 0 2024-03-17T23:58:18.167 INFO:tasks.workunit.client.0.smithi196.stdout:7/47: creat da/ff x:0 0 0 2024-03-17T23:58:18.170 INFO:tasks.workunit.client.0.smithi196.stdout:7/48: write da/fe [893702,88708] 0 2024-03-17T23:58:18.172 INFO:tasks.workunit.client.0.smithi196.stdout:0/124: link d5/l1b d5/d22/l27 0 2024-03-17T23:58:18.174 INFO:tasks.workunit.client.0.smithi196.stdout:0/125: fsync d5/f1c 0 2024-03-17T23:58:18.178 INFO:tasks.workunit.client.0.smithi196.stdout:0/126: stat d5/l1b 0 2024-03-17T23:58:18.179 INFO:tasks.workunit.client.0.smithi196.stdout:7/49: link da/lc da/l10 0 2024-03-17T23:58:18.180 INFO:tasks.workunit.client.0.smithi196.stdout:1/97: write d1/db/f14 [2124057,80409] 0 2024-03-17T23:58:18.180 INFO:tasks.workunit.client.0.smithi196.stdout:0/127: read d5/fa [2018372,24139] 0 2024-03-17T23:58:18.183 INFO:tasks.workunit.client.0.smithi196.stdout:7/50: symlink da/l11 0 2024-03-17T23:58:18.185 INFO:tasks.workunit.client.0.smithi196.stdout:3/198: dwrite d7/fd [4194304,4194304] 0 2024-03-17T23:58:18.185 INFO:tasks.workunit.client.0.smithi196.stdout:1/98: mkdir d1/d13/d2a 0 2024-03-17T23:58:18.187 INFO:tasks.workunit.client.0.smithi196.stdout:0/128: write d5/d22/f26 [920994,17431] 0 2024-03-17T23:58:18.188 INFO:tasks.workunit.client.0.smithi196.stdout:0/129: stat d5/d22/l25 0 2024-03-17T23:58:18.189 INFO:tasks.workunit.client.0.smithi196.stdout:3/199: chown d7/d19/d26/d2b/f42 26299312 1 2024-03-17T23:58:18.190 INFO:tasks.workunit.client.0.smithi196.stdout:7/51: rename f3 to da/f12 0 2024-03-17T23:58:18.190 INFO:tasks.workunit.client.0.smithi196.stdout:1/99: chown d1/c6 12 1 2024-03-17T23:58:18.190 INFO:tasks.workunit.client.0.smithi196.stdout:0/130: fdatasync d5/f13 0 2024-03-17T23:58:18.193 INFO:tasks.workunit.client.0.smithi196.stdout:1/100: mknod d1/d13/d23/c2b 0 2024-03-17T23:58:18.195 INFO:tasks.workunit.client.0.smithi196.stdout:7/52: unlink da/lc 0 2024-03-17T23:58:18.197 INFO:tasks.workunit.client.0.smithi196.stdout:0/131: rename d5/d22 to d5/d23/d24/d28 0 2024-03-17T23:58:18.199 INFO:tasks.workunit.client.0.smithi196.stdout:7/53: fsync da/f12 0 2024-03-17T23:58:18.202 INFO:tasks.workunit.client.0.smithi196.stdout:7/54: creat da/f13 x:0 0 0 2024-03-17T23:58:18.202 INFO:tasks.workunit.client.0.smithi196.stdout:3/200: write d7/f11 [107649,31437] 0 2024-03-17T23:58:18.204 INFO:tasks.workunit.client.0.smithi196.stdout:0/132: link d5/f18 d5/f29 0 2024-03-17T23:58:18.205 INFO:tasks.workunit.client.0.smithi196.stdout:0/133: dread - d5/f1c zero size 2024-03-17T23:58:18.212 INFO:tasks.workunit.client.0.smithi196.stdout:1/101: write d1/db/f15 [626752,67199] 0 2024-03-17T23:58:18.215 INFO:tasks.workunit.client.0.smithi196.stdout:1/102: stat d1/d13/d23 0 2024-03-17T23:58:18.217 INFO:tasks.workunit.client.0.smithi196.stdout:1/103: read - d1/fa zero size 2024-03-17T23:58:18.246 INFO:tasks.workunit.client.0.smithi196.stdout:5/47: sync 2024-03-17T23:58:18.249 INFO:tasks.workunit.client.0.smithi196.stdout:7/55: dwrite da/f13 [0,4194304] 0 2024-03-17T23:58:18.252 INFO:tasks.workunit.client.0.smithi196.stdout:5/48: read f4 [976145,33870] 0 2024-03-17T23:58:18.255 INFO:tasks.workunit.client.0.smithi196.stdout:3/201: dwrite d7/d19/d26/f2f [0,4194304] 0 2024-03-17T23:58:18.255 INFO:tasks.workunit.client.0.smithi196.stdout:1/104: getdents d1/d13 0 2024-03-17T23:58:18.257 INFO:tasks.workunit.client.0.smithi196.stdout:0/134: dwrite d5/fa [0,4194304] 0 2024-03-17T23:58:18.261 INFO:tasks.workunit.client.0.smithi196.stdout:0/135: dread - d5/f1c zero size 2024-03-17T23:58:18.271 INFO:tasks.workunit.client.0.smithi196.stdout:7/56: dwrite da/f13 [0,4194304] 0 2024-03-17T23:58:18.274 INFO:tasks.workunit.client.0.smithi196.stdout:1/105: dwrite d1/f8 [0,4194304] 0 2024-03-17T23:58:18.276 INFO:tasks.workunit.client.0.smithi196.stdout:5/49: dwrite d6/fb [0,4194304] 0 2024-03-17T23:58:18.277 INFO:tasks.workunit.client.0.smithi196.stdout:7/57: readlink da/lb 0 2024-03-17T23:58:18.277 INFO:tasks.workunit.client.0.smithi196.stdout:0/136: write d5/f29 [5122306,77804] 0 2024-03-17T23:58:18.286 INFO:tasks.workunit.client.0.smithi196.stdout:0/137: fsync d5/f18 0 2024-03-17T23:58:18.288 INFO:tasks.workunit.client.0.smithi196.stdout:1/106: truncate d1/d13/d23/f27 769916 0 2024-03-17T23:58:18.289 INFO:tasks.workunit.client.0.smithi196.stdout:7/58: dread da/f13 [0,4194304] 0 2024-03-17T23:58:18.289 INFO:tasks.workunit.client.0.smithi196.stdout:1/107: readlink d1/db/l28 0 2024-03-17T23:58:18.291 INFO:tasks.workunit.client.0.smithi196.stdout:3/202: dwrite d7/f1f [0,4194304] 0 2024-03-17T23:58:18.291 INFO:tasks.workunit.client.0.smithi196.stdout:5/50: truncate d6/fd 377369 0 2024-03-17T23:58:18.294 INFO:tasks.workunit.client.0.smithi196.stdout:0/138: dread d5/f18 [0,4194304] 0 2024-03-17T23:58:18.297 INFO:tasks.workunit.client.0.smithi196.stdout:7/59: symlink da/l14 0 2024-03-17T23:58:18.297 INFO:tasks.workunit.client.0.smithi196.stdout:1/108: unlink d1/d13/d23/c2b 0 2024-03-17T23:58:18.301 INFO:tasks.workunit.client.0.smithi196.stdout:7/60: mkdir da/d15 0 2024-03-17T23:58:18.302 INFO:tasks.workunit.client.0.smithi196.stdout:1/109: mknod d1/db/dd/c2c 0 2024-03-17T23:58:18.303 INFO:tasks.workunit.client.0.smithi196.stdout:0/139: dread d5/f29 [0,4194304] 0 2024-03-17T23:58:18.304 INFO:tasks.workunit.client.0.smithi196.stdout:3/203: getdents d7/d19/d26 0 2024-03-17T23:58:18.306 INFO:tasks.workunit.client.0.smithi196.stdout:3/204: fsync d7/d19/f30 0 2024-03-17T23:58:18.308 INFO:tasks.workunit.client.0.smithi196.stdout:3/205: chown d7/d19/f1d 32 1 2024-03-17T23:58:18.312 INFO:tasks.workunit.client.0.smithi196.stdout:5/51: dwrite d6/fa [0,4194304] 0 2024-03-17T23:58:18.312 INFO:tasks.workunit.client.0.smithi196.stdout:0/140: dread d5/f29 [4194304,4194304] 0 2024-03-17T23:58:18.316 INFO:tasks.workunit.client.0.smithi196.stdout:0/141: read d5/d23/d24/d28/f26 [244412,19304] 0 2024-03-17T23:58:18.318 INFO:tasks.workunit.client.0.smithi196.stdout:1/110: dwrite d1/f9 [8388608,4194304] 0 2024-03-17T23:58:18.322 INFO:tasks.workunit.client.0.smithi196.stdout:7/61: dwrite da/fe [0,4194304] 0 2024-03-17T23:58:18.322 INFO:tasks.workunit.client.0.smithi196.stdout:1/111: write d1/f9 [984561,75668] 0 2024-03-17T23:58:18.332 INFO:tasks.workunit.client.0.smithi196.stdout:0/142: dwrite d5/d23/d24/d28/f26 [0,4194304] 0 2024-03-17T23:58:18.335 INFO:tasks.workunit.client.0.smithi196.stdout:5/52: write f2 [1007676,34678] 0 2024-03-17T23:58:18.335 INFO:tasks.workunit.client.0.smithi196.stdout:1/112: readlink d1/db/l19 0 2024-03-17T23:58:18.336 INFO:tasks.workunit.client.0.smithi196.stdout:3/206: creat d7/d19/d26/d2b/d3c/d3d/f43 x:0 0 0 2024-03-17T23:58:18.338 INFO:tasks.workunit.client.0.smithi196.stdout:3/207: write d7/f17 [147422,123074] 0 2024-03-17T23:58:18.340 INFO:tasks.workunit.client.0.smithi196.stdout:0/143: symlink d5/d23/d24/d28/l2a 0 2024-03-17T23:58:18.341 INFO:tasks.workunit.client.0.smithi196.stdout:1/113: write d1/db/f1f [1791323,118305] 0 2024-03-17T23:58:18.344 INFO:tasks.workunit.client.0.smithi196.stdout:5/53: creat d6/f10 x:0 0 0 2024-03-17T23:58:18.347 INFO:tasks.workunit.client.0.smithi196.stdout:5/54: write d6/fe [375242,63410] 0 2024-03-17T23:58:18.351 INFO:tasks.workunit.client.0.smithi196.stdout:1/114: fdatasync d1/d13/d23/f29 0 2024-03-17T23:58:18.352 INFO:tasks.workunit.client.0.smithi196.stdout:7/62: dwrite da/f12 [0,4194304] 0 2024-03-17T23:58:18.359 INFO:tasks.workunit.client.0.smithi196.stdout:1/115: symlink d1/d13/d23/l2d 0 2024-03-17T23:58:18.363 INFO:tasks.workunit.client.0.smithi196.stdout:7/63: write da/f13 [1846256,106073] 0 2024-03-17T23:58:18.370 INFO:tasks.workunit.client.0.smithi196.stdout:5/55: getdents d6 0 2024-03-17T23:58:18.370 INFO:tasks.workunit.client.0.smithi196.stdout:5/56: readlink d6/l9 0 2024-03-17T23:58:18.371 INFO:tasks.workunit.client.0.smithi196.stdout:1/116: mknod d1/d13/c2e 0 2024-03-17T23:58:18.372 INFO:tasks.workunit.client.0.smithi196.stdout:7/64: dread da/f12 [0,4194304] 0 2024-03-17T23:58:18.373 INFO:tasks.workunit.client.0.smithi196.stdout:0/144: dwrite d5/f12 [0,4194304] 0 2024-03-17T23:58:18.373 INFO:tasks.workunit.client.0.smithi196.stdout:5/57: symlink d6/l11 0 2024-03-17T23:58:18.376 INFO:tasks.workunit.client.0.smithi196.stdout:3/208: dwrite d7/f16 [4194304,4194304] 0 2024-03-17T23:58:18.377 INFO:tasks.workunit.client.0.smithi196.stdout:0/145: write d5/d23/d24/d28/f26 [693839,20719] 0 2024-03-17T23:58:18.378 INFO:tasks.workunit.client.0.smithi196.stdout:7/65: stat da/cd 0 2024-03-17T23:58:18.378 INFO:tasks.workunit.client.0.smithi196.stdout:7/66: fdatasync da/f13 0 2024-03-17T23:58:18.380 INFO:tasks.workunit.client.0.smithi196.stdout:5/58: mknod d6/c12 0 2024-03-17T23:58:18.381 INFO:tasks.workunit.client.0.smithi196.stdout:5/59: chown c5 417 1 2024-03-17T23:58:18.382 INFO:tasks.workunit.client.0.smithi196.stdout:0/146: chown d5/l1b 317877 1 2024-03-17T23:58:18.383 INFO:tasks.workunit.client.0.smithi196.stdout:3/209: creat d7/d19/d26/d2b/f44 x:0 0 0 2024-03-17T23:58:18.387 INFO:tasks.workunit.client.0.smithi196.stdout:0/147: creat d5/d23/d24/f2b x:0 0 0 2024-03-17T23:58:18.387 INFO:tasks.workunit.client.0.smithi196.stdout:1/117: getdents d1 0 2024-03-17T23:58:18.388 INFO:tasks.workunit.client.0.smithi196.stdout:3/210: mknod d7/d19/d26/d2b/d3c/d3d/c45 0 2024-03-17T23:58:18.390 INFO:tasks.workunit.client.0.smithi196.stdout:5/60: link d6/f8 d6/f13 0 2024-03-17T23:58:18.392 INFO:tasks.workunit.client.0.smithi196.stdout:0/148: unlink d5/f12 0 2024-03-17T23:58:18.393 INFO:tasks.workunit.client.0.smithi196.stdout:1/118: creat d1/d13/f2f x:0 0 0 2024-03-17T23:58:18.395 INFO:tasks.workunit.client.0.smithi196.stdout:7/67: dwrite da/ff [0,4194304] 0 2024-03-17T23:58:18.401 INFO:tasks.workunit.client.0.smithi196.stdout:0/149: dread d5/f18 [0,4194304] 0 2024-03-17T23:58:18.401 INFO:tasks.workunit.client.0.smithi196.stdout:0/150: fdatasync d5/f1c 0 2024-03-17T23:58:18.403 INFO:tasks.workunit.client.0.smithi196.stdout:1/119: symlink d1/d13/d2a/l30 0 2024-03-17T23:58:18.405 INFO:tasks.workunit.client.0.smithi196.stdout:9/108: sync 2024-03-17T23:58:18.406 INFO:tasks.workunit.client.0.smithi196.stdout:5/61: dread d6/fd [0,4194304] 0 2024-03-17T23:58:18.408 INFO:tasks.workunit.client.0.smithi196.stdout:7/68: creat da/f16 x:0 0 0 2024-03-17T23:58:18.408 INFO:tasks.workunit.client.0.smithi196.stdout:3/211: truncate d7/f17 236810 0 2024-03-17T23:58:18.412 INFO:tasks.workunit.client.0.smithi196.stdout:5/62: mknod d6/c14 0 2024-03-17T23:58:18.413 INFO:tasks.workunit.client.0.smithi196.stdout:3/212: symlink d7/d19/d26/d2b/l46 0 2024-03-17T23:58:18.422 INFO:tasks.workunit.client.0.smithi196.stdout:3/213: dread d7/ff [0,4194304] 0 2024-03-17T23:58:18.423 INFO:tasks.workunit.client.0.smithi196.stdout:5/63: mkdir d6/d15 0 2024-03-17T23:58:18.425 INFO:tasks.workunit.client.0.smithi196.stdout:1/120: truncate d1/f16 7325889 0 2024-03-17T23:58:18.425 INFO:tasks.workunit.client.0.smithi196.stdout:7/69: dwrite f8 [0,4194304] 0 2024-03-17T23:58:18.433 INFO:tasks.workunit.client.0.smithi196.stdout:5/64: fdatasync f0 0 2024-03-17T23:58:18.434 INFO:tasks.workunit.client.0.smithi196.stdout:7/70: rmdir da 39 2024-03-17T23:58:18.436 INFO:tasks.workunit.client.0.smithi196.stdout:9/109: dwrite d9/d12/f21 [0,4194304] 0 2024-03-17T23:58:18.442 INFO:tasks.workunit.client.0.smithi196.stdout:9/110: symlink d9/df/l24 0 2024-03-17T23:58:18.447 INFO:tasks.workunit.client.0.smithi196.stdout:5/65: write d6/f13 [4303338,117064] 0 2024-03-17T23:58:18.449 INFO:tasks.workunit.client.0.smithi196.stdout:3/214: dread d7/d19/f1c [0,4194304] 0 2024-03-17T23:58:18.452 INFO:tasks.workunit.client.0.smithi196.stdout:5/66: dread d6/fc [0,4194304] 0 2024-03-17T23:58:18.453 INFO:tasks.workunit.client.0.smithi196.stdout:5/67: readlink d6/l11 0 2024-03-17T23:58:18.454 INFO:tasks.workunit.client.0.smithi196.stdout:7/71: dwrite da/f13 [0,4194304] 0 2024-03-17T23:58:18.455 INFO:tasks.workunit.client.0.smithi196.stdout:5/68: read f0 [17491,94113] 0 2024-03-17T23:58:18.458 INFO:tasks.workunit.client.0.smithi196.stdout:3/215: rename d7/f17 to d7/d19/d26/f47 0 2024-03-17T23:58:18.459 INFO:tasks.workunit.client.0.smithi196.stdout:1/121: dwrite d1/f25 [0,4194304] 0 2024-03-17T23:58:18.462 INFO:tasks.workunit.client.0.smithi196.stdout:5/69: mkdir d6/d15/d16 0 2024-03-17T23:58:18.462 INFO:tasks.workunit.client.0.smithi196.stdout:7/72: chown da/f13 10 1 2024-03-17T23:58:18.462 INFO:tasks.workunit.client.0.smithi196.stdout:5/70: readlink d6/l11 0 2024-03-17T23:58:18.464 INFO:tasks.workunit.client.0.smithi196.stdout:1/122: dread d1/db/f14 [0,4194304] 0 2024-03-17T23:58:18.466 INFO:tasks.workunit.client.0.smithi196.stdout:1/123: write d1/db/dd/f12 [4279701,113915] 0 2024-03-17T23:58:18.467 INFO:tasks.workunit.client.0.smithi196.stdout:5/71: mkdir d6/d17 0 2024-03-17T23:58:18.469 INFO:tasks.workunit.client.0.smithi196.stdout:1/124: mknod d1/d13/d2a/c31 0 2024-03-17T23:58:18.471 INFO:tasks.workunit.client.0.smithi196.stdout:5/72: rmdir d6/d15 39 2024-03-17T23:58:18.471 INFO:tasks.workunit.client.0.smithi196.stdout:1/125: write d1/f8 [3654747,85453] 0 2024-03-17T23:58:18.475 INFO:tasks.workunit.client.0.smithi196.stdout:3/216: mkdir d7/d19/d26/d48 0 2024-03-17T23:58:18.477 INFO:tasks.workunit.client.0.smithi196.stdout:3/217: read - d7/d19/f30 zero size 2024-03-17T23:58:18.478 INFO:tasks.workunit.client.0.smithi196.stdout:7/73: truncate f6 643607 0 2024-03-17T23:58:18.484 INFO:tasks.workunit.client.0.smithi196.stdout:9/111: dread d9/f11 [0,4194304] 0 2024-03-17T23:58:18.485 INFO:tasks.workunit.client.0.smithi196.stdout:5/73: dwrite d6/fd [0,4194304] 0 2024-03-17T23:58:18.486 INFO:tasks.workunit.client.0.smithi196.stdout:7/74: chown da/l10 78505629 1 2024-03-17T23:58:18.487 INFO:tasks.workunit.client.0.smithi196.stdout:5/74: write d6/fa [3564995,12994] 0 2024-03-17T23:58:18.497 INFO:tasks.workunit.client.0.smithi196.stdout:3/218: link d7/d19/d26/f47 d7/d33/f49 0 2024-03-17T23:58:18.503 INFO:tasks.workunit.client.0.smithi196.stdout:9/112: dwrite d9/fd [8388608,4194304] 0 2024-03-17T23:58:18.509 INFO:tasks.workunit.client.0.smithi196.stdout:5/75: dwrite d6/ff [0,4194304] 0 2024-03-17T23:58:18.510 INFO:tasks.workunit.client.0.smithi196.stdout:5/76: readlink d6/l7 0 2024-03-17T23:58:18.513 INFO:tasks.workunit.client.0.smithi196.stdout:7/75: chown f6 195 1 2024-03-17T23:58:18.515 INFO:tasks.workunit.client.0.smithi196.stdout:3/219: dwrite d7/d19/f1c [0,4194304] 0 2024-03-17T23:58:18.519 INFO:tasks.workunit.client.0.smithi196.stdout:5/77: mknod d6/d17/c18 0 2024-03-17T23:58:18.521 INFO:tasks.workunit.client.0.smithi196.stdout:3/220: chown d7/d33/f49 6 1 2024-03-17T23:58:18.521 INFO:tasks.workunit.client.0.smithi196.stdout:5/78: chown d6/fb 1931402544 1 2024-03-17T23:58:18.522 INFO:tasks.workunit.client.0.smithi196.stdout:7/76: creat da/d15/f17 x:0 0 0 2024-03-17T23:58:18.524 INFO:tasks.workunit.client.0.smithi196.stdout:9/113: dwrite d9/d12/f17 [0,4194304] 0 2024-03-17T23:58:18.524 INFO:tasks.workunit.client.0.smithi196.stdout:3/221: dread d7/f11 [0,4194304] 0 2024-03-17T23:58:18.526 INFO:tasks.workunit.client.0.smithi196.stdout:3/222: readlink d7/l2e 0 2024-03-17T23:58:18.526 INFO:tasks.workunit.client.0.smithi196.stdout:3/223: readlink d7/l2e 0 2024-03-17T23:58:18.530 INFO:tasks.workunit.client.0.smithi196.stdout:7/77: dread f8 [0,4194304] 0 2024-03-17T23:58:18.535 INFO:tasks.workunit.client.0.smithi196.stdout:7/78: dread f8 [0,4194304] 0 2024-03-17T23:58:18.536 INFO:tasks.workunit.client.0.smithi196.stdout:9/114: fsync d9/df/f1d 0 2024-03-17T23:58:18.537 INFO:tasks.workunit.client.0.smithi196.stdout:9/115: chown d9/d12/c1f 518658820 1 2024-03-17T23:58:18.540 INFO:tasks.workunit.client.0.smithi196.stdout:7/79: rmdir da 39 2024-03-17T23:58:18.543 INFO:tasks.workunit.client.0.smithi196.stdout:9/116: rmdir d9 39 2024-03-17T23:58:18.548 INFO:tasks.workunit.client.0.smithi196.stdout:3/224: rename d7/d19/d26/d2b/c3f to d7/c4a 0 2024-03-17T23:58:18.550 INFO:tasks.workunit.client.0.smithi196.stdout:9/117: creat d9/f25 x:0 0 0 2024-03-17T23:58:18.551 INFO:tasks.workunit.client.0.smithi196.stdout:7/80: rename da/lb to da/d15/l18 0 2024-03-17T23:58:18.553 INFO:tasks.workunit.client.0.smithi196.stdout:9/118: chown d9/d1e/c22 94 1 2024-03-17T23:58:18.553 INFO:tasks.workunit.client.0.smithi196.stdout:7/81: symlink da/l19 0 2024-03-17T23:58:18.554 INFO:tasks.workunit.client.0.smithi196.stdout:7/82: chown f6 0 1 2024-03-17T23:58:18.557 INFO:tasks.workunit.client.0.smithi196.stdout:3/225: dwrite d7/fb [0,4194304] 0 2024-03-17T23:58:18.565 INFO:tasks.workunit.client.0.smithi196.stdout:7/83: dwrite da/fe [4194304,4194304] 0 2024-03-17T23:58:18.566 INFO:tasks.workunit.client.0.smithi196.stdout:7/84: read f8 [3355674,69482] 0 2024-03-17T23:58:18.569 INFO:tasks.workunit.client.0.smithi196.stdout:7/85: mkdir da/d15/d1a 0 2024-03-17T23:58:18.569 INFO:tasks.workunit.client.0.smithi196.stdout:3/226: dread d7/fb [4194304,4194304] 0 2024-03-17T23:58:18.570 INFO:tasks.workunit.client.0.smithi196.stdout:7/86: chown da/d15/d1a 5042462 1 2024-03-17T23:58:18.572 INFO:tasks.workunit.client.0.smithi196.stdout:7/87: symlink da/d15/l1b 0 2024-03-17T23:58:18.573 INFO:tasks.workunit.client.0.smithi196.stdout:3/227: creat d7/d19/d26/f4b x:0 0 0 2024-03-17T23:58:18.573 INFO:tasks.workunit.client.0.smithi196.stdout:4/45: sync 2024-03-17T23:58:18.574 INFO:tasks.workunit.client.0.smithi196.stdout:6/50: sync 2024-03-17T23:58:18.574 INFO:tasks.workunit.client.0.smithi196.stdout:3/228: read - d7/f22 zero size 2024-03-17T23:58:18.575 INFO:tasks.workunit.client.0.smithi196.stdout:3/229: dread - d7/d19/f30 zero size 2024-03-17T23:58:18.579 INFO:tasks.workunit.client.0.smithi196.stdout:7/88: creat da/f1c x:0 0 0 2024-03-17T23:58:18.579 INFO:tasks.workunit.client.0.smithi196.stdout:4/46: chown d1/f4 7731107 1 2024-03-17T23:58:18.579 INFO:tasks.workunit.client.0.smithi196.stdout:6/51: symlink d2/d7/da/l13 0 2024-03-17T23:58:18.580 INFO:tasks.workunit.client.0.smithi196.stdout:3/230: chown d7/d29/c31 310 1 2024-03-17T23:58:18.581 INFO:tasks.workunit.client.0.smithi196.stdout:4/47: creat d1/fb x:0 0 0 2024-03-17T23:58:18.584 INFO:tasks.workunit.client.0.smithi196.stdout:4/48: dread d1/f4 [0,4194304] 0 2024-03-17T23:58:18.584 INFO:tasks.workunit.client.0.smithi196.stdout:3/231: creat d7/d19/d26/f4c x:0 0 0 2024-03-17T23:58:18.587 INFO:tasks.workunit.client.0.smithi196.stdout:4/49: unlink d1/f4 0 2024-03-17T23:58:18.589 INFO:tasks.workunit.client.0.smithi196.stdout:3/232: mkdir d7/d19/d26/d48/d4d 0 2024-03-17T23:58:18.591 INFO:tasks.workunit.client.0.smithi196.stdout:3/233: truncate d7/d19/d26/d2b/f42 869215 0 2024-03-17T23:58:18.592 INFO:tasks.workunit.client.0.smithi196.stdout:4/50: link d1/l9 d1/lc 0 2024-03-17T23:58:18.593 INFO:tasks.workunit.client.0.smithi196.stdout:6/52: write f1 [1277056,79231] 0 2024-03-17T23:58:18.594 INFO:tasks.workunit.client.0.smithi196.stdout:3/234: chown d7/d19/d26/f2f 14703984 1 2024-03-17T23:58:18.595 INFO:tasks.workunit.client.0.smithi196.stdout:4/51: truncate d1/f8 4326944 0 2024-03-17T23:58:18.599 INFO:tasks.workunit.client.0.smithi196.stdout:4/52: creat d1/fd x:0 0 0 2024-03-17T23:58:18.599 INFO:tasks.workunit.client.0.smithi196.stdout:6/53: dread f1 [0,4194304] 0 2024-03-17T23:58:18.601 INFO:tasks.workunit.client.0.smithi196.stdout:6/54: chown d2/d7/da/l13 5100 1 2024-03-17T23:58:18.601 INFO:tasks.workunit.client.0.smithi196.stdout:7/89: dwrite f6 [0,4194304] 0 2024-03-17T23:58:18.602 INFO:tasks.workunit.client.0.smithi196.stdout:6/55: read f1 [312375,27155] 0 2024-03-17T23:58:18.602 INFO:tasks.workunit.client.0.smithi196.stdout:4/53: mkdir d1/de 0 2024-03-17T23:58:18.603 INFO:tasks.workunit.client.0.smithi196.stdout:4/54: fdatasync d1/f8 0 2024-03-17T23:58:18.604 INFO:tasks.workunit.client.0.smithi196.stdout:6/56: write f0 [222889,56498] 0 2024-03-17T23:58:18.604 INFO:tasks.workunit.client.0.smithi196.stdout:4/55: dread - d1/fd zero size 2024-03-17T23:58:18.609 INFO:tasks.workunit.client.0.smithi196.stdout:7/90: mkdir da/d15/d1d 0 2024-03-17T23:58:18.611 INFO:tasks.workunit.client.0.smithi196.stdout:3/235: getdents d7/d19/d26/d2b/d3c 0 2024-03-17T23:58:18.614 INFO:tasks.workunit.client.0.smithi196.stdout:3/236: unlink d7/d19/d26/d2b/c3e 0 2024-03-17T23:58:18.615 INFO:tasks.workunit.client.0.smithi196.stdout:6/57: getdents d2 0 2024-03-17T23:58:18.617 INFO:tasks.workunit.client.0.smithi196.stdout:6/58: write d2/fd [3033850,120418] 0 2024-03-17T23:58:18.618 INFO:tasks.workunit.client.0.smithi196.stdout:4/56: dwrite d1/f8 [0,4194304] 0 2024-03-17T23:58:18.619 INFO:tasks.workunit.client.0.smithi196.stdout:7/91: truncate da/f12 2040090 0 2024-03-17T23:58:18.619 INFO:tasks.workunit.client.0.smithi196.stdout:6/59: write d2/ff [536680,29730] 0 2024-03-17T23:58:18.620 INFO:tasks.workunit.client.0.smithi196.stdout:6/60: readlink d2/d7/l10 0 2024-03-17T23:58:18.624 INFO:tasks.workunit.client.0.smithi196.stdout:3/237: mknod d7/d19/d26/d48/d4d/c4e 0 2024-03-17T23:58:18.626 INFO:tasks.workunit.client.0.smithi196.stdout:6/61: mkdir d2/d14 0 2024-03-17T23:58:18.627 INFO:tasks.workunit.client.0.smithi196.stdout:7/92: symlink da/d15/d1a/l1e 0 2024-03-17T23:58:18.628 INFO:tasks.workunit.client.0.smithi196.stdout:3/238: mknod d7/d33/c4f 0 2024-03-17T23:58:18.628 INFO:tasks.workunit.client.0.smithi196.stdout:7/93: chown l5 9637 1 2024-03-17T23:58:18.629 INFO:tasks.workunit.client.0.smithi196.stdout:7/94: dread - da/f16 zero size 2024-03-17T23:58:18.630 INFO:tasks.workunit.client.0.smithi196.stdout:6/62: creat d2/d7/f15 x:0 0 0 2024-03-17T23:58:18.630 INFO:tasks.workunit.client.0.smithi196.stdout:6/63: readlink d2/d7/l9 0 2024-03-17T23:58:18.630 INFO:tasks.workunit.client.0.smithi196.stdout:3/239: mknod d7/d19/d26/d48/c50 0 2024-03-17T23:58:18.631 INFO:tasks.workunit.client.0.smithi196.stdout:7/95: mknod da/d15/c1f 0 2024-03-17T23:58:18.632 INFO:tasks.workunit.client.0.smithi196.stdout:7/96: stat l5 0 2024-03-17T23:58:18.633 INFO:tasks.workunit.client.0.smithi196.stdout:4/57: getdents d1 0 2024-03-17T23:58:18.635 INFO:tasks.workunit.client.0.smithi196.stdout:3/240: symlink d7/d19/l51 0 2024-03-17T23:58:18.635 INFO:tasks.workunit.client.0.smithi196.stdout:3/241: chown d7/d33/f49 860169 1 2024-03-17T23:58:18.635 INFO:tasks.workunit.client.0.smithi196.stdout:4/58: symlink d1/lf 0 2024-03-17T23:58:18.644 INFO:tasks.workunit.client.0.smithi196.stdout:4/59: dwrite d1/fd [0,4194304] 0 2024-03-17T23:58:18.645 INFO:tasks.workunit.client.0.smithi196.stdout:4/60: chown d1 7 1 2024-03-17T23:58:18.649 INFO:tasks.workunit.client.0.smithi196.stdout:4/61: dread d1/fd [0,4194304] 0 2024-03-17T23:58:18.649 INFO:tasks.workunit.client.0.smithi196.stdout:4/62: chown d1/l3 599973684 1 2024-03-17T23:58:18.650 INFO:tasks.workunit.client.0.smithi196.stdout:4/63: truncate d1/fb 779593 0 2024-03-17T23:58:18.654 INFO:tasks.workunit.client.0.smithi196.stdout:3/242: dread - d7/d19/f28 zero size 2024-03-17T23:58:18.654 INFO:tasks.workunit.client.0.smithi196.stdout:6/64: link d2/d7/da/ce d2/d7/da/c16 0 2024-03-17T23:58:18.655 INFO:tasks.workunit.client.0.smithi196.stdout:6/65: write d2/fd [372417,48565] 0 2024-03-17T23:58:18.656 INFO:tasks.workunit.client.0.smithi196.stdout:6/66: write f0 [2396713,72995] 0 2024-03-17T23:58:18.658 INFO:tasks.workunit.client.0.smithi196.stdout:4/64: dread d1/f8 [0,4194304] 0 2024-03-17T23:58:18.661 INFO:tasks.workunit.client.0.smithi196.stdout:7/97: dread f8 [0,4194304] 0 2024-03-17T23:58:18.666 INFO:tasks.workunit.client.0.smithi196.stdout:6/67: dwrite f1 [0,4194304] 0 2024-03-17T23:58:18.667 INFO:tasks.workunit.client.0.smithi196.stdout:3/243: truncate d7/f16 4492628 0 2024-03-17T23:58:18.667 INFO:tasks.workunit.client.0.smithi196.stdout:3/244: chown d7/d33/c4f 63 1 2024-03-17T23:58:18.668 INFO:tasks.workunit.client.0.smithi196.stdout:7/98: unlink da/ff 0 2024-03-17T23:58:18.669 INFO:tasks.workunit.client.0.smithi196.stdout:6/68: creat d2/d7/f17 x:0 0 0 2024-03-17T23:58:18.670 INFO:tasks.workunit.client.0.smithi196.stdout:6/69: fdatasync f0 0 2024-03-17T23:58:18.670 INFO:tasks.workunit.client.0.smithi196.stdout:4/65: fdatasync d1/fd 0 2024-03-17T23:58:18.676 INFO:tasks.workunit.client.0.smithi196.stdout:6/70: dread f1 [0,4194304] 0 2024-03-17T23:58:18.680 INFO:tasks.workunit.client.0.smithi196.stdout:7/99: link da/f13 da/d15/d1a/f20 0 2024-03-17T23:58:18.681 INFO:tasks.workunit.client.0.smithi196.stdout:7/100: dread - da/f1c zero size 2024-03-17T23:58:18.683 INFO:tasks.workunit.client.0.smithi196.stdout:3/245: write d7/f16 [3196135,74434] 0 2024-03-17T23:58:18.686 INFO:tasks.workunit.client.0.smithi196.stdout:4/66: dwrite d1/f8 [0,4194304] 0 2024-03-17T23:58:18.686 INFO:tasks.workunit.client.0.smithi196.stdout:6/71: symlink d2/d14/l18 0 2024-03-17T23:58:18.689 INFO:tasks.workunit.client.0.smithi196.stdout:7/101: creat da/d15/d1a/f21 x:0 0 0 2024-03-17T23:58:18.694 INFO:tasks.workunit.client.0.smithi196.stdout:6/72: creat d2/d7/da/f19 x:0 0 0 2024-03-17T23:58:18.698 INFO:tasks.workunit.client.0.smithi196.stdout:6/73: symlink d2/d14/l1a 0 2024-03-17T23:58:18.699 INFO:tasks.workunit.client.0.smithi196.stdout:4/67: mknod d1/de/c10 0 2024-03-17T23:58:18.699 INFO:tasks.workunit.client.0.smithi196.stdout:3/246: write d7/fc [1123808,47496] 0 2024-03-17T23:58:18.701 INFO:tasks.workunit.client.0.smithi196.stdout:6/74: mknod d2/d14/c1b 0 2024-03-17T23:58:18.702 INFO:tasks.workunit.client.0.smithi196.stdout:6/75: write d2/d7/da/f19 [823996,129838] 0 2024-03-17T23:58:18.704 INFO:tasks.workunit.client.0.smithi196.stdout:3/247: fsync d7/d33/f49 0 2024-03-17T23:58:18.711 INFO:tasks.workunit.client.0.smithi196.stdout:7/102: dwrite da/d15/d1a/f20 [4194304,4194304] 0 2024-03-17T23:58:18.713 INFO:tasks.workunit.client.0.smithi196.stdout:4/68: truncate d1/f8 2240358 0 2024-03-17T23:58:18.713 INFO:tasks.workunit.client.0.smithi196.stdout:3/248: creat d7/d19/d26/d2b/d3c/f52 x:0 0 0 2024-03-17T23:58:18.713 INFO:tasks.workunit.client.0.smithi196.stdout:7/103: dread - da/d15/d1a/f21 zero size 2024-03-17T23:58:18.716 INFO:tasks.workunit.client.0.smithi196.stdout:4/69: chown d1/f8 352 1 2024-03-17T23:58:18.724 INFO:tasks.workunit.client.0.smithi196.stdout:7/104: dwrite da/fe [0,4194304] 0 2024-03-17T23:58:18.724 INFO:tasks.workunit.client.0.smithi196.stdout:4/70: dread d1/fd [0,4194304] 0 2024-03-17T23:58:18.726 INFO:tasks.workunit.client.0.smithi196.stdout:3/249: getdents d7/d19/d26/d48 0 2024-03-17T23:58:18.726 INFO:tasks.workunit.client.0.smithi196.stdout:3/250: dread - d7/d19/f30 zero size 2024-03-17T23:58:18.728 INFO:tasks.workunit.client.0.smithi196.stdout:3/251: stat d7/d19/d26/d2b/d3c/f52 0 2024-03-17T23:58:18.728 INFO:tasks.workunit.client.0.smithi196.stdout:3/252: truncate d7/fd 9195477 0 2024-03-17T23:58:18.729 INFO:tasks.workunit.client.0.smithi196.stdout:7/105: unlink da/d15/d1a/f21 0 2024-03-17T23:58:18.731 INFO:tasks.workunit.client.0.smithi196.stdout:4/71: mkdir d1/d11 0 2024-03-17T23:58:18.733 INFO:tasks.workunit.client.0.smithi196.stdout:3/253: unlink d7/f1b 0 2024-03-17T23:58:18.736 INFO:tasks.workunit.client.0.smithi196.stdout:4/72: creat d1/d11/f12 x:0 0 0 2024-03-17T23:58:18.738 INFO:tasks.workunit.client.0.smithi196.stdout:7/106: mknod da/c22 0 2024-03-17T23:58:18.739 INFO:tasks.workunit.client.0.smithi196.stdout:7/107: write da/f16 [287568,68207] 0 2024-03-17T23:58:18.740 INFO:tasks.workunit.client.0.smithi196.stdout:7/108: fsync da/d15/f17 0 2024-03-17T23:58:18.740 INFO:tasks.workunit.client.0.smithi196.stdout:7/109: chown f8 462898058 1 2024-03-17T23:58:18.741 INFO:tasks.workunit.client.0.smithi196.stdout:7/110: truncate da/f1c 1020052 0 2024-03-17T23:58:18.742 INFO:tasks.workunit.client.0.smithi196.stdout:7/111: write da/f16 [656092,25361] 0 2024-03-17T23:58:18.743 INFO:tasks.workunit.client.0.smithi196.stdout:3/254: link d7/l2e d7/d19/l53 0 2024-03-17T23:58:18.743 INFO:tasks.workunit.client.0.smithi196.stdout:3/255: fsync d7/f1f 0 2024-03-17T23:58:18.749 INFO:tasks.workunit.client.0.smithi196.stdout:7/112: creat da/d15/d1d/f23 x:0 0 0 2024-03-17T23:58:18.753 INFO:tasks.workunit.client.0.smithi196.stdout:7/113: rename f6 to da/d15/f24 0 2024-03-17T23:58:18.765 INFO:tasks.workunit.client.0.smithi196.stdout:4/73: dwrite d1/f8 [0,4194304] 0 2024-03-17T23:58:18.766 INFO:tasks.workunit.client.0.smithi196.stdout:2/176: sync 2024-03-17T23:58:18.766 INFO:tasks.workunit.client.0.smithi196.stdout:4/74: readlink d1/l3 0 2024-03-17T23:58:18.767 INFO:tasks.workunit.client.0.smithi196.stdout:7/114: dwrite da/f12 [0,4194304] 0 2024-03-17T23:58:18.776 INFO:tasks.workunit.client.0.smithi196.stdout:7/115: rename da/f12 to da/d15/f25 0 2024-03-17T23:58:18.785 INFO:tasks.workunit.client.0.smithi196.stdout:2/177: dwrite d17/d19/f31 [0,4194304] 0 2024-03-17T23:58:18.785 INFO:tasks.workunit.client.0.smithi196.stdout:4/75: dwrite d1/fb [0,4194304] 0 2024-03-17T23:58:18.787 INFO:tasks.workunit.client.0.smithi196.stdout:2/178: chown d17/d19/l1c 1543980221 1 2024-03-17T23:58:18.790 INFO:tasks.workunit.client.0.smithi196.stdout:7/116: dread da/d15/f24 [0,4194304] 0 2024-03-17T23:58:18.794 INFO:tasks.workunit.client.0.smithi196.stdout:2/179: chown c15 1 1 2024-03-17T23:58:18.794 INFO:tasks.workunit.client.0.smithi196.stdout:4/76: dwrite d1/fd [0,4194304] 0 2024-03-17T23:58:18.798 INFO:tasks.workunit.client.0.smithi196.stdout:4/77: creat d1/f13 x:0 0 0 2024-03-17T23:58:18.798 INFO:tasks.workunit.client.0.smithi196.stdout:2/180: symlink d17/d28/d30/l45 0 2024-03-17T23:58:18.802 INFO:tasks.workunit.client.0.smithi196.stdout:4/78: rename d1/l7 to d1/de/l14 0 2024-03-17T23:58:18.803 INFO:tasks.workunit.client.0.smithi196.stdout:7/117: dwrite da/d15/f17 [0,4194304] 0 2024-03-17T23:58:18.804 INFO:tasks.workunit.client.0.smithi196.stdout:2/181: creat d17/d28/f46 x:0 0 0 2024-03-17T23:58:18.804 INFO:tasks.workunit.client.0.smithi196.stdout:4/79: truncate d1/f13 586869 0 2024-03-17T23:58:18.807 INFO:tasks.workunit.client.0.smithi196.stdout:7/118: chown da/l11 0 1 2024-03-17T23:58:18.810 INFO:tasks.workunit.client.0.smithi196.stdout:2/182: creat d17/d28/d30/f47 x:0 0 0 2024-03-17T23:58:18.810 INFO:tasks.workunit.client.0.smithi196.stdout:2/183: read - d17/d19/f35 zero size 2024-03-17T23:58:18.811 INFO:tasks.workunit.client.0.smithi196.stdout:2/184: chown d17/d19/c37 513391 1 2024-03-17T23:58:18.811 INFO:tasks.workunit.client.0.smithi196.stdout:4/80: creat d1/de/f15 x:0 0 0 2024-03-17T23:58:18.813 INFO:tasks.workunit.client.0.smithi196.stdout:4/81: symlink d1/de/l16 0 2024-03-17T23:58:18.815 INFO:tasks.workunit.client.0.smithi196.stdout:7/119: symlink da/l26 0 2024-03-17T23:58:18.816 INFO:tasks.workunit.client.0.smithi196.stdout:2/185: link d17/f18 d17/d22/d3d/f48 0 2024-03-17T23:58:18.817 INFO:tasks.workunit.client.0.smithi196.stdout:7/120: creat da/d15/f27 x:0 0 0 2024-03-17T23:58:18.818 INFO:tasks.workunit.client.0.smithi196.stdout:7/121: chown da/l10 236314 1 2024-03-17T23:58:18.818 INFO:tasks.workunit.client.0.smithi196.stdout:2/186: write fb [3828437,35654] 0 2024-03-17T23:58:18.827 INFO:tasks.workunit.client.0.smithi196.stdout:7/122: truncate da/d15/f17 4134940 0 2024-03-17T23:58:18.829 INFO:tasks.workunit.client.0.smithi196.stdout:7/123: unlink da/fe 0 2024-03-17T23:58:18.831 INFO:tasks.workunit.client.0.smithi196.stdout:7/124: symlink da/d15/l28 0 2024-03-17T23:58:18.831 INFO:tasks.workunit.client.0.smithi196.stdout:7/125: chown da 5796719 1 2024-03-17T23:58:18.840 INFO:tasks.workunit.client.0.smithi196.stdout:7/126: dread da/d15/f17 [0,4194304] 0 2024-03-17T23:58:18.841 INFO:tasks.workunit.client.0.smithi196.stdout:7/127: mkdir da/d15/d1d/d29 0 2024-03-17T23:58:18.842 INFO:tasks.workunit.client.0.smithi196.stdout:7/128: chown da/d15/f25 1917260 1 2024-03-17T23:58:18.843 INFO:tasks.workunit.client.0.smithi196.stdout:7/129: fsync da/d15/f25 0 2024-03-17T23:58:18.845 INFO:tasks.workunit.client.0.smithi196.stdout:7/130: getdents da 0 2024-03-17T23:58:18.848 INFO:tasks.workunit.client.0.smithi196.stdout:7/131: link da/d15/d1a/l1e da/d15/d1d/l2a 0 2024-03-17T23:58:18.849 INFO:tasks.workunit.client.0.smithi196.stdout:7/132: chown da/cd 1229648 1 2024-03-17T23:58:18.855 INFO:tasks.workunit.client.0.smithi196.stdout:7/133: truncate da/d15/d1a/f20 1925386 0 2024-03-17T23:58:18.861 INFO:tasks.workunit.client.0.smithi196.stdout:7/134: dwrite f8 [0,4194304] 0 2024-03-17T23:58:18.866 INFO:tasks.workunit.client.0.smithi196.stdout:7/135: dread da/f16 [0,4194304] 0 2024-03-17T23:58:18.869 INFO:tasks.workunit.client.0.smithi196.stdout:7/136: rename l5 to da/l2b 0 2024-03-17T23:58:18.876 INFO:tasks.workunit.client.0.smithi196.stdout:7/137: read da/d15/f25 [957462,64689] 0 2024-03-17T23:58:18.878 INFO:tasks.workunit.client.0.smithi196.stdout:7/138: stat da/l19 0 2024-03-17T23:58:18.878 INFO:tasks.workunit.client.0.smithi196.stdout:7/139: chown da/d15/f27 11 1 2024-03-17T23:58:18.880 INFO:tasks.workunit.client.0.smithi196.stdout:7/140: creat da/d15/d1d/f2c x:0 0 0 2024-03-17T23:58:18.881 INFO:tasks.workunit.client.0.smithi196.stdout:7/141: read da/f16 [291089,39497] 0 2024-03-17T23:58:18.883 INFO:tasks.workunit.client.0.smithi196.stdout:7/142: creat da/d15/d1d/f2d x:0 0 0 2024-03-17T23:58:18.884 INFO:tasks.workunit.client.0.smithi196.stdout:7/143: write da/f16 [1608848,28413] 0 2024-03-17T23:58:18.892 INFO:tasks.workunit.client.0.smithi196.stdout:7/144: dread da/f13 [0,4194304] 0 2024-03-17T23:58:18.893 INFO:tasks.workunit.client.0.smithi196.stdout:7/145: mkdir da/d15/d1d/d2e 0 2024-03-17T23:58:18.894 INFO:tasks.workunit.client.0.smithi196.stdout:7/146: chown da/f1c 1 1 2024-03-17T23:58:18.896 INFO:tasks.workunit.client.0.smithi196.stdout:7/147: dread da/f13 [0,4194304] 0 2024-03-17T23:58:18.896 INFO:tasks.workunit.client.0.smithi196.stdout:7/148: stat da/d15/f25 0 2024-03-17T23:58:18.900 INFO:tasks.workunit.client.0.smithi196.stdout:7/149: rename da/l14 to da/d15/d1d/l2f 0 2024-03-17T23:58:18.906 INFO:tasks.workunit.client.0.smithi196.stdout:7/150: fdatasync da/f16 0 2024-03-17T23:58:18.906 INFO:tasks.workunit.client.0.smithi196.stdout:7/151: chown f8 1420323 1 2024-03-17T23:58:18.908 INFO:tasks.workunit.client.0.smithi196.stdout:7/152: write da/d15/f24 [5173772,39597] 0 2024-03-17T23:58:18.911 INFO:tasks.workunit.client.0.smithi196.stdout:7/153: getdents da 0 2024-03-17T23:58:18.912 INFO:tasks.workunit.client.0.smithi196.stdout:7/154: chown da/d15/d1d/l2f 105 1 2024-03-17T23:58:18.918 INFO:tasks.workunit.client.0.smithi196.stdout:7/155: dwrite da/d15/f27 [0,4194304] 0 2024-03-17T23:58:18.920 INFO:tasks.workunit.client.0.smithi196.stdout:7/156: write da/f16 [2079065,39560] 0 2024-03-17T23:58:18.934 INFO:tasks.workunit.client.0.smithi196.stdout:7/157: dwrite f8 [0,4194304] 0 2024-03-17T23:58:18.940 INFO:tasks.workunit.client.0.smithi196.stdout:7/158: dread f8 [0,4194304] 0 2024-03-17T23:58:18.943 INFO:tasks.workunit.client.0.smithi196.stdout:7/159: creat da/d15/d1d/f30 x:0 0 0 2024-03-17T23:58:18.945 INFO:tasks.workunit.client.0.smithi196.stdout:7/160: rename da/cd to da/d15/d1d/d29/c31 0 2024-03-17T23:58:18.952 INFO:tasks.workunit.client.0.smithi196.stdout:7/161: creat da/d15/d1d/f32 x:0 0 0 2024-03-17T23:58:18.953 INFO:tasks.workunit.client.0.smithi196.stdout:7/162: write da/d15/f27 [1244073,43476] 0 2024-03-17T23:58:18.955 INFO:tasks.workunit.client.0.smithi196.stdout:7/163: readlink da/l19 0 2024-03-17T23:58:18.957 INFO:tasks.workunit.client.0.smithi196.stdout:7/164: symlink da/d15/d1d/d29/l33 0 2024-03-17T23:58:18.960 INFO:tasks.workunit.client.0.smithi196.stdout:7/165: rename da/d15/d1d/l2f to da/d15/d1d/l34 0 2024-03-17T23:58:18.960 INFO:tasks.workunit.client.0.smithi196.stdout:7/166: chown da/d15/f25 17 1 2024-03-17T23:58:18.962 INFO:tasks.workunit.client.0.smithi196.stdout:7/167: mknod da/c35 0 2024-03-17T23:58:18.963 INFO:tasks.workunit.client.0.smithi196.stdout:7/168: chown da/l26 51085 1 2024-03-17T23:58:18.964 INFO:tasks.workunit.client.0.smithi196.stdout:7/169: rmdir da/d15/d1a 39 2024-03-17T23:58:18.966 INFO:tasks.workunit.client.0.smithi196.stdout:7/170: write da/d15/f25 [1763228,85564] 0 2024-03-17T23:58:18.967 INFO:tasks.workunit.client.0.smithi196.stdout:7/171: write da/d15/d1d/f32 [659540,101127] 0 2024-03-17T23:58:18.969 INFO:tasks.workunit.client.0.smithi196.stdout:7/172: creat da/d15/d1d/d29/f36 x:0 0 0 2024-03-17T23:58:18.976 INFO:tasks.workunit.client.0.smithi196.stdout:7/173: truncate da/f1c 305589 0 2024-03-17T23:58:18.983 INFO:tasks.workunit.client.0.smithi196.stdout:7/174: dread f8 [0,4194304] 0 2024-03-17T23:58:18.983 INFO:tasks.workunit.client.0.smithi196.stdout:7/175: write da/d15/d1d/f2d [181393,8767] 0 2024-03-17T23:58:18.983 INFO:tasks.workunit.client.0.smithi196.stdout:7/176: dread - da/d15/d1d/f2c zero size 2024-03-17T23:58:18.984 INFO:tasks.workunit.client.0.smithi196.stdout:7/177: creat da/d15/d1a/f37 x:0 0 0 2024-03-17T23:58:18.987 INFO:tasks.workunit.client.0.smithi196.stdout:7/178: getdents da/d15/d1d 0 2024-03-17T23:58:18.988 INFO:tasks.workunit.client.0.smithi196.stdout:7/179: symlink da/d15/d1d/d29/l38 0 2024-03-17T23:58:18.989 INFO:tasks.workunit.client.0.smithi196.stdout:7/180: write da/d15/f27 [2194781,23224] 0 2024-03-17T23:58:18.992 INFO:tasks.workunit.client.0.smithi196.stdout:7/181: creat da/f39 x:0 0 0 2024-03-17T23:58:18.993 INFO:tasks.workunit.client.0.smithi196.stdout:7/182: chown da/d15/d1d/f2d 4417238 1 2024-03-17T23:58:18.994 INFO:tasks.workunit.client.0.smithi196.stdout:7/183: truncate da/d15/d1a/f37 268501 0 2024-03-17T23:58:19.030 INFO:tasks.workunit.client.0.smithi196.stdout:8/77: sync 2024-03-17T23:58:19.031 INFO:tasks.workunit.client.0.smithi196.stdout:7/184: symlink da/d15/d1d/l3a 0 2024-03-17T23:58:19.034 INFO:tasks.workunit.client.0.smithi196.stdout:7/185: mknod da/c3b 0 2024-03-17T23:58:19.035 INFO:tasks.workunit.client.0.smithi196.stdout:8/78: link f3 de/f13 0 2024-03-17T23:58:19.039 INFO:tasks.workunit.client.0.smithi196.stdout:8/79: dread f3 [0,4194304] 0 2024-03-17T23:58:19.044 INFO:tasks.workunit.client.0.smithi196.stdout:8/80: dread f7 [0,4194304] 0 2024-03-17T23:58:19.045 INFO:tasks.workunit.client.0.smithi196.stdout:7/186: getdents da/d15/d1d 0 2024-03-17T23:58:19.047 INFO:tasks.workunit.client.0.smithi196.stdout:8/81: creat de/d10/f14 x:0 0 0 2024-03-17T23:58:19.050 INFO:tasks.workunit.client.0.smithi196.stdout:8/82: getdents de 0 2024-03-17T23:58:19.051 INFO:tasks.workunit.client.0.smithi196.stdout:8/83: chown de/d10/f14 1 1 2024-03-17T23:58:19.052 INFO:tasks.workunit.client.0.smithi196.stdout:8/84: creat de/f15 x:0 0 0 2024-03-17T23:58:19.053 INFO:tasks.workunit.client.0.smithi196.stdout:8/85: symlink de/d10/l16 0 2024-03-17T23:58:19.062 INFO:tasks.workunit.client.0.smithi196.stdout:8/86: truncate de/ff 3843457 0 2024-03-17T23:58:19.066 INFO:tasks.workunit.client.0.smithi196.stdout:8/87: rename la to de/l17 0 2024-03-17T23:58:19.068 INFO:tasks.workunit.client.0.smithi196.stdout:8/88: chown lb 0 1 2024-03-17T23:58:19.070 INFO:tasks.workunit.client.0.smithi196.stdout:8/89: read f6 [20525,61187] 0 2024-03-17T23:58:19.071 INFO:tasks.workunit.client.0.smithi196.stdout:8/90: symlink de/d10/l18 0 2024-03-17T23:58:19.092 INFO:tasks.workunit.client.0.smithi196.stdout:8/91: dread f6 [0,4194304] 0 2024-03-17T23:58:19.098 INFO:tasks.workunit.client.0.smithi196.stdout:8/92: dwrite de/d10/f14 [0,4194304] 0 2024-03-17T23:58:19.100 INFO:tasks.workunit.client.0.smithi196.stdout:8/93: creat de/f19 x:0 0 0 2024-03-17T23:58:19.115 INFO:tasks.workunit.client.0.smithi196.stdout:8/94: dwrite de/f13 [0,4194304] 0 2024-03-17T23:58:19.128 INFO:tasks.workunit.client.0.smithi196.stdout:8/95: truncate de/d10/f14 458128 0 2024-03-17T23:58:19.129 INFO:tasks.workunit.client.0.smithi196.stdout:8/96: readlink lb 0 2024-03-17T23:58:19.130 INFO:tasks.workunit.client.0.smithi196.stdout:8/97: creat de/d10/f1a x:0 0 0 2024-03-17T23:58:19.131 INFO:tasks.workunit.client.0.smithi196.stdout:8/98: rmdir de/d10 39 2024-03-17T23:58:19.133 INFO:tasks.workunit.client.0.smithi196.stdout:8/99: creat de/d10/f1b x:0 0 0 2024-03-17T23:58:19.182 INFO:tasks.workunit.client.0.smithi196.stdout:0/151: sync 2024-03-17T23:58:19.195 INFO:tasks.workunit.client.0.smithi196.stdout:0/152: dwrite d5/f13 [0,4194304] 0 2024-03-17T23:58:19.203 INFO:tasks.workunit.client.0.smithi196.stdout:0/153: dwrite d5/f1c [0,4194304] 0 2024-03-17T23:58:19.206 INFO:tasks.workunit.client.0.smithi196.stdout:0/154: creat d5/d23/d24/f2c x:0 0 0 2024-03-17T23:58:19.211 INFO:tasks.workunit.client.0.smithi196.stdout:0/155: dread d5/f29 [0,4194304] 0 2024-03-17T23:58:19.214 INFO:tasks.workunit.client.0.smithi196.stdout:0/156: unlink d5/l15 0 2024-03-17T23:58:19.216 INFO:tasks.workunit.client.0.smithi196.stdout:0/157: creat d5/d23/f2d x:0 0 0 2024-03-17T23:58:19.220 INFO:tasks.workunit.client.0.smithi196.stdout:0/158: dread d5/d23/d24/d28/f26 [0,4194304] 0 2024-03-17T23:58:19.221 INFO:tasks.workunit.client.0.smithi196.stdout:0/159: chown d5/l11 36264759 1 2024-03-17T23:58:19.222 INFO:tasks.workunit.client.0.smithi196.stdout:0/160: read - d5/d23/d24/f2c zero size 2024-03-17T23:58:19.228 INFO:tasks.workunit.client.0.smithi196.stdout:0/161: dwrite d5/fa [0,4194304] 0 2024-03-17T23:58:19.243 INFO:tasks.workunit.client.0.smithi196.stdout:0/162: fdatasync d5/fa 0 2024-03-17T23:58:19.245 INFO:tasks.workunit.client.0.smithi196.stdout:0/163: truncate d5/f10 1205783 0 2024-03-17T23:58:19.245 INFO:tasks.workunit.client.0.smithi196.stdout:0/164: read - d5/d23/f2d zero size 2024-03-17T23:58:19.247 INFO:tasks.workunit.client.0.smithi196.stdout:0/165: creat d5/d23/d24/d28/f2e x:0 0 0 2024-03-17T23:58:19.248 INFO:tasks.workunit.client.0.smithi196.stdout:0/166: write d5/f13 [4072445,43141] 0 2024-03-17T23:58:19.252 INFO:tasks.workunit.client.0.smithi196.stdout:0/167: creat d5/d23/d24/f2f x:0 0 0 2024-03-17T23:58:19.258 INFO:tasks.workunit.client.0.smithi196.stdout:0/168: dwrite d5/f13 [0,4194304] 0 2024-03-17T23:58:19.260 INFO:tasks.workunit.client.0.smithi196.stdout:0/169: write d5/d23/d24/f2f [553831,5642] 0 2024-03-17T23:58:19.263 INFO:tasks.workunit.client.0.smithi196.stdout:0/170: unlink d5/d23/d24/f2b 0 2024-03-17T23:58:19.264 INFO:tasks.workunit.client.0.smithi196.stdout:0/171: mkdir d5/d23/d24/d30 0 2024-03-17T23:58:19.265 INFO:tasks.workunit.client.0.smithi196.stdout:0/172: chown d5/f18 258677 1 2024-03-17T23:58:19.267 INFO:tasks.workunit.client.0.smithi196.stdout:0/173: mknod d5/d23/d24/d28/c31 0 2024-03-17T23:58:19.267 INFO:tasks.workunit.client.0.smithi196.stdout:0/174: chown d5/f29 4821 1 2024-03-17T23:58:19.269 INFO:tasks.workunit.client.0.smithi196.stdout:0/175: fdatasync d5/d23/d24/d28/f26 0 2024-03-17T23:58:19.270 INFO:tasks.workunit.client.0.smithi196.stdout:0/176: write d5/d23/d24/d28/f2e [707554,20170] 0 2024-03-17T23:58:19.271 INFO:tasks.workunit.client.0.smithi196.stdout:0/177: dread - d5/d23/d24/f2c zero size 2024-03-17T23:58:19.274 INFO:tasks.workunit.client.0.smithi196.stdout:0/178: fsync d5/f10 0 2024-03-17T23:58:19.276 INFO:tasks.workunit.client.0.smithi196.stdout:0/179: symlink d5/d23/l32 0 2024-03-17T23:58:19.277 INFO:tasks.workunit.client.0.smithi196.stdout:0/180: write d5/d23/d24/d28/f2e [861841,75031] 0 2024-03-17T23:58:19.279 INFO:tasks.workunit.client.0.smithi196.stdout:0/181: creat d5/d23/f33 x:0 0 0 2024-03-17T23:58:19.280 INFO:tasks.workunit.client.0.smithi196.stdout:0/182: write d5/f18 [3025736,96295] 0 2024-03-17T23:58:19.281 INFO:tasks.workunit.client.0.smithi196.stdout:1/126: sync 2024-03-17T23:58:19.283 INFO:tasks.workunit.client.0.smithi196.stdout:1/127: mknod d1/d13/d23/c32 0 2024-03-17T23:58:19.286 INFO:tasks.workunit.client.0.smithi196.stdout:0/183: dread d5/f1c [0,4194304] 0 2024-03-17T23:58:19.286 INFO:tasks.workunit.client.0.smithi196.stdout:1/128: creat d1/f33 x:0 0 0 2024-03-17T23:58:19.288 INFO:tasks.workunit.client.0.smithi196.stdout:0/184: symlink d5/d23/l34 0 2024-03-17T23:58:19.289 INFO:tasks.workunit.client.0.smithi196.stdout:0/185: write d5/d23/f2d [222059,94416] 0 2024-03-17T23:58:19.295 INFO:tasks.workunit.client.0.smithi196.stdout:1/129: mkdir d1/db/dd/d34 0 2024-03-17T23:58:19.297 INFO:tasks.workunit.client.0.smithi196.stdout:1/130: mknod d1/db/c35 0 2024-03-17T23:58:19.298 INFO:tasks.workunit.client.0.smithi196.stdout:0/186: dwrite d5/d23/d24/d28/f26 [4194304,4194304] 0 2024-03-17T23:58:19.298 INFO:tasks.workunit.client.0.smithi196.stdout:1/131: readlink d1/db/lc 0 2024-03-17T23:58:19.302 INFO:tasks.workunit.client.0.smithi196.stdout:0/187: dread d5/d23/d24/f2f [0,4194304] 0 2024-03-17T23:58:19.303 INFO:tasks.workunit.client.0.smithi196.stdout:1/132: creat d1/d13/d23/f36 x:0 0 0 2024-03-17T23:58:19.306 INFO:tasks.workunit.client.0.smithi196.stdout:0/188: symlink d5/l35 0 2024-03-17T23:58:19.311 INFO:tasks.workunit.client.0.smithi196.stdout:0/189: rmdir d5/d23/d24 39 2024-03-17T23:58:19.311 INFO:tasks.workunit.client.0.smithi196.stdout:0/190: chown d5/l14 2143 1 2024-03-17T23:58:19.313 INFO:tasks.workunit.client.0.smithi196.stdout:1/133: dwrite d1/f25 [4194304,4194304] 0 2024-03-17T23:58:19.314 INFO:tasks.workunit.client.0.smithi196.stdout:1/134: chown d1/db 187 1 2024-03-17T23:58:19.314 INFO:tasks.workunit.client.0.smithi196.stdout:1/135: chown d1/d13/f24 4911 1 2024-03-17T23:58:19.315 INFO:tasks.workunit.client.0.smithi196.stdout:0/191: mkdir d5/d23/d24/d36 0 2024-03-17T23:58:19.317 INFO:tasks.workunit.client.0.smithi196.stdout:1/136: creat d1/d13/d23/f37 x:0 0 0 2024-03-17T23:58:19.317 INFO:tasks.workunit.client.0.smithi196.stdout:0/192: getdents d5/d23/d24/d36 0 2024-03-17T23:58:19.318 INFO:tasks.workunit.client.0.smithi196.stdout:0/193: readlink d5/d23/d24/d28/l27 0 2024-03-17T23:58:19.318 INFO:tasks.workunit.client.0.smithi196.stdout:1/137: creat d1/db/dd/f38 x:0 0 0 2024-03-17T23:58:19.320 INFO:tasks.workunit.client.0.smithi196.stdout:1/138: fdatasync d1/db/f14 0 2024-03-17T23:58:19.325 INFO:tasks.workunit.client.0.smithi196.stdout:1/139: link d1/f21 d1/f39 0 2024-03-17T23:58:19.328 INFO:tasks.workunit.client.0.smithi196.stdout:1/140: mknod d1/d13/d2a/c3a 0 2024-03-17T23:58:19.330 INFO:tasks.workunit.client.0.smithi196.stdout:0/194: truncate d5/f13 1410677 0 2024-03-17T23:58:19.332 INFO:tasks.workunit.client.0.smithi196.stdout:0/195: creat d5/d23/d24/d28/f37 x:0 0 0 2024-03-17T23:58:19.336 INFO:tasks.workunit.client.0.smithi196.stdout:0/196: dread d5/fa [0,4194304] 0 2024-03-17T23:58:19.345 INFO:tasks.workunit.client.0.smithi196.stdout:0/197: dwrite d5/d23/d24/f2c [0,4194304] 0 2024-03-17T23:58:19.356 INFO:tasks.workunit.client.0.smithi196.stdout:0/198: dwrite d5/d23/d24/d28/f37 [0,4194304] 0 2024-03-17T23:58:19.362 INFO:tasks.workunit.client.0.smithi196.stdout:0/199: dread d5/d23/d24/d28/f26 [0,4194304] 0 2024-03-17T23:58:19.370 INFO:tasks.workunit.client.0.smithi196.stdout:0/200: fsync d5/d23/d24/d28/f37 0 2024-03-17T23:58:19.372 INFO:tasks.workunit.client.0.smithi196.stdout:0/201: write d5/d23/d24/f2f [1249316,71811] 0 2024-03-17T23:58:19.376 INFO:tasks.workunit.client.0.smithi196.stdout:0/202: rename d5/l16 to d5/d23/d24/l38 0 2024-03-17T23:58:19.378 INFO:tasks.workunit.client.0.smithi196.stdout:0/203: dread d5/f10 [0,4194304] 0 2024-03-17T23:58:19.380 INFO:tasks.workunit.client.0.smithi196.stdout:0/204: mknod d5/d23/d24/d28/c39 0 2024-03-17T23:58:19.380 INFO:tasks.workunit.client.0.smithi196.stdout:0/205: chown d5/f29 72242 1 2024-03-17T23:58:19.382 INFO:tasks.workunit.client.0.smithi196.stdout:0/206: getdents d5/d23/d24/d36 0 2024-03-17T23:58:19.384 INFO:tasks.workunit.client.0.smithi196.stdout:0/207: mknod d5/d23/d24/c3a 0 2024-03-17T23:58:19.390 INFO:tasks.workunit.client.0.smithi196.stdout:0/208: dwrite d5/d23/f2d [0,4194304] 0 2024-03-17T23:58:19.393 INFO:tasks.workunit.client.0.smithi196.stdout:0/209: creat d5/d23/d24/d28/f3b x:0 0 0 2024-03-17T23:58:19.395 INFO:tasks.workunit.client.0.smithi196.stdout:0/210: getdents d5/d23/d24/d36 0 2024-03-17T23:58:19.397 INFO:tasks.workunit.client.0.smithi196.stdout:0/211: mknod d5/d23/d24/d30/c3c 0 2024-03-17T23:58:19.405 INFO:tasks.workunit.client.0.smithi196.stdout:0/212: dread d5/d23/d24/f2f [0,4194304] 0 2024-03-17T23:58:19.407 INFO:tasks.workunit.client.0.smithi196.stdout:0/213: creat d5/f3d x:0 0 0 2024-03-17T23:58:19.408 INFO:tasks.workunit.client.0.smithi196.stdout:0/214: read d5/d23/d24/f2c [1262051,10905] 0 2024-03-17T23:58:19.410 INFO:tasks.workunit.client.0.smithi196.stdout:0/215: dread - d5/d23/d24/d28/f3b zero size 2024-03-17T23:58:19.411 INFO:tasks.workunit.client.0.smithi196.stdout:0/216: write d5/d23/d24/d28/f3b [390944,49129] 0 2024-03-17T23:58:19.411 INFO:tasks.workunit.client.0.smithi196.stdout:0/217: chown d5/d23 684 1 2024-03-17T23:58:19.413 INFO:tasks.workunit.client.0.smithi196.stdout:5/79: sync 2024-03-17T23:58:19.417 INFO:tasks.workunit.client.0.smithi196.stdout:5/80: unlink d6/l11 0 2024-03-17T23:58:19.418 INFO:tasks.workunit.client.0.smithi196.stdout:0/218: dread d5/f18 [0,4194304] 0 2024-03-17T23:58:19.419 INFO:tasks.workunit.client.0.smithi196.stdout:0/219: write d5/d23/f33 [713627,117185] 0 2024-03-17T23:58:19.419 INFO:tasks.workunit.client.0.smithi196.stdout:5/81: symlink d6/l19 0 2024-03-17T23:58:19.420 INFO:tasks.workunit.client.0.smithi196.stdout:0/220: stat d5/d23/d24/d28/f2e 0 2024-03-17T23:58:19.422 INFO:tasks.workunit.client.0.smithi196.stdout:0/221: write d5/d23/f2d [3839350,105403] 0 2024-03-17T23:58:19.424 INFO:tasks.workunit.client.0.smithi196.stdout:0/222: mkdir d5/d23/d24/d28/d3e 0 2024-03-17T23:58:19.425 INFO:tasks.workunit.client.0.smithi196.stdout:5/82: creat d6/f1a x:0 0 0 2024-03-17T23:58:19.429 INFO:tasks.workunit.client.0.smithi196.stdout:0/223: creat d5/d23/d24/d36/f3f x:0 0 0 2024-03-17T23:58:19.432 INFO:tasks.workunit.client.0.smithi196.stdout:0/224: mknod d5/d23/d24/d28/c40 0 2024-03-17T23:58:19.433 INFO:tasks.workunit.client.0.smithi196.stdout:5/83: dwrite d6/f8 [0,4194304] 0 2024-03-17T23:58:19.433 INFO:tasks.workunit.client.0.smithi196.stdout:0/225: chown d5/d23/d24/d30/c3c 573 1 2024-03-17T23:58:19.435 INFO:tasks.workunit.client.0.smithi196.stdout:0/226: fdatasync d5/d23/d24/d36/f3f 0 2024-03-17T23:58:19.437 INFO:tasks.workunit.client.0.smithi196.stdout:5/84: creat d6/f1b x:0 0 0 2024-03-17T23:58:19.438 INFO:tasks.workunit.client.0.smithi196.stdout:5/85: fsync f1 0 2024-03-17T23:58:19.438 INFO:tasks.workunit.client.0.smithi196.stdout:5/86: chown f0 0 1 2024-03-17T23:58:19.441 INFO:tasks.workunit.client.0.smithi196.stdout:5/87: creat d6/d17/f1c x:0 0 0 2024-03-17T23:58:19.444 INFO:tasks.workunit.client.0.smithi196.stdout:0/227: dwrite d5/fa [4194304,4194304] 0 2024-03-17T23:58:19.445 INFO:tasks.workunit.client.0.smithi196.stdout:5/88: rename c5 to d6/d15/d16/c1d 0 2024-03-17T23:58:19.446 INFO:tasks.workunit.client.0.smithi196.stdout:0/228: write d5/d23/f33 [963203,22746] 0 2024-03-17T23:58:19.446 INFO:tasks.workunit.client.0.smithi196.stdout:5/89: rename d6/d15 to d6/d15/d16/d1e 22 2024-03-17T23:58:19.449 INFO:tasks.workunit.client.0.smithi196.stdout:5/90: write d6/fb [2520232,1831] 0 2024-03-17T23:58:19.451 INFO:tasks.workunit.client.0.smithi196.stdout:0/229: unlink d5/d23/d24/d28/c40 0 2024-03-17T23:58:19.466 INFO:tasks.workunit.client.0.smithi196.stdout:5/91: dread f1 [0,4194304] 0 2024-03-17T23:58:19.556 INFO:tasks.workunit.client.0.smithi196.stdout:0/230: creat d5/d23/d24/d28/f41 x:0 0 0 2024-03-17T23:58:19.558 INFO:tasks.workunit.client.0.smithi196.stdout:5/92: mkdir d6/d17/d1f 0 2024-03-17T23:58:19.558 INFO:tasks.workunit.client.0.smithi196.stdout:0/231: chown d5/d23/d24/d28/l25 165006 1 2024-03-17T23:58:19.559 INFO:tasks.workunit.client.0.smithi196.stdout:0/232: chown d5/d23/d24/f2f 114568268 1 2024-03-17T23:58:19.561 INFO:tasks.workunit.client.0.smithi196.stdout:5/93: symlink d6/d15/d16/l20 0 2024-03-17T23:58:19.562 INFO:tasks.workunit.client.0.smithi196.stdout:5/94: write d6/f1a [118832,18242] 0 2024-03-17T23:58:19.563 INFO:tasks.workunit.client.0.smithi196.stdout:5/95: chown d6/d15/d16 3019298 1 2024-03-17T23:58:19.568 INFO:tasks.workunit.client.0.smithi196.stdout:5/96: dread d6/f8 [0,4194304] 0 2024-03-17T23:58:19.635 INFO:tasks.workunit.client.0.smithi196.stdout:9/119: sync 2024-03-17T23:58:19.635 INFO:tasks.workunit.client.0.smithi196.stdout:6/76: sync 2024-03-17T23:58:19.641 INFO:tasks.workunit.client.0.smithi196.stdout:0/233: link d5/d23/f2d d5/d23/d24/d36/f42 0 2024-03-17T23:58:19.644 INFO:tasks.workunit.client.0.smithi196.stdout:5/97: creat d6/d17/f21 x:0 0 0 2024-03-17T23:58:19.645 INFO:tasks.workunit.client.0.smithi196.stdout:5/98: chown d6/f1b 643 1 2024-03-17T23:58:19.645 INFO:tasks.workunit.client.0.smithi196.stdout:6/77: mkdir d2/d1c 0 2024-03-17T23:58:19.649 INFO:tasks.workunit.client.0.smithi196.stdout:5/99: unlink d6/d17/f21 0 2024-03-17T23:58:19.653 INFO:tasks.workunit.client.0.smithi196.stdout:5/100: dread d6/fc [0,4194304] 0 2024-03-17T23:58:19.713 INFO:tasks.workunit.client.0.smithi196.stdout:0/234: link d5/l1b d5/d23/d24/d36/l43 0 2024-03-17T23:58:19.713 INFO:tasks.workunit.client.0.smithi196.stdout:5/101: fdatasync f4 0 2024-03-17T23:58:19.714 INFO:tasks.workunit.client.0.smithi196.stdout:9/120: truncate d9/f20 2843248 0 2024-03-17T23:58:19.715 INFO:tasks.workunit.client.0.smithi196.stdout:6/78: getdents d2/d7/da 0 2024-03-17T23:58:19.716 INFO:tasks.workunit.client.0.smithi196.stdout:6/79: chown d2/c12 2859 1 2024-03-17T23:58:19.717 INFO:tasks.workunit.client.0.smithi196.stdout:5/102: mknod d6/d17/c22 0 2024-03-17T23:58:19.718 INFO:tasks.workunit.client.0.smithi196.stdout:5/103: dread - d6/f1b zero size 2024-03-17T23:58:19.718 INFO:tasks.workunit.client.0.smithi196.stdout:9/121: unlink d9/df/f1a 0 2024-03-17T23:58:19.722 INFO:tasks.workunit.client.0.smithi196.stdout:6/80: creat d2/d14/f1d x:0 0 0 2024-03-17T23:58:19.724 INFO:tasks.workunit.client.0.smithi196.stdout:0/235: dwrite d5/d23/f33 [0,4194304] 0 2024-03-17T23:58:19.729 INFO:tasks.workunit.client.0.smithi196.stdout:5/104: getdents d6/d15/d16 0 2024-03-17T23:58:19.731 INFO:tasks.workunit.client.0.smithi196.stdout:9/122: dwrite d9/f25 [0,4194304] 0 2024-03-17T23:58:19.734 INFO:tasks.workunit.client.0.smithi196.stdout:5/105: mkdir d6/d17/d23 0 2024-03-17T23:58:19.735 INFO:tasks.workunit.client.0.smithi196.stdout:9/123: creat d9/d1e/f26 x:0 0 0 2024-03-17T23:58:19.738 INFO:tasks.workunit.client.0.smithi196.stdout:0/236: write d5/d23/f2d [4178987,13572] 0 2024-03-17T23:58:19.740 INFO:tasks.workunit.client.0.smithi196.stdout:9/124: mkdir d9/df/d14/d27 0 2024-03-17T23:58:19.742 INFO:tasks.workunit.client.0.smithi196.stdout:0/237: creat d5/f44 x:0 0 0 2024-03-17T23:58:19.744 INFO:tasks.workunit.client.0.smithi196.stdout:9/125: rename d9/f20 to d9/d1e/f28 0 2024-03-17T23:58:19.745 INFO:tasks.workunit.client.0.smithi196.stdout:0/238: creat d5/d23/d24/d36/f45 x:0 0 0 2024-03-17T23:58:19.746 INFO:tasks.workunit.client.0.smithi196.stdout:0/239: chown d5/l20 821741 1 2024-03-17T23:58:19.746 INFO:tasks.workunit.client.0.smithi196.stdout:0/240: chown d5/d23/l32 4776 1 2024-03-17T23:58:19.748 INFO:tasks.workunit.client.0.smithi196.stdout:0/241: dread d5/f10 [0,4194304] 0 2024-03-17T23:58:19.750 INFO:tasks.workunit.client.0.smithi196.stdout:9/126: mknod d9/d12/c29 0 2024-03-17T23:58:19.750 INFO:tasks.workunit.client.0.smithi196.stdout:0/242: write d5/d23/d24/d28/f37 [3408565,114559] 0 2024-03-17T23:58:19.751 INFO:tasks.workunit.client.0.smithi196.stdout:0/243: chown d5/f44 0 1 2024-03-17T23:58:19.752 INFO:tasks.workunit.client.0.smithi196.stdout:9/127: mknod d9/df/d14/d27/c2a 0 2024-03-17T23:58:19.754 INFO:tasks.workunit.client.0.smithi196.stdout:0/244: mknod d5/d23/d24/d30/c46 0 2024-03-17T23:58:19.755 INFO:tasks.workunit.client.0.smithi196.stdout:6/81: dread d2/fd [0,4194304] 0 2024-03-17T23:58:19.755 INFO:tasks.workunit.client.0.smithi196.stdout:0/245: write d5/f3d [929891,89933] 0 2024-03-17T23:58:19.759 INFO:tasks.workunit.client.0.smithi196.stdout:6/82: unlink d2/cc 0 2024-03-17T23:58:19.761 INFO:tasks.workunit.client.0.smithi196.stdout:0/246: rmdir d5/d23/d24/d28/d3e 0 2024-03-17T23:58:19.763 INFO:tasks.workunit.client.0.smithi196.stdout:6/83: mknod d2/d7/da/c1e 0 2024-03-17T23:58:19.763 INFO:tasks.workunit.client.0.smithi196.stdout:6/84: stat d2/c6 0 2024-03-17T23:58:19.763 INFO:tasks.workunit.client.0.smithi196.stdout:4/82: sync 2024-03-17T23:58:19.764 INFO:tasks.workunit.client.0.smithi196.stdout:3/256: sync 2024-03-17T23:58:19.764 INFO:tasks.workunit.client.0.smithi196.stdout:0/247: mkdir d5/d23/d24/d28/d47 0 2024-03-17T23:58:19.765 INFO:tasks.workunit.client.0.smithi196.stdout:6/85: write f1 [2831633,61145] 0 2024-03-17T23:58:19.766 INFO:tasks.workunit.client.0.smithi196.stdout:4/83: symlink d1/l17 0 2024-03-17T23:58:19.767 INFO:tasks.workunit.client.0.smithi196.stdout:0/248: symlink d5/l48 0 2024-03-17T23:58:19.767 INFO:tasks.workunit.client.0.smithi196.stdout:3/257: truncate d7/f11 338256 0 2024-03-17T23:58:19.768 INFO:tasks.workunit.client.0.smithi196.stdout:0/249: dread - d5/d23/d24/d36/f45 zero size 2024-03-17T23:58:19.769 INFO:tasks.workunit.client.0.smithi196.stdout:4/84: creat d1/d11/f18 x:0 0 0 2024-03-17T23:58:19.773 INFO:tasks.workunit.client.0.smithi196.stdout:0/250: mkdir d5/d23/d24/d36/d49 0 2024-03-17T23:58:19.775 INFO:tasks.workunit.client.0.smithi196.stdout:0/251: truncate d5/f44 863997 0 2024-03-17T23:58:19.783 INFO:tasks.workunit.client.0.smithi196.stdout:6/86: dwrite d2/d7/f17 [0,4194304] 0 2024-03-17T23:58:19.785 INFO:tasks.workunit.client.0.smithi196.stdout:6/87: readlink d2/d14/l18 0 2024-03-17T23:58:19.786 INFO:tasks.workunit.client.0.smithi196.stdout:0/252: truncate d5/d23/d24/d28/f2e 1948292 0 2024-03-17T23:58:19.788 INFO:tasks.workunit.client.0.smithi196.stdout:4/85: dwrite d1/d11/f18 [0,4194304] 0 2024-03-17T23:58:19.789 INFO:tasks.workunit.client.0.smithi196.stdout:6/88: mknod d2/c1f 0 2024-03-17T23:58:19.792 INFO:tasks.workunit.client.0.smithi196.stdout:3/258: dwrite d7/f20 [0,4194304] 0 2024-03-17T23:58:19.795 INFO:tasks.workunit.client.0.smithi196.stdout:4/86: creat d1/d11/f19 x:0 0 0 2024-03-17T23:58:19.802 INFO:tasks.workunit.client.0.smithi196.stdout:0/253: dread d5/f29 [0,4194304] 0 2024-03-17T23:58:19.802 INFO:tasks.workunit.client.0.smithi196.stdout:3/259: creat d7/f54 x:0 0 0 2024-03-17T23:58:19.805 INFO:tasks.workunit.client.0.smithi196.stdout:3/260: fsync d7/d19/d26/f47 0 2024-03-17T23:58:19.809 INFO:tasks.workunit.client.0.smithi196.stdout:4/87: dwrite d1/fb [0,4194304] 0 2024-03-17T23:58:19.809 INFO:tasks.workunit.client.0.smithi196.stdout:0/254: link d5/fa d5/d23/f4a 0 2024-03-17T23:58:19.811 INFO:tasks.workunit.client.0.smithi196.stdout:0/255: chown d5/d23/d24/f2f 781501 1 2024-03-17T23:58:19.813 INFO:tasks.workunit.client.0.smithi196.stdout:0/256: mknod d5/d23/d24/c4b 0 2024-03-17T23:58:19.814 INFO:tasks.workunit.client.0.smithi196.stdout:3/261: dread d7/fc [0,4194304] 0 2024-03-17T23:58:19.815 INFO:tasks.workunit.client.0.smithi196.stdout:0/257: chown d5/d23/d24/c3a 4128355 1 2024-03-17T23:58:19.815 INFO:tasks.workunit.client.0.smithi196.stdout:4/88: rename d1/de/c10 to d1/de/c1a 0 2024-03-17T23:58:19.816 INFO:tasks.workunit.client.0.smithi196.stdout:3/262: write d7/d19/d26/f4b [918041,75511] 0 2024-03-17T23:58:19.816 INFO:tasks.workunit.client.0.smithi196.stdout:0/258: rmdir d5/d23/d24 39 2024-03-17T23:58:19.818 INFO:tasks.workunit.client.0.smithi196.stdout:4/89: mkdir d1/d1b 0 2024-03-17T23:58:19.818 INFO:tasks.workunit.client.0.smithi196.stdout:4/90: fdatasync d1/de/f15 0 2024-03-17T23:58:19.819 INFO:tasks.workunit.client.0.smithi196.stdout:0/259: readlink d5/d23/l32 0 2024-03-17T23:58:19.819 INFO:tasks.workunit.client.0.smithi196.stdout:4/91: write d1/fd [2631895,79152] 0 2024-03-17T23:58:19.820 INFO:tasks.workunit.client.0.smithi196.stdout:3/263: creat d7/d19/d26/d2b/f55 x:0 0 0 2024-03-17T23:58:19.823 INFO:tasks.workunit.client.0.smithi196.stdout:6/89: dread f0 [0,4194304] 0 2024-03-17T23:58:19.823 INFO:tasks.workunit.client.0.smithi196.stdout:4/92: unlink d1/f13 0 2024-03-17T23:58:19.827 INFO:tasks.workunit.client.0.smithi196.stdout:3/264: creat d7/d33/f56 x:0 0 0 2024-03-17T23:58:19.832 INFO:tasks.workunit.client.0.smithi196.stdout:6/90: rename d2/d7/f15 to d2/d14/f20 0 2024-03-17T23:58:19.834 INFO:tasks.workunit.client.0.smithi196.stdout:4/93: dwrite d1/f8 [0,4194304] 0 2024-03-17T23:58:19.836 INFO:tasks.workunit.client.0.smithi196.stdout:6/91: write d2/d7/f17 [452835,101850] 0 2024-03-17T23:58:19.843 INFO:tasks.workunit.client.0.smithi196.stdout:4/94: dread d1/fb [0,4194304] 0 2024-03-17T23:58:19.844 INFO:tasks.workunit.client.0.smithi196.stdout:3/265: write d7/ff [3773255,114063] 0 2024-03-17T23:58:19.844 INFO:tasks.workunit.client.0.smithi196.stdout:0/260: link d5/l14 d5/d23/d24/d36/l4c 0 2024-03-17T23:58:19.847 INFO:tasks.workunit.client.0.smithi196.stdout:6/92: dwrite f0 [0,4194304] 0 2024-03-17T23:58:19.847 INFO:tasks.workunit.client.0.smithi196.stdout:3/266: chown d7/f21 193194330 1 2024-03-17T23:58:19.853 INFO:tasks.workunit.client.0.smithi196.stdout:3/267: creat d7/d19/d26/d48/d4d/f57 x:0 0 0 2024-03-17T23:58:19.854 INFO:tasks.workunit.client.0.smithi196.stdout:4/95: dread d1/d11/f18 [0,4194304] 0 2024-03-17T23:58:19.857 INFO:tasks.workunit.client.0.smithi196.stdout:4/96: write d1/f8 [4569811,2094] 0 2024-03-17T23:58:19.859 INFO:tasks.workunit.client.0.smithi196.stdout:0/261: dread d5/f29 [0,4194304] 0 2024-03-17T23:58:19.861 INFO:tasks.workunit.client.0.smithi196.stdout:0/262: truncate d5/f3d 1084391 0 2024-03-17T23:58:19.863 INFO:tasks.workunit.client.0.smithi196.stdout:4/97: rmdir d1/de 39 2024-03-17T23:58:19.863 INFO:tasks.workunit.client.0.smithi196.stdout:6/93: dwrite f1 [0,4194304] 0 2024-03-17T23:58:19.866 INFO:tasks.workunit.client.0.smithi196.stdout:3/268: dwrite d7/d19/d26/d2b/f3b [0,4194304] 0 2024-03-17T23:58:19.867 INFO:tasks.workunit.client.0.smithi196.stdout:0/263: dread d5/f13 [0,4194304] 0 2024-03-17T23:58:19.872 INFO:tasks.workunit.client.0.smithi196.stdout:0/264: write d5/fa [823347,5760] 0 2024-03-17T23:58:19.874 INFO:tasks.workunit.client.0.smithi196.stdout:3/269: rename d7/d19/d26/d48/d4d/f57 to d7/f58 0 2024-03-17T23:58:19.876 INFO:tasks.workunit.client.0.smithi196.stdout:6/94: dwrite f0 [4194304,4194304] 0 2024-03-17T23:58:19.878 INFO:tasks.workunit.client.0.smithi196.stdout:0/265: rename d5/l1b to d5/l4d 0 2024-03-17T23:58:19.882 INFO:tasks.workunit.client.0.smithi196.stdout:0/266: mkdir d5/d23/d24/d30/d4e 0 2024-03-17T23:58:19.883 INFO:tasks.workunit.client.0.smithi196.stdout:3/270: truncate d7/f20 658526 0 2024-03-17T23:58:19.887 INFO:tasks.workunit.client.0.smithi196.stdout:3/271: mknod d7/d19/d26/c59 0 2024-03-17T23:58:19.887 INFO:tasks.workunit.client.0.smithi196.stdout:0/267: dread d5/d23/d24/f2f [0,4194304] 0 2024-03-17T23:58:19.889 INFO:tasks.workunit.client.0.smithi196.stdout:3/272: write d7/ff [720652,28872] 0 2024-03-17T23:58:19.890 INFO:tasks.workunit.client.0.smithi196.stdout:3/273: chown d7/fd 111 1 2024-03-17T23:58:19.890 INFO:tasks.workunit.client.0.smithi196.stdout:6/95: dwrite d2/d14/f1d [0,4194304] 0 2024-03-17T23:58:19.891 INFO:tasks.workunit.client.0.smithi196.stdout:3/274: chown d7/d19/d26/d2b/d3c/d3d/f43 1305 1 2024-03-17T23:58:19.892 INFO:tasks.workunit.client.0.smithi196.stdout:3/275: dread - d7/d19/d26/d2b/f44 zero size 2024-03-17T23:58:19.893 INFO:tasks.workunit.client.0.smithi196.stdout:0/268: chown d5/d23/d24/d28/c39 576109705 1 2024-03-17T23:58:19.898 INFO:tasks.workunit.client.0.smithi196.stdout:3/276: truncate d7/d19/d26/d2b/d3c/d3d/f43 417073 0 2024-03-17T23:58:19.902 INFO:tasks.workunit.client.0.smithi196.stdout:3/277: dread d7/d33/f49 [0,4194304] 0 2024-03-17T23:58:19.905 INFO:tasks.workunit.client.0.smithi196.stdout:0/269: dwrite d5/d23/d24/d28/f3b [0,4194304] 0 2024-03-17T23:58:19.905 INFO:tasks.workunit.client.0.smithi196.stdout:6/96: dwrite d2/d7/da/f19 [0,4194304] 0 2024-03-17T23:58:19.906 INFO:tasks.workunit.client.0.smithi196.stdout:0/270: stat d5/d23/d24/d30 0 2024-03-17T23:58:19.907 INFO:tasks.workunit.client.0.smithi196.stdout:0/271: write d5/d23/d24/d28/f37 [1402789,63157] 0 2024-03-17T23:58:19.918 INFO:tasks.workunit.client.0.smithi196.stdout:6/97: dwrite f1 [4194304,4194304] 0 2024-03-17T23:58:19.920 INFO:tasks.workunit.client.0.smithi196.stdout:0/272: mkdir d5/d23/d24/d28/d4f 0 2024-03-17T23:58:19.920 INFO:tasks.workunit.client.0.smithi196.stdout:0/273: readlink d5/l35 0 2024-03-17T23:58:19.920 INFO:tasks.workunit.client.0.smithi196.stdout:0/274: fdatasync d5/d23/d24/d36/f45 0 2024-03-17T23:58:19.921 INFO:tasks.workunit.client.0.smithi196.stdout:3/278: rename d7/f15 to d7/d19/d26/d2b/d3c/d3d/f5a 0 2024-03-17T23:58:19.925 INFO:tasks.workunit.client.0.smithi196.stdout:6/98: dread f1 [0,4194304] 0 2024-03-17T23:58:19.927 INFO:tasks.workunit.client.0.smithi196.stdout:0/275: dread d5/d23/d24/d28/f3b [0,4194304] 0 2024-03-17T23:58:19.927 INFO:tasks.workunit.client.0.smithi196.stdout:3/279: creat d7/d33/f5b x:0 0 0 2024-03-17T23:58:19.927 INFO:tasks.workunit.client.0.smithi196.stdout:6/99: write d2/d7/da/f19 [3341810,50122] 0 2024-03-17T23:58:19.932 INFO:tasks.workunit.client.0.smithi196.stdout:6/100: write d2/d14/f20 [505410,99065] 0 2024-03-17T23:58:19.934 INFO:tasks.workunit.client.0.smithi196.stdout:3/280: link d7/d19/d26/d2b/f42 d7/d19/d26/f5c 0 2024-03-17T23:58:19.935 INFO:tasks.workunit.client.0.smithi196.stdout:3/281: dread - d7/d33/f5b zero size 2024-03-17T23:58:19.939 INFO:tasks.workunit.client.0.smithi196.stdout:6/101: rename d2/d7/da/ce to d2/d1c/c21 0 2024-03-17T23:58:19.939 INFO:tasks.workunit.client.0.smithi196.stdout:6/102: fdatasync f0 0 2024-03-17T23:58:19.942 INFO:tasks.workunit.client.0.smithi196.stdout:3/282: rename d7/l1e to d7/d19/d26/l5d 0 2024-03-17T23:58:19.946 INFO:tasks.workunit.client.0.smithi196.stdout:3/283: creat d7/d19/d26/d2b/d3c/d3d/f5e x:0 0 0 2024-03-17T23:58:19.947 INFO:tasks.workunit.client.0.smithi196.stdout:3/284: write d7/ff [4778287,42118] 0 2024-03-17T23:58:19.950 INFO:tasks.workunit.client.0.smithi196.stdout:6/103: rename d2/d7/da to d2/d22 0 2024-03-17T23:58:19.951 INFO:tasks.workunit.client.0.smithi196.stdout:3/285: mknod d7/d19/d26/d2b/c5f 0 2024-03-17T23:58:19.953 INFO:tasks.workunit.client.0.smithi196.stdout:3/286: rmdir d7/d19/d26 39 2024-03-17T23:58:19.955 INFO:tasks.workunit.client.0.smithi196.stdout:3/287: dread - d7/f2c zero size 2024-03-17T23:58:19.956 INFO:tasks.workunit.client.0.smithi196.stdout:3/288: fdatasync d7/f1f 0 2024-03-17T23:58:19.958 INFO:tasks.workunit.client.0.smithi196.stdout:6/104: dwrite d2/ff [0,4194304] 0 2024-03-17T23:58:19.964 INFO:tasks.workunit.client.0.smithi196.stdout:6/105: link d2/d7/l9 d2/d22/l23 0 2024-03-17T23:58:19.967 INFO:tasks.workunit.client.0.smithi196.stdout:7/187: sync 2024-03-17T23:58:19.967 INFO:tasks.workunit.client.0.smithi196.stdout:2/187: sync 2024-03-17T23:58:19.968 INFO:tasks.workunit.client.0.smithi196.stdout:6/106: rename d2/d14/l18 to d2/d14/l24 0 2024-03-17T23:58:19.969 INFO:tasks.workunit.client.0.smithi196.stdout:7/188: chown da/d15/d1a/l1e 6328146 1 2024-03-17T23:58:19.972 INFO:tasks.workunit.client.0.smithi196.stdout:2/188: rename d17/d1f/l33 to d17/d28/d30/d3b/l49 0 2024-03-17T23:58:19.974 INFO:tasks.workunit.client.0.smithi196.stdout:2/189: write d17/d1f/f23 [4589170,52974] 0 2024-03-17T23:58:19.974 INFO:tasks.workunit.client.0.smithi196.stdout:3/289: dread d7/f1f [0,4194304] 0 2024-03-17T23:58:19.978 INFO:tasks.workunit.client.0.smithi196.stdout:3/290: rmdir d7/d33 39 2024-03-17T23:58:19.979 INFO:tasks.workunit.client.0.smithi196.stdout:7/189: dwrite da/d15/d1a/f37 [0,4194304] 0 2024-03-17T23:58:19.981 INFO:tasks.workunit.client.0.smithi196.stdout:2/190: creat d17/d28/d30/d3b/f4a x:0 0 0 2024-03-17T23:58:19.983 INFO:tasks.workunit.client.0.smithi196.stdout:7/190: write da/d15/f27 [949592,12837] 0 2024-03-17T23:58:19.983 INFO:tasks.workunit.client.0.smithi196.stdout:3/291: fsync d7/f58 0 2024-03-17T23:58:19.985 INFO:tasks.workunit.client.0.smithi196.stdout:3/292: read d7/f1f [2858960,117801] 0 2024-03-17T23:58:19.988 INFO:tasks.workunit.client.0.smithi196.stdout:2/191: rename d17/d19/f1a to d17/d1f/f4b 0 2024-03-17T23:58:19.991 INFO:tasks.workunit.client.0.smithi196.stdout:3/293: write d7/d19/d26/d2b/f55 [812949,7606] 0 2024-03-17T23:58:19.993 INFO:tasks.workunit.client.0.smithi196.stdout:2/192: symlink d17/l4c 0 2024-03-17T23:58:19.995 INFO:tasks.workunit.client.0.smithi196.stdout:6/107: truncate d2/d14/f1d 253558 0 2024-03-17T23:58:19.999 INFO:tasks.workunit.client.0.smithi196.stdout:6/108: mknod d2/d1c/c25 0 2024-03-17T23:58:20.002 INFO:tasks.workunit.client.0.smithi196.stdout:6/109: unlink d2/d14/c1b 0 2024-03-17T23:58:20.006 INFO:tasks.workunit.client.0.smithi196.stdout:6/110: dread f0 [4194304,4194304] 0 2024-03-17T23:58:20.012 INFO:tasks.workunit.client.0.smithi196.stdout:3/294: dread d7/fd [4194304,4194304] 0 2024-03-17T23:58:20.013 INFO:tasks.workunit.client.0.smithi196.stdout:6/111: truncate f0 4258992 0 2024-03-17T23:58:20.014 INFO:tasks.workunit.client.0.smithi196.stdout:6/112: chown d2/d14 7 1 2024-03-17T23:58:20.014 INFO:tasks.workunit.client.0.smithi196.stdout:2/193: fsync d17/d19/f41 0 2024-03-17T23:58:20.016 INFO:tasks.workunit.client.0.smithi196.stdout:3/295: mknod d7/d19/d26/d2b/d3c/d3d/c60 0 2024-03-17T23:58:20.016 INFO:tasks.workunit.client.0.smithi196.stdout:3/296: stat d7/d19/d26/f4b 0 2024-03-17T23:58:20.017 INFO:tasks.workunit.client.0.smithi196.stdout:6/113: mkdir d2/d26 0 2024-03-17T23:58:20.017 INFO:tasks.workunit.client.0.smithi196.stdout:3/297: chown d7/d19/d26/d2b/f3b 280 1 2024-03-17T23:58:20.019 INFO:tasks.workunit.client.0.smithi196.stdout:2/194: dread - d17/d1f/f20 zero size 2024-03-17T23:58:20.020 INFO:tasks.workunit.client.0.smithi196.stdout:2/195: chown f2 5293836 1 2024-03-17T23:58:20.021 INFO:tasks.workunit.client.0.smithi196.stdout:6/114: rename d2/d1c to d2/d14/d27 0 2024-03-17T23:58:20.023 INFO:tasks.workunit.client.0.smithi196.stdout:3/298: dread d7/d19/d26/d2b/f55 [0,4194304] 0 2024-03-17T23:58:20.031 INFO:tasks.workunit.client.0.smithi196.stdout:6/115: truncate d2/d14/f1d 791847 0 2024-03-17T23:58:20.031 INFO:tasks.workunit.client.0.smithi196.stdout:2/196: dwrite d17/d28/f46 [0,4194304] 0 2024-03-17T23:58:20.033 INFO:tasks.workunit.client.0.smithi196.stdout:6/116: unlink d2/c1f 0 2024-03-17T23:58:20.035 INFO:tasks.workunit.client.0.smithi196.stdout:2/197: rename fb to d17/d22/f4d 0 2024-03-17T23:58:20.039 INFO:tasks.workunit.client.0.smithi196.stdout:2/198: unlink l5 0 2024-03-17T23:58:20.040 INFO:tasks.workunit.client.0.smithi196.stdout:2/199: creat d17/d19/f4e x:0 0 0 2024-03-17T23:58:20.043 INFO:tasks.workunit.client.0.smithi196.stdout:2/200: symlink d17/d1f/l4f 0 2024-03-17T23:58:20.044 INFO:tasks.workunit.client.0.smithi196.stdout:6/117: truncate d2/ff 624548 0 2024-03-17T23:58:20.044 INFO:tasks.workunit.client.0.smithi196.stdout:2/201: write d17/d28/d30/f47 [564067,76691] 0 2024-03-17T23:58:20.046 INFO:tasks.workunit.client.0.smithi196.stdout:2/202: mknod d17/d22/d3f/c50 0 2024-03-17T23:58:20.048 INFO:tasks.workunit.client.0.smithi196.stdout:2/203: mknod d17/d28/c51 0 2024-03-17T23:58:20.052 INFO:tasks.workunit.client.0.smithi196.stdout:6/118: dwrite d2/fd [0,4194304] 0 2024-03-17T23:58:20.054 INFO:tasks.workunit.client.0.smithi196.stdout:6/119: read d2/d7/f17 [3138532,44270] 0 2024-03-17T23:58:20.057 INFO:tasks.workunit.client.0.smithi196.stdout:2/204: dwrite d17/d1f/f23 [4194304,4194304] 0 2024-03-17T23:58:20.059 INFO:tasks.workunit.client.0.smithi196.stdout:2/205: dread - d17/d28/d30/d3b/f4a zero size 2024-03-17T23:58:20.062 INFO:tasks.workunit.client.0.smithi196.stdout:6/120: dread d2/d7/f17 [0,4194304] 0 2024-03-17T23:58:20.062 INFO:tasks.workunit.client.0.smithi196.stdout:6/121: stat f1 0 2024-03-17T23:58:20.067 INFO:tasks.workunit.client.0.smithi196.stdout:6/122: symlink d2/d7/l28 0 2024-03-17T23:58:20.070 INFO:tasks.workunit.client.0.smithi196.stdout:2/206: dwrite d17/d19/f31 [0,4194304] 0 2024-03-17T23:58:20.071 INFO:tasks.workunit.client.0.smithi196.stdout:2/207: chown d17/d22/l2f 2413 1 2024-03-17T23:58:20.074 INFO:tasks.workunit.client.0.smithi196.stdout:6/123: fsync d2/ff 0 2024-03-17T23:58:20.077 INFO:tasks.workunit.client.0.smithi196.stdout:6/124: write f1 [3546525,105200] 0 2024-03-17T23:58:20.077 INFO:tasks.workunit.client.0.smithi196.stdout:6/125: stat d2/d7/l28 0 2024-03-17T23:58:20.077 INFO:tasks.workunit.client.0.smithi196.stdout:2/208: mkdir d17/d19/d44/d52 0 2024-03-17T23:58:20.079 INFO:tasks.workunit.client.0.smithi196.stdout:6/126: creat d2/d14/f29 x:0 0 0 2024-03-17T23:58:20.080 INFO:tasks.workunit.client.0.smithi196.stdout:6/127: read - d2/d14/f29 zero size 2024-03-17T23:58:20.082 INFO:tasks.workunit.client.0.smithi196.stdout:2/209: link d17/d1f/f20 d17/d22/d3d/f53 0 2024-03-17T23:58:20.083 INFO:tasks.workunit.client.0.smithi196.stdout:2/210: read - d17/d19/f4e zero size 2024-03-17T23:58:20.083 INFO:tasks.workunit.client.0.smithi196.stdout:6/128: creat d2/f2a x:0 0 0 2024-03-17T23:58:20.085 INFO:tasks.workunit.client.0.smithi196.stdout:2/211: rename d17/l4c to d17/d22/d3f/l54 0 2024-03-17T23:58:20.090 INFO:tasks.workunit.client.0.smithi196.stdout:6/129: getdents d2/d14 0 2024-03-17T23:58:20.092 INFO:tasks.workunit.client.0.smithi196.stdout:6/130: mkdir d2/d7/d2b 0 2024-03-17T23:58:20.098 INFO:tasks.workunit.client.0.smithi196.stdout:2/212: mknod d17/d22/c55 0 2024-03-17T23:58:20.099 INFO:tasks.workunit.client.0.smithi196.stdout:6/131: write d2/d14/f1d [932503,23953] 0 2024-03-17T23:58:20.100 INFO:tasks.workunit.client.0.smithi196.stdout:2/213: fsync d17/d19/f1d 0 2024-03-17T23:58:20.100 INFO:tasks.workunit.client.0.smithi196.stdout:6/132: readlink d2/d22/l23 0 2024-03-17T23:58:20.102 INFO:tasks.workunit.client.0.smithi196.stdout:2/214: read - d17/f18 zero size 2024-03-17T23:58:20.105 INFO:tasks.workunit.client.0.smithi196.stdout:2/215: rename d17/d19/c37 to d17/d19/d44/d52/c56 0 2024-03-17T23:58:20.105 INFO:tasks.workunit.client.0.smithi196.stdout:6/133: link d2/d22/c1e d2/d7/c2c 0 2024-03-17T23:58:20.107 INFO:tasks.workunit.client.0.smithi196.stdout:2/216: mknod d17/d22/c57 0 2024-03-17T23:58:20.107 INFO:tasks.workunit.client.0.smithi196.stdout:6/134: read f0 [1406673,14963] 0 2024-03-17T23:58:20.107 INFO:tasks.workunit.client.0.smithi196.stdout:2/217: chown d17/d22/l2f 37 1 2024-03-17T23:58:20.108 INFO:tasks.workunit.client.0.smithi196.stdout:2/218: dread - d17/d19/f1d zero size 2024-03-17T23:58:20.116 INFO:tasks.workunit.client.0.smithi196.stdout:6/135: getdents d2/d7 0 2024-03-17T23:58:20.127 INFO:tasks.workunit.client.0.smithi196.stdout:2/219: dread d17/f2a [0,4194304] 0 2024-03-17T23:58:20.128 INFO:tasks.workunit.client.0.smithi196.stdout:6/136: dwrite d2/ff [0,4194304] 0 2024-03-17T23:58:20.133 INFO:tasks.workunit.client.0.smithi196.stdout:6/137: symlink d2/d7/d2b/l2d 0 2024-03-17T23:58:20.134 INFO:tasks.workunit.client.0.smithi196.stdout:2/220: getdents d17/d19/d44 0 2024-03-17T23:58:20.134 INFO:tasks.workunit.client.0.smithi196.stdout:6/138: write d2/ff [4179641,5262] 0 2024-03-17T23:58:20.141 INFO:tasks.workunit.client.0.smithi196.stdout:8/100: sync 2024-03-17T23:58:20.141 INFO:tasks.workunit.client.0.smithi196.stdout:1/141: sync 2024-03-17T23:58:20.143 INFO:tasks.workunit.client.0.smithi196.stdout:8/101: rmdir de 39 2024-03-17T23:58:20.144 INFO:tasks.workunit.client.0.smithi196.stdout:1/142: creat d1/d13/f3b x:0 0 0 2024-03-17T23:58:20.144 INFO:tasks.workunit.client.0.smithi196.stdout:2/221: link d17/d28/d30/d3b/l49 d17/d28/d30/d3b/l58 0 2024-03-17T23:58:20.146 INFO:tasks.workunit.client.0.smithi196.stdout:8/102: dread - de/d10/f1b zero size 2024-03-17T23:58:20.147 INFO:tasks.workunit.client.0.smithi196.stdout:2/222: chown d17/d1f/l34 1135349162 1 2024-03-17T23:58:20.148 INFO:tasks.workunit.client.0.smithi196.stdout:6/139: dwrite f0 [0,4194304] 0 2024-03-17T23:58:20.150 INFO:tasks.workunit.client.0.smithi196.stdout:2/223: mkdir d17/d22/d59 0 2024-03-17T23:58:20.151 INFO:tasks.workunit.client.0.smithi196.stdout:6/140: mknod d2/d7/d2b/c2e 0 2024-03-17T23:58:20.153 INFO:tasks.workunit.client.0.smithi196.stdout:2/224: fdatasync d17/d1f/f4b 0 2024-03-17T23:58:20.157 INFO:tasks.workunit.client.0.smithi196.stdout:8/103: truncate f7 3620250 0 2024-03-17T23:58:20.158 INFO:tasks.workunit.client.0.smithi196.stdout:8/104: readlink de/d10/l18 0 2024-03-17T23:58:20.162 INFO:tasks.workunit.client.0.smithi196.stdout:8/105: truncate de/ff 3099278 0 2024-03-17T23:58:20.168 INFO:tasks.workunit.client.0.smithi196.stdout:1/143: dread d1/f8 [0,4194304] 0 2024-03-17T23:58:20.168 INFO:tasks.workunit.client.0.smithi196.stdout:2/225: dread d17/d19/f25 [0,4194304] 0 2024-03-17T23:58:20.171 INFO:tasks.workunit.client.0.smithi196.stdout:2/226: creat d17/d22/d3f/f5a x:0 0 0 2024-03-17T23:58:20.172 INFO:tasks.workunit.client.0.smithi196.stdout:1/144: rename d1/f21 to d1/d13/f3c 0 2024-03-17T23:58:20.174 INFO:tasks.workunit.client.0.smithi196.stdout:1/145: fsync d1/db/fe 0 2024-03-17T23:58:20.177 INFO:tasks.workunit.client.0.smithi196.stdout:2/227: dread d17/d19/f25 [0,4194304] 0 2024-03-17T23:58:20.179 INFO:tasks.workunit.client.0.smithi196.stdout:1/146: link d1/db/c35 d1/c3d 0 2024-03-17T23:58:20.179 INFO:tasks.workunit.client.0.smithi196.stdout:1/147: stat d1/db/l28 0 2024-03-17T23:58:20.180 INFO:tasks.workunit.client.0.smithi196.stdout:1/148: write d1/d13/f2f [1046882,59866] 0 2024-03-17T23:58:20.183 INFO:tasks.workunit.client.0.smithi196.stdout:2/228: dread d17/d22/f40 [0,4194304] 0 2024-03-17T23:58:20.184 INFO:tasks.workunit.client.0.smithi196.stdout:1/149: getdents d1/d13/d23 0 2024-03-17T23:58:20.185 INFO:tasks.workunit.client.0.smithi196.stdout:1/150: write d1/f33 [1034800,7023] 0 2024-03-17T23:58:20.185 INFO:tasks.workunit.client.0.smithi196.stdout:2/229: truncate d17/d28/d30/d3b/f4a 949388 0 2024-03-17T23:58:20.187 INFO:tasks.workunit.client.0.smithi196.stdout:2/230: rmdir d17/d22/d3d 39 2024-03-17T23:58:20.189 INFO:tasks.workunit.client.0.smithi196.stdout:1/151: link d1/db/c1e d1/db/dd/c3e 0 2024-03-17T23:58:20.189 INFO:tasks.workunit.client.0.smithi196.stdout:1/152: read - d1/d13/d23/f29 zero size 2024-03-17T23:58:20.190 INFO:tasks.workunit.client.0.smithi196.stdout:1/153: read d1/f8 [4130461,91399] 0 2024-03-17T23:58:20.191 INFO:tasks.workunit.client.0.smithi196.stdout:1/154: chown d1/d13/f3c 92 1 2024-03-17T23:58:20.195 INFO:tasks.workunit.client.0.smithi196.stdout:1/155: rename d1/d13/f2f to d1/f3f 0 2024-03-17T23:58:20.203 INFO:tasks.workunit.client.0.smithi196.stdout:1/156: dwrite d1/db/dd/f12 [0,4194304] 0 2024-03-17T23:58:20.205 INFO:tasks.workunit.client.0.smithi196.stdout:1/157: symlink d1/d13/l40 0 2024-03-17T23:58:20.210 INFO:tasks.workunit.client.0.smithi196.stdout:1/158: fsync d1/f8 0 2024-03-17T23:58:20.212 INFO:tasks.workunit.client.0.smithi196.stdout:1/159: creat d1/d13/f41 x:0 0 0 2024-03-17T23:58:20.212 INFO:tasks.workunit.client.0.smithi196.stdout:1/160: readlink d1/d13/d23/l26 0 2024-03-17T23:58:20.219 INFO:tasks.workunit.client.0.smithi196.stdout:1/161: dwrite d1/d13/f3b [0,4194304] 0 2024-03-17T23:58:20.223 INFO:tasks.workunit.client.0.smithi196.stdout:1/162: read d1/f33 [628499,47880] 0 2024-03-17T23:58:20.223 INFO:tasks.workunit.client.0.smithi196.stdout:1/163: chown d1/f39 3 1 2024-03-17T23:58:20.227 INFO:tasks.workunit.client.0.smithi196.stdout:1/164: creat d1/db/dd/d34/f42 x:0 0 0 2024-03-17T23:58:20.230 INFO:tasks.workunit.client.0.smithi196.stdout:1/165: mkdir d1/db/dd/d43 0 2024-03-17T23:58:20.231 INFO:tasks.workunit.client.0.smithi196.stdout:1/166: mknod d1/db/c44 0 2024-03-17T23:58:20.235 INFO:tasks.workunit.client.0.smithi196.stdout:1/167: creat d1/db/dd/d43/f45 x:0 0 0 2024-03-17T23:58:20.336 INFO:tasks.workunit.client.0.smithi196.stdout:5/106: sync 2024-03-17T23:58:20.338 INFO:tasks.workunit.client.0.smithi196.stdout:5/107: creat d6/d15/d16/f24 x:0 0 0 2024-03-17T23:58:20.344 INFO:tasks.workunit.client.0.smithi196.stdout:5/108: write d6/f8 [2059524,49234] 0 2024-03-17T23:58:20.345 INFO:tasks.workunit.client.0.smithi196.stdout:5/109: rmdir d6/d15/d16 39 2024-03-17T23:58:20.347 INFO:tasks.workunit.client.0.smithi196.stdout:5/110: read d6/f1a [85226,15404] 0 2024-03-17T23:58:20.348 INFO:tasks.workunit.client.0.smithi196.stdout:5/111: stat d6/d15/d16/f24 0 2024-03-17T23:58:20.360 INFO:tasks.workunit.client.0.smithi196.stdout:5/112: dread d6/fb [0,4194304] 0 2024-03-17T23:58:20.361 INFO:tasks.workunit.client.0.smithi196.stdout:5/113: unlink d6/l9 0 2024-03-17T23:58:20.422 INFO:tasks.workunit.client.0.smithi196.stdout:5/114: write d6/fd [3028392,85023] 0 2024-03-17T23:58:20.423 INFO:tasks.workunit.client.0.smithi196.stdout:5/115: write d6/fc [2060359,78255] 0 2024-03-17T23:58:20.469 INFO:tasks.workunit.client.0.smithi196.stdout:9/128: sync 2024-03-17T23:58:20.471 INFO:tasks.workunit.client.0.smithi196.stdout:9/129: symlink d9/d1e/l2b 0 2024-03-17T23:58:20.501 INFO:tasks.workunit.client.0.smithi196.stdout:9/130: dread f5 [0,4194304] 0 2024-03-17T23:58:20.506 INFO:tasks.workunit.client.0.smithi196.stdout:9/131: creat d9/d1e/f2c x:0 0 0 2024-03-17T23:58:20.507 INFO:tasks.workunit.client.0.smithi196.stdout:9/132: truncate d9/df/f1d 502113 0 2024-03-17T23:58:20.508 INFO:tasks.workunit.client.0.smithi196.stdout:9/133: dread - d9/d1e/f26 zero size 2024-03-17T23:58:20.512 INFO:tasks.workunit.client.0.smithi196.stdout:9/134: dread d9/f25 [0,4194304] 0 2024-03-17T23:58:20.514 INFO:tasks.workunit.client.0.smithi196.stdout:9/135: write d9/d12/f21 [1891476,118409] 0 2024-03-17T23:58:20.516 INFO:tasks.workunit.client.0.smithi196.stdout:9/136: creat d9/df/d14/d27/f2d x:0 0 0 2024-03-17T23:58:20.519 INFO:tasks.workunit.client.0.smithi196.stdout:9/137: creat d9/df/d14/f2e x:0 0 0 2024-03-17T23:58:20.520 INFO:tasks.workunit.client.0.smithi196.stdout:9/138: write d9/df/d14/f2e [759784,63878] 0 2024-03-17T23:58:20.527 INFO:tasks.workunit.client.0.smithi196.stdout:9/139: dwrite d9/f25 [4194304,4194304] 0 2024-03-17T23:58:20.537 INFO:tasks.workunit.client.0.smithi196.stdout:9/140: getdents d9/d12 0 2024-03-17T23:58:20.540 INFO:tasks.workunit.client.0.smithi196.stdout:9/141: getdents d9/d1e 0 2024-03-17T23:58:20.546 INFO:tasks.workunit.client.0.smithi196.stdout:9/142: dwrite d9/f11 [0,4194304] 0 2024-03-17T23:58:20.549 INFO:tasks.workunit.client.0.smithi196.stdout:9/143: mknod d9/d12/c2f 0 2024-03-17T23:58:20.556 INFO:tasks.workunit.client.0.smithi196.stdout:9/144: dwrite f5 [0,4194304] 0 2024-03-17T23:58:20.562 INFO:tasks.workunit.client.0.smithi196.stdout:4/98: sync 2024-03-17T23:58:20.563 INFO:tasks.workunit.client.0.smithi196.stdout:4/99: creat d1/d11/f1c x:0 0 0 2024-03-17T23:58:20.564 INFO:tasks.workunit.client.0.smithi196.stdout:9/145: link d9/df/f1d d9/df/d14/f30 0 2024-03-17T23:58:20.568 INFO:tasks.workunit.client.0.smithi196.stdout:4/100: creat d1/f1d x:0 0 0 2024-03-17T23:58:20.571 INFO:tasks.workunit.client.0.smithi196.stdout:4/101: write d1/d11/f18 [2453590,4944] 0 2024-03-17T23:58:20.574 INFO:tasks.workunit.client.0.smithi196.stdout:9/146: dwrite d9/d1e/f2c [0,4194304] 0 2024-03-17T23:58:20.575 INFO:tasks.workunit.client.0.smithi196.stdout:4/102: unlink d1/de/f15 0 2024-03-17T23:58:20.587 INFO:tasks.workunit.client.0.smithi196.stdout:4/103: write d1/fb [2322797,11971] 0 2024-03-17T23:58:20.588 INFO:tasks.workunit.client.0.smithi196.stdout:4/104: chown d1/d1b 5 1 2024-03-17T23:58:20.592 INFO:tasks.workunit.client.0.smithi196.stdout:9/147: dwrite d9/d12/f16 [0,4194304] 0 2024-03-17T23:58:20.595 INFO:tasks.workunit.client.0.smithi196.stdout:9/148: rmdir d9/d12 39 2024-03-17T23:58:20.597 INFO:tasks.workunit.client.0.smithi196.stdout:5/116: sync 2024-03-17T23:58:20.597 INFO:tasks.workunit.client.0.smithi196.stdout:8/106: sync 2024-03-17T23:58:20.597 INFO:tasks.workunit.client.0.smithi196.stdout:2/231: sync 2024-03-17T23:58:20.597 INFO:tasks.workunit.client.0.smithi196.stdout:1/168: sync 2024-03-17T23:58:20.598 INFO:tasks.workunit.client.0.smithi196.stdout:0/276: sync 2024-03-17T23:58:20.598 INFO:tasks.workunit.client.0.smithi196.stdout:3/299: sync 2024-03-17T23:58:20.598 INFO:tasks.workunit.client.0.smithi196.stdout:7/191: sync 2024-03-17T23:58:20.598 INFO:tasks.workunit.client.0.smithi196.stdout:6/141: sync 2024-03-17T23:58:20.599 INFO:tasks.workunit.client.0.smithi196.stdout:4/105: dread d1/f8 [0,4194304] 0 2024-03-17T23:58:20.599 INFO:tasks.workunit.client.0.smithi196.stdout:0/277: fdatasync d5/f44 0 2024-03-17T23:58:20.602 INFO:tasks.workunit.client.0.smithi196.stdout:4/106: write d1/d11/f19 [504623,8921] 0 2024-03-17T23:58:20.604 INFO:tasks.workunit.client.0.smithi196.stdout:7/192: write da/d15/d1d/f32 [596380,86629] 0 2024-03-17T23:58:20.605 INFO:tasks.workunit.client.0.smithi196.stdout:6/142: creat d2/d7/d2b/f2f x:0 0 0 2024-03-17T23:58:20.607 INFO:tasks.workunit.client.0.smithi196.stdout:5/117: mknod d6/d15/c25 0 2024-03-17T23:58:20.611 INFO:tasks.workunit.client.0.smithi196.stdout:4/107: mknod d1/c1e 0 2024-03-17T23:58:20.612 INFO:tasks.workunit.client.0.smithi196.stdout:1/169: rename d1/db/dd/c3e to d1/db/dd/c46 0 2024-03-17T23:58:20.614 INFO:tasks.workunit.client.0.smithi196.stdout:0/278: link d5/d23/d24/d36/f42 d5/d23/d24/d28/d47/f50 0 2024-03-17T23:58:20.618 INFO:tasks.workunit.client.0.smithi196.stdout:7/193: rmdir da/d15 39 2024-03-17T23:58:20.618 INFO:tasks.workunit.client.0.smithi196.stdout:5/118: creat d6/d17/f26 x:0 0 0 2024-03-17T23:58:20.618 INFO:tasks.workunit.client.0.smithi196.stdout:7/194: chown da/l11 16 1 2024-03-17T23:58:20.619 INFO:tasks.workunit.client.0.smithi196.stdout:4/108: write d1/d11/f12 [955188,94381] 0 2024-03-17T23:58:20.620 INFO:tasks.workunit.client.0.smithi196.stdout:1/170: mkdir d1/d13/d23/d47 0 2024-03-17T23:58:20.620 INFO:tasks.workunit.client.0.smithi196.stdout:5/119: chown d6/l19 509900799 1 2024-03-17T23:58:20.623 INFO:tasks.workunit.client.0.smithi196.stdout:8/107: dwrite de/f13 [0,4194304] 0 2024-03-17T23:58:20.626 INFO:tasks.workunit.client.0.smithi196.stdout:2/232: dwrite d17/d19/f41 [4194304,4194304] 0 2024-03-17T23:58:20.627 INFO:tasks.workunit.client.0.smithi196.stdout:2/233: chown d17/d22/f40 14 1 2024-03-17T23:58:20.629 INFO:tasks.workunit.client.0.smithi196.stdout:4/109: readlink d1/lf 0 2024-03-17T23:58:20.631 INFO:tasks.workunit.client.0.smithi196.stdout:6/143: dwrite f1 [4194304,4194304] 0 2024-03-17T23:58:20.632 INFO:tasks.workunit.client.0.smithi196.stdout:9/149: dread d9/fd [4194304,4194304] 0 2024-03-17T23:58:20.636 INFO:tasks.workunit.client.0.smithi196.stdout:7/195: chown da/l19 43 1 2024-03-17T23:58:20.636 INFO:tasks.workunit.client.0.smithi196.stdout:5/120: write f0 [597971,120909] 0 2024-03-17T23:58:20.638 INFO:tasks.workunit.client.0.smithi196.stdout:0/279: rename d5/d23/d24/d28/f3b to d5/d23/d24/d28/d4f/f51 0 2024-03-17T23:58:20.640 INFO:tasks.workunit.client.0.smithi196.stdout:6/144: symlink d2/d14/l30 0 2024-03-17T23:58:20.642 INFO:tasks.workunit.client.0.smithi196.stdout:9/150: creat d9/df/d14/d27/f31 x:0 0 0 2024-03-17T23:58:20.644 INFO:tasks.workunit.client.0.smithi196.stdout:1/171: mkdir d1/d13/d23/d47/d48 0 2024-03-17T23:58:20.644 INFO:tasks.workunit.client.0.smithi196.stdout:7/196: write da/d15/d1d/f2d [164824,22573] 0 2024-03-17T23:58:20.645 INFO:tasks.workunit.client.0.smithi196.stdout:5/121: dread d6/fd [0,4194304] 0 2024-03-17T23:58:20.646 INFO:tasks.workunit.client.0.smithi196.stdout:5/122: stat d6/d17/f1c 0 2024-03-17T23:58:20.647 INFO:tasks.workunit.client.0.smithi196.stdout:1/172: chown d1/db/dd/d34/f42 9 1 2024-03-17T23:58:20.647 INFO:tasks.workunit.client.0.smithi196.stdout:4/110: symlink d1/l1f 0 2024-03-17T23:58:20.648 INFO:tasks.workunit.client.0.smithi196.stdout:5/123: dread - d6/d17/f26 zero size 2024-03-17T23:58:20.649 INFO:tasks.workunit.client.0.smithi196.stdout:1/173: read - d1/d13/d23/f29 zero size 2024-03-17T23:58:20.651 INFO:tasks.workunit.client.0.smithi196.stdout:9/151: unlink d9/df/d14/d27/f2d 0 2024-03-17T23:58:20.653 INFO:tasks.workunit.client.0.smithi196.stdout:0/280: dread d5/d23/d24/d28/f2e [0,4194304] 0 2024-03-17T23:58:20.656 INFO:tasks.workunit.client.0.smithi196.stdout:6/145: symlink d2/d26/l31 0 2024-03-17T23:58:20.657 INFO:tasks.workunit.client.0.smithi196.stdout:6/146: read - d2/d7/d2b/f2f zero size 2024-03-17T23:58:20.657 INFO:tasks.workunit.client.0.smithi196.stdout:8/108: write de/ff [1055807,117639] 0 2024-03-17T23:58:20.659 INFO:tasks.workunit.client.0.smithi196.stdout:8/109: write de/d10/f1b [930547,5022] 0 2024-03-17T23:58:20.659 INFO:tasks.workunit.client.0.smithi196.stdout:4/111: rename d1/ca to d1/d1b/c20 0 2024-03-17T23:58:20.661 INFO:tasks.workunit.client.0.smithi196.stdout:1/174: creat d1/d13/d23/f49 x:0 0 0 2024-03-17T23:58:20.662 INFO:tasks.workunit.client.0.smithi196.stdout:3/300: link d7/f21 d7/d19/d26/d2b/f61 0 2024-03-17T23:58:20.663 INFO:tasks.workunit.client.0.smithi196.stdout:1/175: write d1/db/dd/d43/f45 [263055,61713] 0 2024-03-17T23:58:20.663 INFO:tasks.workunit.client.0.smithi196.stdout:7/197: mkdir da/d3c 0 2024-03-17T23:58:20.664 INFO:tasks.workunit.client.0.smithi196.stdout:0/281: rmdir d5/d23/d24/d36 39 2024-03-17T23:58:20.665 INFO:tasks.workunit.client.0.smithi196.stdout:3/301: read d7/d19/f1c [169397,123843] 0 2024-03-17T23:58:20.665 INFO:tasks.workunit.client.0.smithi196.stdout:0/282: write d5/f44 [1665433,94878] 0 2024-03-17T23:58:20.666 INFO:tasks.workunit.client.0.smithi196.stdout:6/147: creat d2/d7/f32 x:0 0 0 2024-03-17T23:58:20.666 INFO:tasks.workunit.client.0.smithi196.stdout:3/302: readlink d7/d19/l1a 0 2024-03-17T23:58:20.668 INFO:tasks.workunit.client.0.smithi196.stdout:6/148: chown d2/c6 50 1 2024-03-17T23:58:20.668 INFO:tasks.workunit.client.0.smithi196.stdout:3/303: fdatasync d7/d19/d26/d2b/f3b 0 2024-03-17T23:58:20.670 INFO:tasks.workunit.client.0.smithi196.stdout:4/112: rename d1/fb to d1/de/f21 0 2024-03-17T23:58:20.670 INFO:tasks.workunit.client.0.smithi196.stdout:0/283: write d5/d23/d24/d28/f41 [73949,3164] 0 2024-03-17T23:58:20.670 INFO:tasks.workunit.client.0.smithi196.stdout:3/304: stat d7/d19/l51 0 2024-03-17T23:58:20.670 INFO:tasks.workunit.client.0.smithi196.stdout:9/152: rmdir d9/d12 39 2024-03-17T23:58:20.670 INFO:tasks.workunit.client.0.smithi196.stdout:4/113: readlink d1/de/l16 0 2024-03-17T23:58:20.671 INFO:tasks.workunit.client.0.smithi196.stdout:8/110: dread de/d10/f14 [0,4194304] 0 2024-03-17T23:58:20.673 INFO:tasks.workunit.client.0.smithi196.stdout:1/176: fsync d1/d13/f3c 0 2024-03-17T23:58:20.674 INFO:tasks.workunit.client.0.smithi196.stdout:3/305: stat d7/d19/d26/d2b/d3c/d3d 0 2024-03-17T23:58:20.674 INFO:tasks.workunit.client.0.smithi196.stdout:1/177: chown d1/f39 3819673 1 2024-03-17T23:58:20.675 INFO:tasks.workunit.client.0.smithi196.stdout:5/124: creat d6/d15/f27 x:0 0 0 2024-03-17T23:58:20.678 INFO:tasks.workunit.client.0.smithi196.stdout:9/153: dread d9/f25 [4194304,4194304] 0 2024-03-17T23:58:20.680 INFO:tasks.workunit.client.0.smithi196.stdout:6/149: symlink d2/d22/l33 0 2024-03-17T23:58:20.690 INFO:tasks.workunit.client.0.smithi196.stdout:4/114: rmdir d1/de 39 2024-03-17T23:58:20.691 INFO:tasks.workunit.client.0.smithi196.stdout:5/125: dwrite d6/d17/f1c [0,4194304] 0 2024-03-17T23:58:20.692 INFO:tasks.workunit.client.0.smithi196.stdout:4/115: stat d1/lf 0 2024-03-17T23:58:20.695 INFO:tasks.workunit.client.0.smithi196.stdout:7/198: mknod da/d15/d1d/d2e/c3d 0 2024-03-17T23:58:20.696 INFO:tasks.workunit.client.0.smithi196.stdout:6/150: dwrite d2/d7/f32 [0,4194304] 0 2024-03-17T23:58:20.697 INFO:tasks.workunit.client.0.smithi196.stdout:9/154: dread d9/d1e/f28 [0,4194304] 0 2024-03-17T23:58:20.702 INFO:tasks.workunit.client.0.smithi196.stdout:3/306: fsync d7/f8 0 2024-03-17T23:58:20.702 INFO:tasks.workunit.client.0.smithi196.stdout:5/126: write d6/d15/d16/f24 [396916,124456] 0 2024-03-17T23:58:20.702 INFO:tasks.workunit.client.0.smithi196.stdout:4/116: mknod d1/d1b/c22 0 2024-03-17T23:58:20.702 INFO:tasks.workunit.client.0.smithi196.stdout:0/284: rename d5/d23/d24/d36 to d5/d23/d24/d28/d47/d52 0 2024-03-17T23:58:20.703 INFO:tasks.workunit.client.0.smithi196.stdout:7/199: fdatasync f8 0 2024-03-17T23:58:20.706 INFO:tasks.workunit.client.0.smithi196.stdout:6/151: symlink d2/d14/l34 0 2024-03-17T23:58:20.707 INFO:tasks.workunit.client.0.smithi196.stdout:6/152: readlink d2/d14/l30 0 2024-03-17T23:58:20.707 INFO:tasks.workunit.client.0.smithi196.stdout:6/153: chown d2/d22/f19 36641 1 2024-03-17T23:58:20.708 INFO:tasks.workunit.client.0.smithi196.stdout:6/154: write d2/d14/f1d [31153,47992] 0 2024-03-17T23:58:20.713 INFO:tasks.workunit.client.0.smithi196.stdout:1/178: rename d1/f33 to d1/db/dd/d43/f4a 0 2024-03-17T23:58:20.714 INFO:tasks.workunit.client.0.smithi196.stdout:3/307: symlink d7/d19/d26/d48/d4d/l62 0 2024-03-17T23:58:20.715 INFO:tasks.workunit.client.0.smithi196.stdout:0/285: unlink d5/f29 0 2024-03-17T23:58:20.716 INFO:tasks.workunit.client.0.smithi196.stdout:5/127: symlink d6/d15/d16/l28 0 2024-03-17T23:58:20.717 INFO:tasks.workunit.client.0.smithi196.stdout:3/308: read d7/f1f [245171,45209] 0 2024-03-17T23:58:20.717 INFO:tasks.workunit.client.0.smithi196.stdout:9/155: dwrite d9/d1e/f28 [0,4194304] 0 2024-03-17T23:58:20.719 INFO:tasks.workunit.client.0.smithi196.stdout:8/111: getdents de 0 2024-03-17T23:58:20.721 INFO:tasks.workunit.client.0.smithi196.stdout:4/117: symlink d1/l23 0 2024-03-17T23:58:20.725 INFO:tasks.workunit.client.0.smithi196.stdout:0/286: symlink d5/d23/d24/d28/l53 0 2024-03-17T23:58:20.726 INFO:tasks.workunit.client.0.smithi196.stdout:7/200: mkdir da/d3e 0 2024-03-17T23:58:20.727 INFO:tasks.workunit.client.0.smithi196.stdout:0/287: write d5/d23/f33 [3314275,87113] 0 2024-03-17T23:58:20.728 INFO:tasks.workunit.client.0.smithi196.stdout:4/118: truncate d1/d11/f1c 499750 0 2024-03-17T23:58:20.729 INFO:tasks.workunit.client.0.smithi196.stdout:3/309: creat d7/d29/f63 x:0 0 0 2024-03-17T23:58:20.732 INFO:tasks.workunit.client.0.smithi196.stdout:6/155: dwrite f1 [0,4194304] 0 2024-03-17T23:58:20.738 INFO:tasks.workunit.client.0.smithi196.stdout:1/179: link d1/d13/d23/f49 d1/f4b 0 2024-03-17T23:58:20.740 INFO:tasks.workunit.client.0.smithi196.stdout:6/156: mkdir d2/d14/d35 0 2024-03-17T23:58:20.743 INFO:tasks.workunit.client.0.smithi196.stdout:9/156: dwrite d9/d1e/f28 [4194304,4194304] 0 2024-03-17T23:58:20.745 INFO:tasks.workunit.client.0.smithi196.stdout:5/128: dread f3 [0,4194304] 0 2024-03-17T23:58:20.746 INFO:tasks.workunit.client.0.smithi196.stdout:5/129: dread - d6/f10 zero size 2024-03-17T23:58:20.747 INFO:tasks.workunit.client.0.smithi196.stdout:5/130: write f4 [2941380,117745] 0 2024-03-17T23:58:20.749 INFO:tasks.workunit.client.0.smithi196.stdout:7/201: dread da/d15/d1a/f20 [0,4194304] 0 2024-03-17T23:58:20.750 INFO:tasks.workunit.client.0.smithi196.stdout:6/157: stat d2/d14/l30 0 2024-03-17T23:58:20.750 INFO:tasks.workunit.client.0.smithi196.stdout:1/180: fsync d1/f9 0 2024-03-17T23:58:20.756 INFO:tasks.workunit.client.0.smithi196.stdout:1/181: dread d1/f3f [0,4194304] 0 2024-03-17T23:58:20.763 INFO:tasks.workunit.client.0.smithi196.stdout:5/131: fsync d6/fc 0 2024-03-17T23:58:20.764 INFO:tasks.workunit.client.0.smithi196.stdout:0/288: dwrite d5/d23/d24/d28/d47/f50 [0,4194304] 0 2024-03-17T23:58:20.764 INFO:tasks.workunit.client.0.smithi196.stdout:5/132: readlink d6/l19 0 2024-03-17T23:58:20.767 INFO:tasks.workunit.client.0.smithi196.stdout:5/133: fdatasync f0 0 2024-03-17T23:58:20.770 INFO:tasks.workunit.client.0.smithi196.stdout:9/157: dread f6 [0,4194304] 0 2024-03-17T23:58:20.771 INFO:tasks.workunit.client.0.smithi196.stdout:5/134: write d6/f8 [448447,74245] 0 2024-03-17T23:58:20.772 INFO:tasks.workunit.client.0.smithi196.stdout:1/182: read d1/d13/f3c [667553,127410] 0 2024-03-17T23:58:20.772 INFO:tasks.workunit.client.0.smithi196.stdout:9/158: rmdir d9/d1e 39 2024-03-17T23:58:20.778 INFO:tasks.workunit.client.0.smithi196.stdout:9/159: mknod d9/df/c32 0 2024-03-17T23:58:20.779 INFO:tasks.workunit.client.0.smithi196.stdout:1/183: mkdir d1/d13/d4c 0 2024-03-17T23:58:20.781 INFO:tasks.workunit.client.0.smithi196.stdout:7/202: dwrite da/d15/f17 [0,4194304] 0 2024-03-17T23:58:20.782 INFO:tasks.workunit.client.0.smithi196.stdout:5/135: dread d6/fc [0,4194304] 0 2024-03-17T23:58:20.782 INFO:tasks.workunit.client.0.smithi196.stdout:9/160: mkdir d9/d33 0 2024-03-17T23:58:20.784 INFO:tasks.workunit.client.0.smithi196.stdout:7/203: creat da/d15/d1d/f3f x:0 0 0 2024-03-17T23:58:20.785 INFO:tasks.workunit.client.0.smithi196.stdout:7/204: fsync da/d15/f24 0 2024-03-17T23:58:20.786 INFO:tasks.workunit.client.0.smithi196.stdout:1/184: creat d1/f4d x:0 0 0 2024-03-17T23:58:20.787 INFO:tasks.workunit.client.0.smithi196.stdout:9/161: truncate d9/d12/f21 4424976 0 2024-03-17T23:58:20.788 INFO:tasks.workunit.client.0.smithi196.stdout:7/205: truncate da/d15/d1d/f30 789249 0 2024-03-17T23:58:20.789 INFO:tasks.workunit.client.0.smithi196.stdout:7/206: readlink da/l11 0 2024-03-17T23:58:20.789 INFO:tasks.workunit.client.0.smithi196.stdout:5/136: getdents d6/d15/d16 0 2024-03-17T23:58:20.793 INFO:tasks.workunit.client.0.smithi196.stdout:1/185: rename d1/d13/d2a/c3a to d1/d13/d23/c4e 0 2024-03-17T23:58:20.795 INFO:tasks.workunit.client.0.smithi196.stdout:7/207: symlink da/d3e/l40 0 2024-03-17T23:58:20.796 INFO:tasks.workunit.client.0.smithi196.stdout:9/162: dread d9/f11 [0,4194304] 0 2024-03-17T23:58:20.798 INFO:tasks.workunit.client.0.smithi196.stdout:1/186: symlink d1/d13/d23/d47/d48/l4f 0 2024-03-17T23:58:20.799 INFO:tasks.workunit.client.0.smithi196.stdout:9/163: rename f4 to d9/df/f34 0 2024-03-17T23:58:20.802 INFO:tasks.workunit.client.0.smithi196.stdout:5/137: dwrite f0 [0,4194304] 0 2024-03-17T23:58:20.803 INFO:tasks.workunit.client.0.smithi196.stdout:9/164: read d9/d1e/f2c [1497504,32791] 0 2024-03-17T23:58:20.803 INFO:tasks.workunit.client.0.smithi196.stdout:1/187: creat d1/db/dd/d43/f50 x:0 0 0 2024-03-17T23:58:20.814 INFO:tasks.workunit.client.0.smithi196.stdout:1/188: unlink d1/f39 0 2024-03-17T23:58:20.815 INFO:tasks.workunit.client.0.smithi196.stdout:9/165: chown d9/df/d14/f30 587 1 2024-03-17T23:58:20.815 INFO:tasks.workunit.client.0.smithi196.stdout:5/138: dwrite f1 [0,4194304] 0 2024-03-17T23:58:20.819 INFO:tasks.workunit.client.0.smithi196.stdout:1/189: mknod d1/d13/d23/c51 0 2024-03-17T23:58:20.819 INFO:tasks.workunit.client.0.smithi196.stdout:7/208: write da/f13 [1432378,82638] 0 2024-03-17T23:58:20.820 INFO:tasks.workunit.client.0.smithi196.stdout:1/190: dread - d1/f4b zero size 2024-03-17T23:58:20.821 INFO:tasks.workunit.client.0.smithi196.stdout:7/209: readlink da/d15/d1d/l2a 0 2024-03-17T23:58:20.821 INFO:tasks.workunit.client.0.smithi196.stdout:5/139: fdatasync d6/f1a 0 2024-03-17T23:58:20.822 INFO:tasks.workunit.client.0.smithi196.stdout:5/140: chown d6/fc 2 1 2024-03-17T23:58:20.830 INFO:tasks.workunit.client.0.smithi196.stdout:9/166: link f5 d9/f35 0 2024-03-17T23:58:20.833 INFO:tasks.workunit.client.0.smithi196.stdout:5/141: creat d6/d17/d1f/f29 x:0 0 0 2024-03-17T23:58:20.834 INFO:tasks.workunit.client.0.smithi196.stdout:9/167: creat d9/df/f36 x:0 0 0 2024-03-17T23:58:20.835 INFO:tasks.workunit.client.0.smithi196.stdout:1/191: write d1/d13/f18 [3074875,110875] 0 2024-03-17T23:58:20.836 INFO:tasks.workunit.client.0.smithi196.stdout:7/210: creat da/f41 x:0 0 0 2024-03-17T23:58:20.837 INFO:tasks.workunit.client.0.smithi196.stdout:9/168: fdatasync d9/fd 0 2024-03-17T23:58:20.839 INFO:tasks.workunit.client.0.smithi196.stdout:7/211: chown da/d15/d1d/d29/l38 714384 1 2024-03-17T23:58:20.840 INFO:tasks.workunit.client.0.smithi196.stdout:1/192: fdatasync d1/d13/f18 0 2024-03-17T23:58:20.844 INFO:tasks.workunit.client.0.smithi196.stdout:7/212: symlink da/l42 0 2024-03-17T23:58:20.845 INFO:tasks.workunit.client.0.smithi196.stdout:5/142: dwrite d6/d17/f1c [0,4194304] 0 2024-03-17T23:58:20.846 INFO:tasks.workunit.client.0.smithi196.stdout:9/169: link d9/d1e/l2b d9/l37 0 2024-03-17T23:58:20.847 INFO:tasks.workunit.client.0.smithi196.stdout:9/170: chown d9/f25 14434 1 2024-03-17T23:58:20.848 INFO:tasks.workunit.client.0.smithi196.stdout:7/213: mkdir da/d3c/d43 0 2024-03-17T23:58:20.853 INFO:tasks.workunit.client.0.smithi196.stdout:5/143: dread f4 [0,4194304] 0 2024-03-17T23:58:20.853 INFO:tasks.workunit.client.0.smithi196.stdout:1/193: dread d1/db/f1f [0,4194304] 0 2024-03-17T23:58:20.854 INFO:tasks.workunit.client.0.smithi196.stdout:9/171: dread d9/d12/f16 [0,4194304] 0 2024-03-17T23:58:20.855 INFO:tasks.workunit.client.0.smithi196.stdout:1/194: fsync d1/d13/f24 0 2024-03-17T23:58:20.856 INFO:tasks.workunit.client.0.smithi196.stdout:7/214: link da/d15/f25 da/d15/d1a/f44 0 2024-03-17T23:58:20.863 INFO:tasks.workunit.client.0.smithi196.stdout:7/215: unlink da/f41 0 2024-03-17T23:58:20.863 INFO:tasks.workunit.client.0.smithi196.stdout:7/216: readlink da/d15/l28 0 2024-03-17T23:58:20.864 INFO:tasks.workunit.client.0.smithi196.stdout:1/195: unlink d1/l1c 0 2024-03-17T23:58:20.865 INFO:tasks.workunit.client.0.smithi196.stdout:9/172: write d9/f35 [1866312,27252] 0 2024-03-17T23:58:20.865 INFO:tasks.workunit.client.0.smithi196.stdout:7/217: mkdir da/d3e/d45 0 2024-03-17T23:58:20.868 INFO:tasks.workunit.client.0.smithi196.stdout:5/144: dwrite f0 [0,4194304] 0 2024-03-17T23:58:20.868 INFO:tasks.workunit.client.0.smithi196.stdout:7/218: truncate f8 90649 0 2024-03-17T23:58:20.871 INFO:tasks.workunit.client.0.smithi196.stdout:9/173: mkdir d9/d38 0 2024-03-17T23:58:20.872 INFO:tasks.workunit.client.0.smithi196.stdout:1/196: truncate d1/d13/f18 2932427 0 2024-03-17T23:58:20.873 INFO:tasks.workunit.client.0.smithi196.stdout:1/197: stat d1/db/f14 0 2024-03-17T23:58:20.873 INFO:tasks.workunit.client.0.smithi196.stdout:1/198: dread - d1/d13/d23/f37 zero size 2024-03-17T23:58:20.875 INFO:tasks.workunit.client.0.smithi196.stdout:9/174: truncate d9/df/d14/f30 551748 0 2024-03-17T23:58:20.876 INFO:tasks.workunit.client.0.smithi196.stdout:7/219: write da/f13 [250458,62585] 0 2024-03-17T23:58:20.879 INFO:tasks.workunit.client.0.smithi196.stdout:9/175: dread f6 [0,4194304] 0 2024-03-17T23:58:20.880 INFO:tasks.workunit.client.0.smithi196.stdout:7/220: mknod da/d3e/c46 0 2024-03-17T23:58:20.888 INFO:tasks.workunit.client.0.smithi196.stdout:2/234: sync 2024-03-17T23:58:20.889 INFO:tasks.workunit.client.0.smithi196.stdout:7/221: write da/d15/d1d/f3f [1041645,87198] 0 2024-03-17T23:58:20.890 INFO:tasks.workunit.client.0.smithi196.stdout:1/199: link d1/d13/d23/f36 d1/d13/d23/d47/f52 0 2024-03-17T23:58:20.891 INFO:tasks.workunit.client.0.smithi196.stdout:9/176: rename d9/df/d14/d27/c2a to d9/d33/c39 0 2024-03-17T23:58:20.893 INFO:tasks.workunit.client.0.smithi196.stdout:2/235: mknod d17/d28/d30/d3b/c5b 0 2024-03-17T23:58:20.893 INFO:tasks.workunit.client.0.smithi196.stdout:1/200: symlink d1/db/l53 0 2024-03-17T23:58:20.894 INFO:tasks.workunit.client.0.smithi196.stdout:5/145: dwrite d6/f1a [0,4194304] 0 2024-03-17T23:58:20.895 INFO:tasks.workunit.client.0.smithi196.stdout:1/201: readlink d1/d13/d2a/l30 0 2024-03-17T23:58:20.899 INFO:tasks.workunit.client.0.smithi196.stdout:9/177: creat d9/df/d14/d27/f3a x:0 0 0 2024-03-17T23:58:20.902 INFO:tasks.workunit.client.0.smithi196.stdout:1/202: rename d1/d13/d23/f27 to d1/d13/d23/d47/d48/f54 0 2024-03-17T23:58:20.907 INFO:tasks.workunit.client.0.smithi196.stdout:5/146: mkdir d6/d2a 0 2024-03-17T23:58:20.909 INFO:tasks.workunit.client.0.smithi196.stdout:9/178: write d9/d12/f16 [4889106,31707] 0 2024-03-17T23:58:20.910 INFO:tasks.workunit.client.0.smithi196.stdout:9/179: stat d9/d1e 0 2024-03-17T23:58:20.911 INFO:tasks.workunit.client.0.smithi196.stdout:9/180: write d9/d1e/f28 [852005,30506] 0 2024-03-17T23:58:20.915 INFO:tasks.workunit.client.0.smithi196.stdout:1/203: write d1/db/dd/d43/f4a [1690704,66093] 0 2024-03-17T23:58:20.917 INFO:tasks.workunit.client.0.smithi196.stdout:9/181: chown d9/df/d14/f30 28 1 2024-03-17T23:58:20.924 INFO:tasks.workunit.client.0.smithi196.stdout:9/182: dread f6 [0,4194304] 0 2024-03-17T23:58:20.925 INFO:tasks.workunit.client.0.smithi196.stdout:1/204: creat d1/db/dd/d34/f55 x:0 0 0 2024-03-17T23:58:20.926 INFO:tasks.workunit.client.0.smithi196.stdout:7/222: dwrite da/f1c [0,4194304] 0 2024-03-17T23:58:20.928 INFO:tasks.workunit.client.0.smithi196.stdout:2/236: dwrite d17/d1f/f20 [0,4194304] 0 2024-03-17T23:58:20.928 INFO:tasks.workunit.client.0.smithi196.stdout:9/183: fsync d9/df/d14/f2e 0 2024-03-17T23:58:20.929 INFO:tasks.workunit.client.0.smithi196.stdout:5/147: dwrite d6/fc [0,4194304] 0 2024-03-17T23:58:20.933 INFO:tasks.workunit.client.0.smithi196.stdout:7/223: fsync da/f16 0 2024-03-17T23:58:20.934 INFO:tasks.workunit.client.0.smithi196.stdout:5/148: unlink d6/d17/f1c 0 2024-03-17T23:58:20.935 INFO:tasks.workunit.client.0.smithi196.stdout:7/224: write da/f13 [1180123,125738] 0 2024-03-17T23:58:20.937 INFO:tasks.workunit.client.0.smithi196.stdout:5/149: write f1 [2391958,30901] 0 2024-03-17T23:58:20.939 INFO:tasks.workunit.client.0.smithi196.stdout:9/184: link d9/f25 d9/df/f3b 0 2024-03-17T23:58:20.943 INFO:tasks.workunit.client.0.smithi196.stdout:9/185: creat d9/d12/f3c x:0 0 0 2024-03-17T23:58:20.945 INFO:tasks.workunit.client.0.smithi196.stdout:9/186: chown d9/l37 0 1 2024-03-17T23:58:20.945 INFO:tasks.workunit.client.0.smithi196.stdout:7/225: link da/d15/d1d/l2a da/d15/d1d/l47 0 2024-03-17T23:58:20.949 INFO:tasks.workunit.client.0.smithi196.stdout:7/226: chown da/d15/d1d/d29/l38 222619676 1 2024-03-17T23:58:20.950 INFO:tasks.workunit.client.0.smithi196.stdout:5/150: fsync d6/fd 0 2024-03-17T23:58:20.951 INFO:tasks.workunit.client.0.smithi196.stdout:5/151: readlink d6/d15/d16/l28 0 2024-03-17T23:58:20.954 INFO:tasks.workunit.client.0.smithi196.stdout:2/237: dread f4 [0,4194304] 0 2024-03-17T23:58:20.955 INFO:tasks.workunit.client.0.smithi196.stdout:7/227: mknod da/d3c/d43/c48 0 2024-03-17T23:58:20.956 INFO:tasks.workunit.client.0.smithi196.stdout:7/228: readlink da/d3e/l40 0 2024-03-17T23:58:20.956 INFO:tasks.workunit.client.0.smithi196.stdout:7/229: chown da/d15/d1d/d2e 51450 1 2024-03-17T23:58:20.957 INFO:tasks.workunit.client.0.smithi196.stdout:5/152: link f2 d6/d17/f2b 0 2024-03-17T23:58:20.963 INFO:tasks.workunit.client.0.smithi196.stdout:9/187: truncate d9/d1e/f28 5808761 0 2024-03-17T23:58:20.964 INFO:tasks.workunit.client.0.smithi196.stdout:5/153: symlink d6/d17/d23/l2c 0 2024-03-17T23:58:20.965 INFO:tasks.workunit.client.0.smithi196.stdout:5/154: chown d6/d17/c22 33088260 1 2024-03-17T23:58:20.965 INFO:tasks.workunit.client.0.smithi196.stdout:2/238: creat d17/d22/f5c x:0 0 0 2024-03-17T23:58:20.967 INFO:tasks.workunit.client.0.smithi196.stdout:9/188: mkdir d9/df/d14/d3d 0 2024-03-17T23:58:20.968 INFO:tasks.workunit.client.0.smithi196.stdout:2/239: dread d17/d22/f40 [0,4194304] 0 2024-03-17T23:58:20.969 INFO:tasks.workunit.client.0.smithi196.stdout:5/155: mkdir d6/d2d 0 2024-03-17T23:58:20.970 INFO:tasks.workunit.client.0.smithi196.stdout:2/240: readlink d17/d1f/l4f 0 2024-03-17T23:58:20.973 INFO:tasks.workunit.client.0.smithi196.stdout:9/189: link f5 d9/df/d14/d3d/f3e 0 2024-03-17T23:58:20.975 INFO:tasks.workunit.client.0.smithi196.stdout:7/230: dwrite da/d15/d1a/f44 [0,4194304] 0 2024-03-17T23:58:20.975 INFO:tasks.workunit.client.0.smithi196.stdout:2/241: creat d17/d1f/f5d x:0 0 0 2024-03-17T23:58:20.975 INFO:tasks.workunit.client.0.smithi196.stdout:5/156: mknod d6/d2d/c2e 0 2024-03-17T23:58:20.982 INFO:tasks.workunit.client.0.smithi196.stdout:9/190: truncate d9/df/d14/d27/f3a 758297 0 2024-03-17T23:58:20.982 INFO:tasks.workunit.client.0.smithi196.stdout:7/231: rename da/d15/d1d/d29/l33 to da/d3c/d43/l49 0 2024-03-17T23:58:20.984 INFO:tasks.workunit.client.0.smithi196.stdout:7/232: dread - da/d15/d1d/f2c zero size 2024-03-17T23:58:20.986 INFO:tasks.workunit.client.0.smithi196.stdout:5/157: rmdir d6 39 2024-03-17T23:58:20.987 INFO:tasks.workunit.client.0.smithi196.stdout:2/242: mknod d17/d22/d3d/c5e 0 2024-03-17T23:58:20.989 INFO:tasks.workunit.client.0.smithi196.stdout:7/233: creat da/d15/d1d/d2e/f4a x:0 0 0 2024-03-17T23:58:20.990 INFO:tasks.workunit.client.0.smithi196.stdout:7/234: chown da/d3e/l40 126894 1 2024-03-17T23:58:20.991 INFO:tasks.workunit.client.0.smithi196.stdout:9/191: creat d9/d38/f3f x:0 0 0 2024-03-17T23:58:20.991 INFO:tasks.workunit.client.0.smithi196.stdout:9/192: readlink d9/l23 0 2024-03-17T23:58:20.993 INFO:tasks.workunit.client.0.smithi196.stdout:2/243: dread d17/f2a [0,4194304] 0 2024-03-17T23:58:20.994 INFO:tasks.workunit.client.0.smithi196.stdout:7/235: rename da/d15/d1d/l3a to da/d3c/d43/l4b 0 2024-03-17T23:58:20.996 INFO:tasks.workunit.client.0.smithi196.stdout:7/236: rmdir da/d15/d1d/d29 39 2024-03-17T23:58:21.000 INFO:tasks.workunit.client.0.smithi196.stdout:2/244: creat d17/f5f x:0 0 0 2024-03-17T23:58:21.003 INFO:tasks.workunit.client.0.smithi196.stdout:5/158: dwrite d6/f10 [0,4194304] 0 2024-03-17T23:58:21.003 INFO:tasks.workunit.client.0.smithi196.stdout:5/159: dread - d6/d15/f27 zero size 2024-03-17T23:58:21.004 INFO:tasks.workunit.client.0.smithi196.stdout:2/245: read f16 [9923,85795] 0 2024-03-17T23:58:21.005 INFO:tasks.workunit.client.0.smithi196.stdout:7/237: dread f8 [0,4194304] 0 2024-03-17T23:58:21.007 INFO:tasks.workunit.client.0.smithi196.stdout:9/193: dread d9/df/f34 [0,4194304] 0 2024-03-17T23:58:21.012 INFO:tasks.workunit.client.0.smithi196.stdout:2/246: readlink d17/d28/d30/d3b/l58 0 2024-03-17T23:58:21.015 INFO:tasks.workunit.client.0.smithi196.stdout:7/238: mkdir da/d15/d1d/d4c 0 2024-03-17T23:58:21.018 INFO:tasks.workunit.client.0.smithi196.stdout:9/194: truncate f5 1321337 0 2024-03-17T23:58:21.019 INFO:tasks.workunit.client.0.smithi196.stdout:5/160: link d6/c12 d6/d2d/c2f 0 2024-03-17T23:58:21.020 INFO:tasks.workunit.client.0.smithi196.stdout:2/247: rename d17/d19/f25 to d17/d19/f60 0 2024-03-17T23:58:21.022 INFO:tasks.workunit.client.0.smithi196.stdout:5/161: unlink d6/d15/d16/l28 0 2024-03-17T23:58:21.026 INFO:tasks.workunit.client.0.smithi196.stdout:7/239: dwrite da/d15/d1d/f30 [0,4194304] 0 2024-03-17T23:58:21.028 INFO:tasks.workunit.client.0.smithi196.stdout:5/162: rename d6/d17/f2b to d6/d2d/f30 0 2024-03-17T23:58:21.031 INFO:tasks.workunit.client.0.smithi196.stdout:7/240: mkdir da/d4d 0 2024-03-17T23:58:21.033 INFO:tasks.workunit.client.0.smithi196.stdout:7/241: fdatasync da/f39 0 2024-03-17T23:58:21.034 INFO:tasks.workunit.client.0.smithi196.stdout:9/195: dwrite d9/f11 [4194304,4194304] 0 2024-03-17T23:58:21.040 INFO:tasks.workunit.client.0.smithi196.stdout:9/196: symlink d9/d33/l40 0 2024-03-17T23:58:21.042 INFO:tasks.workunit.client.0.smithi196.stdout:2/248: truncate f16 4193507 0 2024-03-17T23:58:21.048 INFO:tasks.workunit.client.0.smithi196.stdout:7/242: dwrite da/d15/d1d/f23 [0,4194304] 0 2024-03-17T23:58:21.049 INFO:tasks.workunit.client.0.smithi196.stdout:5/163: truncate d6/f1a 688914 0 2024-03-17T23:58:21.050 INFO:tasks.workunit.client.0.smithi196.stdout:7/243: write da/d15/f24 [3827392,33568] 0 2024-03-17T23:58:21.051 INFO:tasks.workunit.client.0.smithi196.stdout:7/244: fdatasync da/d15/d1d/f30 0 2024-03-17T23:58:21.053 INFO:tasks.workunit.client.0.smithi196.stdout:2/249: symlink d17/d22/d59/l61 0 2024-03-17T23:58:21.054 INFO:tasks.workunit.client.0.smithi196.stdout:9/197: write d9/d1e/f28 [3166749,113572] 0 2024-03-17T23:58:21.055 INFO:tasks.workunit.client.0.smithi196.stdout:5/164: rmdir d6/d15/d16 39 2024-03-17T23:58:21.055 INFO:tasks.workunit.client.0.smithi196.stdout:9/198: readlink d9/l37 0 2024-03-17T23:58:21.057 INFO:tasks.workunit.client.0.smithi196.stdout:7/245: rename da/d15/f24 to da/d15/d1d/d4c/f4e 0 2024-03-17T23:58:21.118 INFO:tasks.workunit.client.0.smithi196.stdout:2/250: creat d17/d28/d30/f62 x:0 0 0 2024-03-17T23:58:21.126 INFO:tasks.workunit.client.0.smithi196.stdout:7/246: rename da/d3c to da/d3e/d45/d4f 0 2024-03-17T23:58:21.128 INFO:tasks.workunit.client.0.smithi196.stdout:9/199: write d9/df/d14/f30 [1476548,104920] 0 2024-03-17T23:58:21.129 INFO:tasks.workunit.client.0.smithi196.stdout:9/200: stat d9/df/l1b 0 2024-03-17T23:58:21.130 INFO:tasks.workunit.client.0.smithi196.stdout:2/251: unlink d17/f5f 0 2024-03-17T23:58:21.130 INFO:tasks.workunit.client.0.smithi196.stdout:5/165: dwrite d6/d15/d16/f24 [0,4194304] 0 2024-03-17T23:58:21.131 INFO:tasks.workunit.client.0.smithi196.stdout:5/166: chown d6/l19 3232 1 2024-03-17T23:58:21.133 INFO:tasks.workunit.client.0.smithi196.stdout:9/201: symlink d9/d38/l41 0 2024-03-17T23:58:21.133 INFO:tasks.workunit.client.0.smithi196.stdout:7/247: mknod da/d15/d1d/c50 0 2024-03-17T23:58:21.136 INFO:tasks.workunit.client.0.smithi196.stdout:9/202: creat d9/d33/f42 x:0 0 0 2024-03-17T23:58:21.137 INFO:tasks.workunit.client.0.smithi196.stdout:5/167: creat d6/d2a/f31 x:0 0 0 2024-03-17T23:58:21.139 INFO:tasks.workunit.client.0.smithi196.stdout:9/203: symlink d9/d38/l43 0 2024-03-17T23:58:21.144 INFO:tasks.workunit.client.0.smithi196.stdout:9/204: link d9/d12/f16 d9/f44 0 2024-03-17T23:58:21.147 INFO:tasks.workunit.client.0.smithi196.stdout:5/168: dwrite d6/d15/f27 [0,4194304] 0 2024-03-17T23:58:21.148 INFO:tasks.workunit.client.0.smithi196.stdout:9/205: fdatasync d9/df/f34 0 2024-03-17T23:58:21.152 INFO:tasks.workunit.client.0.smithi196.stdout:7/248: dread da/d15/f27 [0,4194304] 0 2024-03-17T23:58:21.154 INFO:tasks.workunit.client.0.smithi196.stdout:7/249: stat da/l26 0 2024-03-17T23:58:21.158 INFO:tasks.workunit.client.0.smithi196.stdout:2/252: truncate d17/d22/d3d/f53 65791 0 2024-03-17T23:58:21.158 INFO:tasks.workunit.client.0.smithi196.stdout:9/206: rmdir d9/df/d14 39 2024-03-17T23:58:21.160 INFO:tasks.workunit.client.0.smithi196.stdout:7/250: write da/d15/d1d/d29/f36 [782683,70100] 0 2024-03-17T23:58:21.166 INFO:tasks.workunit.client.0.smithi196.stdout:9/207: dread d9/f44 [0,4194304] 0 2024-03-17T23:58:21.168 INFO:tasks.workunit.client.0.smithi196.stdout:9/208: rmdir d9/d33 39 2024-03-17T23:58:21.168 INFO:tasks.workunit.client.0.smithi196.stdout:2/253: dwrite d17/d1f/f23 [0,4194304] 0 2024-03-17T23:58:21.171 INFO:tasks.workunit.client.0.smithi196.stdout:9/209: read d9/df/d14/f30 [389889,6805] 0 2024-03-17T23:58:21.172 INFO:tasks.workunit.client.0.smithi196.stdout:2/254: dread - d17/f18 zero size 2024-03-17T23:58:21.172 INFO:tasks.workunit.client.0.smithi196.stdout:5/169: truncate f4 3921505 0 2024-03-17T23:58:21.175 INFO:tasks.workunit.client.0.smithi196.stdout:2/255: creat d17/d1f/f63 x:0 0 0 2024-03-17T23:58:21.177 INFO:tasks.workunit.client.0.smithi196.stdout:5/170: creat d6/d15/d16/f32 x:0 0 0 2024-03-17T23:58:21.178 INFO:tasks.workunit.client.0.smithi196.stdout:5/171: chown d6/d15/d16/f24 77412033 1 2024-03-17T23:58:21.181 INFO:tasks.workunit.client.0.smithi196.stdout:5/172: mkdir d6/d2d/d33 0 2024-03-17T23:58:21.182 INFO:tasks.workunit.client.0.smithi196.stdout:2/256: creat d17/d22/f64 x:0 0 0 2024-03-17T23:58:21.183 INFO:tasks.workunit.client.0.smithi196.stdout:2/257: dread - d17/d19/f35 zero size 2024-03-17T23:58:21.185 INFO:tasks.workunit.client.0.smithi196.stdout:5/173: creat d6/d17/f34 x:0 0 0 2024-03-17T23:58:21.187 INFO:tasks.workunit.client.0.smithi196.stdout:2/258: creat d17/d28/d30/d3b/f65 x:0 0 0 2024-03-17T23:58:21.188 INFO:tasks.workunit.client.0.smithi196.stdout:5/174: mkdir d6/d17/d35 0 2024-03-17T23:58:21.191 INFO:tasks.workunit.client.0.smithi196.stdout:9/210: write d9/df/f3b [2474167,15122] 0 2024-03-17T23:58:21.193 INFO:tasks.workunit.client.0.smithi196.stdout:9/211: chown d9/d12/f3c 700326 1 2024-03-17T23:58:21.194 INFO:tasks.workunit.client.0.smithi196.stdout:2/259: link d17/d28/d30/l45 d17/d22/l66 0 2024-03-17T23:58:21.198 INFO:tasks.workunit.client.0.smithi196.stdout:2/260: write d17/d28/d30/f47 [405366,54898] 0 2024-03-17T23:58:21.199 INFO:tasks.workunit.client.0.smithi196.stdout:5/175: dwrite d6/d17/f34 [0,4194304] 0 2024-03-17T23:58:21.200 INFO:tasks.workunit.client.0.smithi196.stdout:5/176: write d6/fa [862365,14662] 0 2024-03-17T23:58:21.206 INFO:tasks.workunit.client.0.smithi196.stdout:5/177: write d6/f10 [1538187,41048] 0 2024-03-17T23:58:21.211 INFO:tasks.workunit.client.0.smithi196.stdout:9/212: write d9/df/d14/d3d/f3e [74602,60805] 0 2024-03-17T23:58:21.211 INFO:tasks.workunit.client.0.smithi196.stdout:5/178: mknod d6/d17/d23/c36 0 2024-03-17T23:58:21.212 INFO:tasks.workunit.client.0.smithi196.stdout:5/179: chown d6 3726 1 2024-03-17T23:58:21.213 INFO:tasks.workunit.client.0.smithi196.stdout:2/261: dwrite d17/d1f/f4b [0,4194304] 0 2024-03-17T23:58:21.214 INFO:tasks.workunit.client.0.smithi196.stdout:5/180: write d6/f1b [684649,36973] 0 2024-03-17T23:58:21.216 INFO:tasks.workunit.client.0.smithi196.stdout:5/181: write d6/d15/d16/f24 [2039221,87033] 0 2024-03-17T23:58:21.217 INFO:tasks.workunit.client.0.smithi196.stdout:5/182: read d6/f10 [113572,11303] 0 2024-03-17T23:58:21.221 INFO:tasks.workunit.client.0.smithi196.stdout:2/262: rename d17/d19/d44/d52/c56 to d17/d28/d30/c67 0 2024-03-17T23:58:21.223 INFO:tasks.workunit.client.0.smithi196.stdout:5/183: symlink d6/d17/l37 0 2024-03-17T23:58:21.223 INFO:tasks.workunit.client.0.smithi196.stdout:9/213: link d9/d1e/c22 d9/df/c45 0 2024-03-17T23:58:21.224 INFO:tasks.workunit.client.0.smithi196.stdout:2/263: rmdir d17/d28/d30 39 2024-03-17T23:58:21.225 INFO:tasks.workunit.client.0.smithi196.stdout:5/184: mknod d6/d15/d16/c38 0 2024-03-17T23:58:21.226 INFO:tasks.workunit.client.0.smithi196.stdout:9/214: unlink d9/d1e/l2b 0 2024-03-17T23:58:21.229 INFO:tasks.workunit.client.0.smithi196.stdout:2/264: rmdir d17/d28/d30 39 2024-03-17T23:58:21.230 INFO:tasks.workunit.client.0.smithi196.stdout:9/215: fdatasync d9/d12/f16 0 2024-03-17T23:58:21.231 INFO:tasks.workunit.client.0.smithi196.stdout:2/265: mkdir d17/d68 0 2024-03-17T23:58:21.235 INFO:tasks.workunit.client.0.smithi196.stdout:9/216: rename d9/d12/c2f to d9/df/d14/d3d/c46 0 2024-03-17T23:58:21.238 INFO:tasks.workunit.client.0.smithi196.stdout:2/266: write d17/f38 [2724172,83669] 0 2024-03-17T23:58:21.239 INFO:tasks.workunit.client.0.smithi196.stdout:5/185: dwrite d6/d17/f34 [0,4194304] 0 2024-03-17T23:58:21.242 INFO:tasks.workunit.client.0.smithi196.stdout:2/267: creat d17/d19/f69 x:0 0 0 2024-03-17T23:58:21.245 INFO:tasks.workunit.client.0.smithi196.stdout:5/186: mkdir d6/d2d/d39 0 2024-03-17T23:58:21.248 INFO:tasks.workunit.client.0.smithi196.stdout:9/217: dwrite d9/d12/f3c [0,4194304] 0 2024-03-17T23:58:21.252 INFO:tasks.workunit.client.0.smithi196.stdout:5/187: creat d6/d2d/f3a x:0 0 0 2024-03-17T23:58:21.253 INFO:tasks.workunit.client.0.smithi196.stdout:5/188: chown d6/l19 71948214 1 2024-03-17T23:58:21.254 INFO:tasks.workunit.client.0.smithi196.stdout:5/189: chown d6/c12 11 1 2024-03-17T23:58:21.260 INFO:tasks.workunit.client.0.smithi196.stdout:5/190: truncate f2 815782 0 2024-03-17T23:58:21.262 INFO:tasks.workunit.client.0.smithi196.stdout:2/268: write d17/d22/d3d/f48 [574450,122421] 0 2024-03-17T23:58:21.264 INFO:tasks.workunit.client.0.smithi196.stdout:5/191: mkdir d6/d2d/d33/d3b 0 2024-03-17T23:58:21.264 INFO:tasks.workunit.client.0.smithi196.stdout:9/218: read d9/df/f1d [638236,88210] 0 2024-03-17T23:58:21.265 INFO:tasks.workunit.client.0.smithi196.stdout:2/269: symlink d17/d22/d3d/l6a 0 2024-03-17T23:58:21.268 INFO:tasks.workunit.client.0.smithi196.stdout:9/219: rmdir d9/d1e 39 2024-03-17T23:58:21.270 INFO:tasks.workunit.client.0.smithi196.stdout:2/270: rename d17/d1f/f4b to d17/d28/d30/f6b 0 2024-03-17T23:58:21.270 INFO:tasks.workunit.client.0.smithi196.stdout:5/192: dread f4 [0,4194304] 0 2024-03-17T23:58:21.271 INFO:tasks.workunit.client.0.smithi196.stdout:2/271: readlink d17/d28/d30/d3b/l49 0 2024-03-17T23:58:21.276 INFO:tasks.workunit.client.0.smithi196.stdout:2/272: rename d17/d1f/f2e to d17/d22/f6c 0 2024-03-17T23:58:21.276 INFO:tasks.workunit.client.0.smithi196.stdout:2/273: chown f4 78 1 2024-03-17T23:58:21.279 INFO:tasks.workunit.client.0.smithi196.stdout:9/220: getdents d9/df/d14/d27 0 2024-03-17T23:58:21.284 INFO:tasks.workunit.client.0.smithi196.stdout:9/221: stat d9/d12 0 2024-03-17T23:58:21.285 INFO:tasks.workunit.client.0.smithi196.stdout:5/193: write f3 [2315822,93696] 0 2024-03-17T23:58:21.288 INFO:tasks.workunit.client.0.smithi196.stdout:9/222: creat d9/d12/f47 x:0 0 0 2024-03-17T23:58:21.288 INFO:tasks.workunit.client.0.smithi196.stdout:2/274: dwrite d17/d19/f1d [0,4194304] 0 2024-03-17T23:58:21.290 INFO:tasks.workunit.client.0.smithi196.stdout:2/275: write d17/d22/f5c [227197,87661] 0 2024-03-17T23:58:21.291 INFO:tasks.workunit.client.0.smithi196.stdout:2/276: chown d17/d22/c2b 1196 1 2024-03-17T23:58:21.292 INFO:tasks.workunit.client.0.smithi196.stdout:2/277: readlink d17/d28/d30/d3b/l49 0 2024-03-17T23:58:21.293 INFO:tasks.workunit.client.0.smithi196.stdout:2/278: stat d17/f18 0 2024-03-17T23:58:21.293 INFO:tasks.workunit.client.0.smithi196.stdout:5/194: unlink d6/d15/d16/c38 0 2024-03-17T23:58:21.297 INFO:tasks.workunit.client.0.smithi196.stdout:5/195: link f4 d6/d17/d1f/f3c 0 2024-03-17T23:58:21.297 INFO:tasks.workunit.client.0.smithi196.stdout:9/223: truncate d9/d1e/f2c 4307305 0 2024-03-17T23:58:21.298 INFO:tasks.workunit.client.0.smithi196.stdout:9/224: stat d9/df/d14/f30 0 2024-03-17T23:58:21.299 INFO:tasks.workunit.client.0.smithi196.stdout:9/225: write d9/df/f3b [7208742,130894] 0 2024-03-17T23:58:21.302 INFO:tasks.workunit.client.0.smithi196.stdout:5/196: mknod d6/d2d/d33/d3b/c3d 0 2024-03-17T23:58:21.303 INFO:tasks.workunit.client.0.smithi196.stdout:9/226: unlink d9/df/f3b 0 2024-03-17T23:58:21.304 INFO:tasks.workunit.client.0.smithi196.stdout:5/197: write d6/fa [1991423,129130] 0 2024-03-17T23:58:21.307 INFO:tasks.workunit.client.0.smithi196.stdout:2/279: dwrite d17/d28/d30/d3b/f65 [0,4194304] 0 2024-03-17T23:58:21.308 INFO:tasks.workunit.client.0.smithi196.stdout:2/280: stat d17/d28/c51 0 2024-03-17T23:58:21.311 INFO:tasks.workunit.client.0.smithi196.stdout:5/198: rename d6/d17/c22 to d6/d15/d16/c3e 0 2024-03-17T23:58:21.313 INFO:tasks.workunit.client.0.smithi196.stdout:2/281: creat d17/d22/d3d/f6d x:0 0 0 2024-03-17T23:58:21.317 INFO:tasks.workunit.client.0.smithi196.stdout:5/199: mkdir d6/d17/d3f 0 2024-03-17T23:58:21.320 INFO:tasks.workunit.client.0.smithi196.stdout:5/200: mkdir d6/d17/d3f/d40 0 2024-03-17T23:58:21.320 INFO:tasks.workunit.client.0.smithi196.stdout:4/119: sync 2024-03-17T23:58:21.321 INFO:tasks.workunit.client.0.smithi196.stdout:3/310: sync 2024-03-17T23:58:21.321 INFO:tasks.workunit.client.0.smithi196.stdout:8/112: sync 2024-03-17T23:58:21.321 INFO:tasks.workunit.client.0.smithi196.stdout:3/311: readlink d7/d19/l27 0 2024-03-17T23:58:21.322 INFO:tasks.workunit.client.0.smithi196.stdout:4/120: write d1/d11/f12 [1436449,131070] 0 2024-03-17T23:58:21.322 INFO:tasks.workunit.client.0.smithi196.stdout:5/201: chown d6/d15/c25 64649193 1 2024-03-17T23:58:21.324 INFO:tasks.workunit.client.0.smithi196.stdout:3/312: chown d7/d19/d26/d2b/f55 520637 1 2024-03-17T23:58:21.325 INFO:tasks.workunit.client.0.smithi196.stdout:2/282: write d17/d22/d3d/f53 [168296,83852] 0 2024-03-17T23:58:21.326 INFO:tasks.workunit.client.0.smithi196.stdout:4/121: symlink d1/d1b/l24 0 2024-03-17T23:58:21.326 INFO:tasks.workunit.client.0.smithi196.stdout:3/313: read d7/d19/d26/d2b/f42 [299047,99517] 0 2024-03-17T23:58:21.327 INFO:tasks.workunit.client.0.smithi196.stdout:4/122: fsync d1/d11/f1c 0 2024-03-17T23:58:21.328 INFO:tasks.workunit.client.0.smithi196.stdout:4/123: readlink d1/l23 0 2024-03-17T23:58:21.329 INFO:tasks.workunit.client.0.smithi196.stdout:4/124: fsync d1/f1d 0 2024-03-17T23:58:21.329 INFO:tasks.workunit.client.0.smithi196.stdout:5/202: creat d6/d17/d35/f41 x:0 0 0 2024-03-17T23:58:21.330 INFO:tasks.workunit.client.0.smithi196.stdout:8/113: dread de/f13 [0,4194304] 0 2024-03-17T23:58:21.330 INFO:tasks.workunit.client.0.smithi196.stdout:4/125: fsync d1/d11/f19 0 2024-03-17T23:58:21.331 INFO:tasks.workunit.client.0.smithi196.stdout:2/283: unlink d17/d22/d3d/f6d 0 2024-03-17T23:58:21.332 INFO:tasks.workunit.client.0.smithi196.stdout:4/126: write d1/d11/f19 [737500,49025] 0 2024-03-17T23:58:21.335 INFO:tasks.workunit.client.0.smithi196.stdout:5/203: fdatasync f4 0 2024-03-17T23:58:21.337 INFO:tasks.workunit.client.0.smithi196.stdout:5/204: chown d6/d15/d16/c1d 745168 1 2024-03-17T23:58:21.339 INFO:tasks.workunit.client.0.smithi196.stdout:8/114: write de/d10/f14 [507351,15184] 0 2024-03-17T23:58:21.339 INFO:tasks.workunit.client.0.smithi196.stdout:4/127: symlink d1/d11/l25 0 2024-03-17T23:58:21.344 INFO:tasks.workunit.client.0.smithi196.stdout:3/314: dwrite d7/fc [0,4194304] 0 2024-03-17T23:58:21.345 INFO:tasks.workunit.client.0.smithi196.stdout:3/315: chown d7/fc 6792 1 2024-03-17T23:58:21.346 INFO:tasks.workunit.client.0.smithi196.stdout:8/115: creat de/d10/f1c x:0 0 0 2024-03-17T23:58:21.347 INFO:tasks.workunit.client.0.smithi196.stdout:2/284: creat d17/d22/f6e x:0 0 0 2024-03-17T23:58:21.348 INFO:tasks.workunit.client.0.smithi196.stdout:8/116: write de/ff [594794,77118] 0 2024-03-17T23:58:21.348 INFO:tasks.workunit.client.0.smithi196.stdout:4/128: mkdir d1/d26 0 2024-03-17T23:58:21.350 INFO:tasks.workunit.client.0.smithi196.stdout:5/205: write d6/f1a [367521,61209] 0 2024-03-17T23:58:21.351 INFO:tasks.workunit.client.0.smithi196.stdout:2/285: symlink d17/d19/l6f 0 2024-03-17T23:58:21.352 INFO:tasks.workunit.client.0.smithi196.stdout:5/206: readlink d6/d15/d16/l20 0 2024-03-17T23:58:21.352 INFO:tasks.workunit.client.0.smithi196.stdout:3/316: dread - d7/d19/d26/d2b/f61 zero size 2024-03-17T23:58:21.355 INFO:tasks.workunit.client.0.smithi196.stdout:2/286: write d17/d1f/f20 [805572,34085] 0 2024-03-17T23:58:21.355 INFO:tasks.workunit.client.0.smithi196.stdout:5/207: dread d6/f1a [0,4194304] 0 2024-03-17T23:58:21.356 INFO:tasks.workunit.client.0.smithi196.stdout:8/117: dread f3 [0,4194304] 0 2024-03-17T23:58:21.357 INFO:tasks.workunit.client.0.smithi196.stdout:4/129: link d1/l2 d1/l27 0 2024-03-17T23:58:21.359 INFO:tasks.workunit.client.0.smithi196.stdout:3/317: creat d7/d19/d26/f64 x:0 0 0 2024-03-17T23:58:21.360 INFO:tasks.workunit.client.0.smithi196.stdout:8/118: creat de/f1d x:0 0 0 2024-03-17T23:58:21.361 INFO:tasks.workunit.client.0.smithi196.stdout:2/287: creat d17/f70 x:0 0 0 2024-03-17T23:58:21.363 INFO:tasks.workunit.client.0.smithi196.stdout:2/288: mkdir d17/d28/d30/d71 0 2024-03-17T23:58:21.364 INFO:tasks.workunit.client.0.smithi196.stdout:4/130: dread d1/f8 [0,4194304] 0 2024-03-17T23:58:21.365 INFO:tasks.workunit.client.0.smithi196.stdout:3/318: truncate d7/fb 1321176 0 2024-03-17T23:58:21.366 INFO:tasks.workunit.client.0.smithi196.stdout:2/289: mkdir d17/d28/d30/d72 0 2024-03-17T23:58:21.367 INFO:tasks.workunit.client.0.smithi196.stdout:2/290: readlink d17/d22/d59/l61 0 2024-03-17T23:58:21.369 INFO:tasks.workunit.client.0.smithi196.stdout:3/319: creat d7/d19/d26/d2b/d3c/d3d/f65 x:0 0 0 2024-03-17T23:58:21.370 INFO:tasks.workunit.client.0.smithi196.stdout:2/291: symlink d17/d22/d3f/l73 0 2024-03-17T23:58:21.373 INFO:tasks.workunit.client.0.smithi196.stdout:5/208: truncate d6/fe 391041 0 2024-03-17T23:58:21.374 INFO:tasks.workunit.client.0.smithi196.stdout:3/320: mknod d7/d19/d26/d48/d4d/c66 0 2024-03-17T23:58:21.375 INFO:tasks.workunit.client.0.smithi196.stdout:8/119: stat de/f15 0 2024-03-17T23:58:21.377 INFO:tasks.workunit.client.0.smithi196.stdout:3/321: dread d7/d19/f32 [0,4194304] 0 2024-03-17T23:58:21.377 INFO:tasks.workunit.client.0.smithi196.stdout:2/292: rename d17/d1f/l2d to d17/d22/d3d/l74 0 2024-03-17T23:58:21.379 INFO:tasks.workunit.client.0.smithi196.stdout:8/120: write de/d10/f1c [209638,30764] 0 2024-03-17T23:58:21.380 INFO:tasks.workunit.client.0.smithi196.stdout:8/121: truncate de/f1d 1046351 0 2024-03-17T23:58:21.382 INFO:tasks.workunit.client.0.smithi196.stdout:8/122: write de/d10/f1a [287924,96064] 0 2024-03-17T23:58:21.384 INFO:tasks.workunit.client.0.smithi196.stdout:8/123: readlink de/d10/l16 0 2024-03-17T23:58:21.389 INFO:tasks.workunit.client.0.smithi196.stdout:4/131: dread d1/de/f21 [0,4194304] 0 2024-03-17T23:58:21.394 INFO:tasks.workunit.client.0.smithi196.stdout:5/209: write d6/d2d/f30 [1554480,11098] 0 2024-03-17T23:58:21.397 INFO:tasks.workunit.client.0.smithi196.stdout:2/293: dwrite d17/f2a [0,4194304] 0 2024-03-17T23:58:21.398 INFO:tasks.workunit.client.0.smithi196.stdout:3/322: getdents d7/d19/d26 0 2024-03-17T23:58:21.400 INFO:tasks.workunit.client.0.smithi196.stdout:5/210: mknod d6/d17/c42 0 2024-03-17T23:58:21.404 INFO:tasks.workunit.client.0.smithi196.stdout:5/211: symlink d6/d17/l43 0 2024-03-17T23:58:21.404 INFO:tasks.workunit.client.0.smithi196.stdout:4/132: dwrite d1/f1d [0,4194304] 0 2024-03-17T23:58:21.404 INFO:tasks.workunit.client.0.smithi196.stdout:2/294: fdatasync f16 0 2024-03-17T23:58:21.414 INFO:tasks.workunit.client.0.smithi196.stdout:5/212: mknod d6/d2d/d39/c44 0 2024-03-17T23:58:21.414 INFO:tasks.workunit.client.0.smithi196.stdout:4/133: creat d1/d26/f28 x:0 0 0 2024-03-17T23:58:21.415 INFO:tasks.workunit.client.0.smithi196.stdout:2/295: getdents d17/d19/d44 0 2024-03-17T23:58:21.417 INFO:tasks.workunit.client.0.smithi196.stdout:4/134: symlink d1/d26/l29 0 2024-03-17T23:58:21.418 INFO:tasks.workunit.client.0.smithi196.stdout:5/213: mknod d6/d15/c45 0 2024-03-17T23:58:21.418 INFO:tasks.workunit.client.0.smithi196.stdout:4/135: chown d1/d1b 440606698 1 2024-03-17T23:58:21.418 INFO:tasks.workunit.client.0.smithi196.stdout:2/296: read d17/d28/d30/f47 [589914,89122] 0 2024-03-17T23:58:21.420 INFO:tasks.workunit.client.0.smithi196.stdout:4/136: rmdir d1/d11 39 2024-03-17T23:58:21.423 INFO:tasks.workunit.client.0.smithi196.stdout:3/323: dwrite d7/d19/f23 [0,4194304] 0 2024-03-17T23:58:21.423 INFO:tasks.workunit.client.0.smithi196.stdout:5/214: symlink d6/d17/d35/l46 0 2024-03-17T23:58:21.426 INFO:tasks.workunit.client.0.smithi196.stdout:4/137: write d1/d11/f18 [319272,95052] 0 2024-03-17T23:58:21.430 INFO:tasks.workunit.client.0.smithi196.stdout:3/324: creat d7/d19/d26/d2b/f67 x:0 0 0 2024-03-17T23:58:21.435 INFO:tasks.workunit.client.0.smithi196.stdout:3/325: mknod d7/d19/d26/d2b/d3c/d3d/c68 0 2024-03-17T23:58:21.435 INFO:tasks.workunit.client.0.smithi196.stdout:2/297: link d17/d19/c3e d17/d68/c75 0 2024-03-17T23:58:21.436 INFO:tasks.workunit.client.0.smithi196.stdout:4/138: dwrite d1/f1d [0,4194304] 0 2024-03-17T23:58:21.437 INFO:tasks.workunit.client.0.smithi196.stdout:3/326: write d7/fd [4354997,10896] 0 2024-03-17T23:58:21.439 INFO:tasks.workunit.client.0.smithi196.stdout:4/139: creat d1/d26/f2a x:0 0 0 2024-03-17T23:58:21.439 INFO:tasks.workunit.client.0.smithi196.stdout:2/298: mknod d17/d28/c76 0 2024-03-17T23:58:21.441 INFO:tasks.workunit.client.0.smithi196.stdout:4/140: creat d1/d26/f2b x:0 0 0 2024-03-17T23:58:21.445 INFO:tasks.workunit.client.0.smithi196.stdout:4/141: creat d1/f2c x:0 0 0 2024-03-17T23:58:21.449 INFO:tasks.workunit.client.0.smithi196.stdout:2/299: dwrite d17/d19/f4e [0,4194304] 0 2024-03-17T23:58:21.450 INFO:tasks.workunit.client.0.smithi196.stdout:4/142: rename d1/d26/f28 to d1/de/f2d 0 2024-03-17T23:58:21.451 INFO:tasks.workunit.client.0.smithi196.stdout:2/300: chown d17/d22/c2b 1847 1 2024-03-17T23:58:21.453 INFO:tasks.workunit.client.0.smithi196.stdout:2/301: symlink d17/d19/l77 0 2024-03-17T23:58:21.453 INFO:tasks.workunit.client.0.smithi196.stdout:4/143: read d1/fd [1958726,1276] 0 2024-03-17T23:58:21.455 INFO:tasks.workunit.client.0.smithi196.stdout:4/144: mknod d1/d26/c2e 0 2024-03-17T23:58:21.459 INFO:tasks.workunit.client.0.smithi196.stdout:4/145: rmdir d1/d11 39 2024-03-17T23:58:21.459 INFO:tasks.workunit.client.0.smithi196.stdout:4/146: dread - d1/f2c zero size 2024-03-17T23:58:21.461 INFO:tasks.workunit.client.0.smithi196.stdout:4/147: creat d1/d26/f2f x:0 0 0 2024-03-17T23:58:21.463 INFO:tasks.workunit.client.0.smithi196.stdout:4/148: write d1/de/f21 [3778483,39244] 0 2024-03-17T23:58:21.464 INFO:tasks.workunit.client.0.smithi196.stdout:4/149: write d1/d26/f2b [1036983,121755] 0 2024-03-17T23:58:21.468 INFO:tasks.workunit.client.0.smithi196.stdout:4/150: dread d1/f8 [0,4194304] 0 2024-03-17T23:58:21.475 INFO:tasks.workunit.client.0.smithi196.stdout:4/151: dwrite d1/f1d [0,4194304] 0 2024-03-17T23:58:21.477 INFO:tasks.workunit.client.0.smithi196.stdout:4/152: chown d1/d26 354 1 2024-03-17T23:58:21.481 INFO:tasks.workunit.client.0.smithi196.stdout:5/215: truncate f1 2489962 0 2024-03-17T23:58:21.489 INFO:tasks.workunit.client.0.smithi196.stdout:4/153: link d1/de/l14 d1/d26/l30 0 2024-03-17T23:58:21.491 INFO:tasks.workunit.client.0.smithi196.stdout:2/302: truncate d17/d28/f46 109639 0 2024-03-17T23:58:21.491 INFO:tasks.workunit.client.0.smithi196.stdout:5/216: getdents d6/d17/d1f 0 2024-03-17T23:58:21.492 INFO:tasks.workunit.client.0.smithi196.stdout:4/154: link d1/c5 d1/de/c31 0 2024-03-17T23:58:21.493 INFO:tasks.workunit.client.0.smithi196.stdout:5/217: chown d6/d15/d16/l20 51066 1 2024-03-17T23:58:21.493 INFO:tasks.workunit.client.0.smithi196.stdout:4/155: fsync d1/fd 0 2024-03-17T23:58:21.494 INFO:tasks.workunit.client.0.smithi196.stdout:2/303: unlink d17/d22/l66 0 2024-03-17T23:58:21.496 INFO:tasks.workunit.client.0.smithi196.stdout:5/218: creat d6/d2a/f47 x:0 0 0 2024-03-17T23:58:21.497 INFO:tasks.workunit.client.0.smithi196.stdout:4/156: rename d1 to d1/d32 22 2024-03-17T23:58:21.498 INFO:tasks.workunit.client.0.smithi196.stdout:5/219: creat d6/d17/f48 x:0 0 0 2024-03-17T23:58:21.499 INFO:tasks.workunit.client.0.smithi196.stdout:4/157: unlink d1/f8 0 2024-03-17T23:58:21.503 INFO:tasks.workunit.client.0.smithi196.stdout:2/304: dwrite d17/d22/d3d/f48 [0,4194304] 0 2024-03-17T23:58:21.506 INFO:tasks.workunit.client.0.smithi196.stdout:2/305: chown c1 45364911 1 2024-03-17T23:58:21.508 INFO:tasks.workunit.client.0.smithi196.stdout:2/306: chown d17/d28/d30/d3b/l58 583 1 2024-03-17T23:58:21.508 INFO:tasks.workunit.client.0.smithi196.stdout:4/158: dwrite d1/d11/f18 [0,4194304] 0 2024-03-17T23:58:21.509 INFO:tasks.workunit.client.0.smithi196.stdout:4/159: fdatasync d1/f2c 0 2024-03-17T23:58:21.509 INFO:tasks.workunit.client.0.smithi196.stdout:2/307: truncate d17/d22/d3d/f53 1339895 0 2024-03-17T23:58:21.510 INFO:tasks.workunit.client.0.smithi196.stdout:4/160: dread - d1/f2c zero size 2024-03-17T23:58:21.525 INFO:tasks.workunit.client.0.smithi196.stdout:4/161: dwrite d1/d11/f12 [0,4194304] 0 2024-03-17T23:58:21.533 INFO:tasks.workunit.client.0.smithi196.stdout:4/162: write d1/de/f21 [2851968,81556] 0 2024-03-17T23:58:21.533 INFO:tasks.workunit.client.0.smithi196.stdout:2/308: write f16 [4435380,83528] 0 2024-03-17T23:58:21.537 INFO:tasks.workunit.client.0.smithi196.stdout:4/163: mkdir d1/d26/d33 0 2024-03-17T23:58:21.537 INFO:tasks.workunit.client.0.smithi196.stdout:2/309: chown f13 100147913 1 2024-03-17T23:58:21.538 INFO:tasks.workunit.client.0.smithi196.stdout:2/310: dread d17/d22/f40 [0,4194304] 0 2024-03-17T23:58:21.538 INFO:tasks.workunit.client.0.smithi196.stdout:4/164: mknod d1/d26/d33/c34 0 2024-03-17T23:58:21.538 INFO:tasks.workunit.client.0.smithi196.stdout:4/165: mknod d1/d1b/c35 0 2024-03-17T23:58:21.539 INFO:tasks.workunit.client.0.smithi196.stdout:2/311: creat d17/d22/d59/f78 x:0 0 0 2024-03-17T23:58:21.541 INFO:tasks.workunit.client.0.smithi196.stdout:4/166: creat d1/f36 x:0 0 0 2024-03-17T23:58:21.542 INFO:tasks.workunit.client.0.smithi196.stdout:2/312: symlink d17/d22/d3f/l79 0 2024-03-17T23:58:21.546 INFO:tasks.workunit.client.0.smithi196.stdout:2/313: link d17/d28/d30/d3b/l58 d17/d22/l7a 0 2024-03-17T23:58:21.546 INFO:tasks.workunit.client.0.smithi196.stdout:4/167: dread d1/d26/f2b [0,4194304] 0 2024-03-17T23:58:21.548 INFO:tasks.workunit.client.0.smithi196.stdout:2/314: rename d17/d1f/f43 to d17/d22/d3f/f7b 0 2024-03-17T23:58:21.550 INFO:tasks.workunit.client.0.smithi196.stdout:2/315: creat d17/d19/f7c x:0 0 0 2024-03-17T23:58:21.552 INFO:tasks.workunit.client.0.smithi196.stdout:2/316: symlink d17/d22/d3f/l7d 0 2024-03-17T23:58:21.553 INFO:tasks.workunit.client.0.smithi196.stdout:2/317: write d17/d28/d30/f62 [249979,91757] 0 2024-03-17T23:58:21.581 INFO:tasks.workunit.client.0.smithi196.stdout:2/318: symlink d17/d28/l7e 0 2024-03-17T23:58:21.583 INFO:tasks.workunit.client.0.smithi196.stdout:2/319: mknod d17/d22/c7f 0 2024-03-17T23:58:21.583 INFO:tasks.workunit.client.0.smithi196.stdout:2/320: chown d17/f18 25974 1 2024-03-17T23:58:21.588 INFO:tasks.workunit.client.0.smithi196.stdout:2/321: fsync d17/d22/d59/f78 0 2024-03-17T23:58:21.589 INFO:tasks.workunit.client.0.smithi196.stdout:2/322: write d17/d19/f69 [154469,37275] 0 2024-03-17T23:58:21.592 INFO:tasks.workunit.client.0.smithi196.stdout:2/323: creat d17/d22/d59/f80 x:0 0 0 2024-03-17T23:58:21.593 INFO:tasks.workunit.client.0.smithi196.stdout:2/324: write d17/d22/d3f/f5a [874376,127300] 0 2024-03-17T23:58:21.600 INFO:tasks.workunit.client.0.smithi196.stdout:2/325: dwrite f2 [0,4194304] 0 2024-03-17T23:58:21.603 INFO:tasks.workunit.client.0.smithi196.stdout:2/326: mkdir d17/d28/d30/d72/d81 0 2024-03-17T23:58:21.613 INFO:tasks.workunit.client.0.smithi196.stdout:2/327: dread d17/d22/d3d/f53 [0,4194304] 0 2024-03-17T23:58:21.613 INFO:tasks.workunit.client.0.smithi196.stdout:2/328: fsync d17/d19/f35 0 2024-03-17T23:58:21.622 INFO:tasks.workunit.client.0.smithi196.stdout:2/329: dwrite d17/d22/f40 [0,4194304] 0 2024-03-17T23:58:21.626 INFO:tasks.workunit.client.0.smithi196.stdout:2/330: symlink d17/d1f/l82 0 2024-03-17T23:58:21.630 INFO:tasks.workunit.client.0.smithi196.stdout:2/331: link d17/d22/d3f/f7b d17/f83 0 2024-03-17T23:58:21.632 INFO:tasks.workunit.client.0.smithi196.stdout:2/332: creat d17/d19/d44/d52/f84 x:0 0 0 2024-03-17T23:58:21.635 INFO:tasks.workunit.client.0.smithi196.stdout:2/333: symlink d17/d22/d3d/l85 0 2024-03-17T23:58:21.636 INFO:tasks.workunit.client.0.smithi196.stdout:2/334: fdatasync d17/d22/f6c 0 2024-03-17T23:58:21.637 INFO:tasks.workunit.client.0.smithi196.stdout:2/335: write d17/d28/d30/f62 [1297681,51030] 0 2024-03-17T23:58:21.640 INFO:tasks.workunit.client.0.smithi196.stdout:2/336: unlink d17/d22/f40 0 2024-03-17T23:58:21.641 INFO:tasks.workunit.client.0.smithi196.stdout:2/337: write d17/d22/f5c [871344,122796] 0 2024-03-17T23:58:21.642 INFO:tasks.workunit.client.0.smithi196.stdout:2/338: chown d17/d22/d3f/c50 1 1 2024-03-17T23:58:21.642 INFO:tasks.workunit.client.0.smithi196.stdout:2/339: dread - d17/d22/d59/f80 zero size 2024-03-17T23:58:21.649 INFO:tasks.workunit.client.0.smithi196.stdout:2/340: dwrite d17/d19/f1d [0,4194304] 0 2024-03-17T23:58:21.650 INFO:tasks.workunit.client.0.smithi196.stdout:2/341: stat d17/d22/f27 0 2024-03-17T23:58:21.658 INFO:tasks.workunit.client.0.smithi196.stdout:2/342: dwrite d17/d28/d30/d3b/f4a [0,4194304] 0 2024-03-17T23:58:21.660 INFO:tasks.workunit.client.0.smithi196.stdout:2/343: fdatasync f4 0 2024-03-17T23:58:21.670 INFO:tasks.workunit.client.0.smithi196.stdout:2/344: dwrite d17/d19/d44/d52/f84 [0,4194304] 0 2024-03-17T23:58:21.676 INFO:tasks.workunit.client.0.smithi196.stdout:2/345: write d17/d28/f46 [717146,121193] 0 2024-03-17T23:58:21.678 INFO:tasks.workunit.client.0.smithi196.stdout:2/346: rmdir d17/d28/d30/d3b 39 2024-03-17T23:58:21.680 INFO:tasks.workunit.client.0.smithi196.stdout:2/347: mknod d17/d19/d44/d52/c86 0 2024-03-17T23:58:21.682 INFO:tasks.workunit.client.0.smithi196.stdout:2/348: mknod d17/d22/c87 0 2024-03-17T23:58:21.688 INFO:tasks.workunit.client.0.smithi196.stdout:2/349: write d17/d28/f29 [3266819,119523] 0 2024-03-17T23:58:21.690 INFO:tasks.workunit.client.0.smithi196.stdout:2/350: read d17/d28/f46 [493263,15219] 0 2024-03-17T23:58:21.693 INFO:tasks.workunit.client.0.smithi196.stdout:2/351: creat d17/d28/d30/d71/f88 x:0 0 0 2024-03-17T23:58:21.695 INFO:tasks.workunit.client.0.smithi196.stdout:2/352: unlink d17/d22/l3a 0 2024-03-17T23:58:21.697 INFO:tasks.workunit.client.0.smithi196.stdout:2/353: rename d17/d22/d3f/l79 to d17/d1f/l89 0 2024-03-17T23:58:21.705 INFO:tasks.workunit.client.0.smithi196.stdout:2/354: dwrite d17/d22/f6c [0,4194304] 0 2024-03-17T23:58:21.718 INFO:tasks.workunit.client.0.smithi196.stdout:2/355: dread d17/d22/f4d [0,4194304] 0 2024-03-17T23:58:21.720 INFO:tasks.workunit.client.0.smithi196.stdout:0/289: sync 2024-03-17T23:58:21.720 INFO:tasks.workunit.client.0.smithi196.stdout:6/158: sync 2024-03-17T23:58:21.720 INFO:tasks.workunit.client.0.smithi196.stdout:1/205: sync 2024-03-17T23:58:21.720 INFO:tasks.workunit.client.0.smithi196.stdout:2/356: write d17/d28/d30/f47 [568562,20687] 0 2024-03-17T23:58:21.721 INFO:tasks.workunit.client.0.smithi196.stdout:6/159: rename d2/d22 to d2/d22/d36 22 2024-03-17T23:58:21.722 INFO:tasks.workunit.client.0.smithi196.stdout:2/357: write f13 [860779,90345] 0 2024-03-17T23:58:21.725 INFO:tasks.workunit.client.0.smithi196.stdout:6/160: write d2/f2a [724133,49822] 0 2024-03-17T23:58:21.726 INFO:tasks.workunit.client.0.smithi196.stdout:2/358: readlink d17/d19/l77 0 2024-03-17T23:58:21.729 INFO:tasks.workunit.client.0.smithi196.stdout:2/359: write d17/d28/f29 [3331882,93136] 0 2024-03-17T23:58:21.732 INFO:tasks.workunit.client.0.smithi196.stdout:6/161: mknod d2/d7/d2b/c37 0 2024-03-17T23:58:21.734 INFO:tasks.workunit.client.0.smithi196.stdout:6/162: write d2/fd [2141654,60334] 0 2024-03-17T23:58:21.735 INFO:tasks.workunit.client.0.smithi196.stdout:1/206: dread d1/db/f14 [0,4194304] 0 2024-03-17T23:58:21.737 INFO:tasks.workunit.client.0.smithi196.stdout:6/163: unlink d2/d14/f29 0 2024-03-17T23:58:21.739 INFO:tasks.workunit.client.0.smithi196.stdout:0/290: dread d5/d23/d24/d28/d4f/f51 [0,4194304] 0 2024-03-17T23:58:21.740 INFO:tasks.workunit.client.0.smithi196.stdout:6/164: creat d2/d14/d27/f38 x:0 0 0 2024-03-17T23:58:21.741 INFO:tasks.workunit.client.0.smithi196.stdout:2/360: link d17/d22/c87 d17/c8a 0 2024-03-17T23:58:21.744 INFO:tasks.workunit.client.0.smithi196.stdout:6/165: rename d2/d7/d2b/l2d to d2/d7/d2b/l39 0 2024-03-17T23:58:21.746 INFO:tasks.workunit.client.0.smithi196.stdout:1/207: getdents d1/d13/d23 0 2024-03-17T23:58:21.747 INFO:tasks.workunit.client.0.smithi196.stdout:6/166: creat d2/d14/d27/f3a x:0 0 0 2024-03-17T23:58:21.748 INFO:tasks.workunit.client.0.smithi196.stdout:6/167: chown d2/d14/d27/f38 1968866 1 2024-03-17T23:58:21.749 INFO:tasks.workunit.client.0.smithi196.stdout:1/208: creat d1/db/dd/f56 x:0 0 0 2024-03-17T23:58:21.750 INFO:tasks.workunit.client.0.smithi196.stdout:6/168: write d2/d14/d27/f38 [180209,43262] 0 2024-03-17T23:58:21.751 INFO:tasks.workunit.client.0.smithi196.stdout:2/361: rename d17/d19/l1e to d17/d22/l8b 0 2024-03-17T23:58:21.754 INFO:tasks.workunit.client.0.smithi196.stdout:1/209: rename d1/f4b to d1/f57 0 2024-03-17T23:58:21.756 INFO:tasks.workunit.client.0.smithi196.stdout:2/362: creat d17/d19/d44/f8c x:0 0 0 2024-03-17T23:58:21.759 INFO:tasks.workunit.client.0.smithi196.stdout:0/291: dread d5/d23/d24/d28/f37 [0,4194304] 0 2024-03-17T23:58:21.759 INFO:tasks.workunit.client.0.smithi196.stdout:1/210: symlink d1/l58 0 2024-03-17T23:58:21.761 INFO:tasks.workunit.client.0.smithi196.stdout:6/169: link d2/d7/l9 d2/d26/l3b 0 2024-03-17T23:58:21.762 INFO:tasks.workunit.client.0.smithi196.stdout:2/363: creat d17/d28/d30/d72/f8d x:0 0 0 2024-03-17T23:58:21.764 INFO:tasks.workunit.client.0.smithi196.stdout:0/292: creat d5/d23/d24/d28/d47/d52/f54 x:0 0 0 2024-03-17T23:58:21.765 INFO:tasks.workunit.client.0.smithi196.stdout:2/364: symlink d17/d28/l8e 0 2024-03-17T23:58:21.766 INFO:tasks.workunit.client.0.smithi196.stdout:0/293: readlink d5/d23/d24/d28/d47/d52/l4c 0 2024-03-17T23:58:21.768 INFO:tasks.workunit.client.0.smithi196.stdout:0/294: write d5/d23/d24/d28/d47/d52/f45 [55082,29836] 0 2024-03-17T23:58:21.768 INFO:tasks.workunit.client.0.smithi196.stdout:2/365: mkdir d17/d22/d3d/d8f 0 2024-03-17T23:58:21.772 INFO:tasks.workunit.client.0.smithi196.stdout:0/295: fdatasync d5/d23/d24/d28/d4f/f51 0 2024-03-17T23:58:21.779 INFO:tasks.workunit.client.0.smithi196.stdout:0/296: creat d5/d23/d24/d28/f55 x:0 0 0 2024-03-17T23:58:21.780 INFO:tasks.workunit.client.0.smithi196.stdout:1/211: truncate d1/f57 187356 0 2024-03-17T23:58:21.781 INFO:tasks.workunit.client.0.smithi196.stdout:1/212: readlink d1/db/lc 0 2024-03-17T23:58:21.782 INFO:tasks.workunit.client.0.smithi196.stdout:0/297: unlink d5/d23/d24/d28/d47/d52/l4c 0 2024-03-17T23:58:21.787 INFO:tasks.workunit.client.0.smithi196.stdout:6/170: truncate f0 828300 0 2024-03-17T23:58:21.788 INFO:tasks.workunit.client.0.smithi196.stdout:6/171: rmdir d2/d14/d27 39 2024-03-17T23:58:21.791 INFO:tasks.workunit.client.0.smithi196.stdout:6/172: rmdir d2/d14 39 2024-03-17T23:58:21.793 INFO:tasks.workunit.client.0.smithi196.stdout:6/173: mknod d2/d22/c3c 0 2024-03-17T23:58:21.797 INFO:tasks.workunit.client.0.smithi196.stdout:1/213: dwrite d1/f9 [4194304,4194304] 0 2024-03-17T23:58:21.801 INFO:tasks.workunit.client.0.smithi196.stdout:1/214: rmdir d1 39 2024-03-17T23:58:21.803 INFO:tasks.workunit.client.0.smithi196.stdout:0/298: dread d5/d23/f4a [4194304,4194304] 0 2024-03-17T23:58:21.811 INFO:tasks.workunit.client.0.smithi196.stdout:6/174: dread d2/d7/f17 [0,4194304] 0 2024-03-17T23:58:21.812 INFO:tasks.workunit.client.0.smithi196.stdout:1/215: symlink d1/d13/l59 0 2024-03-17T23:58:21.813 INFO:tasks.workunit.client.0.smithi196.stdout:1/216: write d1/d13/f41 [162639,36426] 0 2024-03-17T23:58:21.816 INFO:tasks.workunit.client.0.smithi196.stdout:1/217: creat d1/d13/f5a x:0 0 0 2024-03-17T23:58:21.818 INFO:tasks.workunit.client.0.smithi196.stdout:0/299: dwrite d5/d23/f33 [4194304,4194304] 0 2024-03-17T23:58:21.826 INFO:tasks.workunit.client.0.smithi196.stdout:1/218: dwrite d1/d13/d23/f29 [0,4194304] 0 2024-03-17T23:58:21.835 INFO:tasks.workunit.client.0.smithi196.stdout:0/300: dwrite d5/d23/d24/d28/d47/d52/f45 [0,4194304] 0 2024-03-17T23:58:21.839 INFO:tasks.workunit.client.0.smithi196.stdout:1/219: mknod d1/db/dd/d34/c5b 0 2024-03-17T23:58:21.841 INFO:tasks.workunit.client.0.smithi196.stdout:6/175: fsync f0 0 2024-03-17T23:58:21.842 INFO:tasks.workunit.client.0.smithi196.stdout:0/301: mknod d5/d23/c56 0 2024-03-17T23:58:21.843 INFO:tasks.workunit.client.0.smithi196.stdout:0/302: chown d5/d23/d24/d28/l53 12 1 2024-03-17T23:58:21.844 INFO:tasks.workunit.client.0.smithi196.stdout:1/220: creat d1/d13/d23/d47/f5c x:0 0 0 2024-03-17T23:58:21.851 INFO:tasks.workunit.client.0.smithi196.stdout:6/176: dwrite d2/d7/f17 [0,4194304] 0 2024-03-17T23:58:21.851 INFO:tasks.workunit.client.0.smithi196.stdout:0/303: link d5/d23/d24/l38 d5/d23/d24/d28/d47/l57 0 2024-03-17T23:58:21.853 INFO:tasks.workunit.client.0.smithi196.stdout:6/177: write f1 [6367370,91656] 0 2024-03-17T23:58:21.854 INFO:tasks.workunit.client.0.smithi196.stdout:1/221: write d1/db/f14 [1226262,75060] 0 2024-03-17T23:58:21.856 INFO:tasks.workunit.client.0.smithi196.stdout:1/222: rmdir d1/d13/d2a 39 2024-03-17T23:58:21.857 INFO:tasks.workunit.client.0.smithi196.stdout:1/223: readlink d1/db/l19 0 2024-03-17T23:58:21.859 INFO:tasks.workunit.client.0.smithi196.stdout:6/178: getdents d2/d7 0 2024-03-17T23:58:21.860 INFO:tasks.workunit.client.0.smithi196.stdout:6/179: write d2/d22/f19 [2236454,31491] 0 2024-03-17T23:58:21.863 INFO:tasks.workunit.client.0.smithi196.stdout:6/180: creat d2/d7/d2b/f3d x:0 0 0 2024-03-17T23:58:21.864 INFO:tasks.workunit.client.0.smithi196.stdout:6/181: readlink d2/d7/l28 0 2024-03-17T23:58:21.865 INFO:tasks.workunit.client.0.smithi196.stdout:6/182: fdatasync d2/ff 0 2024-03-17T23:58:21.866 INFO:tasks.workunit.client.0.smithi196.stdout:1/224: dread d1/db/dd/d43/f4a [0,4194304] 0 2024-03-17T23:58:21.867 INFO:tasks.workunit.client.0.smithi196.stdout:6/183: write d2/d7/f17 [3576330,22327] 0 2024-03-17T23:58:21.868 INFO:tasks.workunit.client.0.smithi196.stdout:1/225: unlink d1/d13/l40 0 2024-03-17T23:58:21.872 INFO:tasks.workunit.client.0.smithi196.stdout:1/226: creat d1/db/dd/f5d x:0 0 0 2024-03-17T23:58:21.873 INFO:tasks.workunit.client.0.smithi196.stdout:6/184: unlink d2/d26/l3b 0 2024-03-17T23:58:21.875 INFO:tasks.workunit.client.0.smithi196.stdout:6/185: write d2/d7/d2b/f3d [629545,19511] 0 2024-03-17T23:58:21.877 INFO:tasks.workunit.client.0.smithi196.stdout:1/227: rename d1/c6 to d1/d13/d23/c5e 0 2024-03-17T23:58:21.879 INFO:tasks.workunit.client.0.smithi196.stdout:6/186: creat d2/f3e x:0 0 0 2024-03-17T23:58:21.879 INFO:tasks.workunit.client.0.smithi196.stdout:9/227: sync 2024-03-17T23:58:21.880 INFO:tasks.workunit.client.0.smithi196.stdout:7/251: sync 2024-03-17T23:58:21.881 INFO:tasks.workunit.client.0.smithi196.stdout:6/187: readlink d2/d22/l23 0 2024-03-17T23:58:21.882 INFO:tasks.workunit.client.0.smithi196.stdout:0/304: dwrite d5/d23/d24/f2c [0,4194304] 0 2024-03-17T23:58:21.884 INFO:tasks.workunit.client.0.smithi196.stdout:9/228: write d9/f11 [643287,69024] 0 2024-03-17T23:58:21.884 INFO:tasks.workunit.client.0.smithi196.stdout:7/252: creat da/d15/d1d/d4c/f51 x:0 0 0 2024-03-17T23:58:21.885 INFO:tasks.workunit.client.0.smithi196.stdout:9/229: truncate d9/df/d14/f2e 1216683 0 2024-03-17T23:58:21.886 INFO:tasks.workunit.client.0.smithi196.stdout:6/188: rename d2/d7/f17 to d2/d22/f3f 0 2024-03-17T23:58:21.912 INFO:tasks.workunit.client.0.smithi196.stdout:9/230: readlink d9/l23 0 2024-03-17T23:58:21.912 INFO:tasks.workunit.client.0.smithi196.stdout:7/253: mknod da/d4d/c52 0 2024-03-17T23:58:21.914 INFO:tasks.workunit.client.0.smithi196.stdout:6/189: mkdir d2/d40 0 2024-03-17T23:58:21.915 INFO:tasks.workunit.client.0.smithi196.stdout:7/254: creat da/d15/d1d/d29/f53 x:0 0 0 2024-03-17T23:58:21.916 INFO:tasks.workunit.client.0.smithi196.stdout:9/231: fdatasync d9/d1e/f2c 0 2024-03-17T23:58:21.917 INFO:tasks.workunit.client.0.smithi196.stdout:6/190: chown d2/d14/l1a 0 1 2024-03-17T23:58:21.917 INFO:tasks.workunit.client.0.smithi196.stdout:6/191: fdatasync d2/ff 0 2024-03-17T23:58:21.918 INFO:tasks.workunit.client.0.smithi196.stdout:7/255: mkdir da/d15/d1d/d29/d54 0 2024-03-17T23:58:21.921 INFO:tasks.workunit.client.0.smithi196.stdout:9/232: read d9/fd [9229873,89137] 0 2024-03-17T23:58:21.924 INFO:tasks.workunit.client.0.smithi196.stdout:9/233: creat d9/d1e/f48 x:0 0 0 2024-03-17T23:58:21.925 INFO:tasks.workunit.client.0.smithi196.stdout:9/234: fdatasync d9/fd 0 2024-03-17T23:58:21.926 INFO:tasks.workunit.client.0.smithi196.stdout:9/235: chown d9/d12/f17 13474 1 2024-03-17T23:58:21.926 INFO:tasks.workunit.client.0.smithi196.stdout:9/236: fsync d9/d12/f17 0 2024-03-17T23:58:21.927 INFO:tasks.workunit.client.0.smithi196.stdout:6/192: creat d2/f41 x:0 0 0 2024-03-17T23:58:21.930 INFO:tasks.workunit.client.0.smithi196.stdout:7/256: link da/d3e/l40 da/d3e/d45/d4f/l55 0 2024-03-17T23:58:21.935 INFO:tasks.workunit.client.0.smithi196.stdout:7/257: rename da/d15/c1f to da/d3e/d45/c56 0 2024-03-17T23:58:21.937 INFO:tasks.workunit.client.0.smithi196.stdout:9/237: dwrite d9/df/d14/f2e [0,4194304] 0 2024-03-17T23:58:21.937 INFO:tasks.workunit.client.0.smithi196.stdout:6/193: mkdir d2/d14/d42 0 2024-03-17T23:58:21.943 INFO:tasks.workunit.client.0.smithi196.stdout:9/238: creat d9/df/d14/d27/f49 x:0 0 0 2024-03-17T23:58:21.946 INFO:tasks.workunit.client.0.smithi196.stdout:9/239: mkdir d9/df/d4a 0 2024-03-17T23:58:21.946 INFO:tasks.workunit.client.0.smithi196.stdout:7/258: dwrite da/d15/d1d/f32 [0,4194304] 0 2024-03-17T23:58:21.950 INFO:tasks.workunit.client.0.smithi196.stdout:7/259: write da/d15/d1d/d4c/f4e [3144066,129539] 0 2024-03-17T23:58:21.951 INFO:tasks.workunit.client.0.smithi196.stdout:6/194: write f0 [1281654,80999] 0 2024-03-17T23:58:21.953 INFO:tasks.workunit.client.0.smithi196.stdout:9/240: write d9/df/f34 [1610831,7127] 0 2024-03-17T23:58:21.954 INFO:tasks.workunit.client.0.smithi196.stdout:9/241: read d9/f11 [8062025,54747] 0 2024-03-17T23:58:21.958 INFO:tasks.workunit.client.0.smithi196.stdout:7/260: dread da/d15/f25 [0,4194304] 0 2024-03-17T23:58:21.958 INFO:tasks.workunit.client.0.smithi196.stdout:6/195: creat d2/f43 x:0 0 0 2024-03-17T23:58:21.960 INFO:tasks.workunit.client.0.smithi196.stdout:6/196: write d2/f43 [967385,117350] 0 2024-03-17T23:58:21.960 INFO:tasks.workunit.client.0.smithi196.stdout:9/242: mkdir d9/df/d4b 0 2024-03-17T23:58:21.961 INFO:tasks.workunit.client.0.smithi196.stdout:7/261: fsync da/d15/d1d/f32 0 2024-03-17T23:58:21.963 INFO:tasks.workunit.client.0.smithi196.stdout:6/197: write d2/d22/f19 [4436239,126053] 0 2024-03-17T23:58:21.963 INFO:tasks.workunit.client.0.smithi196.stdout:7/262: fdatasync da/d15/d1d/f2d 0 2024-03-17T23:58:21.964 INFO:tasks.workunit.client.0.smithi196.stdout:9/243: creat d9/df/d14/d27/f4c x:0 0 0 2024-03-17T23:58:21.966 INFO:tasks.workunit.client.0.smithi196.stdout:6/198: read - d2/d14/d27/f3a zero size 2024-03-17T23:58:21.967 INFO:tasks.workunit.client.0.smithi196.stdout:9/244: mknod d9/d1e/c4d 0 2024-03-17T23:58:21.968 INFO:tasks.workunit.client.0.smithi196.stdout:6/199: write d2/d7/d2b/f3d [461852,24412] 0 2024-03-17T23:58:21.968 INFO:tasks.workunit.client.0.smithi196.stdout:7/263: mkdir da/d15/d1d/d29/d54/d57 0 2024-03-17T23:58:21.969 INFO:tasks.workunit.client.0.smithi196.stdout:9/245: rmdir d9/df/d14/d27 39 2024-03-17T23:58:21.969 INFO:tasks.workunit.client.0.smithi196.stdout:9/246: dread - d9/df/f36 zero size 2024-03-17T23:58:21.972 INFO:tasks.workunit.client.0.smithi196.stdout:7/264: mknod da/d15/d1d/d29/d54/c58 0 2024-03-17T23:58:21.973 INFO:tasks.workunit.client.0.smithi196.stdout:7/265: creat da/d4d/f59 x:0 0 0 2024-03-17T23:58:21.974 INFO:tasks.workunit.client.0.smithi196.stdout:6/200: link d2/d7/l28 d2/l44 0 2024-03-17T23:58:21.976 INFO:tasks.workunit.client.0.smithi196.stdout:6/201: read d2/d14/f1d [328512,8984] 0 2024-03-17T23:58:21.977 INFO:tasks.workunit.client.0.smithi196.stdout:6/202: chown d2/d14/d27/f3a 17 1 2024-03-17T23:58:21.979 INFO:tasks.workunit.client.0.smithi196.stdout:7/266: dread da/f1c [0,4194304] 0 2024-03-17T23:58:21.980 INFO:tasks.workunit.client.0.smithi196.stdout:9/247: rename d9/df/d14/f30 to d9/f4e 0 2024-03-17T23:58:21.984 INFO:tasks.workunit.client.0.smithi196.stdout:7/267: rename da/d15/d1d/d2e/f4a to da/d15/d1d/d29/f5a 0 2024-03-17T23:58:21.984 INFO:tasks.workunit.client.0.smithi196.stdout:9/248: read d9/d12/f17 [3523022,7825] 0 2024-03-17T23:58:21.986 INFO:tasks.workunit.client.0.smithi196.stdout:9/249: write f5 [1856965,104614] 0 2024-03-17T23:58:21.987 INFO:tasks.workunit.client.0.smithi196.stdout:6/203: dwrite d2/d7/f32 [0,4194304] 0 2024-03-17T23:58:21.991 INFO:tasks.workunit.client.0.smithi196.stdout:6/204: read d2/fd [1205224,67735] 0 2024-03-17T23:58:21.991 INFO:tasks.workunit.client.0.smithi196.stdout:6/205: chown f0 1301683611 1 2024-03-17T23:58:21.992 INFO:tasks.workunit.client.0.smithi196.stdout:6/206: chown d2/d22/f3f 60881 1 2024-03-17T23:58:21.999 INFO:tasks.workunit.client.0.smithi196.stdout:9/250: link d9/d38/l43 d9/d1e/l4f 0 2024-03-17T23:58:22.000 INFO:tasks.workunit.client.0.smithi196.stdout:6/207: creat d2/f45 x:0 0 0 2024-03-17T23:58:22.001 INFO:tasks.workunit.client.0.smithi196.stdout:7/268: dwrite f8 [0,4194304] 0 2024-03-17T23:58:22.003 INFO:tasks.workunit.client.0.smithi196.stdout:6/208: write d2/d7/f32 [2082503,32316] 0 2024-03-17T23:58:22.003 INFO:tasks.workunit.client.0.smithi196.stdout:9/251: symlink d9/df/d14/l50 0 2024-03-17T23:58:22.011 INFO:tasks.workunit.client.0.smithi196.stdout:7/269: dwrite da/f39 [0,4194304] 0 2024-03-17T23:58:22.014 INFO:tasks.workunit.client.0.smithi196.stdout:6/209: mknod d2/d40/c46 0 2024-03-17T23:58:22.015 INFO:tasks.workunit.client.0.smithi196.stdout:9/252: mknod d9/df/d14/c51 0 2024-03-17T23:58:22.023 INFO:tasks.workunit.client.0.smithi196.stdout:7/270: dwrite da/d15/d1d/d29/f5a [0,4194304] 0 2024-03-17T23:58:22.073 INFO:tasks.workunit.client.0.smithi196.stdout:8/124: sync 2024-03-17T23:58:22.109 INFO:tasks.workunit.client.0.smithi196.stdout:9/253: creat d9/d33/f52 x:0 0 0 2024-03-17T23:58:22.114 INFO:tasks.workunit.client.0.smithi196.stdout:6/210: creat d2/d14/f47 x:0 0 0 2024-03-17T23:58:22.115 INFO:tasks.workunit.client.0.smithi196.stdout:9/254: creat d9/df/d14/d3d/f53 x:0 0 0 2024-03-17T23:58:22.116 INFO:tasks.workunit.client.0.smithi196.stdout:9/255: write d9/df/d14/f2e [1706021,68638] 0 2024-03-17T23:58:22.117 INFO:tasks.workunit.client.0.smithi196.stdout:8/125: symlink de/l1e 0 2024-03-17T23:58:22.119 INFO:tasks.workunit.client.0.smithi196.stdout:6/211: mknod d2/d26/c48 0 2024-03-17T23:58:22.123 INFO:tasks.workunit.client.0.smithi196.stdout:9/256: symlink d9/df/l54 0 2024-03-17T23:58:22.125 INFO:tasks.workunit.client.0.smithi196.stdout:6/212: dread d2/d22/f3f [0,4194304] 0 2024-03-17T23:58:22.125 INFO:tasks.workunit.client.0.smithi196.stdout:6/213: fdatasync f1 0 2024-03-17T23:58:22.126 INFO:tasks.workunit.client.0.smithi196.stdout:6/214: fdatasync d2/f3e 0 2024-03-17T23:58:22.127 INFO:tasks.workunit.client.0.smithi196.stdout:8/126: creat de/f1f x:0 0 0 2024-03-17T23:58:22.134 INFO:tasks.workunit.client.0.smithi196.stdout:6/215: dread d2/f43 [0,4194304] 0 2024-03-17T23:58:22.137 INFO:tasks.workunit.client.0.smithi196.stdout:6/216: readlink d2/d7/d2b/l39 0 2024-03-17T23:58:22.139 INFO:tasks.workunit.client.0.smithi196.stdout:9/257: dwrite d9/df/d14/d27/f31 [0,4194304] 0 2024-03-17T23:58:22.141 INFO:tasks.workunit.client.0.smithi196.stdout:6/217: mkdir d2/d22/d49 0 2024-03-17T23:58:22.141 INFO:tasks.workunit.client.0.smithi196.stdout:8/127: dwrite de/ff [0,4194304] 0 2024-03-17T23:58:22.141 INFO:tasks.workunit.client.0.smithi196.stdout:6/218: chown d2/d26 0 1 2024-03-17T23:58:22.143 INFO:tasks.workunit.client.0.smithi196.stdout:6/219: truncate d2/f45 379948 0 2024-03-17T23:58:22.143 INFO:tasks.workunit.client.0.smithi196.stdout:6/220: read - d2/d14/d27/f3a zero size 2024-03-17T23:58:22.145 INFO:tasks.workunit.client.0.smithi196.stdout:8/128: write de/f15 [580439,35537] 0 2024-03-17T23:58:22.145 INFO:tasks.workunit.client.0.smithi196.stdout:6/221: dread - d2/d14/f47 zero size 2024-03-17T23:58:22.146 INFO:tasks.workunit.client.0.smithi196.stdout:8/129: read f6 [4187441,99173] 0 2024-03-17T23:58:22.147 INFO:tasks.workunit.client.0.smithi196.stdout:6/222: creat d2/d7/d2b/f4a x:0 0 0 2024-03-17T23:58:22.148 INFO:tasks.workunit.client.0.smithi196.stdout:9/258: dread d9/df/d14/d27/f3a [0,4194304] 0 2024-03-17T23:58:22.150 INFO:tasks.workunit.client.0.smithi196.stdout:6/223: link f1 d2/d14/d42/f4b 0 2024-03-17T23:58:22.151 INFO:tasks.workunit.client.0.smithi196.stdout:9/259: mkdir d9/df/d55 0 2024-03-17T23:58:22.157 INFO:tasks.workunit.client.0.smithi196.stdout:9/260: getdents d9/df/d14/d3d 0 2024-03-17T23:58:22.159 INFO:tasks.workunit.client.0.smithi196.stdout:9/261: dread - d9/d38/f3f zero size 2024-03-17T23:58:22.159 INFO:tasks.workunit.client.0.smithi196.stdout:6/224: dread d2/d7/f32 [0,4194304] 0 2024-03-17T23:58:22.159 INFO:tasks.workunit.client.0.smithi196.stdout:8/130: dwrite de/d10/f1c [0,4194304] 0 2024-03-17T23:58:22.161 INFO:tasks.workunit.client.0.smithi196.stdout:9/262: rmdir d9/d1e 39 2024-03-17T23:58:22.162 INFO:tasks.workunit.client.0.smithi196.stdout:8/131: fdatasync f6 0 2024-03-17T23:58:22.162 INFO:tasks.workunit.client.0.smithi196.stdout:8/132: chown de/d10/f1b 10 1 2024-03-17T23:58:22.163 INFO:tasks.workunit.client.0.smithi196.stdout:6/225: creat d2/d22/f4c x:0 0 0 2024-03-17T23:58:22.166 INFO:tasks.workunit.client.0.smithi196.stdout:8/133: unlink de/d10/f1c 0 2024-03-17T23:58:22.167 INFO:tasks.workunit.client.0.smithi196.stdout:9/263: creat d9/df/d4b/f56 x:0 0 0 2024-03-17T23:58:22.168 INFO:tasks.workunit.client.0.smithi196.stdout:6/226: write d2/d22/f3f [2388378,22484] 0 2024-03-17T23:58:22.171 INFO:tasks.workunit.client.0.smithi196.stdout:9/264: creat d9/df/d4b/f57 x:0 0 0 2024-03-17T23:58:22.176 INFO:tasks.workunit.client.0.smithi196.stdout:9/265: fsync d9/d1e/f2c 0 2024-03-17T23:58:22.178 INFO:tasks.workunit.client.0.smithi196.stdout:6/227: dwrite f0 [0,4194304] 0 2024-03-17T23:58:22.178 INFO:tasks.workunit.client.0.smithi196.stdout:9/266: read f6 [373104,45237] 0 2024-03-17T23:58:22.180 INFO:tasks.workunit.client.0.smithi196.stdout:8/134: link lc de/l20 0 2024-03-17T23:58:22.183 INFO:tasks.workunit.client.0.smithi196.stdout:9/267: mknod d9/d12/c58 0 2024-03-17T23:58:22.186 INFO:tasks.workunit.client.0.smithi196.stdout:8/135: symlink de/l21 0 2024-03-17T23:58:22.188 INFO:tasks.workunit.client.0.smithi196.stdout:9/268: mkdir d9/d12/d59 0 2024-03-17T23:58:22.189 INFO:tasks.workunit.client.0.smithi196.stdout:6/228: link d2/c6 d2/d14/d27/c4d 0 2024-03-17T23:58:22.191 INFO:tasks.workunit.client.0.smithi196.stdout:6/229: creat d2/d14/d42/f4e x:0 0 0 2024-03-17T23:58:22.192 INFO:tasks.workunit.client.0.smithi196.stdout:6/230: chown d2/d26/l31 216882967 1 2024-03-17T23:58:22.194 INFO:tasks.workunit.client.0.smithi196.stdout:6/231: creat d2/d14/d42/f4f x:0 0 0 2024-03-17T23:58:22.200 INFO:tasks.workunit.client.0.smithi196.stdout:9/269: getdents d9/d12 0 2024-03-17T23:58:22.201 INFO:tasks.workunit.client.0.smithi196.stdout:8/136: truncate de/ff 2732219 0 2024-03-17T23:58:22.202 INFO:tasks.workunit.client.0.smithi196.stdout:6/232: dwrite d2/ff [0,4194304] 0 2024-03-17T23:58:22.202 INFO:tasks.workunit.client.0.smithi196.stdout:9/270: truncate d9/d1e/f26 917922 0 2024-03-17T23:58:22.203 INFO:tasks.workunit.client.0.smithi196.stdout:8/137: truncate de/f13 4590543 0 2024-03-17T23:58:22.206 INFO:tasks.workunit.client.0.smithi196.stdout:8/138: dread de/f1d [0,4194304] 0 2024-03-17T23:58:22.211 INFO:tasks.workunit.client.0.smithi196.stdout:8/139: mknod de/d10/c22 0 2024-03-17T23:58:22.213 INFO:tasks.workunit.client.0.smithi196.stdout:6/233: dwrite d2/f45 [0,4194304] 0 2024-03-17T23:58:22.216 INFO:tasks.workunit.client.0.smithi196.stdout:5/220: sync 2024-03-17T23:58:22.216 INFO:tasks.workunit.client.0.smithi196.stdout:3/327: sync 2024-03-17T23:58:22.216 INFO:tasks.workunit.client.0.smithi196.stdout:8/140: getdents de 0 2024-03-17T23:58:22.217 INFO:tasks.workunit.client.0.smithi196.stdout:5/221: read d6/fe [251935,113490] 0 2024-03-17T23:58:22.217 INFO:tasks.workunit.client.0.smithi196.stdout:8/141: unlink c9 0 2024-03-17T23:58:22.219 INFO:tasks.workunit.client.0.smithi196.stdout:6/234: mkdir d2/d14/d50 0 2024-03-17T23:58:22.219 INFO:tasks.workunit.client.0.smithi196.stdout:5/222: dread - d6/d15/d16/f32 zero size 2024-03-17T23:58:22.220 INFO:tasks.workunit.client.0.smithi196.stdout:3/328: mknod d7/d19/d26/d2b/d3c/d3d/c69 0 2024-03-17T23:58:22.221 INFO:tasks.workunit.client.0.smithi196.stdout:5/223: write d6/d2a/f31 [540357,104191] 0 2024-03-17T23:58:22.222 INFO:tasks.workunit.client.0.smithi196.stdout:6/235: write d2/d14/d27/f38 [186107,72791] 0 2024-03-17T23:58:22.223 INFO:tasks.workunit.client.0.smithi196.stdout:5/224: chown d6/d15/c25 431 1 2024-03-17T23:58:22.225 INFO:tasks.workunit.client.0.smithi196.stdout:9/271: write d9/df/f1d [2004903,87892] 0 2024-03-17T23:58:22.227 INFO:tasks.workunit.client.0.smithi196.stdout:5/225: dread d6/fe [0,4194304] 0 2024-03-17T23:58:22.228 INFO:tasks.workunit.client.0.smithi196.stdout:8/142: dread de/d10/f1b [0,4194304] 0 2024-03-17T23:58:22.230 INFO:tasks.workunit.client.0.smithi196.stdout:6/236: rename d2/d26 to d2/d14/d27/d51 0 2024-03-17T23:58:22.235 INFO:tasks.workunit.client.0.smithi196.stdout:8/143: creat de/f23 x:0 0 0 2024-03-17T23:58:22.237 INFO:tasks.workunit.client.0.smithi196.stdout:6/237: unlink d2/f43 0 2024-03-17T23:58:22.237 INFO:tasks.workunit.client.0.smithi196.stdout:3/329: write d7/d19/d26/f5c [122104,123819] 0 2024-03-17T23:58:22.238 INFO:tasks.workunit.client.0.smithi196.stdout:9/272: creat d9/df/d4a/f5a x:0 0 0 2024-03-17T23:58:22.241 INFO:tasks.workunit.client.0.smithi196.stdout:5/226: truncate f1 1465053 0 2024-03-17T23:58:22.241 INFO:tasks.workunit.client.0.smithi196.stdout:3/330: chown d7/d19/d26/d2b/f42 1 1 2024-03-17T23:58:22.241 INFO:tasks.workunit.client.0.smithi196.stdout:6/238: fsync d2/d14/d42/f4b 0 2024-03-17T23:58:22.242 INFO:tasks.workunit.client.0.smithi196.stdout:9/273: mkdir d9/df/d4a/d5b 0 2024-03-17T23:58:22.244 INFO:tasks.workunit.client.0.smithi196.stdout:9/274: chown d9/df/d14/d3d/f53 0 1 2024-03-17T23:58:22.244 INFO:tasks.workunit.client.0.smithi196.stdout:5/227: mknod d6/d17/d1f/c49 0 2024-03-17T23:58:22.245 INFO:tasks.workunit.client.0.smithi196.stdout:3/331: creat d7/d19/d26/d2b/d3c/d3d/f6a x:0 0 0 2024-03-17T23:58:22.245 INFO:tasks.workunit.client.0.smithi196.stdout:9/275: read d9/d12/f17 [3496879,46079] 0 2024-03-17T23:58:22.247 INFO:tasks.workunit.client.0.smithi196.stdout:6/239: creat d2/d14/d35/f52 x:0 0 0 2024-03-17T23:58:22.248 INFO:tasks.workunit.client.0.smithi196.stdout:9/276: rmdir d9/df/d14/d27 39 2024-03-17T23:58:22.250 INFO:tasks.workunit.client.0.smithi196.stdout:6/240: symlink d2/d14/d42/l53 0 2024-03-17T23:58:22.255 INFO:tasks.workunit.client.0.smithi196.stdout:5/228: dread f3 [0,4194304] 0 2024-03-17T23:58:22.257 INFO:tasks.workunit.client.0.smithi196.stdout:5/229: truncate d6/d2d/f3a 523195 0 2024-03-17T23:58:22.258 INFO:tasks.workunit.client.0.smithi196.stdout:3/332: dwrite d7/d19/d26/d2b/f42 [0,4194304] 0 2024-03-17T23:58:22.259 INFO:tasks.workunit.client.0.smithi196.stdout:6/241: mknod d2/d22/d49/c54 0 2024-03-17T23:58:22.260 INFO:tasks.workunit.client.0.smithi196.stdout:6/242: fsync d2/d14/f20 0 2024-03-17T23:58:22.261 INFO:tasks.workunit.client.0.smithi196.stdout:6/243: write d2/d14/d42/f4f [17000,62130] 0 2024-03-17T23:58:22.270 INFO:tasks.workunit.client.0.smithi196.stdout:5/230: getdents d6/d17/d35 0 2024-03-17T23:58:22.273 INFO:tasks.workunit.client.0.smithi196.stdout:8/144: dwrite de/f1f [0,4194304] 0 2024-03-17T23:58:22.274 INFO:tasks.workunit.client.0.smithi196.stdout:3/333: rename d7/d19/l53 to d7/d33/l6b 0 2024-03-17T23:58:22.278 INFO:tasks.workunit.client.0.smithi196.stdout:9/277: dwrite d9/f44 [0,4194304] 0 2024-03-17T23:58:22.278 INFO:tasks.workunit.client.0.smithi196.stdout:8/145: chown de/d10/l11 169 1 2024-03-17T23:58:22.281 INFO:tasks.workunit.client.0.smithi196.stdout:9/278: chown d9/l23 3 1 2024-03-17T23:58:22.286 INFO:tasks.workunit.client.0.smithi196.stdout:8/146: creat de/d10/f24 x:0 0 0 2024-03-17T23:58:22.288 INFO:tasks.workunit.client.0.smithi196.stdout:6/244: dread d2/d14/d42/f4b [4194304,4194304] 0 2024-03-17T23:58:22.292 INFO:tasks.workunit.client.0.smithi196.stdout:8/147: mknod de/c25 0 2024-03-17T23:58:22.298 INFO:tasks.workunit.client.0.smithi196.stdout:6/245: dwrite d2/d22/f4c [0,4194304] 0 2024-03-17T23:58:22.303 INFO:tasks.workunit.client.0.smithi196.stdout:8/148: mknod de/d10/c26 0 2024-03-17T23:58:22.303 INFO:tasks.workunit.client.0.smithi196.stdout:9/279: dread d9/f35 [0,4194304] 0 2024-03-17T23:58:22.304 INFO:tasks.workunit.client.0.smithi196.stdout:9/280: truncate d9/f4e 2403589 0 2024-03-17T23:58:22.305 INFO:tasks.workunit.client.0.smithi196.stdout:5/231: dread d6/fc [0,4194304] 0 2024-03-17T23:58:22.306 INFO:tasks.workunit.client.0.smithi196.stdout:5/232: write f0 [1525083,43146] 0 2024-03-17T23:58:22.313 INFO:tasks.workunit.client.0.smithi196.stdout:3/334: dread d7/d19/d26/d2b/d3c/d3d/f5a [0,4194304] 0 2024-03-17T23:58:22.313 INFO:tasks.workunit.client.0.smithi196.stdout:9/281: write d9/df/d14/d27/f4c [296847,27607] 0 2024-03-17T23:58:22.314 INFO:tasks.workunit.client.0.smithi196.stdout:6/246: symlink d2/d14/l55 0 2024-03-17T23:58:22.314 INFO:tasks.workunit.client.0.smithi196.stdout:5/233: creat d6/d15/d16/f4a x:0 0 0 2024-03-17T23:58:22.315 INFO:tasks.workunit.client.0.smithi196.stdout:9/282: chown d9/df/l18 45477 1 2024-03-17T23:58:22.316 INFO:tasks.workunit.client.0.smithi196.stdout:3/335: chown d7/l12 155140706 1 2024-03-17T23:58:22.320 INFO:tasks.workunit.client.0.smithi196.stdout:3/336: fsync d7/d19/f1c 0 2024-03-17T23:58:22.320 INFO:tasks.workunit.client.0.smithi196.stdout:5/234: dread d6/d2a/f31 [0,4194304] 0 2024-03-17T23:58:22.323 INFO:tasks.workunit.client.0.smithi196.stdout:5/235: dread - d6/d15/d16/f32 zero size 2024-03-17T23:58:22.323 INFO:tasks.workunit.client.0.smithi196.stdout:3/337: chown d7/d19/d26/d2b/d3c/d3d/c60 18 1 2024-03-17T23:58:22.324 INFO:tasks.workunit.client.0.smithi196.stdout:8/149: truncate de/f15 509846 0 2024-03-17T23:58:22.326 INFO:tasks.workunit.client.0.smithi196.stdout:3/338: chown d7/d19/l40 339841032 1 2024-03-17T23:58:22.326 INFO:tasks.workunit.client.0.smithi196.stdout:6/247: dwrite d2/f45 [0,4194304] 0 2024-03-17T23:58:22.327 INFO:tasks.workunit.client.0.smithi196.stdout:3/339: chown d7/d19/l51 1356134585 1 2024-03-17T23:58:22.328 INFO:tasks.workunit.client.0.smithi196.stdout:5/236: symlink d6/d2d/d33/l4b 0 2024-03-17T23:58:22.331 INFO:tasks.workunit.client.0.smithi196.stdout:8/150: creat de/d10/f27 x:0 0 0 2024-03-17T23:58:22.332 INFO:tasks.workunit.client.0.smithi196.stdout:9/283: truncate d9/df/d14/f2e 1812153 0 2024-03-17T23:58:22.333 INFO:tasks.workunit.client.0.smithi196.stdout:3/340: creat d7/d19/d26/d48/f6c x:0 0 0 2024-03-17T23:58:22.334 INFO:tasks.workunit.client.0.smithi196.stdout:5/237: creat d6/d17/d1f/f4c x:0 0 0 2024-03-17T23:58:22.335 INFO:tasks.workunit.client.0.smithi196.stdout:5/238: readlink d6/d17/l37 0 2024-03-17T23:58:22.336 INFO:tasks.workunit.client.0.smithi196.stdout:8/151: fdatasync de/f1d 0 2024-03-17T23:58:22.338 INFO:tasks.workunit.client.0.smithi196.stdout:6/248: symlink d2/l56 0 2024-03-17T23:58:22.345 INFO:tasks.workunit.client.0.smithi196.stdout:8/152: symlink de/l28 0 2024-03-17T23:58:22.347 INFO:tasks.workunit.client.0.smithi196.stdout:9/284: creat d9/df/d14/f5c x:0 0 0 2024-03-17T23:58:22.348 INFO:tasks.workunit.client.0.smithi196.stdout:3/341: write d7/d19/d26/d2b/d3c/d3d/f5a [3375024,118487] 0 2024-03-17T23:58:22.349 INFO:tasks.workunit.client.0.smithi196.stdout:3/342: fdatasync f6 0 2024-03-17T23:58:22.349 INFO:tasks.workunit.client.0.smithi196.stdout:9/285: read d9/d12/f21 [470577,26845] 0 2024-03-17T23:58:22.353 INFO:tasks.workunit.client.0.smithi196.stdout:8/153: mknod de/c29 0 2024-03-17T23:58:22.355 INFO:tasks.workunit.client.0.smithi196.stdout:3/343: mknod d7/d19/d26/d2b/c6d 0 2024-03-17T23:58:22.357 INFO:tasks.workunit.client.0.smithi196.stdout:3/344: dread - d7/d19/f30 zero size 2024-03-17T23:58:22.357 INFO:tasks.workunit.client.0.smithi196.stdout:9/286: mknod d9/df/d4a/c5d 0 2024-03-17T23:58:22.358 INFO:tasks.workunit.client.0.smithi196.stdout:5/239: dwrite d6/d17/d1f/f3c [0,4194304] 0 2024-03-17T23:58:22.363 INFO:tasks.workunit.client.0.smithi196.stdout:9/287: write d9/df/d14/d27/f31 [3605751,117547] 0 2024-03-17T23:58:22.365 INFO:tasks.workunit.client.0.smithi196.stdout:9/288: dread - d9/df/d14/d3d/f53 zero size 2024-03-17T23:58:22.367 INFO:tasks.workunit.client.0.smithi196.stdout:9/289: chown d9/df/d14/d27/f31 426 1 2024-03-17T23:58:22.368 INFO:tasks.workunit.client.0.smithi196.stdout:9/290: dread - d9/d1e/f48 zero size 2024-03-17T23:58:22.373 INFO:tasks.workunit.client.0.smithi196.stdout:8/154: dwrite de/ff [0,4194304] 0 2024-03-17T23:58:22.375 INFO:tasks.workunit.client.0.smithi196.stdout:9/291: rename d9/df/d4b to d9/d1e/d5e 0 2024-03-17T23:58:22.378 INFO:tasks.workunit.client.0.smithi196.stdout:3/345: truncate d7/d19/d26/d2b/f55 610387 0 2024-03-17T23:58:22.381 INFO:tasks.workunit.client.0.smithi196.stdout:9/292: dread d9/d1e/f26 [0,4194304] 0 2024-03-17T23:58:22.384 INFO:tasks.workunit.client.0.smithi196.stdout:9/293: rmdir d9/d38 39 2024-03-17T23:58:22.384 INFO:tasks.workunit.client.0.smithi196.stdout:8/155: link de/l21 de/l2a 0 2024-03-17T23:58:22.392 INFO:tasks.workunit.client.0.smithi196.stdout:5/240: dread d6/d15/d16/f24 [0,4194304] 0 2024-03-17T23:58:22.394 INFO:tasks.workunit.client.0.smithi196.stdout:3/346: dread d7/f1f [0,4194304] 0 2024-03-17T23:58:22.396 INFO:tasks.workunit.client.0.smithi196.stdout:8/156: mkdir de/d2b 0 2024-03-17T23:58:22.399 INFO:tasks.workunit.client.0.smithi196.stdout:9/294: dread d9/f4e [0,4194304] 0 2024-03-17T23:58:22.402 INFO:tasks.workunit.client.0.smithi196.stdout:5/241: dwrite f3 [0,4194304] 0 2024-03-17T23:58:22.405 INFO:tasks.workunit.client.0.smithi196.stdout:3/347: fsync d7/f11 0 2024-03-17T23:58:22.412 INFO:tasks.workunit.client.0.smithi196.stdout:8/157: dwrite de/ff [0,4194304] 0 2024-03-17T23:58:22.414 INFO:tasks.workunit.client.0.smithi196.stdout:4/168: sync 2024-03-17T23:58:22.415 INFO:tasks.workunit.client.0.smithi196.stdout:5/242: creat d6/d17/d3f/d40/f4d x:0 0 0 2024-03-17T23:58:22.416 INFO:tasks.workunit.client.0.smithi196.stdout:5/243: chown d6/d17/d1f/f3c 2375733 1 2024-03-17T23:58:22.419 INFO:tasks.workunit.client.0.smithi196.stdout:3/348: link d7/d19/d26/d2b/d3c/d3d/f5a d7/d19/d26/d2b/f6e 0 2024-03-17T23:58:22.420 INFO:tasks.workunit.client.0.smithi196.stdout:3/349: dread - d7/d19/d26/f37 zero size 2024-03-17T23:58:22.421 INFO:tasks.workunit.client.0.smithi196.stdout:5/244: fdatasync d6/d2a/f31 0 2024-03-17T23:58:22.421 INFO:tasks.workunit.client.0.smithi196.stdout:5/245: write f3 [4711969,94351] 0 2024-03-17T23:58:22.422 INFO:tasks.workunit.client.0.smithi196.stdout:4/169: link d1/l23 d1/d11/l37 0 2024-03-17T23:58:22.424 INFO:tasks.workunit.client.0.smithi196.stdout:8/158: dread de/f15 [0,4194304] 0 2024-03-17T23:58:22.452 INFO:tasks.workunit.client.0.smithi196.stdout:8/159: write de/d10/f14 [1528294,60887] 0 2024-03-17T23:58:22.452 INFO:tasks.workunit.client.0.smithi196.stdout:3/350: symlink d7/l6f 0 2024-03-17T23:58:22.453 INFO:tasks.workunit.client.0.smithi196.stdout:9/295: dread d9/d12/f21 [0,4194304] 0 2024-03-17T23:58:22.455 INFO:tasks.workunit.client.0.smithi196.stdout:4/170: mknod d1/d11/c38 0 2024-03-17T23:58:22.457 INFO:tasks.workunit.client.0.smithi196.stdout:8/160: stat de/d10/f14 0 2024-03-17T23:58:22.459 INFO:tasks.workunit.client.0.smithi196.stdout:8/161: fsync de/d10/f27 0 2024-03-17T23:58:22.461 INFO:tasks.workunit.client.0.smithi196.stdout:9/296: dread d9/f35 [0,4194304] 0 2024-03-17T23:58:22.462 INFO:tasks.workunit.client.0.smithi196.stdout:4/171: getdents d1 0 2024-03-17T23:58:22.464 INFO:tasks.workunit.client.0.smithi196.stdout:5/246: dwrite d6/d17/f34 [0,4194304] 0 2024-03-17T23:58:22.472 INFO:tasks.workunit.client.0.smithi196.stdout:9/297: truncate d9/df/f34 2337454 0 2024-03-17T23:58:22.474 INFO:tasks.workunit.client.0.smithi196.stdout:3/351: dwrite d7/d19/d26/d2b/d3c/d3d/f5e [0,4194304] 0 2024-03-17T23:58:22.477 INFO:tasks.workunit.client.0.smithi196.stdout:8/162: dwrite de/d10/f14 [0,4194304] 0 2024-03-17T23:58:22.478 INFO:tasks.workunit.client.0.smithi196.stdout:4/172: link d1/d26/f2b d1/d26/f39 0 2024-03-17T23:58:22.480 INFO:tasks.workunit.client.0.smithi196.stdout:5/247: dwrite d6/f1a [0,4194304] 0 2024-03-17T23:58:22.482 INFO:tasks.workunit.client.0.smithi196.stdout:5/248: stat d6/d17/l37 0 2024-03-17T23:58:22.484 INFO:tasks.workunit.client.0.smithi196.stdout:9/298: rename d9/d12/f47 to d9/d33/f5f 0 2024-03-17T23:58:22.488 INFO:tasks.workunit.client.0.smithi196.stdout:8/163: creat de/d10/f2c x:0 0 0 2024-03-17T23:58:22.491 INFO:tasks.workunit.client.0.smithi196.stdout:8/164: write de/d10/f1a [933603,78207] 0 2024-03-17T23:58:22.494 INFO:tasks.workunit.client.0.smithi196.stdout:5/249: mkdir d6/d17/d3f/d4e 0 2024-03-17T23:58:22.494 INFO:tasks.workunit.client.0.smithi196.stdout:8/165: chown de/d10/l18 1859 1 2024-03-17T23:58:22.494 INFO:tasks.workunit.client.0.smithi196.stdout:4/173: dwrite d1/d11/f19 [0,4194304] 0 2024-03-17T23:58:22.496 INFO:tasks.workunit.client.0.smithi196.stdout:5/250: write d6/f8 [2578832,13427] 0 2024-03-17T23:58:22.503 INFO:tasks.workunit.client.0.smithi196.stdout:3/352: write d7/f20 [827564,113966] 0 2024-03-17T23:58:22.505 INFO:tasks.workunit.client.0.smithi196.stdout:9/299: rename d9/d1e to d9/d38/d60 0 2024-03-17T23:58:22.507 INFO:tasks.workunit.client.0.smithi196.stdout:5/251: stat d6/d15/d16/c3e 0 2024-03-17T23:58:22.508 INFO:tasks.workunit.client.0.smithi196.stdout:3/353: symlink d7/d19/d26/d48/d4d/l70 0 2024-03-17T23:58:22.512 INFO:tasks.workunit.client.0.smithi196.stdout:9/300: rename d9/f35 to d9/d38/d60/f61 0 2024-03-17T23:58:22.515 INFO:tasks.workunit.client.0.smithi196.stdout:5/252: creat d6/d17/d35/f4f x:0 0 0 2024-03-17T23:58:22.516 INFO:tasks.workunit.client.0.smithi196.stdout:3/354: mknod d7/d19/d26/d2b/d3c/d3d/c71 0 2024-03-17T23:58:22.517 INFO:tasks.workunit.client.0.smithi196.stdout:5/253: read - d6/d17/d1f/f29 zero size 2024-03-17T23:58:22.518 INFO:tasks.workunit.client.0.smithi196.stdout:4/174: dwrite d1/f2c [0,4194304] 0 2024-03-17T23:58:22.522 INFO:tasks.workunit.client.0.smithi196.stdout:8/166: dwrite de/f15 [0,4194304] 0 2024-03-17T23:58:22.531 INFO:tasks.workunit.client.0.smithi196.stdout:9/301: unlink d9/d38/d60/c22 0 2024-03-17T23:58:22.531 INFO:tasks.workunit.client.0.smithi196.stdout:4/175: dread d1/d11/f19 [0,4194304] 0 2024-03-17T23:58:22.533 INFO:tasks.workunit.client.0.smithi196.stdout:3/355: creat d7/d19/d26/f72 x:0 0 0 2024-03-17T23:58:22.541 INFO:tasks.workunit.client.0.smithi196.stdout:8/167: fdatasync de/f13 0 2024-03-17T23:58:22.544 INFO:tasks.workunit.client.0.smithi196.stdout:9/302: mkdir d9/df/d4a/d5b/d62 0 2024-03-17T23:58:22.546 INFO:tasks.workunit.client.0.smithi196.stdout:5/254: getdents d6/d2d 0 2024-03-17T23:58:22.547 INFO:tasks.workunit.client.0.smithi196.stdout:3/356: creat d7/d19/f73 x:0 0 0 2024-03-17T23:58:22.549 INFO:tasks.workunit.client.0.smithi196.stdout:4/176: getdents d1/d1b 0 2024-03-17T23:58:22.550 INFO:tasks.workunit.client.0.smithi196.stdout:3/357: read - d7/d29/f63 zero size 2024-03-17T23:58:22.553 INFO:tasks.workunit.client.0.smithi196.stdout:8/168: dwrite de/d10/f27 [0,4194304] 0 2024-03-17T23:58:22.555 INFO:tasks.workunit.client.0.smithi196.stdout:9/303: creat d9/d12/d59/f63 x:0 0 0 2024-03-17T23:58:22.555 INFO:tasks.workunit.client.0.smithi196.stdout:8/169: read de/d10/f27 [1167511,114839] 0 2024-03-17T23:58:22.555 INFO:tasks.workunit.client.0.smithi196.stdout:3/358: rmdir d7/d19 39 2024-03-17T23:58:22.561 INFO:tasks.workunit.client.0.smithi196.stdout:4/177: dwrite d1/d11/f18 [0,4194304] 0 2024-03-17T23:58:22.563 INFO:tasks.workunit.client.0.smithi196.stdout:9/304: chown d9/f25 118 1 2024-03-17T23:58:22.565 INFO:tasks.workunit.client.0.smithi196.stdout:5/255: dwrite d6/fb [0,4194304] 0 2024-03-17T23:58:22.574 INFO:tasks.workunit.client.0.smithi196.stdout:8/170: creat de/f2d x:0 0 0 2024-03-17T23:58:22.576 INFO:tasks.workunit.client.0.smithi196.stdout:8/171: chown lb 53269 1 2024-03-17T23:58:22.579 INFO:tasks.workunit.client.0.smithi196.stdout:9/305: dwrite d9/d12/d59/f63 [0,4194304] 0 2024-03-17T23:58:22.580 INFO:tasks.workunit.client.0.smithi196.stdout:5/256: dwrite d6/d15/d16/f32 [0,4194304] 0 2024-03-17T23:58:22.583 INFO:tasks.workunit.client.0.smithi196.stdout:9/306: write d9/d38/d60/d5e/f56 [372820,13343] 0 2024-03-17T23:58:22.593 INFO:tasks.workunit.client.0.smithi196.stdout:3/359: rename d7/d19/f1d to d7/d19/d26/d48/f74 0 2024-03-17T23:58:22.597 INFO:tasks.workunit.client.0.smithi196.stdout:9/307: truncate d9/df/d14/f5c 86319 0 2024-03-17T23:58:22.598 INFO:tasks.workunit.client.0.smithi196.stdout:8/172: write f7 [3805123,7852] 0 2024-03-17T23:58:22.599 INFO:tasks.workunit.client.0.smithi196.stdout:5/257: write f1 [715097,72025] 0 2024-03-17T23:58:22.606 INFO:tasks.workunit.client.0.smithi196.stdout:2/366: sync 2024-03-17T23:58:22.606 INFO:tasks.workunit.client.0.smithi196.stdout:0/305: sync 2024-03-17T23:58:22.606 INFO:tasks.workunit.client.0.smithi196.stdout:1/228: sync 2024-03-17T23:58:22.606 INFO:tasks.workunit.client.0.smithi196.stdout:5/258: creat d6/d17/d1f/f50 x:0 0 0 2024-03-17T23:58:22.608 INFO:tasks.workunit.client.0.smithi196.stdout:2/367: chown d17/d22/d3d/d8f 7634188 1 2024-03-17T23:58:22.609 INFO:tasks.workunit.client.0.smithi196.stdout:3/360: truncate d7/d19/d26/f5c 122085 0 2024-03-17T23:58:22.611 INFO:tasks.workunit.client.0.smithi196.stdout:1/229: symlink d1/d13/d4c/l5f 0 2024-03-17T23:58:22.612 INFO:tasks.workunit.client.0.smithi196.stdout:5/259: write d6/d2d/f3a [749219,50373] 0 2024-03-17T23:58:22.613 INFO:tasks.workunit.client.0.smithi196.stdout:8/173: dwrite de/d10/f24 [0,4194304] 0 2024-03-17T23:58:22.616 INFO:tasks.workunit.client.0.smithi196.stdout:1/230: truncate d1/db/dd/d43/f4a 2708279 0 2024-03-17T23:58:22.617 INFO:tasks.workunit.client.0.smithi196.stdout:8/174: write f3 [2737757,104995] 0 2024-03-17T23:58:22.617 INFO:tasks.workunit.client.0.smithi196.stdout:9/308: dwrite d9/d38/d60/f28 [4194304,4194304] 0 2024-03-17T23:58:22.620 INFO:tasks.workunit.client.0.smithi196.stdout:5/260: symlink d6/d17/d23/l51 0 2024-03-17T23:58:22.643 INFO:tasks.workunit.client.0.smithi196.stdout:2/368: creat d17/d28/d30/f90 x:0 0 0 2024-03-17T23:58:22.643 INFO:tasks.workunit.client.0.smithi196.stdout:9/309: mknod d9/df/d14/d27/c64 0 2024-03-17T23:58:22.645 INFO:tasks.workunit.client.0.smithi196.stdout:5/261: unlink d6/d17/d1f/c49 0 2024-03-17T23:58:22.646 INFO:tasks.workunit.client.0.smithi196.stdout:8/175: creat de/d10/f2e x:0 0 0 2024-03-17T23:58:22.647 INFO:tasks.workunit.client.0.smithi196.stdout:2/369: stat cc 0 2024-03-17T23:58:22.649 INFO:tasks.workunit.client.0.smithi196.stdout:1/231: dread d1/d13/f3c [0,4194304] 0 2024-03-17T23:58:22.650 INFO:tasks.workunit.client.0.smithi196.stdout:1/232: chown d1/db/fe 23342 1 2024-03-17T23:58:22.650 INFO:tasks.workunit.client.0.smithi196.stdout:8/176: chown de/d10/f24 124955947 1 2024-03-17T23:58:22.651 INFO:tasks.workunit.client.0.smithi196.stdout:8/177: stat de/d10/f24 0 2024-03-17T23:58:22.651 INFO:tasks.workunit.client.0.smithi196.stdout:1/233: stat d1/d13/d23/d47/d48/f54 0 2024-03-17T23:58:22.651 INFO:tasks.workunit.client.0.smithi196.stdout:8/178: dread - de/d10/f2e zero size 2024-03-17T23:58:22.652 INFO:tasks.workunit.client.0.smithi196.stdout:1/234: chown d1/d13/d23/c4e 14 1 2024-03-17T23:58:22.742 INFO:tasks.workunit.client.0.smithi196.stdout:3/361: getdents d7/d19/d26/d48/d4d 0 2024-03-17T23:58:22.744 INFO:tasks.workunit.client.0.smithi196.stdout:2/370: creat d17/d22/d3d/f91 x:0 0 0 2024-03-17T23:58:22.745 INFO:tasks.workunit.client.0.smithi196.stdout:8/179: chown de/f19 1874 1 2024-03-17T23:58:22.747 INFO:tasks.workunit.client.0.smithi196.stdout:5/262: symlink d6/d17/d3f/d4e/l52 0 2024-03-17T23:58:22.749 INFO:tasks.workunit.client.0.smithi196.stdout:5/263: write d6/fb [4526901,77828] 0 2024-03-17T23:58:22.752 INFO:tasks.workunit.client.0.smithi196.stdout:1/235: symlink d1/d13/l60 0 2024-03-17T23:58:22.754 INFO:tasks.workunit.client.0.smithi196.stdout:3/362: truncate d7/d19/d26/f2f 5123794 0 2024-03-17T23:58:22.755 INFO:tasks.workunit.client.0.smithi196.stdout:2/371: dwrite f2 [8388608,4194304] 0 2024-03-17T23:58:22.758 INFO:tasks.workunit.client.0.smithi196.stdout:5/264: mkdir d6/d17/d23/d53 0 2024-03-17T23:58:22.758 INFO:tasks.workunit.client.0.smithi196.stdout:8/180: rename de/l21 to de/d10/l2f 0 2024-03-17T23:58:22.759 INFO:tasks.workunit.client.0.smithi196.stdout:5/265: write d6/fc [4770383,3726] 0 2024-03-17T23:58:22.760 INFO:tasks.workunit.client.0.smithi196.stdout:1/236: creat d1/d13/d4c/f61 x:0 0 0 2024-03-17T23:58:22.762 INFO:tasks.workunit.client.0.smithi196.stdout:9/310: dwrite d9/d12/f21 [0,4194304] 0 2024-03-17T23:58:22.769 INFO:tasks.workunit.client.0.smithi196.stdout:1/237: unlink d1/db/dd/d43/f45 0 2024-03-17T23:58:22.770 INFO:tasks.workunit.client.0.smithi196.stdout:9/311: dread d9/d12/f16 [0,4194304] 0 2024-03-17T23:58:22.770 INFO:tasks.workunit.client.0.smithi196.stdout:3/363: symlink d7/d19/l75 0 2024-03-17T23:58:22.771 INFO:tasks.workunit.client.0.smithi196.stdout:5/266: creat d6/d17/d23/d53/f54 x:0 0 0 2024-03-17T23:58:22.771 INFO:tasks.workunit.client.0.smithi196.stdout:8/181: dwrite f6 [0,4194304] 0 2024-03-17T23:58:22.775 INFO:tasks.workunit.client.0.smithi196.stdout:2/372: rename d17/d1f/l82 to d17/d28/d30/l92 0 2024-03-17T23:58:22.778 INFO:tasks.workunit.client.0.smithi196.stdout:9/312: unlink d9/d38/d60/f2c 0 2024-03-17T23:58:22.782 INFO:tasks.workunit.client.0.smithi196.stdout:5/267: creat d6/d2d/f55 x:0 0 0 2024-03-17T23:58:22.783 INFO:tasks.workunit.client.0.smithi196.stdout:1/238: mkdir d1/d13/d23/d62 0 2024-03-17T23:58:22.787 INFO:tasks.workunit.client.0.smithi196.stdout:8/182: mkdir de/d2b/d30 0 2024-03-17T23:58:22.789 INFO:tasks.workunit.client.0.smithi196.stdout:5/268: mknod d6/d2d/d33/d3b/c56 0 2024-03-17T23:58:22.791 INFO:tasks.workunit.client.0.smithi196.stdout:8/183: chown de/d10/f24 0 1 2024-03-17T23:58:22.793 INFO:tasks.workunit.client.0.smithi196.stdout:9/313: dread d9/f11 [4194304,4194304] 0 2024-03-17T23:58:22.797 INFO:tasks.workunit.client.0.smithi196.stdout:1/239: dwrite d1/db/dd/d43/f50 [0,4194304] 0 2024-03-17T23:58:22.798 INFO:tasks.workunit.client.0.smithi196.stdout:5/269: symlink d6/d17/d3f/d4e/l57 0 2024-03-17T23:58:22.807 INFO:tasks.workunit.client.0.smithi196.stdout:9/314: fsync d9/df/d14/f1c 0 2024-03-17T23:58:22.814 INFO:tasks.workunit.client.0.smithi196.stdout:8/184: creat de/f31 x:0 0 0 2024-03-17T23:58:22.815 INFO:tasks.workunit.client.0.smithi196.stdout:5/270: dwrite d6/fb [4194304,4194304] 0 2024-03-17T23:58:22.818 INFO:tasks.workunit.client.0.smithi196.stdout:3/364: dwrite d7/d19/f32 [0,4194304] 0 2024-03-17T23:58:22.822 INFO:tasks.workunit.client.0.smithi196.stdout:2/373: dwrite d17/d22/d3d/f53 [0,4194304] 0 2024-03-17T23:58:22.830 INFO:tasks.workunit.client.0.smithi196.stdout:2/374: write d17/d28/d30/f6b [1302556,26182] 0 2024-03-17T23:58:22.830 INFO:tasks.workunit.client.0.smithi196.stdout:3/365: creat d7/d19/d26/d2b/d3c/f76 x:0 0 0 2024-03-17T23:58:22.831 INFO:tasks.workunit.client.0.smithi196.stdout:3/366: fdatasync d7/fd 0 2024-03-17T23:58:22.831 INFO:tasks.workunit.client.0.smithi196.stdout:9/315: dread d9/d12/d59/f63 [0,4194304] 0 2024-03-17T23:58:22.835 INFO:tasks.workunit.client.0.smithi196.stdout:8/185: dread de/f1f [0,4194304] 0 2024-03-17T23:58:22.836 INFO:tasks.workunit.client.0.smithi196.stdout:3/367: rename d7/f22 to d7/d19/d26/d2b/d3c/f77 0 2024-03-17T23:58:22.837 INFO:tasks.workunit.client.0.smithi196.stdout:9/316: creat d9/d12/d59/f65 x:0 0 0 2024-03-17T23:58:22.840 INFO:tasks.workunit.client.0.smithi196.stdout:3/368: truncate f6 628949 0 2024-03-17T23:58:22.840 INFO:tasks.workunit.client.0.smithi196.stdout:5/271: dread d6/d2d/f30 [0,4194304] 0 2024-03-17T23:58:22.841 INFO:tasks.workunit.client.0.smithi196.stdout:5/272: dread - d6/d17/d1f/f29 zero size 2024-03-17T23:58:22.843 INFO:tasks.workunit.client.0.smithi196.stdout:3/369: write d7/f58 [238667,8464] 0 2024-03-17T23:58:22.843 INFO:tasks.workunit.client.0.smithi196.stdout:9/317: read d9/df/f34 [529382,129552] 0 2024-03-17T23:58:22.845 INFO:tasks.workunit.client.0.smithi196.stdout:9/318: write d9/d38/f3f [126201,48948] 0 2024-03-17T23:58:22.846 INFO:tasks.workunit.client.0.smithi196.stdout:1/240: dread d1/f25 [0,4194304] 0 2024-03-17T23:58:22.848 INFO:tasks.workunit.client.0.smithi196.stdout:5/273: dread - d6/d17/d35/f41 zero size 2024-03-17T23:58:22.850 INFO:tasks.workunit.client.0.smithi196.stdout:2/375: dread d17/d1f/f23 [4194304,4194304] 0 2024-03-17T23:58:22.850 INFO:tasks.workunit.client.0.smithi196.stdout:5/274: dread - d6/d2a/f47 zero size 2024-03-17T23:58:22.851 INFO:tasks.workunit.client.0.smithi196.stdout:3/370: fsync d7/d19/d26/d2b/d3c/f76 0 2024-03-17T23:58:22.853 INFO:tasks.workunit.client.0.smithi196.stdout:9/319: truncate d9/df/d4a/f5a 619076 0 2024-03-17T23:58:22.853 INFO:tasks.workunit.client.0.smithi196.stdout:2/376: mkdir d17/d19/d93 0 2024-03-17T23:58:22.854 INFO:tasks.workunit.client.0.smithi196.stdout:1/241: read d1/d13/d23/d47/d48/f54 [217618,38973] 0 2024-03-17T23:58:22.855 INFO:tasks.workunit.client.0.smithi196.stdout:5/275: symlink d6/d2d/d33/d3b/l58 0 2024-03-17T23:58:22.857 INFO:tasks.workunit.client.0.smithi196.stdout:5/276: fdatasync d6/d17/d23/d53/f54 0 2024-03-17T23:58:22.858 INFO:tasks.workunit.client.0.smithi196.stdout:5/277: chown f4 1754 1 2024-03-17T23:58:22.861 INFO:tasks.workunit.client.0.smithi196.stdout:3/371: unlink d7/d19/d26/f3a 0 2024-03-17T23:58:22.862 INFO:tasks.workunit.client.0.smithi196.stdout:1/242: rmdir d1/db/dd/d34 39 2024-03-17T23:58:22.863 INFO:tasks.workunit.client.0.smithi196.stdout:2/377: unlink c10 0 2024-03-17T23:58:22.868 INFO:tasks.workunit.client.0.smithi196.stdout:5/278: dwrite d6/d17/d1f/f29 [0,4194304] 0 2024-03-17T23:58:22.868 INFO:tasks.workunit.client.0.smithi196.stdout:3/372: write d7/d19/d26/d2b/f44 [1022222,58271] 0 2024-03-17T23:58:22.870 INFO:tasks.workunit.client.0.smithi196.stdout:3/373: dread - d7/d19/d26/d2b/d3c/d3d/f65 zero size 2024-03-17T23:58:22.873 INFO:tasks.workunit.client.0.smithi196.stdout:9/320: truncate d9/df/d14/d27/f31 1226476 0 2024-03-17T23:58:22.875 INFO:tasks.workunit.client.0.smithi196.stdout:2/378: creat d17/d28/d30/f94 x:0 0 0 2024-03-17T23:58:22.877 INFO:tasks.workunit.client.0.smithi196.stdout:1/243: write d1/d13/d23/d47/d48/f54 [161849,5298] 0 2024-03-17T23:58:22.878 INFO:tasks.workunit.client.0.smithi196.stdout:2/379: dread - d17/d28/d30/d72/f8d zero size 2024-03-17T23:58:22.878 INFO:tasks.workunit.client.0.smithi196.stdout:3/374: fdatasync d7/f2c 0 2024-03-17T23:58:22.880 INFO:tasks.workunit.client.0.smithi196.stdout:1/244: chown d1/db/lc 7954105 1 2024-03-17T23:58:22.883 INFO:tasks.workunit.client.0.smithi196.stdout:5/279: getdents d6/d17/d3f/d4e 0 2024-03-17T23:58:22.886 INFO:tasks.workunit.client.0.smithi196.stdout:3/375: mkdir d7/d19/d78 0 2024-03-17T23:58:22.887 INFO:tasks.workunit.client.0.smithi196.stdout:3/376: read - d7/d19/d26/f72 zero size 2024-03-17T23:58:22.888 INFO:tasks.workunit.client.0.smithi196.stdout:5/280: symlink d6/d17/d23/l59 0 2024-03-17T23:58:22.890 INFO:tasks.workunit.client.0.smithi196.stdout:1/245: write d1/f4 [1557691,73582] 0 2024-03-17T23:58:22.891 INFO:tasks.workunit.client.0.smithi196.stdout:1/246: stat d1/db/dd/f12 0 2024-03-17T23:58:22.893 INFO:tasks.workunit.client.0.smithi196.stdout:2/380: rename d17/d22/d3d/l74 to d17/d22/l95 0 2024-03-17T23:58:22.894 INFO:tasks.workunit.client.0.smithi196.stdout:5/281: mknod d6/d17/d3f/c5a 0 2024-03-17T23:58:22.895 INFO:tasks.workunit.client.0.smithi196.stdout:5/282: write f3 [5308738,45969] 0 2024-03-17T23:58:22.897 INFO:tasks.workunit.client.0.smithi196.stdout:5/283: write d6/d17/f48 [782447,94860] 0 2024-03-17T23:58:22.899 INFO:tasks.workunit.client.0.smithi196.stdout:2/381: mkdir d17/d28/d96 0 2024-03-17T23:58:22.899 INFO:tasks.workunit.client.0.smithi196.stdout:3/377: link d7/d19/d26/d2b/d3c/d3d/c45 d7/d19/d26/d48/c79 0 2024-03-17T23:58:22.901 INFO:tasks.workunit.client.0.smithi196.stdout:5/284: mknod d6/d2d/d33/d3b/c5b 0 2024-03-17T23:58:22.901 INFO:tasks.workunit.client.0.smithi196.stdout:2/382: mknod d17/d28/d30/d71/c97 0 2024-03-17T23:58:22.902 INFO:tasks.workunit.client.0.smithi196.stdout:5/285: rmdir d6/d2d/d33 39 2024-03-17T23:58:22.903 INFO:tasks.workunit.client.0.smithi196.stdout:2/383: symlink d17/d28/d30/d71/l98 0 2024-03-17T23:58:22.905 INFO:tasks.workunit.client.0.smithi196.stdout:3/378: truncate d7/d19/d26/d2b/d3c/f77 983608 0 2024-03-17T23:58:22.908 INFO:tasks.workunit.client.0.smithi196.stdout:1/247: write d1/d13/d23/f49 [535294,7930] 0 2024-03-17T23:58:22.909 INFO:tasks.workunit.client.0.smithi196.stdout:2/384: fdatasync d17/f83 0 2024-03-17T23:58:22.911 INFO:tasks.workunit.client.0.smithi196.stdout:1/248: truncate d1/f57 732734 0 2024-03-17T23:58:22.912 INFO:tasks.workunit.client.0.smithi196.stdout:5/286: dwrite d6/ff [0,4194304] 0 2024-03-17T23:58:22.912 INFO:tasks.workunit.client.0.smithi196.stdout:2/385: mknod d17/d19/d44/c99 0 2024-03-17T23:58:22.918 INFO:tasks.workunit.client.0.smithi196.stdout:5/287: mkdir d6/d17/d1f/d5c 0 2024-03-17T23:58:22.919 INFO:tasks.workunit.client.0.smithi196.stdout:3/379: dread f6 [0,4194304] 0 2024-03-17T23:58:22.922 INFO:tasks.workunit.client.0.smithi196.stdout:3/380: read d7/d19/d26/d2b/f55 [151410,78833] 0 2024-03-17T23:58:22.923 INFO:tasks.workunit.client.0.smithi196.stdout:3/381: dread - d7/d19/d26/d2b/d3c/f76 zero size 2024-03-17T23:58:22.926 INFO:tasks.workunit.client.0.smithi196.stdout:2/386: dwrite d17/d22/d3d/f48 [0,4194304] 0 2024-03-17T23:58:22.932 INFO:tasks.workunit.client.0.smithi196.stdout:7/271: sync 2024-03-17T23:58:22.932 INFO:tasks.workunit.client.0.smithi196.stdout:6/249: sync 2024-03-17T23:58:22.933 INFO:tasks.workunit.client.0.smithi196.stdout:2/387: write d17/f83 [426309,1568] 0 2024-03-17T23:58:22.934 INFO:tasks.workunit.client.0.smithi196.stdout:5/288: dwrite f0 [0,4194304] 0 2024-03-17T23:58:22.935 INFO:tasks.workunit.client.0.smithi196.stdout:6/250: rmdir d2/d14/d42 39 2024-03-17T23:58:22.939 INFO:tasks.workunit.client.0.smithi196.stdout:6/251: fdatasync d2/d7/d2b/f3d 0 2024-03-17T23:58:22.941 INFO:tasks.workunit.client.0.smithi196.stdout:5/289: chown d6/f13 31533264 1 2024-03-17T23:58:22.942 INFO:tasks.workunit.client.0.smithi196.stdout:5/290: mknod d6/d15/d16/c5d 0 2024-03-17T23:58:22.944 INFO:tasks.workunit.client.0.smithi196.stdout:6/252: rename d2/d14/d27/d51 to d2/d14/d42/d57 0 2024-03-17T23:58:22.950 INFO:tasks.workunit.client.0.smithi196.stdout:3/382: dwrite d7/d19/d26/d2b/f61 [0,4194304] 0 2024-03-17T23:58:22.955 INFO:tasks.workunit.client.0.smithi196.stdout:2/388: dwrite d17/d28/d30/f6b [0,4194304] 0 2024-03-17T23:58:22.957 INFO:tasks.workunit.client.0.smithi196.stdout:7/272: dread da/d15/d1d/f3f [0,4194304] 0 2024-03-17T23:58:22.959 INFO:tasks.workunit.client.0.smithi196.stdout:6/253: symlink d2/d14/l58 0 2024-03-17T23:58:22.961 INFO:tasks.workunit.client.0.smithi196.stdout:2/389: mknod d17/d68/c9a 0 2024-03-17T23:58:22.964 INFO:tasks.workunit.client.0.smithi196.stdout:3/383: write d7/d19/d26/d2b/d3c/d3d/f5a [2697433,40191] 0 2024-03-17T23:58:22.966 INFO:tasks.workunit.client.0.smithi196.stdout:5/291: dread d6/fb [0,4194304] 0 2024-03-17T23:58:22.969 INFO:tasks.workunit.client.0.smithi196.stdout:5/292: truncate d6/d17/d35/f4f 942819 0 2024-03-17T23:58:22.969 INFO:tasks.workunit.client.0.smithi196.stdout:3/384: mknod d7/d19/d26/d48/c7a 0 2024-03-17T23:58:22.971 INFO:tasks.workunit.client.0.smithi196.stdout:5/293: fdatasync d6/d17/d23/d53/f54 0 2024-03-17T23:58:22.973 INFO:tasks.workunit.client.0.smithi196.stdout:3/385: unlink d7/d19/d26/d48/c50 0 2024-03-17T23:58:22.974 INFO:tasks.workunit.client.0.smithi196.stdout:7/273: dread da/d15/f25 [0,4194304] 0 2024-03-17T23:58:22.975 INFO:tasks.workunit.client.0.smithi196.stdout:5/294: dread d6/d2d/f30 [0,4194304] 0 2024-03-17T23:58:22.975 INFO:tasks.workunit.client.0.smithi196.stdout:3/386: readlink d7/d19/d26/l5d 0 2024-03-17T23:58:22.977 INFO:tasks.workunit.client.0.smithi196.stdout:5/295: dread d6/fe [0,4194304] 0 2024-03-17T23:58:22.977 INFO:tasks.workunit.client.0.smithi196.stdout:3/387: rmdir d7/d33 39 2024-03-17T23:58:22.979 INFO:tasks.workunit.client.0.smithi196.stdout:7/274: creat da/d15/d1d/d4c/f5b x:0 0 0 2024-03-17T23:58:22.982 INFO:tasks.workunit.client.0.smithi196.stdout:3/388: creat d7/d19/d26/d2b/d3c/f7b x:0 0 0 2024-03-17T23:58:22.983 INFO:tasks.workunit.client.0.smithi196.stdout:2/390: dread d17/d28/d30/d3b/f65 [0,4194304] 0 2024-03-17T23:58:22.984 INFO:tasks.workunit.client.0.smithi196.stdout:5/296: creat d6/d2d/d33/d3b/f5e x:0 0 0 2024-03-17T23:58:22.984 INFO:tasks.workunit.client.0.smithi196.stdout:2/391: fsync d17/d19/f41 0 2024-03-17T23:58:22.985 INFO:tasks.workunit.client.0.smithi196.stdout:3/389: fsync d7/d19/d26/f64 0 2024-03-17T23:58:22.988 INFO:tasks.workunit.client.0.smithi196.stdout:7/275: link da/d15/d1d/d4c/f5b da/f5c 0 2024-03-17T23:58:22.989 INFO:tasks.workunit.client.0.smithi196.stdout:5/297: mknod d6/d2d/d39/c5f 0 2024-03-17T23:58:22.994 INFO:tasks.workunit.client.0.smithi196.stdout:2/392: creat d17/d19/d44/d52/f9b x:0 0 0 2024-03-17T23:58:22.996 INFO:tasks.workunit.client.0.smithi196.stdout:3/390: dwrite d7/d19/f32 [4194304,4194304] 0 2024-03-17T23:58:22.998 INFO:tasks.workunit.client.0.smithi196.stdout:7/276: symlink da/d3e/d45/d4f/l5d 0 2024-03-17T23:58:22.999 INFO:tasks.workunit.client.0.smithi196.stdout:7/277: write da/d4d/f59 [1024122,68942] 0 2024-03-17T23:58:23.001 INFO:tasks.workunit.client.0.smithi196.stdout:7/278: truncate da/f5c 295400 0 2024-03-17T23:58:23.009 INFO:tasks.workunit.client.0.smithi196.stdout:2/393: link d17/f83 d17/d22/f9c 0 2024-03-17T23:58:23.009 INFO:tasks.workunit.client.0.smithi196.stdout:5/298: getdents d6/d2a 0 2024-03-17T23:58:23.010 INFO:tasks.workunit.client.0.smithi196.stdout:3/391: symlink d7/d19/d26/l7c 0 2024-03-17T23:58:23.011 INFO:tasks.workunit.client.0.smithi196.stdout:2/394: stat d17/d28/d30/d3b/c5b 0 2024-03-17T23:58:23.012 INFO:tasks.workunit.client.0.smithi196.stdout:2/395: stat d17/d22/c7f 0 2024-03-17T23:58:23.012 INFO:tasks.workunit.client.0.smithi196.stdout:5/299: mknod d6/d2d/d33/c60 0 2024-03-17T23:58:23.013 INFO:tasks.workunit.client.0.smithi196.stdout:3/392: mkdir d7/d19/d26/d2b/d3c/d3d/d7d 0 2024-03-17T23:58:23.015 INFO:tasks.workunit.client.0.smithi196.stdout:3/393: read - d7/d19/d26/d2b/d3c/d3d/f65 zero size 2024-03-17T23:58:23.016 INFO:tasks.workunit.client.0.smithi196.stdout:5/300: symlink d6/d17/d3f/l61 0 2024-03-17T23:58:23.018 INFO:tasks.workunit.client.0.smithi196.stdout:3/394: chown d7/d33/f56 13 1 2024-03-17T23:58:23.019 INFO:tasks.workunit.client.0.smithi196.stdout:7/279: dwrite da/d15/f27 [4194304,4194304] 0 2024-03-17T23:58:23.020 INFO:tasks.workunit.client.0.smithi196.stdout:5/301: mknod d6/d2a/c62 0 2024-03-17T23:58:23.026 INFO:tasks.workunit.client.0.smithi196.stdout:2/396: dwrite d17/d19/f4e [0,4194304] 0 2024-03-17T23:58:23.029 INFO:tasks.workunit.client.0.smithi196.stdout:2/397: write f4 [3907246,50846] 0 2024-03-17T23:58:23.032 INFO:tasks.workunit.client.0.smithi196.stdout:5/302: dwrite d6/f13 [0,4194304] 0 2024-03-17T23:58:23.033 INFO:tasks.workunit.client.0.smithi196.stdout:7/280: write da/f5c [616098,9411] 0 2024-03-17T23:58:23.035 INFO:tasks.workunit.client.0.smithi196.stdout:3/395: link d7/c18 d7/d19/d26/d2b/d3c/c7e 0 2024-03-17T23:58:23.036 INFO:tasks.workunit.client.0.smithi196.stdout:5/303: chown d6/d15/d16 21431689 1 2024-03-17T23:58:23.037 INFO:tasks.workunit.client.0.smithi196.stdout:5/304: read d6/fd [1086665,8921] 0 2024-03-17T23:58:23.040 INFO:tasks.workunit.client.0.smithi196.stdout:2/398: dread d17/d28/d30/f6b [0,4194304] 0 2024-03-17T23:58:23.046 INFO:tasks.workunit.client.0.smithi196.stdout:3/396: symlink d7/d19/d26/d2b/d3c/d3d/d7d/l7f 0 2024-03-17T23:58:23.046 INFO:tasks.workunit.client.0.smithi196.stdout:3/397: stat d7/d33/c4f 0 2024-03-17T23:58:23.046 INFO:tasks.workunit.client.0.smithi196.stdout:5/305: write d6/fb [6285438,103769] 0 2024-03-17T23:58:23.046 INFO:tasks.workunit.client.0.smithi196.stdout:7/281: getdents da/d3e/d45 0 2024-03-17T23:58:23.046 INFO:tasks.workunit.client.0.smithi196.stdout:5/306: dread - d6/d17/f26 zero size 2024-03-17T23:58:23.046 INFO:tasks.workunit.client.0.smithi196.stdout:3/398: dread - d7/d19/f30 zero size 2024-03-17T23:58:23.047 INFO:tasks.workunit.client.0.smithi196.stdout:7/282: mkdir da/d15/d1a/d5e 0 2024-03-17T23:58:23.048 INFO:tasks.workunit.client.0.smithi196.stdout:5/307: write d6/d15/d16/f24 [290458,104717] 0 2024-03-17T23:58:23.048 INFO:tasks.workunit.client.0.smithi196.stdout:7/283: fdatasync da/d15/d1d/d29/f5a 0 2024-03-17T23:58:23.049 INFO:tasks.workunit.client.0.smithi196.stdout:3/399: fsync d7/fd 0 2024-03-17T23:58:23.054 INFO:tasks.workunit.client.0.smithi196.stdout:5/308: mknod d6/d2d/c63 0 2024-03-17T23:58:23.054 INFO:tasks.workunit.client.0.smithi196.stdout:5/309: fdatasync d6/fb 0 2024-03-17T23:58:23.057 INFO:tasks.workunit.client.0.smithi196.stdout:2/399: rename d17/c42 to d17/d19/d44/d52/c9d 0 2024-03-17T23:58:23.057 INFO:tasks.workunit.client.0.smithi196.stdout:7/284: creat da/d15/d1a/d5e/f5f x:0 0 0 2024-03-17T23:58:23.060 INFO:tasks.workunit.client.0.smithi196.stdout:2/400: creat d17/d22/d3f/f9e x:0 0 0 2024-03-17T23:58:23.060 INFO:tasks.workunit.client.0.smithi196.stdout:7/285: rmdir da/d3e/d45 39 2024-03-17T23:58:23.062 INFO:tasks.workunit.client.0.smithi196.stdout:3/400: creat d7/f80 x:0 0 0 2024-03-17T23:58:23.062 INFO:tasks.workunit.client.0.smithi196.stdout:7/286: fdatasync da/d15/f27 0 2024-03-17T23:58:23.064 INFO:tasks.workunit.client.0.smithi196.stdout:5/310: dwrite f4 [0,4194304] 0 2024-03-17T23:58:23.066 INFO:tasks.workunit.client.0.smithi196.stdout:2/401: rename d17/d28/d30/d72/f8d to d17/d22/d3d/d8f/f9f 0 2024-03-17T23:58:23.067 INFO:tasks.workunit.client.0.smithi196.stdout:3/401: chown d7/d19/d26/d2b/f42 18192693 1 2024-03-17T23:58:23.069 INFO:tasks.workunit.client.0.smithi196.stdout:2/402: fdatasync d17/d22/d59/f80 0 2024-03-17T23:58:23.070 INFO:tasks.workunit.client.0.smithi196.stdout:3/402: stat d7/d19/d26/d2b/f3b 0 2024-03-17T23:58:23.074 INFO:tasks.workunit.client.0.smithi196.stdout:7/287: mkdir da/d3e/d45/d60 0 2024-03-17T23:58:23.074 INFO:tasks.workunit.client.0.smithi196.stdout:2/403: truncate d17/d28/d30/d71/f88 895614 0 2024-03-17T23:58:23.075 INFO:tasks.workunit.client.0.smithi196.stdout:2/404: dread - d17/d22/f39 zero size 2024-03-17T23:58:23.076 INFO:tasks.workunit.client.0.smithi196.stdout:7/288: creat da/d15/d1d/d4c/f61 x:0 0 0 2024-03-17T23:58:23.077 INFO:tasks.workunit.client.0.smithi196.stdout:7/289: chown da/d3e/d45/c56 1433375336 1 2024-03-17T23:58:23.080 INFO:tasks.workunit.client.0.smithi196.stdout:2/405: getdents d17/d19/d44 0 2024-03-17T23:58:23.085 INFO:tasks.workunit.client.0.smithi196.stdout:7/290: dwrite da/d15/f25 [0,4194304] 0 2024-03-17T23:58:23.087 INFO:tasks.workunit.client.0.smithi196.stdout:7/291: write da/d15/d1a/f37 [4749753,100990] 0 2024-03-17T23:58:23.088 INFO:tasks.workunit.client.0.smithi196.stdout:7/292: creat da/d15/d1a/d5e/f62 x:0 0 0 2024-03-17T23:58:23.091 INFO:tasks.workunit.client.0.smithi196.stdout:7/293: creat da/d15/d1d/f63 x:0 0 0 2024-03-17T23:58:23.093 INFO:tasks.workunit.client.0.smithi196.stdout:7/294: mknod da/d15/d1d/d4c/c64 0 2024-03-17T23:58:23.099 INFO:tasks.workunit.client.0.smithi196.stdout:0/306: sync 2024-03-17T23:58:23.099 INFO:tasks.workunit.client.0.smithi196.stdout:4/178: sync 2024-03-17T23:58:23.101 INFO:tasks.workunit.client.0.smithi196.stdout:0/307: chown d5/f44 111989937 1 2024-03-17T23:58:23.103 INFO:tasks.workunit.client.0.smithi196.stdout:0/308: truncate d5/f13 1209578 0 2024-03-17T23:58:23.105 INFO:tasks.workunit.client.0.smithi196.stdout:0/309: fsync d5/d23/d24/d28/d47/d52/f54 0 2024-03-17T23:58:23.106 INFO:tasks.workunit.client.0.smithi196.stdout:2/406: rename d17/d22/d3f to d17/d22/da0 0 2024-03-17T23:58:23.107 INFO:tasks.workunit.client.0.smithi196.stdout:4/179: write d1/de/f2d [989296,35562] 0 2024-03-17T23:58:23.108 INFO:tasks.workunit.client.0.smithi196.stdout:0/310: write d5/d23/d24/d28/f55 [17111,34783] 0 2024-03-17T23:58:23.109 INFO:tasks.workunit.client.0.smithi196.stdout:7/295: dwrite da/d15/d1d/d4c/f51 [0,4194304] 0 2024-03-17T23:58:23.110 INFO:tasks.workunit.client.0.smithi196.stdout:2/407: readlink d17/d19/l26 0 2024-03-17T23:58:23.111 INFO:tasks.workunit.client.0.smithi196.stdout:4/180: creat d1/f3a x:0 0 0 2024-03-17T23:58:23.117 INFO:tasks.workunit.client.0.smithi196.stdout:7/296: chown da/d15/d1d/d2e 3 1 2024-03-17T23:58:23.118 INFO:tasks.workunit.client.0.smithi196.stdout:4/181: write d1/d11/f19 [5072136,100209] 0 2024-03-17T23:58:23.118 INFO:tasks.workunit.client.0.smithi196.stdout:7/297: write da/d15/d1d/f2c [1020247,9863] 0 2024-03-17T23:58:23.118 INFO:tasks.workunit.client.0.smithi196.stdout:2/408: creat d17/d28/d30/d72/d81/fa1 x:0 0 0 2024-03-17T23:58:23.120 INFO:tasks.workunit.client.0.smithi196.stdout:4/182: creat d1/d26/f3b x:0 0 0 2024-03-17T23:58:23.123 INFO:tasks.workunit.client.0.smithi196.stdout:0/311: truncate d5/d23/d24/d28/d4f/f51 4078300 0 2024-03-17T23:58:23.124 INFO:tasks.workunit.client.0.smithi196.stdout:7/298: mknod da/d3e/d45/d60/c65 0 2024-03-17T23:58:23.126 INFO:tasks.workunit.client.0.smithi196.stdout:4/183: symlink d1/d1b/l3c 0 2024-03-17T23:58:23.127 INFO:tasks.workunit.client.0.smithi196.stdout:4/184: write d1/d11/f12 [157729,89264] 0 2024-03-17T23:58:23.130 INFO:tasks.workunit.client.0.smithi196.stdout:7/299: stat da/c22 0 2024-03-17T23:58:23.130 INFO:tasks.workunit.client.0.smithi196.stdout:7/300: fdatasync da/d15/d1d/f32 0 2024-03-17T23:58:23.135 INFO:tasks.workunit.client.0.smithi196.stdout:0/312: unlink d5/d23/d24/d28/d4f/f51 0 2024-03-17T23:58:23.137 INFO:tasks.workunit.client.0.smithi196.stdout:2/409: truncate f2 1960461 0 2024-03-17T23:58:23.141 INFO:tasks.workunit.client.0.smithi196.stdout:2/410: read d17/d28/f29 [886177,58640] 0 2024-03-17T23:58:23.143 INFO:tasks.workunit.client.0.smithi196.stdout:4/185: dwrite d1/fd [0,4194304] 0 2024-03-17T23:58:23.145 INFO:tasks.workunit.client.0.smithi196.stdout:2/411: chown d17/d19/f60 86 1 2024-03-17T23:58:23.145 INFO:tasks.workunit.client.0.smithi196.stdout:7/301: dwrite da/f16 [0,4194304] 0 2024-03-17T23:58:23.147 INFO:tasks.workunit.client.0.smithi196.stdout:0/313: dwrite d5/f3d [0,4194304] 0 2024-03-17T23:58:23.148 INFO:tasks.workunit.client.0.smithi196.stdout:7/302: chown da/d15/d1d/d29/d54/d57 183 1 2024-03-17T23:58:23.150 INFO:tasks.workunit.client.0.smithi196.stdout:7/303: write da/d15/d1d/d4c/f4e [4212523,58870] 0 2024-03-17T23:58:23.150 INFO:tasks.workunit.client.0.smithi196.stdout:4/186: rename d1/d26/f2f to d1/d11/f3d 0 2024-03-17T23:58:23.153 INFO:tasks.workunit.client.0.smithi196.stdout:2/412: unlink d17/d22/f4d 0 2024-03-17T23:58:23.156 INFO:tasks.workunit.client.0.smithi196.stdout:0/314: write d5/d23/d24/d28/f37 [3467840,18844] 0 2024-03-17T23:58:23.160 INFO:tasks.workunit.client.0.smithi196.stdout:7/304: creat da/d3e/d45/d4f/d43/f66 x:0 0 0 2024-03-17T23:58:23.163 INFO:tasks.workunit.client.0.smithi196.stdout:4/187: dwrite d1/d11/f12 [0,4194304] 0 2024-03-17T23:58:23.165 INFO:tasks.workunit.client.0.smithi196.stdout:4/188: chown d1/l9 384145 1 2024-03-17T23:58:23.169 INFO:tasks.workunit.client.0.smithi196.stdout:7/305: dread da/d15/f27 [4194304,4194304] 0 2024-03-17T23:58:23.171 INFO:tasks.workunit.client.0.smithi196.stdout:4/189: unlink d1/d11/f18 0 2024-03-17T23:58:23.174 INFO:tasks.workunit.client.0.smithi196.stdout:7/306: chown da/d15/d1a/l1e 8073 1 2024-03-17T23:58:23.176 INFO:tasks.workunit.client.0.smithi196.stdout:4/190: mknod d1/d26/c3e 0 2024-03-17T23:58:23.178 INFO:tasks.workunit.client.0.smithi196.stdout:7/307: creat da/d3e/d45/d4f/d43/f67 x:0 0 0 2024-03-17T23:58:23.181 INFO:tasks.workunit.client.0.smithi196.stdout:4/191: unlink d1/d26/f2b 0 2024-03-17T23:58:23.182 INFO:tasks.workunit.client.0.smithi196.stdout:4/192: rmdir d1 39 2024-03-17T23:58:23.184 INFO:tasks.workunit.client.0.smithi196.stdout:0/315: write d5/d23/d24/d28/f2e [1300146,120312] 0 2024-03-17T23:58:23.187 INFO:tasks.workunit.client.0.smithi196.stdout:2/413: truncate d17/d1f/f23 1121350 0 2024-03-17T23:58:23.189 INFO:tasks.workunit.client.0.smithi196.stdout:7/308: dwrite da/d4d/f59 [0,4194304] 0 2024-03-17T23:58:23.193 INFO:tasks.workunit.client.0.smithi196.stdout:2/414: mknod d17/d28/d30/d71/ca2 0 2024-03-17T23:58:23.196 INFO:tasks.workunit.client.0.smithi196.stdout:2/415: write d17/d28/d30/d72/d81/fa1 [371279,29705] 0 2024-03-17T23:58:23.198 INFO:tasks.workunit.client.0.smithi196.stdout:4/193: dwrite d1/f1d [0,4194304] 0 2024-03-17T23:58:23.200 INFO:tasks.workunit.client.0.smithi196.stdout:2/416: write d17/d19/f31 [1412744,41637] 0 2024-03-17T23:58:23.201 INFO:tasks.workunit.client.0.smithi196.stdout:4/194: dread - d1/d26/f3b zero size 2024-03-17T23:58:23.204 INFO:tasks.workunit.client.0.smithi196.stdout:0/316: dwrite d5/f1c [0,4194304] 0 2024-03-17T23:58:23.206 INFO:tasks.workunit.client.0.smithi196.stdout:4/195: chown d1/d11/f1c 2766 1 2024-03-17T23:58:23.208 INFO:tasks.workunit.client.0.smithi196.stdout:2/417: rename d17/d28/d30/d3b/l58 to d17/d68/la3 0 2024-03-17T23:58:23.210 INFO:tasks.workunit.client.0.smithi196.stdout:0/317: fdatasync d5/f10 0 2024-03-17T23:58:23.211 INFO:tasks.workunit.client.0.smithi196.stdout:0/318: write d5/d23/d24/d28/d47/d52/f54 [853128,72486] 0 2024-03-17T23:58:23.213 INFO:tasks.workunit.client.0.smithi196.stdout:7/309: dwrite da/d15/d1d/f2d [0,4194304] 0 2024-03-17T23:58:23.220 INFO:tasks.workunit.client.0.smithi196.stdout:2/418: write d17/d22/da0/f7b [1290208,115983] 0 2024-03-17T23:58:23.222 INFO:tasks.workunit.client.0.smithi196.stdout:2/419: write d17/d19/f69 [44171,61799] 0 2024-03-17T23:58:23.225 INFO:tasks.workunit.client.0.smithi196.stdout:0/319: mknod d5/c58 0 2024-03-17T23:58:23.229 INFO:tasks.workunit.client.0.smithi196.stdout:7/310: readlink da/d3e/d45/d4f/d43/l49 0 2024-03-17T23:58:23.234 INFO:tasks.workunit.client.0.smithi196.stdout:2/420: rmdir d17/d22/da0 39 2024-03-17T23:58:23.236 INFO:tasks.workunit.client.0.smithi196.stdout:4/196: getdents d1/d1b 0 2024-03-17T23:58:23.238 INFO:tasks.workunit.client.0.smithi196.stdout:4/197: write d1/de/f21 [2147670,31116] 0 2024-03-17T23:58:23.238 INFO:tasks.workunit.client.0.smithi196.stdout:0/320: rename d5/d23/d24/d28/d4f to d5/d23/d24/d59 0 2024-03-17T23:58:23.241 INFO:tasks.workunit.client.0.smithi196.stdout:0/321: read d5/f1c [1800417,19772] 0 2024-03-17T23:58:23.241 INFO:tasks.workunit.client.0.smithi196.stdout:4/198: chown d1/l3 26108105 1 2024-03-17T23:58:23.242 INFO:tasks.workunit.client.0.smithi196.stdout:7/311: dwrite f8 [4194304,4194304] 0 2024-03-17T23:58:23.244 INFO:tasks.workunit.client.0.smithi196.stdout:0/322: fdatasync d5/d23/d24/d28/d47/d52/f3f 0 2024-03-17T23:58:23.244 INFO:tasks.workunit.client.0.smithi196.stdout:2/421: getdents d17/d28/d30/d71 0 2024-03-17T23:58:23.246 INFO:tasks.workunit.client.0.smithi196.stdout:0/323: chown d5/d23/d24/d28/l53 40 1 2024-03-17T23:58:23.246 INFO:tasks.workunit.client.0.smithi196.stdout:4/199: stat d1/d26/c3e 0 2024-03-17T23:58:23.249 INFO:tasks.workunit.client.0.smithi196.stdout:7/312: creat da/d15/d1d/d29/d54/d57/f68 x:0 0 0 2024-03-17T23:58:23.250 INFO:tasks.workunit.client.0.smithi196.stdout:7/313: write da/f13 [1916893,110096] 0 2024-03-17T23:58:23.253 INFO:tasks.workunit.client.0.smithi196.stdout:2/422: getdents d17/d22/d59 0 2024-03-17T23:58:23.255 INFO:tasks.workunit.client.0.smithi196.stdout:7/314: stat da/d15/d1a/f44 0 2024-03-17T23:58:23.257 INFO:tasks.workunit.client.0.smithi196.stdout:4/200: dwrite d1/d11/f19 [4194304,4194304] 0 2024-03-17T23:58:23.259 INFO:tasks.workunit.client.0.smithi196.stdout:2/423: fsync d17/d22/da0/f5a 0 2024-03-17T23:58:23.261 INFO:tasks.workunit.client.0.smithi196.stdout:7/315: creat da/d15/d1d/d2e/f69 x:0 0 0 2024-03-17T23:58:23.261 INFO:tasks.workunit.client.0.smithi196.stdout:2/424: fsync d17/d28/d30/f94 0 2024-03-17T23:58:23.261 INFO:tasks.workunit.client.0.smithi196.stdout:4/201: stat d1/d26/c2e 0 2024-03-17T23:58:23.265 INFO:tasks.workunit.client.0.smithi196.stdout:4/202: mkdir d1/d26/d33/d3f 0 2024-03-17T23:58:23.266 INFO:tasks.workunit.client.0.smithi196.stdout:7/316: symlink da/d15/d1a/l6a 0 2024-03-17T23:58:23.266 INFO:tasks.workunit.client.0.smithi196.stdout:0/324: dwrite d5/f13 [0,4194304] 0 2024-03-17T23:58:23.269 INFO:tasks.workunit.client.0.smithi196.stdout:4/203: stat d1/d26/l29 0 2024-03-17T23:58:23.272 INFO:tasks.workunit.client.0.smithi196.stdout:7/317: truncate da/d15/d1d/d29/f53 133363 0 2024-03-17T23:58:23.273 INFO:tasks.workunit.client.0.smithi196.stdout:4/204: write d1/f3a [877392,99559] 0 2024-03-17T23:58:23.273 INFO:tasks.workunit.client.0.smithi196.stdout:2/425: dwrite d17/f83 [0,4194304] 0 2024-03-17T23:58:23.280 INFO:tasks.workunit.client.0.smithi196.stdout:7/318: readlink da/l42 0 2024-03-17T23:58:23.282 INFO:tasks.workunit.client.0.smithi196.stdout:4/205: write d1/f1d [2465284,44638] 0 2024-03-17T23:58:23.282 INFO:tasks.workunit.client.0.smithi196.stdout:7/319: fsync da/f13 0 2024-03-17T23:58:23.283 INFO:tasks.workunit.client.0.smithi196.stdout:0/325: rename d5/d23/d24/d28/l25 to d5/d23/d24/d28/d47/d52/d49/l5a 0 2024-03-17T23:58:23.283 INFO:tasks.workunit.client.0.smithi196.stdout:4/206: fdatasync d1/f3a 0 2024-03-17T23:58:23.284 INFO:tasks.workunit.client.0.smithi196.stdout:4/207: chown d1/d11/c38 115 1 2024-03-17T23:58:23.286 INFO:tasks.workunit.client.0.smithi196.stdout:2/426: link d17/f2a d17/d28/d30/d72/d81/fa4 0 2024-03-17T23:58:23.287 INFO:tasks.workunit.client.0.smithi196.stdout:4/208: mkdir d1/d26/d33/d40 0 2024-03-17T23:58:23.289 INFO:tasks.workunit.client.0.smithi196.stdout:7/320: truncate da/d15/d1d/d29/f5a 1440347 0 2024-03-17T23:58:23.291 INFO:tasks.workunit.client.0.smithi196.stdout:7/321: fdatasync da/d15/d1d/d4c/f5b 0 2024-03-17T23:58:23.301 INFO:tasks.workunit.client.0.smithi196.stdout:4/209: dread d1/de/f21 [0,4194304] 0 2024-03-17T23:58:23.301 INFO:tasks.workunit.client.0.smithi196.stdout:7/322: dwrite da/d15/d1d/f2d [0,4194304] 0 2024-03-17T23:58:23.302 INFO:tasks.workunit.client.0.smithi196.stdout:2/427: truncate d17/d28/d30/d72/d81/fa4 546710 0 2024-03-17T23:58:23.304 INFO:tasks.workunit.client.0.smithi196.stdout:4/210: write d1/d11/f19 [8583722,4087] 0 2024-03-17T23:58:23.305 INFO:tasks.workunit.client.0.smithi196.stdout:7/323: write da/f1c [4942251,58871] 0 2024-03-17T23:58:23.306 INFO:tasks.workunit.client.0.smithi196.stdout:4/211: symlink d1/l41 0 2024-03-17T23:58:23.307 INFO:tasks.workunit.client.0.smithi196.stdout:7/324: dread - da/d15/d1d/f63 zero size 2024-03-17T23:58:23.308 INFO:tasks.workunit.client.0.smithi196.stdout:4/212: symlink d1/de/l42 0 2024-03-17T23:58:23.309 INFO:tasks.workunit.client.0.smithi196.stdout:7/325: mknod da/d3e/d45/c6b 0 2024-03-17T23:58:23.314 INFO:tasks.workunit.client.0.smithi196.stdout:4/213: mkdir d1/d26/d33/d40/d43 0 2024-03-17T23:58:23.317 INFO:tasks.workunit.client.0.smithi196.stdout:4/214: symlink d1/d26/d33/d40/l44 0 2024-03-17T23:58:23.326 INFO:tasks.workunit.client.0.smithi196.stdout:4/215: dwrite d1/d11/f3d [0,4194304] 0 2024-03-17T23:58:23.332 INFO:tasks.workunit.client.0.smithi196.stdout:7/326: dread da/d15/d1d/f32 [0,4194304] 0 2024-03-17T23:58:23.332 INFO:tasks.workunit.client.0.smithi196.stdout:7/327: chown da/c35 101099 1 2024-03-17T23:58:23.332 INFO:tasks.workunit.client.0.smithi196.stdout:7/328: write da/d3e/d45/d4f/d43/f67 [516727,55163] 0 2024-03-17T23:58:23.334 INFO:tasks.workunit.client.0.smithi196.stdout:4/216: dread d1/de/f2d [0,4194304] 0 2024-03-17T23:58:23.335 INFO:tasks.workunit.client.0.smithi196.stdout:7/329: creat da/d15/d1d/d4c/f6c x:0 0 0 2024-03-17T23:58:23.337 INFO:tasks.workunit.client.0.smithi196.stdout:4/217: unlink d1/l2 0 2024-03-17T23:58:23.338 INFO:tasks.workunit.client.0.smithi196.stdout:7/330: mkdir da/d3e/d6d 0 2024-03-17T23:58:23.339 INFO:tasks.workunit.client.0.smithi196.stdout:4/218: chown d1/de/c1a 135206254 1 2024-03-17T23:58:23.342 INFO:tasks.workunit.client.0.smithi196.stdout:4/219: getdents d1/d26/d33/d40/d43 0 2024-03-17T23:58:23.347 INFO:tasks.workunit.client.0.smithi196.stdout:4/220: rename d1/d26/f2a to d1/d26/d33/f45 0 2024-03-17T23:58:23.349 INFO:tasks.workunit.client.0.smithi196.stdout:7/331: dwrite da/f16 [0,4194304] 0 2024-03-17T23:58:23.352 INFO:tasks.workunit.client.0.smithi196.stdout:7/332: unlink da/d15/d1d/l2a 0 2024-03-17T23:58:23.354 INFO:tasks.workunit.client.0.smithi196.stdout:7/333: truncate da/d15/d1d/d4c/f61 496667 0 2024-03-17T23:58:23.356 INFO:tasks.workunit.client.0.smithi196.stdout:7/334: write da/d3e/d45/d4f/d43/f67 [23688,121484] 0 2024-03-17T23:58:23.356 INFO:tasks.workunit.client.0.smithi196.stdout:4/221: write d1/d26/d33/f45 [330168,47988] 0 2024-03-17T23:58:23.359 INFO:tasks.workunit.client.0.smithi196.stdout:7/335: write da/d15/d1d/f3f [456109,12587] 0 2024-03-17T23:58:23.359 INFO:tasks.workunit.client.0.smithi196.stdout:4/222: mknod d1/d26/c46 0 2024-03-17T23:58:23.367 INFO:tasks.workunit.client.0.smithi196.stdout:7/336: dwrite da/d15/f27 [4194304,4194304] 0 2024-03-17T23:58:23.369 INFO:tasks.workunit.client.0.smithi196.stdout:8/186: sync 2024-03-17T23:58:23.369 INFO:tasks.workunit.client.0.smithi196.stdout:7/337: fsync da/d15/d1a/f37 0 2024-03-17T23:58:23.373 INFO:tasks.workunit.client.0.smithi196.stdout:7/338: creat da/d3e/d45/f6e x:0 0 0 2024-03-17T23:58:23.373 INFO:tasks.workunit.client.0.smithi196.stdout:8/187: mknod de/c32 0 2024-03-17T23:58:23.375 INFO:tasks.workunit.client.0.smithi196.stdout:4/223: dread d1/f2c [0,4194304] 0 2024-03-17T23:58:23.376 INFO:tasks.workunit.client.0.smithi196.stdout:8/188: mkdir de/d2b/d30/d33 0 2024-03-17T23:58:23.376 INFO:tasks.workunit.client.0.smithi196.stdout:7/339: dread da/d15/d1d/d4c/f61 [0,4194304] 0 2024-03-17T23:58:23.377 INFO:tasks.workunit.client.0.smithi196.stdout:4/224: chown d1/d26/d33/f45 4 1 2024-03-17T23:58:23.423 INFO:tasks.workunit.client.0.smithi196.stdout:7/340: rmdir da/d4d 39 2024-03-17T23:58:23.424 INFO:tasks.workunit.client.0.smithi196.stdout:7/341: chown da/d15/d1d/d4c/f4e 30 1 2024-03-17T23:58:23.424 INFO:tasks.workunit.client.0.smithi196.stdout:8/189: symlink de/d2b/l34 0 2024-03-17T23:58:23.426 INFO:tasks.workunit.client.0.smithi196.stdout:8/190: mkdir de/d10/d35 0 2024-03-17T23:58:23.427 INFO:tasks.workunit.client.0.smithi196.stdout:4/225: symlink d1/d11/l47 0 2024-03-17T23:58:23.429 INFO:tasks.workunit.client.0.smithi196.stdout:7/342: mkdir da/d3e/d6f 0 2024-03-17T23:58:23.430 INFO:tasks.workunit.client.0.smithi196.stdout:4/226: dread - d1/d26/f3b zero size 2024-03-17T23:58:23.431 INFO:tasks.workunit.client.0.smithi196.stdout:8/191: symlink de/d10/d35/l36 0 2024-03-17T23:58:23.432 INFO:tasks.workunit.client.0.smithi196.stdout:7/343: mkdir da/d15/d1a/d5e/d70 0 2024-03-17T23:58:23.433 INFO:tasks.workunit.client.0.smithi196.stdout:4/227: chown d1/l9 152075 1 2024-03-17T23:58:23.435 INFO:tasks.workunit.client.0.smithi196.stdout:7/344: read da/d15/d1d/f23 [924156,35502] 0 2024-03-17T23:58:23.436 INFO:tasks.workunit.client.0.smithi196.stdout:8/192: fsync de/f1d 0 2024-03-17T23:58:23.437 INFO:tasks.workunit.client.0.smithi196.stdout:7/345: write da/d15/d1a/f37 [2201183,67175] 0 2024-03-17T23:58:23.440 INFO:tasks.workunit.client.0.smithi196.stdout:7/346: write da/d15/d1a/f37 [2977680,102802] 0 2024-03-17T23:58:23.445 INFO:tasks.workunit.client.0.smithi196.stdout:4/228: rename d1/lc to d1/l48 0 2024-03-17T23:58:23.447 INFO:tasks.workunit.client.0.smithi196.stdout:8/193: dwrite de/f19 [0,4194304] 0 2024-03-17T23:58:23.453 INFO:tasks.workunit.client.0.smithi196.stdout:7/347: link da/d15/d1d/d4c/f6c da/d3e/d45/f71 0 2024-03-17T23:58:23.454 INFO:tasks.workunit.client.0.smithi196.stdout:8/194: creat de/d2b/d30/d33/f37 x:0 0 0 2024-03-17T23:58:23.458 INFO:tasks.workunit.client.0.smithi196.stdout:7/348: rename da/d15/d1d/f63 to da/d15/d1d/d29/d54/f72 0 2024-03-17T23:58:23.463 INFO:tasks.workunit.client.0.smithi196.stdout:8/195: link de/ff de/d2b/f38 0 2024-03-17T23:58:23.471 INFO:tasks.workunit.client.0.smithi196.stdout:7/349: dwrite da/f39 [4194304,4194304] 0 2024-03-17T23:58:23.474 INFO:tasks.workunit.client.0.smithi196.stdout:4/229: dwrite d1/d11/f19 [0,4194304] 0 2024-03-17T23:58:23.482 INFO:tasks.workunit.client.0.smithi196.stdout:8/196: dwrite de/d10/f2e [0,4194304] 0 2024-03-17T23:58:23.482 INFO:tasks.workunit.client.0.smithi196.stdout:7/350: rename da/f39 to da/d3e/d45/f73 0 2024-03-17T23:58:23.484 INFO:tasks.workunit.client.0.smithi196.stdout:4/230: symlink d1/d1b/l49 0 2024-03-17T23:58:23.485 INFO:tasks.workunit.client.0.smithi196.stdout:8/197: creat de/f39 x:0 0 0 2024-03-17T23:58:23.486 INFO:tasks.workunit.client.0.smithi196.stdout:8/198: chown de/d10/f27 59108 1 2024-03-17T23:58:23.494 INFO:tasks.workunit.client.0.smithi196.stdout:4/231: dwrite d1/f1d [0,4194304] 0 2024-03-17T23:58:23.501 INFO:tasks.workunit.client.0.smithi196.stdout:7/351: dread da/f13 [0,4194304] 0 2024-03-17T23:58:23.501 INFO:tasks.workunit.client.0.smithi196.stdout:4/232: mkdir d1/d26/d33/d40/d43/d4a 0 2024-03-17T23:58:23.501 INFO:tasks.workunit.client.0.smithi196.stdout:8/199: dwrite de/d10/f14 [0,4194304] 0 2024-03-17T23:58:23.503 INFO:tasks.workunit.client.0.smithi196.stdout:4/233: chown d1/d11/f12 3767 1 2024-03-17T23:58:23.503 INFO:tasks.workunit.client.0.smithi196.stdout:7/352: rmdir da/d15/d1d/d29 39 2024-03-17T23:58:23.504 INFO:tasks.workunit.client.0.smithi196.stdout:8/200: truncate de/d10/f1a 1031142 0 2024-03-17T23:58:23.507 INFO:tasks.workunit.client.0.smithi196.stdout:4/234: creat d1/de/f4b x:0 0 0 2024-03-17T23:58:23.507 INFO:tasks.workunit.client.0.smithi196.stdout:8/201: unlink de/d10/l16 0 2024-03-17T23:58:23.508 INFO:tasks.workunit.client.0.smithi196.stdout:8/202: chown de/d2b/l34 50442510 1 2024-03-17T23:58:23.509 INFO:tasks.workunit.client.0.smithi196.stdout:7/353: mknod da/d15/c74 0 2024-03-17T23:58:23.509 INFO:tasks.workunit.client.0.smithi196.stdout:4/235: symlink d1/d11/l4c 0 2024-03-17T23:58:23.520 INFO:tasks.workunit.client.0.smithi196.stdout:4/236: truncate d1/d11/f12 3432853 0 2024-03-17T23:58:23.520 INFO:tasks.workunit.client.0.smithi196.stdout:8/203: dwrite de/f31 [0,4194304] 0 2024-03-17T23:58:23.522 INFO:tasks.workunit.client.0.smithi196.stdout:4/237: write d1/d26/f3b [1012964,70762] 0 2024-03-17T23:58:23.523 INFO:tasks.workunit.client.0.smithi196.stdout:4/238: write d1/de/f4b [1011111,84283] 0 2024-03-17T23:58:23.529 INFO:tasks.workunit.client.0.smithi196.stdout:8/204: creat de/d2b/d30/f3a x:0 0 0 2024-03-17T23:58:23.529 INFO:tasks.workunit.client.0.smithi196.stdout:7/354: dread da/d15/f17 [0,4194304] 0 2024-03-17T23:58:23.532 INFO:tasks.workunit.client.0.smithi196.stdout:4/239: rename d1/lf to d1/d26/d33/l4d 0 2024-03-17T23:58:23.533 INFO:tasks.workunit.client.0.smithi196.stdout:8/205: rename de/d10/f27 to de/d10/f3b 0 2024-03-17T23:58:23.534 INFO:tasks.workunit.client.0.smithi196.stdout:7/355: mkdir da/d3e/d45/d4f/d75 0 2024-03-17T23:58:23.535 INFO:tasks.workunit.client.0.smithi196.stdout:8/206: mkdir de/d2b/d3c 0 2024-03-17T23:58:23.539 INFO:tasks.workunit.client.0.smithi196.stdout:7/356: rename da/d3e/d45/f6e to da/d15/d1d/d29/f76 0 2024-03-17T23:58:23.543 INFO:tasks.workunit.client.0.smithi196.stdout:8/207: link de/f2d de/d2b/d30/d33/f3d 0 2024-03-17T23:58:23.546 INFO:tasks.workunit.client.0.smithi196.stdout:4/240: write d1/de/f4b [20327,124864] 0 2024-03-17T23:58:23.546 INFO:tasks.workunit.client.0.smithi196.stdout:8/208: truncate de/d2b/d30/d33/f37 886074 0 2024-03-17T23:58:23.551 INFO:tasks.workunit.client.0.smithi196.stdout:4/241: dread d1/f3a [0,4194304] 0 2024-03-17T23:58:23.552 INFO:tasks.workunit.client.0.smithi196.stdout:4/242: write d1/f3a [1490108,60594] 0 2024-03-17T23:58:23.558 INFO:tasks.workunit.client.0.smithi196.stdout:8/209: truncate de/f15 2781323 0 2024-03-17T23:58:23.558 INFO:tasks.workunit.client.0.smithi196.stdout:4/243: dread d1/d11/f19 [0,4194304] 0 2024-03-17T23:58:23.566 INFO:tasks.workunit.client.0.smithi196.stdout:8/210: dwrite de/d10/f14 [0,4194304] 0 2024-03-17T23:58:23.575 INFO:tasks.workunit.client.0.smithi196.stdout:8/211: getdents de/d2b/d30 0 2024-03-17T23:58:23.575 INFO:tasks.workunit.client.0.smithi196.stdout:4/244: dwrite d1/d11/f12 [0,4194304] 0 2024-03-17T23:58:23.579 INFO:tasks.workunit.client.0.smithi196.stdout:4/245: symlink d1/d26/d33/d3f/l4e 0 2024-03-17T23:58:23.581 INFO:tasks.workunit.client.0.smithi196.stdout:4/246: creat d1/d26/d33/f4f x:0 0 0 2024-03-17T23:58:23.584 INFO:tasks.workunit.client.0.smithi196.stdout:4/247: mkdir d1/de/d50 0 2024-03-17T23:58:23.587 INFO:tasks.workunit.client.0.smithi196.stdout:4/248: creat d1/de/d50/f51 x:0 0 0 2024-03-17T23:58:23.593 INFO:tasks.workunit.client.0.smithi196.stdout:4/249: write d1/d26/f39 [869582,108697] 0 2024-03-17T23:58:23.614 INFO:tasks.workunit.client.0.smithi196.stdout:1/249: sync 2024-03-17T23:58:23.614 INFO:tasks.workunit.client.0.smithi196.stdout:9/321: sync 2024-03-17T23:58:23.614 INFO:tasks.workunit.client.0.smithi196.stdout:4/250: mknod d1/de/c52 0 2024-03-17T23:58:23.618 INFO:tasks.workunit.client.0.smithi196.stdout:1/250: creat d1/d13/d23/d47/f63 x:0 0 0 2024-03-17T23:58:23.620 INFO:tasks.workunit.client.0.smithi196.stdout:9/322: rename d9/d33/c39 to d9/d38/d60/c66 0 2024-03-17T23:58:23.621 INFO:tasks.workunit.client.0.smithi196.stdout:1/251: dread - d1/fa zero size 2024-03-17T23:58:23.624 INFO:tasks.workunit.client.0.smithi196.stdout:9/323: chown d9/df/d14/d27/f31 1834923043 1 2024-03-17T23:58:23.625 INFO:tasks.workunit.client.0.smithi196.stdout:4/251: dwrite d1/de/d50/f51 [0,4194304] 0 2024-03-17T23:58:23.631 INFO:tasks.workunit.client.0.smithi196.stdout:9/324: dread d9/df/d14/d27/f4c [0,4194304] 0 2024-03-17T23:58:23.633 INFO:tasks.workunit.client.0.smithi196.stdout:4/252: dread d1/d11/f3d [0,4194304] 0 2024-03-17T23:58:23.636 INFO:tasks.workunit.client.0.smithi196.stdout:9/325: symlink d9/df/d14/d3d/l67 0 2024-03-17T23:58:23.636 INFO:tasks.workunit.client.0.smithi196.stdout:1/252: dwrite d1/db/dd/d43/f50 [0,4194304] 0 2024-03-17T23:58:23.636 INFO:tasks.workunit.client.0.smithi196.stdout:4/253: stat d1/d1b/c22 0 2024-03-17T23:58:23.639 INFO:tasks.workunit.client.0.smithi196.stdout:4/254: truncate d1/d26/d33/f45 447855 0 2024-03-17T23:58:23.643 INFO:tasks.workunit.client.0.smithi196.stdout:9/326: creat d9/d38/d60/f68 x:0 0 0 2024-03-17T23:58:23.643 INFO:tasks.workunit.client.0.smithi196.stdout:1/253: mkdir d1/db/dd/d43/d64 0 2024-03-17T23:58:23.644 INFO:tasks.workunit.client.0.smithi196.stdout:1/254: chown d1/d13/d4c 519757805 1 2024-03-17T23:58:23.644 INFO:tasks.workunit.client.0.smithi196.stdout:9/327: stat d9/df/d4a 0 2024-03-17T23:58:23.647 INFO:tasks.workunit.client.0.smithi196.stdout:1/255: chown d1/db/dd/d34/c5b 1 1 2024-03-17T23:58:23.649 INFO:tasks.workunit.client.0.smithi196.stdout:4/255: dwrite d1/de/d50/f51 [0,4194304] 0 2024-03-17T23:58:23.652 INFO:tasks.workunit.client.0.smithi196.stdout:9/328: creat d9/f69 x:0 0 0 2024-03-17T23:58:23.653 INFO:tasks.workunit.client.0.smithi196.stdout:4/256: dread d1/f3a [0,4194304] 0 2024-03-17T23:58:23.654 INFO:tasks.workunit.client.0.smithi196.stdout:9/329: mknod d9/d38/d60/c6a 0 2024-03-17T23:58:23.655 INFO:tasks.workunit.client.0.smithi196.stdout:4/257: fdatasync d1/d11/f19 0 2024-03-17T23:58:23.658 INFO:tasks.workunit.client.0.smithi196.stdout:1/256: dwrite d1/f57 [0,4194304] 0 2024-03-17T23:58:23.658 INFO:tasks.workunit.client.0.smithi196.stdout:4/258: symlink d1/de/l53 0 2024-03-17T23:58:23.659 INFO:tasks.workunit.client.0.smithi196.stdout:1/257: readlink d1/db/l19 0 2024-03-17T23:58:23.660 INFO:tasks.workunit.client.0.smithi196.stdout:1/258: chown d1/l58 783 1 2024-03-17T23:58:23.662 INFO:tasks.workunit.client.0.smithi196.stdout:4/259: symlink d1/d26/d33/d40/d43/d4a/l54 0 2024-03-17T23:58:23.672 INFO:tasks.workunit.client.0.smithi196.stdout:1/259: dwrite d1/db/dd/f38 [0,4194304] 0 2024-03-17T23:58:23.676 INFO:tasks.workunit.client.0.smithi196.stdout:4/260: rename d1/d26/d33/d40/d43 to d1/de/d50/d55 0 2024-03-17T23:58:23.679 INFO:tasks.workunit.client.0.smithi196.stdout:4/261: creat d1/de/f56 x:0 0 0 2024-03-17T23:58:23.685 INFO:tasks.workunit.client.0.smithi196.stdout:9/330: dread d9/f25 [0,4194304] 0 2024-03-17T23:58:23.685 INFO:tasks.workunit.client.0.smithi196.stdout:1/260: dwrite d1/d13/f5a [0,4194304] 0 2024-03-17T23:58:23.688 INFO:tasks.workunit.client.0.smithi196.stdout:4/262: dread d1/fd [0,4194304] 0 2024-03-17T23:58:23.691 INFO:tasks.workunit.client.0.smithi196.stdout:1/261: getdents d1/d13/d23/d62 0 2024-03-17T23:58:23.695 INFO:tasks.workunit.client.0.smithi196.stdout:4/263: dread d1/d11/f3d [0,4194304] 0 2024-03-17T23:58:23.695 INFO:tasks.workunit.client.0.smithi196.stdout:9/331: link d9/d12/d59/f63 d9/df/d14/f6b 0 2024-03-17T23:58:23.698 INFO:tasks.workunit.client.0.smithi196.stdout:4/264: mkdir d1/d26/d57 0 2024-03-17T23:58:23.698 INFO:tasks.workunit.client.0.smithi196.stdout:9/332: truncate d9/d38/d60/f48 79348 0 2024-03-17T23:58:23.701 INFO:tasks.workunit.client.0.smithi196.stdout:1/262: dwrite d1/db/f15 [0,4194304] 0 2024-03-17T23:58:23.706 INFO:tasks.workunit.client.0.smithi196.stdout:1/263: unlink d1/d13/d23/f29 0 2024-03-17T23:58:23.706 INFO:tasks.workunit.client.0.smithi196.stdout:4/265: dread d1/de/f4b [0,4194304] 0 2024-03-17T23:58:23.711 INFO:tasks.workunit.client.0.smithi196.stdout:9/333: dread d9/df/d14/d3d/f3e [0,4194304] 0 2024-03-17T23:58:23.712 INFO:tasks.workunit.client.0.smithi196.stdout:1/264: rename d1/d13/d23/c5e to d1/d13/d23/d47/c65 0 2024-03-17T23:58:23.712 INFO:tasks.workunit.client.0.smithi196.stdout:9/334: fdatasync d9/d33/f5f 0 2024-03-17T23:58:23.714 INFO:tasks.workunit.client.0.smithi196.stdout:1/265: fsync d1/d13/d23/f49 0 2024-03-17T23:58:23.715 INFO:tasks.workunit.client.0.smithi196.stdout:4/266: dread d1/f2c [0,4194304] 0 2024-03-17T23:58:23.719 INFO:tasks.workunit.client.0.smithi196.stdout:1/266: dread d1/d13/d23/f49 [0,4194304] 0 2024-03-17T23:58:23.722 INFO:tasks.workunit.client.0.smithi196.stdout:9/335: dwrite d9/fd [4194304,4194304] 0 2024-03-17T23:58:23.723 INFO:tasks.workunit.client.0.smithi196.stdout:9/336: chown d9/df/d14/d27/f3a 3714507 1 2024-03-17T23:58:23.730 INFO:tasks.workunit.client.0.smithi196.stdout:1/267: dwrite d1/db/fe [4194304,4194304] 0 2024-03-17T23:58:23.731 INFO:tasks.workunit.client.0.smithi196.stdout:9/337: write d9/d12/f16 [4161964,128388] 0 2024-03-17T23:58:23.746 INFO:tasks.workunit.client.0.smithi196.stdout:1/268: dread d1/d13/f24 [0,4194304] 0 2024-03-17T23:58:23.748 INFO:tasks.workunit.client.0.smithi196.stdout:9/338: dread d9/f44 [0,4194304] 0 2024-03-17T23:58:23.753 INFO:tasks.workunit.client.0.smithi196.stdout:9/339: link d9/df/d14/d3d/l67 d9/df/d55/l6c 0 2024-03-17T23:58:23.755 INFO:tasks.workunit.client.0.smithi196.stdout:1/269: dwrite d1/d13/f3b [0,4194304] 0 2024-03-17T23:58:23.757 INFO:tasks.workunit.client.0.smithi196.stdout:9/340: dread d9/df/d4a/f5a [0,4194304] 0 2024-03-17T23:58:23.759 INFO:tasks.workunit.client.0.smithi196.stdout:1/270: symlink d1/d13/d23/d47/d48/l66 0 2024-03-17T23:58:23.766 INFO:tasks.workunit.client.0.smithi196.stdout:6/254: sync 2024-03-17T23:58:23.768 INFO:tasks.workunit.client.0.smithi196.stdout:6/255: chown d2/d14/d42/f4e 6838 1 2024-03-17T23:58:23.770 INFO:tasks.workunit.client.0.smithi196.stdout:1/271: dwrite d1/db/f14 [0,4194304] 0 2024-03-17T23:58:23.770 INFO:tasks.workunit.client.0.smithi196.stdout:6/256: creat d2/d14/d42/f59 x:0 0 0 2024-03-17T23:58:23.776 INFO:tasks.workunit.client.0.smithi196.stdout:6/257: unlink d2/d22/l23 0 2024-03-17T23:58:23.801 INFO:tasks.workunit.client.0.smithi196.stdout:9/341: dread d9/d38/d60/f28 [4194304,4194304] 0 2024-03-17T23:58:23.805 INFO:tasks.workunit.client.0.smithi196.stdout:1/272: dwrite d1/db/f15 [0,4194304] 0 2024-03-17T23:58:23.805 INFO:tasks.workunit.client.0.smithi196.stdout:1/273: dread d1/d13/f41 [0,4194304] 0 2024-03-17T23:58:23.812 INFO:tasks.workunit.client.0.smithi196.stdout:9/342: mkdir d9/df/d4a/d5b/d6d 0 2024-03-17T23:58:23.815 INFO:tasks.workunit.client.0.smithi196.stdout:9/343: creat d9/d12/d59/f6e x:0 0 0 2024-03-17T23:58:23.816 INFO:tasks.workunit.client.0.smithi196.stdout:1/274: fsync d1/d13/f18 0 2024-03-17T23:58:23.818 INFO:tasks.workunit.client.0.smithi196.stdout:9/344: truncate d9/d38/d60/d5e/f56 1356332 0 2024-03-17T23:58:23.820 INFO:tasks.workunit.client.0.smithi196.stdout:9/345: dread d9/df/d14/f5c [0,4194304] 0 2024-03-17T23:58:23.821 INFO:tasks.workunit.client.0.smithi196.stdout:6/258: dread d2/fd [0,4194304] 0 2024-03-17T23:58:23.822 INFO:tasks.workunit.client.0.smithi196.stdout:9/346: dread - d9/d33/f5f zero size 2024-03-17T23:58:23.822 INFO:tasks.workunit.client.0.smithi196.stdout:6/259: stat d2/d22/c3c 0 2024-03-17T23:58:23.825 INFO:tasks.workunit.client.0.smithi196.stdout:6/260: truncate d2/d22/f3f 5083044 0 2024-03-17T23:58:23.827 INFO:tasks.workunit.client.0.smithi196.stdout:1/275: dwrite d1/d13/f3b [0,4194304] 0 2024-03-17T23:58:23.827 INFO:tasks.workunit.client.0.smithi196.stdout:6/261: creat d2/d40/f5a x:0 0 0 2024-03-17T23:58:23.832 INFO:tasks.workunit.client.0.smithi196.stdout:1/276: fdatasync d1/f3f 0 2024-03-17T23:58:23.833 INFO:tasks.workunit.client.0.smithi196.stdout:9/347: dwrite d9/d12/f3c [0,4194304] 0 2024-03-17T23:58:23.834 INFO:tasks.workunit.client.0.smithi196.stdout:9/348: readlink d9/l23 0 2024-03-17T23:58:23.836 INFO:tasks.workunit.client.0.smithi196.stdout:6/262: dwrite d2/ff [4194304,4194304] 0 2024-03-17T23:58:23.840 INFO:tasks.workunit.client.0.smithi196.stdout:6/263: dread d2/fd [0,4194304] 0 2024-03-17T23:58:23.842 INFO:tasks.workunit.client.0.smithi196.stdout:6/264: write d2/d7/f32 [1569199,14048] 0 2024-03-17T23:58:23.851 INFO:tasks.workunit.client.0.smithi196.stdout:6/265: dwrite d2/d40/f5a [0,4194304] 0 2024-03-17T23:58:23.863 INFO:tasks.workunit.client.0.smithi196.stdout:6/266: dwrite d2/d14/d42/f4b [4194304,4194304] 0 2024-03-17T23:58:23.864 INFO:tasks.workunit.client.0.smithi196.stdout:6/267: chown f1 1550 1 2024-03-17T23:58:23.866 INFO:tasks.workunit.client.0.smithi196.stdout:6/268: mkdir d2/d14/d5b 0 2024-03-17T23:58:23.867 INFO:tasks.workunit.client.0.smithi196.stdout:6/269: fsync d2/d40/f5a 0 2024-03-17T23:58:23.880 INFO:tasks.workunit.client.0.smithi196.stdout:6/270: dread d2/d7/f32 [0,4194304] 0 2024-03-17T23:58:23.881 INFO:tasks.workunit.client.0.smithi196.stdout:6/271: dread - d2/d14/d35/f52 zero size 2024-03-17T23:58:23.881 INFO:tasks.workunit.client.0.smithi196.stdout:6/272: chown d2/d14/d42/d57 30758745 1 2024-03-17T23:58:23.889 INFO:tasks.workunit.client.0.smithi196.stdout:6/273: dwrite d2/d14/f20 [0,4194304] 0 2024-03-17T23:58:23.890 INFO:tasks.workunit.client.0.smithi196.stdout:6/274: chown d2/d14/d27/f3a 59 1 2024-03-17T23:58:23.897 INFO:tasks.workunit.client.0.smithi196.stdout:6/275: creat d2/d14/d42/f5c x:0 0 0 2024-03-17T23:58:23.897 INFO:tasks.workunit.client.0.smithi196.stdout:6/276: chown d2/d14/d42 11750512 1 2024-03-17T23:58:23.897 INFO:tasks.workunit.client.0.smithi196.stdout:6/277: dread - d2/d14/d35/f52 zero size 2024-03-17T23:58:23.902 INFO:tasks.workunit.client.0.smithi196.stdout:6/278: truncate d2/d22/f19 1342370 0 2024-03-17T23:58:23.903 INFO:tasks.workunit.client.0.smithi196.stdout:6/279: truncate d2/d14/d27/f38 1033275 0 2024-03-17T23:58:23.904 INFO:tasks.workunit.client.0.smithi196.stdout:6/280: dread - d2/d14/d27/f3a zero size 2024-03-17T23:58:23.906 INFO:tasks.workunit.client.0.smithi196.stdout:6/281: creat d2/d14/f5d x:0 0 0 2024-03-17T23:58:23.907 INFO:tasks.workunit.client.0.smithi196.stdout:6/282: fsync d2/d14/d27/f38 0 2024-03-17T23:58:23.909 INFO:tasks.workunit.client.0.smithi196.stdout:6/283: getdents d2/d22/d49 0 2024-03-17T23:58:23.914 INFO:tasks.workunit.client.0.smithi196.stdout:6/284: dwrite d2/d40/f5a [0,4194304] 0 2024-03-17T23:58:23.916 INFO:tasks.workunit.client.0.smithi196.stdout:6/285: mknod d2/d40/c5e 0 2024-03-17T23:58:23.919 INFO:tasks.workunit.client.0.smithi196.stdout:6/286: rmdir d2/d14/d27 39 2024-03-17T23:58:23.920 INFO:tasks.workunit.client.0.smithi196.stdout:6/287: write d2/d14/d42/f5c [95598,68175] 0 2024-03-17T23:58:23.923 INFO:tasks.workunit.client.0.smithi196.stdout:6/288: mkdir d2/d14/d42/d57/d5f 0 2024-03-17T23:58:23.925 INFO:tasks.workunit.client.0.smithi196.stdout:6/289: symlink d2/d14/d42/d57/l60 0 2024-03-17T23:58:23.925 INFO:tasks.workunit.client.0.smithi196.stdout:6/290: readlink d2/d14/l1a 0 2024-03-17T23:58:23.926 INFO:tasks.workunit.client.0.smithi196.stdout:6/291: chown d2/d14/f20 420888 1 2024-03-17T23:58:23.927 INFO:tasks.workunit.client.0.smithi196.stdout:6/292: write d2/d7/f32 [3586332,101753] 0 2024-03-17T23:58:23.930 INFO:tasks.workunit.client.0.smithi196.stdout:6/293: rename d2/l44 to d2/d7/l61 0 2024-03-17T23:58:23.932 INFO:tasks.workunit.client.0.smithi196.stdout:6/294: symlink d2/d14/d35/l62 0 2024-03-17T23:58:23.941 INFO:tasks.workunit.client.0.smithi196.stdout:6/295: dwrite d2/ff [4194304,4194304] 0 2024-03-17T23:58:23.945 INFO:tasks.workunit.client.0.smithi196.stdout:6/296: rename d2/d14/d27 to d2/d14/d35/d63 0 2024-03-17T23:58:23.946 INFO:tasks.workunit.client.0.smithi196.stdout:6/297: creat d2/d14/d42/f64 x:0 0 0 2024-03-17T23:58:23.953 INFO:tasks.workunit.client.0.smithi196.stdout:6/298: dwrite d2/d40/f5a [0,4194304] 0 2024-03-17T23:58:23.955 INFO:tasks.workunit.client.0.smithi196.stdout:6/299: mknod d2/d14/d42/c65 0 2024-03-17T23:58:23.956 INFO:tasks.workunit.client.0.smithi196.stdout:6/300: stat d2/d22/f4c 0 2024-03-17T23:58:23.958 INFO:tasks.workunit.client.0.smithi196.stdout:5/311: sync 2024-03-17T23:58:23.958 INFO:tasks.workunit.client.0.smithi196.stdout:3/403: sync 2024-03-17T23:58:23.960 INFO:tasks.workunit.client.0.smithi196.stdout:6/301: mkdir d2/d66 0 2024-03-17T23:58:23.961 INFO:tasks.workunit.client.0.smithi196.stdout:3/404: getdents d7/d19/d26/d48/d4d 0 2024-03-17T23:58:23.963 INFO:tasks.workunit.client.0.smithi196.stdout:3/405: read d7/f16 [2458713,89321] 0 2024-03-17T23:58:23.964 INFO:tasks.workunit.client.0.smithi196.stdout:5/312: creat d6/f64 x:0 0 0 2024-03-17T23:58:23.966 INFO:tasks.workunit.client.0.smithi196.stdout:3/406: mkdir d7/d33/d81 0 2024-03-17T23:58:23.968 INFO:tasks.workunit.client.0.smithi196.stdout:5/313: rename d6/d17/d3f/d40 to d6/d2d/d33/d3b/d65 0 2024-03-17T23:58:23.969 INFO:tasks.workunit.client.0.smithi196.stdout:3/407: symlink d7/d33/l82 0 2024-03-17T23:58:23.972 INFO:tasks.workunit.client.0.smithi196.stdout:6/302: dwrite d2/d22/f4c [0,4194304] 0 2024-03-17T23:58:23.974 INFO:tasks.workunit.client.0.smithi196.stdout:3/408: mkdir d7/d19/d78/d83 0 2024-03-17T23:58:23.979 INFO:tasks.workunit.client.0.smithi196.stdout:5/314: creat d6/d17/d35/f66 x:0 0 0 2024-03-17T23:58:23.983 INFO:tasks.workunit.client.0.smithi196.stdout:3/409: link d7/d19/d26/l5d d7/d19/d78/l84 0 2024-03-17T23:58:23.989 INFO:tasks.workunit.client.0.smithi196.stdout:6/303: dwrite d2/d14/d42/f4f [0,4194304] 0 2024-03-17T23:58:23.989 INFO:tasks.workunit.client.0.smithi196.stdout:6/304: chown d2/d14/d5b 478708 1 2024-03-17T23:58:23.990 INFO:tasks.workunit.client.0.smithi196.stdout:6/305: write d2/ff [263046,29309] 0 2024-03-17T23:58:23.992 INFO:tasks.workunit.client.0.smithi196.stdout:3/410: rename d7/d19/d26/d2b/f61 to d7/d19/d26/d48/d4d/f85 0 2024-03-17T23:58:23.992 INFO:tasks.workunit.client.0.smithi196.stdout:3/411: stat d7/d19/l27 0 2024-03-17T23:58:23.993 INFO:tasks.workunit.client.0.smithi196.stdout:3/412: chown d7/d19/d26/d48/c7a 132163437 1 2024-03-17T23:58:23.996 INFO:tasks.workunit.client.0.smithi196.stdout:6/306: rename d2/d14/d42/f4e to d2/d7/d2b/f67 0 2024-03-17T23:58:23.996 INFO:tasks.workunit.client.0.smithi196.stdout:5/315: truncate f3 2294912 0 2024-03-17T23:58:24.000 INFO:tasks.workunit.client.0.smithi196.stdout:5/316: creat d6/d17/d3f/f67 x:0 0 0 2024-03-17T23:58:24.001 INFO:tasks.workunit.client.0.smithi196.stdout:3/413: dread d7/d19/d26/f47 [0,4194304] 0 2024-03-17T23:58:24.002 INFO:tasks.workunit.client.0.smithi196.stdout:5/317: mknod d6/d2d/d33/d3b/c68 0 2024-03-17T23:58:24.002 INFO:tasks.workunit.client.0.smithi196.stdout:3/414: chown d7/d19/d26/d2b/d3c/d3d/f5a 1486584 1 2024-03-17T23:58:24.004 INFO:tasks.workunit.client.0.smithi196.stdout:3/415: fsync d7/d19/d26/d2b/d3c/d3d/f5e 0 2024-03-17T23:58:24.005 INFO:tasks.workunit.client.0.smithi196.stdout:5/318: rename d6/d2d/d39 to d6/d17/d3f/d4e/d69 0 2024-03-17T23:58:24.007 INFO:tasks.workunit.client.0.smithi196.stdout:3/416: fdatasync d7/f11 0 2024-03-17T23:58:24.008 INFO:tasks.workunit.client.0.smithi196.stdout:5/319: unlink d6/d17/d23/l51 0 2024-03-17T23:58:24.010 INFO:tasks.workunit.client.0.smithi196.stdout:3/417: dread f6 [0,4194304] 0 2024-03-17T23:58:24.011 INFO:tasks.workunit.client.0.smithi196.stdout:5/320: mknod d6/d17/d3f/d4e/d69/c6a 0 2024-03-17T23:58:24.012 INFO:tasks.workunit.client.0.smithi196.stdout:3/418: fsync f6 0 2024-03-17T23:58:24.021 INFO:tasks.workunit.client.0.smithi196.stdout:5/321: dwrite d6/d17/d3f/f67 [0,4194304] 0 2024-03-17T23:58:24.026 INFO:tasks.workunit.client.0.smithi196.stdout:5/322: symlink d6/d17/d3f/d4e/d69/l6b 0 2024-03-17T23:58:24.027 INFO:tasks.workunit.client.0.smithi196.stdout:3/419: dwrite d7/d19/d26/d2b/d3c/d3d/f6a [0,4194304] 0 2024-03-17T23:58:24.029 INFO:tasks.workunit.client.0.smithi196.stdout:5/323: creat d6/d17/f6c x:0 0 0 2024-03-17T23:58:24.032 INFO:tasks.workunit.client.0.smithi196.stdout:5/324: rename d6/fc to d6/d2d/d33/d3b/f6d 0 2024-03-17T23:58:24.034 INFO:tasks.workunit.client.0.smithi196.stdout:5/325: mknod d6/d17/d1f/d5c/c6e 0 2024-03-17T23:58:24.036 INFO:tasks.workunit.client.0.smithi196.stdout:5/326: unlink d6/d17/d3f/d4e/d69/l6b 0 2024-03-17T23:58:24.039 INFO:tasks.workunit.client.0.smithi196.stdout:5/327: rename d6/d15/c25 to d6/d2d/d33/c6f 0 2024-03-17T23:58:24.057 INFO:tasks.workunit.client.0.smithi196.stdout:3/420: dread d7/f21 [0,4194304] 0 2024-03-17T23:58:24.059 INFO:tasks.workunit.client.0.smithi196.stdout:3/421: symlink d7/d19/d26/d2b/d3c/l86 0 2024-03-17T23:58:24.061 INFO:tasks.workunit.client.0.smithi196.stdout:3/422: rename d7/f54 to d7/d29/f87 0 2024-03-17T23:58:24.061 INFO:tasks.workunit.client.0.smithi196.stdout:3/423: rmdir d7/d19/d78 39 2024-03-17T23:58:24.064 INFO:tasks.workunit.client.0.smithi196.stdout:3/424: rename d7/c4a to d7/d19/d26/d2b/d3c/d3d/c88 0 2024-03-17T23:58:24.065 INFO:tasks.workunit.client.0.smithi196.stdout:3/425: chown d7/d19/d26/d2b/d3c/d3d 5828522 1 2024-03-17T23:58:24.068 INFO:tasks.workunit.client.0.smithi196.stdout:3/426: link d7/d19/d26/d2b/d3c/d3d/c71 d7/d19/d26/d2b/d3c/c89 0 2024-03-17T23:58:24.070 INFO:tasks.workunit.client.0.smithi196.stdout:3/427: mknod d7/c8a 0 2024-03-17T23:58:24.070 INFO:tasks.workunit.client.0.smithi196.stdout:3/428: fdatasync d7/f58 0 2024-03-17T23:58:24.080 INFO:tasks.workunit.client.0.smithi196.stdout:3/429: dread d7/fb [0,4194304] 0 2024-03-17T23:58:24.082 INFO:tasks.workunit.client.0.smithi196.stdout:3/430: mkdir d7/d19/d78/d8b 0 2024-03-17T23:58:24.083 INFO:tasks.workunit.client.0.smithi196.stdout:3/431: readlink d7/d19/d26/l7c 0 2024-03-17T23:58:24.084 INFO:tasks.workunit.client.0.smithi196.stdout:3/432: mknod d7/d19/d26/d2b/c8c 0 2024-03-17T23:58:24.087 INFO:tasks.workunit.client.0.smithi196.stdout:3/433: creat d7/d33/d81/f8d x:0 0 0 2024-03-17T23:58:24.099 INFO:tasks.workunit.client.0.smithi196.stdout:3/434: rename d7/d19/d26/f4c to d7/d19/d78/f8e 0 2024-03-17T23:58:24.105 INFO:tasks.workunit.client.0.smithi196.stdout:3/435: truncate d7/ff 3667417 0 2024-03-17T23:58:24.106 INFO:tasks.workunit.client.0.smithi196.stdout:3/436: mknod d7/d19/c8f 0 2024-03-17T23:58:24.107 INFO:tasks.workunit.client.0.smithi196.stdout:3/437: readlink d7/d19/l1a 0 2024-03-17T23:58:24.113 INFO:tasks.workunit.client.0.smithi196.stdout:3/438: dwrite d7/d19/d26/d2b/f3b [0,4194304] 0 2024-03-17T23:58:24.116 INFO:tasks.workunit.client.0.smithi196.stdout:3/439: rename d7/d19/d26/f72 to d7/d33/f90 0 2024-03-17T23:58:24.123 INFO:tasks.workunit.client.0.smithi196.stdout:3/440: dwrite d7/d19/d26/d48/d4d/f85 [0,4194304] 0 2024-03-17T23:58:24.124 INFO:tasks.workunit.client.0.smithi196.stdout:3/441: truncate d7/d33/d81/f8d 1032219 0 2024-03-17T23:58:24.125 INFO:tasks.workunit.client.0.smithi196.stdout:3/442: creat d7/d33/f91 x:0 0 0 2024-03-17T23:58:24.132 INFO:tasks.workunit.client.0.smithi196.stdout:3/443: dwrite d7/d19/d26/f4b [0,4194304] 0 2024-03-17T23:58:24.135 INFO:tasks.workunit.client.0.smithi196.stdout:3/444: mknod d7/d19/d26/d2b/d3c/c92 0 2024-03-17T23:58:24.137 INFO:tasks.workunit.client.0.smithi196.stdout:3/445: fdatasync d7/f2c 0 2024-03-17T23:58:24.177 INFO:tasks.workunit.client.0.smithi196.stdout:0/326: sync 2024-03-17T23:58:24.186 INFO:tasks.workunit.client.0.smithi196.stdout:0/327: dwrite d5/f18 [0,4194304] 0 2024-03-17T23:58:24.190 INFO:tasks.workunit.client.0.smithi196.stdout:0/328: mknod d5/d23/d24/c5b 0 2024-03-17T23:58:24.196 INFO:tasks.workunit.client.0.smithi196.stdout:0/329: creat d5/d23/f5c x:0 0 0 2024-03-17T23:58:24.196 INFO:tasks.workunit.client.0.smithi196.stdout:0/330: chown d5/f13 746121 1 2024-03-17T23:58:24.212 INFO:tasks.workunit.client.0.smithi196.stdout:0/331: dread d5/d23/d24/d28/f26 [4194304,4194304] 0 2024-03-17T23:58:24.212 INFO:tasks.workunit.client.0.smithi196.stdout:0/332: stat d5/d23/f2d 0 2024-03-17T23:58:24.217 INFO:tasks.workunit.client.0.smithi196.stdout:0/333: link d5/d23/d24/d28/d47/f50 d5/d23/d24/d30/f5d 0 2024-03-17T23:58:24.227 INFO:tasks.workunit.client.0.smithi196.stdout:0/334: getdents d5/d23/d24/d30 0 2024-03-17T23:58:24.229 INFO:tasks.workunit.client.0.smithi196.stdout:0/335: creat d5/d23/d24/f5e x:0 0 0 2024-03-17T23:58:24.234 INFO:tasks.workunit.client.0.smithi196.stdout:0/336: write d5/d23/d24/d28/d47/f50 [977463,68831] 0 2024-03-17T23:58:24.236 INFO:tasks.workunit.client.0.smithi196.stdout:0/337: creat d5/d23/d24/f5f x:0 0 0 2024-03-17T23:58:24.237 INFO:tasks.workunit.client.0.smithi196.stdout:0/338: write d5/d23/f5c [62991,3111] 0 2024-03-17T23:58:24.240 INFO:tasks.workunit.client.0.smithi196.stdout:0/339: unlink d5/d23/d24/d28/d47/l57 0 2024-03-17T23:58:24.243 INFO:tasks.workunit.client.0.smithi196.stdout:0/340: unlink d5/d23/d24/c5b 0 2024-03-17T23:58:24.249 INFO:tasks.workunit.client.0.smithi196.stdout:0/341: dwrite d5/f1c [0,4194304] 0 2024-03-17T23:58:24.257 INFO:tasks.workunit.client.0.smithi196.stdout:0/342: dwrite d5/d23/d24/d30/f5d [0,4194304] 0 2024-03-17T23:58:24.260 INFO:tasks.workunit.client.0.smithi196.stdout:0/343: chown d5/l4d 185266 1 2024-03-17T23:58:24.261 INFO:tasks.workunit.client.0.smithi196.stdout:0/344: fdatasync d5/d23/d24/f2f 0 2024-03-17T23:58:24.262 INFO:tasks.workunit.client.0.smithi196.stdout:0/345: write d5/f3d [1244817,126495] 0 2024-03-17T23:58:24.271 INFO:tasks.workunit.client.0.smithi196.stdout:0/346: dwrite d5/f44 [0,4194304] 0 2024-03-17T23:58:24.273 INFO:tasks.workunit.client.0.smithi196.stdout:0/347: mkdir d5/d23/d24/d28/d47/d60 0 2024-03-17T23:58:24.290 INFO:tasks.workunit.client.0.smithi196.stdout:0/348: dread d5/f13 [0,4194304] 0 2024-03-17T23:58:24.291 INFO:tasks.workunit.client.0.smithi196.stdout:0/349: fsync d5/f1c 0 2024-03-17T23:58:24.294 INFO:tasks.workunit.client.0.smithi196.stdout:0/350: mkdir d5/d23/d24/d28/d47/d52/d61 0 2024-03-17T23:58:24.295 INFO:tasks.workunit.client.0.smithi196.stdout:0/351: write d5/d23/d24/f2c [3425107,94531] 0 2024-03-17T23:58:24.302 INFO:tasks.workunit.client.0.smithi196.stdout:0/352: truncate d5/f18 2043984 0 2024-03-17T23:58:24.302 INFO:tasks.workunit.client.0.smithi196.stdout:0/353: readlink d5/l11 0 2024-03-17T23:58:24.305 INFO:tasks.workunit.client.0.smithi196.stdout:0/354: rename d5/d23/d24/d28/d47/d52/f45 to d5/d23/d24/d28/d47/d52/d49/f62 0 2024-03-17T23:58:24.307 INFO:tasks.workunit.client.0.smithi196.stdout:0/355: mkdir d5/d23/d24/d28/d63 0 2024-03-17T23:58:24.309 INFO:tasks.workunit.client.0.smithi196.stdout:2/428: sync 2024-03-17T23:58:24.309 INFO:tasks.workunit.client.0.smithi196.stdout:7/357: sync 2024-03-17T23:58:24.309 INFO:tasks.workunit.client.0.smithi196.stdout:8/212: sync 2024-03-17T23:58:24.312 INFO:tasks.workunit.client.0.smithi196.stdout:2/429: chown l12 60 1 2024-03-17T23:58:24.312 INFO:tasks.workunit.client.0.smithi196.stdout:8/213: mkdir de/d10/d35/d3e 0 2024-03-17T23:58:24.316 INFO:tasks.workunit.client.0.smithi196.stdout:8/214: symlink de/d10/d35/l3f 0 2024-03-17T23:58:24.316 INFO:tasks.workunit.client.0.smithi196.stdout:8/215: fsync f7 0 2024-03-17T23:58:24.318 INFO:tasks.workunit.client.0.smithi196.stdout:8/216: truncate de/d2b/f38 4514146 0 2024-03-17T23:58:24.318 INFO:tasks.workunit.client.0.smithi196.stdout:2/430: link d17/d28/d30/f90 d17/d22/d3d/d8f/fa5 0 2024-03-17T23:58:24.319 INFO:tasks.workunit.client.0.smithi196.stdout:8/217: chown de/d10/f2e 1849666 1 2024-03-17T23:58:24.321 INFO:tasks.workunit.client.0.smithi196.stdout:0/356: truncate d5/d23/d24/d28/f2e 985254 0 2024-03-17T23:58:24.322 INFO:tasks.workunit.client.0.smithi196.stdout:7/358: getdents da/d3e/d45/d4f/d43 0 2024-03-17T23:58:24.323 INFO:tasks.workunit.client.0.smithi196.stdout:0/357: creat d5/f64 x:0 0 0 2024-03-17T23:58:24.325 INFO:tasks.workunit.client.0.smithi196.stdout:2/431: creat d17/d22/fa6 x:0 0 0 2024-03-17T23:58:24.326 INFO:tasks.workunit.client.0.smithi196.stdout:0/358: creat d5/d23/d24/d59/f65 x:0 0 0 2024-03-17T23:58:24.327 INFO:tasks.workunit.client.0.smithi196.stdout:0/359: chown d5/d23/d24/d30 100 1 2024-03-17T23:58:24.329 INFO:tasks.workunit.client.0.smithi196.stdout:2/432: creat d17/d22/d3d/d8f/fa7 x:0 0 0 2024-03-17T23:58:24.331 INFO:tasks.workunit.client.0.smithi196.stdout:0/360: fsync d5/d23/d24/d28/d47/d52/f54 0 2024-03-17T23:58:24.331 INFO:tasks.workunit.client.0.smithi196.stdout:8/218: dwrite de/d10/f3b [4194304,4194304] 0 2024-03-17T23:58:24.333 INFO:tasks.workunit.client.0.smithi196.stdout:2/433: symlink d17/d28/d30/la8 0 2024-03-17T23:58:24.334 INFO:tasks.workunit.client.0.smithi196.stdout:8/219: dread - de/d2b/d30/f3a zero size 2024-03-17T23:58:24.336 INFO:tasks.workunit.client.0.smithi196.stdout:0/361: write d5/d23/d24/d28/f37 [344443,61780] 0 2024-03-17T23:58:24.339 INFO:tasks.workunit.client.0.smithi196.stdout:8/220: read de/f19 [166330,24739] 0 2024-03-17T23:58:24.339 INFO:tasks.workunit.client.0.smithi196.stdout:7/359: dread da/d15/d1d/f32 [0,4194304] 0 2024-03-17T23:58:24.339 INFO:tasks.workunit.client.0.smithi196.stdout:2/434: link d17/d19/f41 d17/d1f/fa9 0 2024-03-17T23:58:24.340 INFO:tasks.workunit.client.0.smithi196.stdout:7/360: write da/d15/f25 [408485,67543] 0 2024-03-17T23:58:24.340 INFO:tasks.workunit.client.0.smithi196.stdout:0/362: mkdir d5/d23/d24/d28/d47/d52/d66 0 2024-03-17T23:58:24.342 INFO:tasks.workunit.client.0.smithi196.stdout:8/221: mknod de/d2b/c40 0 2024-03-17T23:58:24.342 INFO:tasks.workunit.client.0.smithi196.stdout:2/435: truncate d17/d22/f6e 360216 0 2024-03-17T23:58:24.343 INFO:tasks.workunit.client.0.smithi196.stdout:7/361: write da/d15/d1d/d29/f76 [647353,104615] 0 2024-03-17T23:58:24.344 INFO:tasks.workunit.client.0.smithi196.stdout:8/222: symlink de/d10/l41 0 2024-03-17T23:58:24.347 INFO:tasks.workunit.client.0.smithi196.stdout:2/436: write d17/d22/d59/f78 [525328,82960] 0 2024-03-17T23:58:24.347 INFO:tasks.workunit.client.0.smithi196.stdout:8/223: chown de/d10/f14 9 1 2024-03-17T23:58:24.349 INFO:tasks.workunit.client.0.smithi196.stdout:2/437: chown d17/d22/d3d/d8f 17144742 1 2024-03-17T23:58:24.350 INFO:tasks.workunit.client.0.smithi196.stdout:2/438: stat d17/d22/c7f 0 2024-03-17T23:58:24.351 INFO:tasks.workunit.client.0.smithi196.stdout:8/224: rmdir de/d2b/d30 39 2024-03-17T23:58:24.353 INFO:tasks.workunit.client.0.smithi196.stdout:8/225: chown de/f19 9027 1 2024-03-17T23:58:24.354 INFO:tasks.workunit.client.0.smithi196.stdout:8/226: dread - de/f23 zero size 2024-03-17T23:58:24.354 INFO:tasks.workunit.client.0.smithi196.stdout:0/363: dwrite d5/d23/d24/d28/f37 [4194304,4194304] 0 2024-03-17T23:58:24.356 INFO:tasks.workunit.client.0.smithi196.stdout:2/439: creat d17/d28/d30/d71/faa x:0 0 0 2024-03-17T23:58:24.356 INFO:tasks.workunit.client.0.smithi196.stdout:8/227: chown de/f31 1206937 1 2024-03-17T23:58:24.359 INFO:tasks.workunit.client.0.smithi196.stdout:7/362: rmdir da/d3e/d6f 0 2024-03-17T23:58:24.362 INFO:tasks.workunit.client.0.smithi196.stdout:0/364: creat d5/d23/d24/d28/d47/d52/d49/f67 x:0 0 0 2024-03-17T23:58:24.365 INFO:tasks.workunit.client.0.smithi196.stdout:8/228: dwrite de/d10/f14 [0,4194304] 0 2024-03-17T23:58:24.366 INFO:tasks.workunit.client.0.smithi196.stdout:2/440: mknod d17/d22/d59/cab 0 2024-03-17T23:58:24.366 INFO:tasks.workunit.client.0.smithi196.stdout:8/229: write de/f39 [34942,10929] 0 2024-03-17T23:58:24.369 INFO:tasks.workunit.client.0.smithi196.stdout:2/441: creat d17/d28/d30/d3b/fac x:0 0 0 2024-03-17T23:58:24.370 INFO:tasks.workunit.client.0.smithi196.stdout:8/230: truncate de/d10/f1a 1175985 0 2024-03-17T23:58:24.371 INFO:tasks.workunit.client.0.smithi196.stdout:7/363: rename da/d15/d1d/d29/d54/f72 to da/d4d/f77 0 2024-03-17T23:58:24.373 INFO:tasks.workunit.client.0.smithi196.stdout:8/231: fdatasync de/d2b/f38 0 2024-03-17T23:58:24.374 INFO:tasks.workunit.client.0.smithi196.stdout:2/442: symlink d17/d28/d30/lad 0 2024-03-17T23:58:24.376 INFO:tasks.workunit.client.0.smithi196.stdout:8/232: read de/d10/f3b [91094,124203] 0 2024-03-17T23:58:24.377 INFO:tasks.workunit.client.0.smithi196.stdout:2/443: mkdir d17/d28/dae 0 2024-03-17T23:58:24.378 INFO:tasks.workunit.client.0.smithi196.stdout:0/365: dwrite d5/d23/d24/d28/d47/d52/d49/f67 [0,4194304] 0 2024-03-17T23:58:24.380 INFO:tasks.workunit.client.0.smithi196.stdout:8/233: fsync de/ff 0 2024-03-17T23:58:24.381 INFO:tasks.workunit.client.0.smithi196.stdout:0/366: chown d5/c1d 1061 1 2024-03-17T23:58:24.384 INFO:tasks.workunit.client.0.smithi196.stdout:0/367: mknod d5/d23/d24/d28/c68 0 2024-03-17T23:58:24.385 INFO:tasks.workunit.client.0.smithi196.stdout:8/234: mknod de/d2b/d30/d33/c42 0 2024-03-17T23:58:24.387 INFO:tasks.workunit.client.0.smithi196.stdout:8/235: mkdir de/d10/d43 0 2024-03-17T23:58:24.388 INFO:tasks.workunit.client.0.smithi196.stdout:8/236: readlink de/d10/d35/l3f 0 2024-03-17T23:58:24.389 INFO:tasks.workunit.client.0.smithi196.stdout:8/237: mknod de/d2b/d30/d33/c44 0 2024-03-17T23:58:24.393 INFO:tasks.workunit.client.0.smithi196.stdout:2/444: truncate f13 1228555 0 2024-03-17T23:58:24.394 INFO:tasks.workunit.client.0.smithi196.stdout:2/445: dread - d17/d28/d30/d3b/fac zero size 2024-03-17T23:58:24.396 INFO:tasks.workunit.client.0.smithi196.stdout:2/446: write d17/d22/d3d/f48 [2391715,61040] 0 2024-03-17T23:58:24.397 INFO:tasks.workunit.client.0.smithi196.stdout:8/238: dwrite f3 [0,4194304] 0 2024-03-17T23:58:24.398 INFO:tasks.workunit.client.0.smithi196.stdout:2/447: truncate d17/d28/d30/f94 6441 0 2024-03-17T23:58:24.404 INFO:tasks.workunit.client.0.smithi196.stdout:8/239: chown de/l17 0 1 2024-03-17T23:58:24.405 INFO:tasks.workunit.client.0.smithi196.stdout:8/240: stat de/d2b/d30/d33 0 2024-03-17T23:58:24.407 INFO:tasks.workunit.client.0.smithi196.stdout:8/241: creat de/d2b/d30/d33/f45 x:0 0 0 2024-03-17T23:58:24.409 INFO:tasks.workunit.client.0.smithi196.stdout:8/242: symlink de/d2b/d3c/l46 0 2024-03-17T23:58:24.409 INFO:tasks.workunit.client.0.smithi196.stdout:8/243: chown de/d2b/d30/d33/c42 13 1 2024-03-17T23:58:24.420 INFO:tasks.workunit.client.0.smithi196.stdout:8/244: truncate de/f13 1907508 0 2024-03-17T23:58:24.422 INFO:tasks.workunit.client.0.smithi196.stdout:8/245: write de/d2b/d30/d33/f37 [998032,3146] 0 2024-03-17T23:58:24.423 INFO:tasks.workunit.client.0.smithi196.stdout:8/246: readlink de/l1e 0 2024-03-17T23:58:24.425 INFO:tasks.workunit.client.0.smithi196.stdout:2/448: dread d17/d28/d30/f6b [0,4194304] 0 2024-03-17T23:58:24.428 INFO:tasks.workunit.client.0.smithi196.stdout:8/247: write de/d2b/f38 [4518234,85070] 0 2024-03-17T23:58:24.430 INFO:tasks.workunit.client.0.smithi196.stdout:8/248: chown de/l2a 1133 1 2024-03-17T23:58:24.431 INFO:tasks.workunit.client.0.smithi196.stdout:8/249: truncate de/d2b/f38 4845733 0 2024-03-17T23:58:24.433 INFO:tasks.workunit.client.0.smithi196.stdout:8/250: getdents de/d2b/d30 0 2024-03-17T23:58:24.444 INFO:tasks.workunit.client.0.smithi196.stdout:8/251: dread de/d10/f24 [0,4194304] 0 2024-03-17T23:58:24.447 INFO:tasks.workunit.client.0.smithi196.stdout:8/252: creat de/d2b/f47 x:0 0 0 2024-03-17T23:58:24.451 INFO:tasks.workunit.client.0.smithi196.stdout:8/253: dread de/d10/f1b [0,4194304] 0 2024-03-17T23:58:24.452 INFO:tasks.workunit.client.0.smithi196.stdout:8/254: write f7 [3457281,115629] 0 2024-03-17T23:58:24.452 INFO:tasks.workunit.client.0.smithi196.stdout:8/255: stat de/f1f 0 2024-03-17T23:58:24.454 INFO:tasks.workunit.client.0.smithi196.stdout:8/256: creat de/d2b/d30/d33/f48 x:0 0 0 2024-03-17T23:58:24.454 INFO:tasks.workunit.client.0.smithi196.stdout:8/257: stat de/c32 0 2024-03-17T23:58:24.455 INFO:tasks.workunit.client.0.smithi196.stdout:8/258: fdatasync de/d10/f24 0 2024-03-17T23:58:24.456 INFO:tasks.workunit.client.0.smithi196.stdout:8/259: chown de/l1e 132 1 2024-03-17T23:58:24.456 INFO:tasks.workunit.client.0.smithi196.stdout:8/260: dread - de/d2b/d30/f3a zero size 2024-03-17T23:58:24.459 INFO:tasks.workunit.client.0.smithi196.stdout:8/261: creat de/d2b/f49 x:0 0 0 2024-03-17T23:58:24.459 INFO:tasks.workunit.client.0.smithi196.stdout:8/262: chown ld 1980 1 2024-03-17T23:58:24.459 INFO:tasks.workunit.client.0.smithi196.stdout:8/263: chown de/d2b/d30/d33/f37 8 1 2024-03-17T23:58:24.463 INFO:tasks.workunit.client.0.smithi196.stdout:8/264: link de/l17 de/d2b/l4a 0 2024-03-17T23:58:24.469 INFO:tasks.workunit.client.0.smithi196.stdout:8/265: truncate de/d10/f3b 1264836 0 2024-03-17T23:58:24.472 INFO:tasks.workunit.client.0.smithi196.stdout:8/266: link de/l2a de/d2b/l4b 0 2024-03-17T23:58:24.480 INFO:tasks.workunit.client.0.smithi196.stdout:8/267: dwrite de/f13 [0,4194304] 0 2024-03-17T23:58:24.484 INFO:tasks.workunit.client.0.smithi196.stdout:8/268: rmdir de/d10 39 2024-03-17T23:58:24.485 INFO:tasks.workunit.client.0.smithi196.stdout:1/277: sync 2024-03-17T23:58:24.485 INFO:tasks.workunit.client.0.smithi196.stdout:1/278: fdatasync d1/f25 0 2024-03-17T23:58:24.488 INFO:tasks.workunit.client.0.smithi196.stdout:1/279: truncate d1/f8 3202039 0 2024-03-17T23:58:24.491 INFO:tasks.workunit.client.0.smithi196.stdout:1/280: creat d1/db/dd/f67 x:0 0 0 2024-03-17T23:58:24.494 INFO:tasks.workunit.client.0.smithi196.stdout:1/281: write d1/db/fe [5062974,122134] 0 2024-03-17T23:58:24.494 INFO:tasks.workunit.client.0.smithi196.stdout:1/282: fsync d1/d13/d4c/f61 0 2024-03-17T23:58:24.495 INFO:tasks.workunit.client.0.smithi196.stdout:1/283: write d1/db/fe [8414193,65057] 0 2024-03-17T23:58:24.498 INFO:tasks.workunit.client.0.smithi196.stdout:1/284: truncate d1/db/dd/d43/f4a 2850215 0 2024-03-17T23:58:24.498 INFO:tasks.workunit.client.0.smithi196.stdout:8/269: dread f7 [0,4194304] 0 2024-03-17T23:58:24.498 INFO:tasks.workunit.client.0.smithi196.stdout:1/285: fdatasync d1/d13/f5a 0 2024-03-17T23:58:24.502 INFO:tasks.workunit.client.0.smithi196.stdout:1/286: readlink d1/d13/d4c/l5f 0 2024-03-17T23:58:24.503 INFO:tasks.workunit.client.0.smithi196.stdout:1/287: chown d1/d13/d23/l2d 10546544 1 2024-03-17T23:58:24.503 INFO:tasks.workunit.client.0.smithi196.stdout:1/288: chown d1/db/dd/f12 0 1 2024-03-17T23:58:24.503 INFO:tasks.workunit.client.0.smithi196.stdout:8/270: unlink de/d2b/f49 0 2024-03-17T23:58:24.503 INFO:tasks.workunit.client.0.smithi196.stdout:1/289: read d1/d13/d23/f49 [4024394,71613] 0 2024-03-17T23:58:24.507 INFO:tasks.workunit.client.0.smithi196.stdout:1/290: mknod d1/d13/d23/d47/d48/c68 0 2024-03-17T23:58:24.510 INFO:tasks.workunit.client.0.smithi196.stdout:8/271: creat de/d10/d35/d3e/f4c x:0 0 0 2024-03-17T23:58:24.511 INFO:tasks.workunit.client.0.smithi196.stdout:8/272: truncate de/f19 5080677 0 2024-03-17T23:58:24.515 INFO:tasks.workunit.client.0.smithi196.stdout:1/291: dwrite d1/f25 [4194304,4194304] 0 2024-03-17T23:58:24.521 INFO:tasks.workunit.client.0.smithi196.stdout:8/273: dwrite f6 [0,4194304] 0 2024-03-17T23:58:24.521 INFO:tasks.workunit.client.0.smithi196.stdout:1/292: rename d1/d13/d23/d47/d48/c68 to d1/d13/c69 0 2024-03-17T23:58:24.523 INFO:tasks.workunit.client.0.smithi196.stdout:1/293: mkdir d1/db/dd/d34/d6a 0 2024-03-17T23:58:24.525 INFO:tasks.workunit.client.0.smithi196.stdout:8/274: symlink de/d10/d43/l4d 0 2024-03-17T23:58:24.526 INFO:tasks.workunit.client.0.smithi196.stdout:8/275: write de/d10/f2e [143687,106506] 0 2024-03-17T23:58:24.536 INFO:tasks.workunit.client.0.smithi196.stdout:8/276: dwrite de/d2b/d30/d33/f48 [0,4194304] 0 2024-03-17T23:58:24.538 INFO:tasks.workunit.client.0.smithi196.stdout:8/277: chown de/d2b/d3c/l46 3 1 2024-03-17T23:58:24.541 INFO:tasks.workunit.client.0.smithi196.stdout:1/294: truncate d1/db/fe 4682569 0 2024-03-17T23:58:24.543 INFO:tasks.workunit.client.0.smithi196.stdout:8/278: getdents de 0 2024-03-17T23:58:24.550 INFO:tasks.workunit.client.0.smithi196.stdout:8/279: dwrite de/f1f [4194304,4194304] 0 2024-03-17T23:58:24.558 INFO:tasks.workunit.client.0.smithi196.stdout:8/280: dwrite de/ff [0,4194304] 0 2024-03-17T23:58:24.643 INFO:tasks.workunit.client.0.smithi196.stdout:4/267: sync 2024-03-17T23:58:24.645 INFO:tasks.workunit.client.0.smithi196.stdout:4/268: fsync d1/d11/f3d 0 2024-03-17T23:58:24.651 INFO:tasks.workunit.client.0.smithi196.stdout:4/269: link d1/de/f4b d1/f58 0 2024-03-17T23:58:24.653 INFO:tasks.workunit.client.0.smithi196.stdout:4/270: readlink d1/de/d50/d55/d4a/l54 0 2024-03-17T23:58:24.656 INFO:tasks.workunit.client.0.smithi196.stdout:4/271: creat d1/d1b/f59 x:0 0 0 2024-03-17T23:58:24.659 INFO:tasks.workunit.client.0.smithi196.stdout:4/272: creat d1/f5a x:0 0 0 2024-03-17T23:58:24.660 INFO:tasks.workunit.client.0.smithi196.stdout:4/273: write d1/f36 [568460,129469] 0 2024-03-17T23:58:24.663 INFO:tasks.workunit.client.0.smithi196.stdout:4/274: symlink d1/d11/l5b 0 2024-03-17T23:58:24.666 INFO:tasks.workunit.client.0.smithi196.stdout:4/275: rmdir d1/d26 39 2024-03-17T23:58:24.667 INFO:tasks.workunit.client.0.smithi196.stdout:4/276: chown d1/d26/d33 62 1 2024-03-17T23:58:24.668 INFO:tasks.workunit.client.0.smithi196.stdout:4/277: chown d1/f1d 10 1 2024-03-17T23:58:24.670 INFO:tasks.workunit.client.0.smithi196.stdout:4/278: creat d1/d26/d33/f5c x:0 0 0 2024-03-17T23:58:24.675 INFO:tasks.workunit.client.0.smithi196.stdout:4/279: dread d1/fd [0,4194304] 0 2024-03-17T23:58:24.677 INFO:tasks.workunit.client.0.smithi196.stdout:4/280: mkdir d1/d11/d5d 0 2024-03-17T23:58:24.678 INFO:tasks.workunit.client.0.smithi196.stdout:4/281: write d1/de/f21 [2761042,10680] 0 2024-03-17T23:58:24.680 INFO:tasks.workunit.client.0.smithi196.stdout:4/282: creat d1/d26/d33/d40/f5e x:0 0 0 2024-03-17T23:58:24.682 INFO:tasks.workunit.client.0.smithi196.stdout:4/283: write d1/d1b/f59 [618990,113798] 0 2024-03-17T23:58:24.685 INFO:tasks.workunit.client.0.smithi196.stdout:4/284: rename d1/de/d50/f51 to d1/d1b/f5f 0 2024-03-17T23:58:24.694 INFO:tasks.workunit.client.0.smithi196.stdout:4/285: dwrite d1/de/f2d [0,4194304] 0 2024-03-17T23:58:24.701 INFO:tasks.workunit.client.0.smithi196.stdout:4/286: creat d1/de/d50/f60 x:0 0 0 2024-03-17T23:58:24.702 INFO:tasks.workunit.client.0.smithi196.stdout:4/287: read d1/de/f2d [1228244,109556] 0 2024-03-17T23:58:24.719 INFO:tasks.workunit.client.0.smithi196.stdout:9/349: sync 2024-03-17T23:58:24.719 INFO:tasks.workunit.client.0.smithi196.stdout:6/307: sync 2024-03-17T23:58:24.722 INFO:tasks.workunit.client.0.smithi196.stdout:6/308: mkdir d2/d14/d50/d68 0 2024-03-17T23:58:24.722 INFO:tasks.workunit.client.0.smithi196.stdout:6/309: chown d2/d14 22706475 1 2024-03-17T23:58:24.723 INFO:tasks.workunit.client.0.smithi196.stdout:9/350: mknod d9/df/d4a/d5b/d6d/c6f 0 2024-03-17T23:58:24.724 INFO:tasks.workunit.client.0.smithi196.stdout:9/351: mknod d9/d12/d59/c70 0 2024-03-17T23:58:24.725 INFO:tasks.workunit.client.0.smithi196.stdout:9/352: fsync d9/d12/d59/f6e 0 2024-03-17T23:58:24.727 INFO:tasks.workunit.client.0.smithi196.stdout:9/353: write d9/df/d14/d27/f4c [45237,44893] 0 2024-03-17T23:58:24.738 INFO:tasks.workunit.client.0.smithi196.stdout:4/288: mkdir d1/d61 0 2024-03-17T23:58:24.741 INFO:tasks.workunit.client.0.smithi196.stdout:4/289: rename d1/de/c52 to d1/d26/d33/d3f/c62 0 2024-03-17T23:58:24.745 INFO:tasks.workunit.client.0.smithi196.stdout:6/310: dwrite d2/fd [0,4194304] 0 2024-03-17T23:58:24.748 INFO:tasks.workunit.client.0.smithi196.stdout:4/290: getdents d1/de/d50/d55/d4a 0 2024-03-17T23:58:24.749 INFO:tasks.workunit.client.0.smithi196.stdout:6/311: creat d2/d66/f69 x:0 0 0 2024-03-17T23:58:24.750 INFO:tasks.workunit.client.0.smithi196.stdout:4/291: chown d1/l41 71 1 2024-03-17T23:58:24.751 INFO:tasks.workunit.client.0.smithi196.stdout:9/354: dwrite d9/df/d14/f5c [0,4194304] 0 2024-03-17T23:58:24.751 INFO:tasks.workunit.client.0.smithi196.stdout:6/312: fsync d2/d14/f20 0 2024-03-17T23:58:24.753 INFO:tasks.workunit.client.0.smithi196.stdout:4/292: truncate d1/de/d50/f60 153671 0 2024-03-17T23:58:24.754 INFO:tasks.workunit.client.0.smithi196.stdout:6/313: mkdir d2/d14/d35/d6a 0 2024-03-17T23:58:24.755 INFO:tasks.workunit.client.0.smithi196.stdout:9/355: symlink d9/df/d14/d27/l71 0 2024-03-17T23:58:24.756 INFO:tasks.workunit.client.0.smithi196.stdout:9/356: truncate d9/f69 867032 0 2024-03-17T23:58:24.757 INFO:tasks.workunit.client.0.smithi196.stdout:4/293: symlink d1/d26/d57/l63 0 2024-03-17T23:58:24.761 INFO:tasks.workunit.client.0.smithi196.stdout:4/294: mknod d1/d26/d57/c64 0 2024-03-17T23:58:24.765 INFO:tasks.workunit.client.0.smithi196.stdout:6/314: truncate d2/d22/f4c 1844623 0 2024-03-17T23:58:24.767 INFO:tasks.workunit.client.0.smithi196.stdout:4/295: symlink d1/de/d50/d55/d4a/l65 0 2024-03-17T23:58:24.767 INFO:tasks.workunit.client.0.smithi196.stdout:6/315: chown d2/d7/d2b/l39 4 1 2024-03-17T23:58:24.768 INFO:tasks.workunit.client.0.smithi196.stdout:9/357: creat d9/df/d14/f72 x:0 0 0 2024-03-17T23:58:24.769 INFO:tasks.workunit.client.0.smithi196.stdout:1/295: sync 2024-03-17T23:58:24.769 INFO:tasks.workunit.client.0.smithi196.stdout:7/364: sync 2024-03-17T23:58:24.769 INFO:tasks.workunit.client.0.smithi196.stdout:5/328: sync 2024-03-17T23:58:24.770 INFO:tasks.workunit.client.0.smithi196.stdout:3/446: sync 2024-03-17T23:58:24.770 INFO:tasks.workunit.client.0.smithi196.stdout:8/281: sync 2024-03-17T23:58:24.770 INFO:tasks.workunit.client.0.smithi196.stdout:2/449: sync 2024-03-17T23:58:24.770 INFO:tasks.workunit.client.0.smithi196.stdout:0/368: sync 2024-03-17T23:58:24.775 INFO:tasks.workunit.client.0.smithi196.stdout:1/296: stat d1/d13/d23/f37 0 2024-03-17T23:58:24.775 INFO:tasks.workunit.client.0.smithi196.stdout:3/447: fsync d7/d33/f49 0 2024-03-17T23:58:24.776 INFO:tasks.workunit.client.0.smithi196.stdout:7/365: mkdir da/d4d/d78 0 2024-03-17T23:58:24.778 INFO:tasks.workunit.client.0.smithi196.stdout:9/358: chown d9/df/l54 62 1 2024-03-17T23:58:24.779 INFO:tasks.workunit.client.0.smithi196.stdout:4/296: dread d1/d1b/f59 [0,4194304] 0 2024-03-17T23:58:24.780 INFO:tasks.workunit.client.0.smithi196.stdout:6/316: truncate d2/d22/f19 358264 0 2024-03-17T23:58:24.780 INFO:tasks.workunit.client.0.smithi196.stdout:9/359: readlink d9/d38/l41 0 2024-03-17T23:58:24.782 INFO:tasks.workunit.client.0.smithi196.stdout:2/450: mknod d17/d19/d44/d52/caf 0 2024-03-17T23:58:24.784 INFO:tasks.workunit.client.0.smithi196.stdout:7/366: creat da/d15/d1d/d29/f79 x:0 0 0 2024-03-17T23:58:24.785 INFO:tasks.workunit.client.0.smithi196.stdout:9/360: chown d9/d33/f52 154018676 1 2024-03-17T23:58:24.786 INFO:tasks.workunit.client.0.smithi196.stdout:6/317: chown d2/d14/d35/d63 11170 1 2024-03-17T23:58:24.788 INFO:tasks.workunit.client.0.smithi196.stdout:3/448: fdatasync d7/d19/d26/f37 0 2024-03-17T23:58:24.789 INFO:tasks.workunit.client.0.smithi196.stdout:0/369: dread d5/f13 [0,4194304] 0 2024-03-17T23:58:24.793 INFO:tasks.workunit.client.0.smithi196.stdout:5/329: dwrite d6/d2a/f31 [0,4194304] 0 2024-03-17T23:58:24.795 INFO:tasks.workunit.client.0.smithi196.stdout:6/318: creat d2/d14/d35/d63/f6b x:0 0 0 2024-03-17T23:58:24.796 INFO:tasks.workunit.client.0.smithi196.stdout:9/361: truncate d9/df/d14/f5c 4917854 0 2024-03-17T23:58:24.796 INFO:tasks.workunit.client.0.smithi196.stdout:1/297: dwrite d1/f4d [0,4194304] 0 2024-03-17T23:58:24.797 INFO:tasks.workunit.client.0.smithi196.stdout:2/451: rename d17/d22/da0/l7d to d17/d22/lb0 0 2024-03-17T23:58:24.797 INFO:tasks.workunit.client.0.smithi196.stdout:3/449: mkdir d7/d19/d78/d93 0 2024-03-17T23:58:24.800 INFO:tasks.workunit.client.0.smithi196.stdout:6/319: truncate d2/d14/f5d 560537 0 2024-03-17T23:58:24.811 INFO:tasks.workunit.client.0.smithi196.stdout:5/330: chown d6/fd 126881 1 2024-03-17T23:58:24.811 INFO:tasks.workunit.client.0.smithi196.stdout:6/320: creat d2/d14/d35/d63/f6c x:0 0 0 2024-03-17T23:58:24.812 INFO:tasks.workunit.client.0.smithi196.stdout:4/297: truncate d1/d1b/f5f 1492086 0 2024-03-17T23:58:24.814 INFO:tasks.workunit.client.0.smithi196.stdout:2/452: creat d17/d19/d44/fb1 x:0 0 0 2024-03-17T23:58:24.817 INFO:tasks.workunit.client.0.smithi196.stdout:4/298: stat d1/d11/l25 0 2024-03-17T23:58:24.820 INFO:tasks.workunit.client.0.smithi196.stdout:7/367: rename da/d15/d1d/l47 to da/d3e/l7a 0 2024-03-17T23:58:24.820 INFO:tasks.workunit.client.0.smithi196.stdout:2/453: fsync d17/d19/d44/d52/f84 0 2024-03-17T23:58:24.820 INFO:tasks.workunit.client.0.smithi196.stdout:3/450: readlink d7/d19/d26/d2b/d3c/d3d/d7d/l7f 0 2024-03-17T23:58:24.824 INFO:tasks.workunit.client.0.smithi196.stdout:1/298: dwrite d1/db/dd/f12 [0,4194304] 0 2024-03-17T23:58:24.825 INFO:tasks.workunit.client.0.smithi196.stdout:5/331: dread f2 [0,4194304] 0 2024-03-17T23:58:24.825 INFO:tasks.workunit.client.0.smithi196.stdout:5/332: chown d6/f1b 68098013 1 2024-03-17T23:58:24.828 INFO:tasks.workunit.client.0.smithi196.stdout:0/370: write d5/d23/d24/d28/f2e [1942164,97068] 0 2024-03-17T23:58:24.829 INFO:tasks.workunit.client.0.smithi196.stdout:6/321: rename d2/d14/d42/f5c to d2/d14/d35/f6d 0 2024-03-17T23:58:24.832 INFO:tasks.workunit.client.0.smithi196.stdout:8/282: dwrite de/d10/f3b [0,4194304] 0 2024-03-17T23:58:24.832 INFO:tasks.workunit.client.0.smithi196.stdout:4/299: truncate d1/d26/d33/d40/f5e 468435 0 2024-03-17T23:58:24.832 INFO:tasks.workunit.client.0.smithi196.stdout:2/454: creat d17/d28/d30/d72/fb2 x:0 0 0 2024-03-17T23:58:24.833 INFO:tasks.workunit.client.0.smithi196.stdout:7/368: creat da/d15/d1d/d29/d54/f7b x:0 0 0 2024-03-17T23:58:24.834 INFO:tasks.workunit.client.0.smithi196.stdout:5/333: rmdir d6/d17/d1f 39 2024-03-17T23:58:24.834 INFO:tasks.workunit.client.0.smithi196.stdout:3/451: unlink d7/d19/d26/d2b/l39 0 2024-03-17T23:58:24.837 INFO:tasks.workunit.client.0.smithi196.stdout:1/299: chown d1/d13/d23/f36 28633 1 2024-03-17T23:58:24.838 INFO:tasks.workunit.client.0.smithi196.stdout:6/322: creat d2/d7/d2b/f6e x:0 0 0 2024-03-17T23:58:24.841 INFO:tasks.workunit.client.0.smithi196.stdout:9/362: getdents d9/df/d4a/d5b 0 2024-03-17T23:58:24.841 INFO:tasks.workunit.client.0.smithi196.stdout:2/455: dread d17/d28/d30/f94 [0,4194304] 0 2024-03-17T23:58:24.844 INFO:tasks.workunit.client.0.smithi196.stdout:4/300: getdents d1/d11/d5d 0 2024-03-17T23:58:24.845 INFO:tasks.workunit.client.0.smithi196.stdout:5/334: mkdir d6/d17/d3f/d4e/d70 0 2024-03-17T23:58:24.846 INFO:tasks.workunit.client.0.smithi196.stdout:7/369: dread da/d15/d1d/d29/f76 [0,4194304] 0 2024-03-17T23:58:24.847 INFO:tasks.workunit.client.0.smithi196.stdout:0/371: symlink d5/d23/d24/d28/d47/d52/d66/l69 0 2024-03-17T23:58:24.848 INFO:tasks.workunit.client.0.smithi196.stdout:6/323: read d2/fd [1331022,13017] 0 2024-03-17T23:58:24.850 INFO:tasks.workunit.client.0.smithi196.stdout:9/363: creat d9/df/d4a/d5b/d6d/f73 x:0 0 0 2024-03-17T23:58:24.853 INFO:tasks.workunit.client.0.smithi196.stdout:3/452: dwrite d7/d19/d26/d2b/f67 [0,4194304] 0 2024-03-17T23:58:24.854 INFO:tasks.workunit.client.0.smithi196.stdout:1/300: rename d1/d13/f24 to d1/d13/f6b 0 2024-03-17T23:58:24.857 INFO:tasks.workunit.client.0.smithi196.stdout:6/324: dread - d2/d7/d2b/f4a zero size 2024-03-17T23:58:24.862 INFO:tasks.workunit.client.0.smithi196.stdout:2/456: link d17/d28/f29 d17/d28/d30/d72/fb3 0 2024-03-17T23:58:24.867 INFO:tasks.workunit.client.0.smithi196.stdout:1/301: dwrite d1/db/dd/f12 [0,4194304] 0 2024-03-17T23:58:24.869 INFO:tasks.workunit.client.0.smithi196.stdout:9/364: readlink d9/d38/d60/l4f 0 2024-03-17T23:58:24.869 INFO:tasks.workunit.client.0.smithi196.stdout:0/372: dread d5/d23/d24/d28/d47/d52/d49/f67 [0,4194304] 0 2024-03-17T23:58:24.875 INFO:tasks.workunit.client.0.smithi196.stdout:7/370: dread da/d15/d1d/f30 [0,4194304] 0 2024-03-17T23:58:24.875 INFO:tasks.workunit.client.0.smithi196.stdout:3/453: rename d7/d19/d26/d2b/f44 to d7/d29/f94 0 2024-03-17T23:58:24.875 INFO:tasks.workunit.client.0.smithi196.stdout:3/454: stat d7/f20 0 2024-03-17T23:58:24.880 INFO:tasks.workunit.client.0.smithi196.stdout:6/325: dwrite f0 [0,4194304] 0 2024-03-17T23:58:24.882 INFO:tasks.workunit.client.0.smithi196.stdout:9/365: symlink d9/df/l74 0 2024-03-17T23:58:24.884 INFO:tasks.workunit.client.0.smithi196.stdout:9/366: stat d9/d12/f21 0 2024-03-17T23:58:24.885 INFO:tasks.workunit.client.0.smithi196.stdout:9/367: dread - d9/d33/f52 zero size 2024-03-17T23:58:24.886 INFO:tasks.workunit.client.0.smithi196.stdout:5/335: dwrite d6/d2d/d33/d3b/f6d [0,4194304] 0 2024-03-17T23:58:24.886 INFO:tasks.workunit.client.0.smithi196.stdout:4/301: truncate d1/d11/f12 688497 0 2024-03-17T23:58:24.890 INFO:tasks.workunit.client.0.smithi196.stdout:3/455: write d7/d19/d26/f5c [17540,101680] 0 2024-03-17T23:58:24.890 INFO:tasks.workunit.client.0.smithi196.stdout:6/326: readlink d2/d7/l9 0 2024-03-17T23:58:24.891 INFO:tasks.workunit.client.0.smithi196.stdout:1/302: dread d1/f4 [0,4194304] 0 2024-03-17T23:58:24.892 INFO:tasks.workunit.client.0.smithi196.stdout:7/371: mknod da/d3e/d6d/c7c 0 2024-03-17T23:58:24.894 INFO:tasks.workunit.client.0.smithi196.stdout:1/303: chown d1/f4 4 1 2024-03-17T23:58:24.896 INFO:tasks.workunit.client.0.smithi196.stdout:5/336: creat d6/d15/d16/f71 x:0 0 0 2024-03-17T23:58:24.897 INFO:tasks.workunit.client.0.smithi196.stdout:3/456: creat d7/d19/d78/f95 x:0 0 0 2024-03-17T23:58:24.901 INFO:tasks.workunit.client.0.smithi196.stdout:0/373: truncate d5/d23/d24/d28/d47/d52/d49/f62 738334 0 2024-03-17T23:58:24.903 INFO:tasks.workunit.client.0.smithi196.stdout:5/337: mknod d6/d2d/d33/c72 0 2024-03-17T23:58:24.905 INFO:tasks.workunit.client.0.smithi196.stdout:3/457: mknod d7/d33/d81/c96 0 2024-03-17T23:58:24.907 INFO:tasks.workunit.client.0.smithi196.stdout:3/458: chown d7/d33/d81 84 1 2024-03-17T23:58:24.908 INFO:tasks.workunit.client.0.smithi196.stdout:9/368: dwrite d9/d38/d60/d5e/f57 [0,4194304] 0 2024-03-17T23:58:24.908 INFO:tasks.workunit.client.0.smithi196.stdout:5/338: fsync d6/d2d/d33/d3b/f5e 0 2024-03-17T23:58:24.909 INFO:tasks.workunit.client.0.smithi196.stdout:7/372: link da/d15/f27 da/d15/d1d/d4c/f7d 0 2024-03-17T23:58:24.914 INFO:tasks.workunit.client.0.smithi196.stdout:4/302: dwrite d1/f1d [0,4194304] 0 2024-03-17T23:58:24.914 INFO:tasks.workunit.client.0.smithi196.stdout:3/459: fsync d7/d19/f23 0 2024-03-17T23:58:24.914 INFO:tasks.workunit.client.0.smithi196.stdout:1/304: creat d1/d13/f6c x:0 0 0 2024-03-17T23:58:24.914 INFO:tasks.workunit.client.0.smithi196.stdout:6/327: link d2/d22/f4c d2/d22/f6f 0 2024-03-17T23:58:24.914 INFO:tasks.workunit.client.0.smithi196.stdout:1/305: read - d1/d13/d23/d47/f5c zero size 2024-03-17T23:58:24.917 INFO:tasks.workunit.client.0.smithi196.stdout:5/339: creat d6/d17/d3f/d4e/f73 x:0 0 0 2024-03-17T23:58:24.919 INFO:tasks.workunit.client.0.smithi196.stdout:7/373: unlink da/f16 0 2024-03-17T23:58:24.920 INFO:tasks.workunit.client.0.smithi196.stdout:9/369: mknod d9/d38/d60/d5e/c75 0 2024-03-17T23:58:24.922 INFO:tasks.workunit.client.0.smithi196.stdout:4/303: creat d1/d26/d33/f66 x:0 0 0 2024-03-17T23:58:24.924 INFO:tasks.workunit.client.0.smithi196.stdout:4/304: chown d1/d11/f1c 3 1 2024-03-17T23:58:24.925 INFO:tasks.workunit.client.0.smithi196.stdout:0/374: creat d5/d23/d24/d28/d63/f6a x:0 0 0 2024-03-17T23:58:24.927 INFO:tasks.workunit.client.0.smithi196.stdout:9/370: fdatasync d9/f25 0 2024-03-17T23:58:24.933 INFO:tasks.workunit.client.0.smithi196.stdout:1/306: symlink d1/d13/d2a/l6d 0 2024-03-17T23:58:24.935 INFO:tasks.workunit.client.0.smithi196.stdout:1/307: dread - d1/d13/d23/d47/f5c zero size 2024-03-17T23:58:24.935 INFO:tasks.workunit.client.0.smithi196.stdout:9/371: creat d9/d38/f76 x:0 0 0 2024-03-17T23:58:24.937 INFO:tasks.workunit.client.0.smithi196.stdout:1/308: write d1/f3f [190653,12786] 0 2024-03-17T23:58:24.938 INFO:tasks.workunit.client.0.smithi196.stdout:3/460: creat d7/d19/f97 x:0 0 0 2024-03-17T23:58:24.938 INFO:tasks.workunit.client.0.smithi196.stdout:7/374: dread da/d15/d1d/d4c/f4e [0,4194304] 0 2024-03-17T23:58:24.941 INFO:tasks.workunit.client.0.smithi196.stdout:3/461: fdatasync d7/d19/d26/d2b/d3c/d3d/f5a 0 2024-03-17T23:58:24.944 INFO:tasks.workunit.client.0.smithi196.stdout:1/309: symlink d1/db/dd/d34/l6e 0 2024-03-17T23:58:24.948 INFO:tasks.workunit.client.0.smithi196.stdout:0/375: dread d5/d23/d24/f2c [0,4194304] 0 2024-03-17T23:58:24.949 INFO:tasks.workunit.client.0.smithi196.stdout:4/305: dread d1/d11/f19 [4194304,4194304] 0 2024-03-17T23:58:24.949 INFO:tasks.workunit.client.0.smithi196.stdout:0/376: read d5/f13 [207714,93577] 0 2024-03-17T23:58:24.951 INFO:tasks.workunit.client.0.smithi196.stdout:7/375: creat da/d15/d1d/d29/d54/d57/f7e x:0 0 0 2024-03-17T23:58:24.951 INFO:tasks.workunit.client.0.smithi196.stdout:3/462: mkdir d7/d19/d26/d48/d98 0 2024-03-17T23:58:24.952 INFO:tasks.workunit.client.0.smithi196.stdout:4/306: dread - d1/d26/d33/f5c zero size 2024-03-17T23:58:24.953 INFO:tasks.workunit.client.0.smithi196.stdout:1/310: symlink d1/db/dd/d43/l6f 0 2024-03-17T23:58:24.955 INFO:tasks.workunit.client.0.smithi196.stdout:0/377: creat d5/d23/d24/d30/f6b x:0 0 0 2024-03-17T23:58:24.957 INFO:tasks.workunit.client.0.smithi196.stdout:6/328: dwrite d2/d22/f6f [0,4194304] 0 2024-03-17T23:58:24.960 INFO:tasks.workunit.client.0.smithi196.stdout:4/307: unlink d1/l3 0 2024-03-17T23:58:24.962 INFO:tasks.workunit.client.0.smithi196.stdout:1/311: unlink d1/d13/l60 0 2024-03-17T23:58:24.962 INFO:tasks.workunit.client.0.smithi196.stdout:9/372: dwrite d9/df/d14/d27/f3a [0,4194304] 0 2024-03-17T23:58:24.972 INFO:tasks.workunit.client.0.smithi196.stdout:9/373: symlink d9/d38/d60/l77 0 2024-03-17T23:58:24.977 INFO:tasks.workunit.client.0.smithi196.stdout:7/376: dwrite da/f1c [0,4194304] 0 2024-03-17T23:58:24.977 INFO:tasks.workunit.client.0.smithi196.stdout:6/329: dread d2/d14/d42/f4f [0,4194304] 0 2024-03-17T23:58:24.982 INFO:tasks.workunit.client.0.smithi196.stdout:3/463: dwrite d7/d29/f63 [0,4194304] 0 2024-03-17T23:58:24.987 INFO:tasks.workunit.client.0.smithi196.stdout:0/378: mkdir d5/d23/d24/d28/d47/d52/d61/d6c 0 2024-03-17T23:58:24.994 INFO:tasks.workunit.client.0.smithi196.stdout:4/308: dread d1/de/f21 [0,4194304] 0 2024-03-17T23:58:24.995 INFO:tasks.workunit.client.0.smithi196.stdout:9/374: mknod d9/df/d14/d3d/c78 0 2024-03-17T23:58:24.995 INFO:tasks.workunit.client.0.smithi196.stdout:1/312: dread d1/d13/f6b [0,4194304] 0 2024-03-17T23:58:24.996 INFO:tasks.workunit.client.0.smithi196.stdout:6/330: dwrite d2/f3e [0,4194304] 0 2024-03-17T23:58:24.996 INFO:tasks.workunit.client.0.smithi196.stdout:9/375: stat d9/df/d14/d3d/c78 0 2024-03-17T23:58:24.997 INFO:tasks.workunit.client.0.smithi196.stdout:0/379: write d5/d23/d24/d28/d47/f50 [3691886,85959] 0 2024-03-17T23:58:24.998 INFO:tasks.workunit.client.0.smithi196.stdout:7/377: mkdir da/d3e/d7f 0 2024-03-17T23:58:25.000 INFO:tasks.workunit.client.0.smithi196.stdout:7/378: write da/d15/d1d/f3f [1756435,88826] 0 2024-03-17T23:58:25.001 INFO:tasks.workunit.client.0.smithi196.stdout:7/379: chown da/d15/d1d/d29/d54/f7b 7 1 2024-03-17T23:58:25.001 INFO:tasks.workunit.client.0.smithi196.stdout:7/380: fsync da/f13 0 2024-03-17T23:58:25.002 INFO:tasks.workunit.client.0.smithi196.stdout:7/381: readlink da/d15/l28 0 2024-03-17T23:58:25.004 INFO:tasks.workunit.client.0.smithi196.stdout:1/313: rmdir d1/d13/d23 39 2024-03-17T23:58:25.010 INFO:tasks.workunit.client.0.smithi196.stdout:4/309: write d1/f3a [1635872,65061] 0 2024-03-17T23:58:25.010 INFO:tasks.workunit.client.0.smithi196.stdout:1/314: dread - d1/d13/d23/d47/f52 zero size 2024-03-17T23:58:25.011 INFO:tasks.workunit.client.0.smithi196.stdout:0/380: symlink d5/d23/l6d 0 2024-03-17T23:58:25.012 INFO:tasks.workunit.client.0.smithi196.stdout:6/331: creat d2/d14/d50/d68/f70 x:0 0 0 2024-03-17T23:58:25.014 INFO:tasks.workunit.client.0.smithi196.stdout:7/382: creat da/d15/d1a/d5e/d70/f80 x:0 0 0 2024-03-17T23:58:25.016 INFO:tasks.workunit.client.0.smithi196.stdout:1/315: mkdir d1/d13/d23/d70 0 2024-03-17T23:58:25.016 INFO:tasks.workunit.client.0.smithi196.stdout:9/376: dwrite f5 [0,4194304] 0 2024-03-17T23:58:25.017 INFO:tasks.workunit.client.0.smithi196.stdout:6/332: fdatasync d2/d14/d35/d63/f6b 0 2024-03-17T23:58:25.019 INFO:tasks.workunit.client.0.smithi196.stdout:6/333: chown d2/d14/d35/d63/f3a 24516799 1 2024-03-17T23:58:25.020 INFO:tasks.workunit.client.0.smithi196.stdout:1/316: write d1/d13/d23/d47/d48/f54 [276931,99601] 0 2024-03-17T23:58:25.023 INFO:tasks.workunit.client.0.smithi196.stdout:7/383: mkdir da/d4d/d78/d81 0 2024-03-17T23:58:25.024 INFO:tasks.workunit.client.0.smithi196.stdout:4/310: dread d1/de/d50/f60 [0,4194304] 0 2024-03-17T23:58:25.026 INFO:tasks.workunit.client.0.smithi196.stdout:7/384: write da/d15/d1d/d2e/f69 [550340,84375] 0 2024-03-17T23:58:25.027 INFO:tasks.workunit.client.0.smithi196.stdout:4/311: truncate d1/d11/f1c 1087634 0 2024-03-17T23:58:25.029 INFO:tasks.workunit.client.0.smithi196.stdout:4/312: dread - d1/d26/d33/f5c zero size 2024-03-17T23:58:25.029 INFO:tasks.workunit.client.0.smithi196.stdout:1/317: mkdir d1/d13/d23/d62/d71 0 2024-03-17T23:58:25.030 INFO:tasks.workunit.client.0.smithi196.stdout:7/385: rmdir da/d3e/d45/d60 39 2024-03-17T23:58:25.032 INFO:tasks.workunit.client.0.smithi196.stdout:6/334: rename f0 to d2/d14/f71 0 2024-03-17T23:58:25.033 INFO:tasks.workunit.client.0.smithi196.stdout:0/381: dread d5/f10 [0,4194304] 0 2024-03-17T23:58:25.036 INFO:tasks.workunit.client.0.smithi196.stdout:1/318: fdatasync d1/d13/f41 0 2024-03-17T23:58:25.036 INFO:tasks.workunit.client.0.smithi196.stdout:4/313: mknod d1/d61/c67 0 2024-03-17T23:58:25.036 INFO:tasks.workunit.client.0.smithi196.stdout:7/386: mkdir da/d82 0 2024-03-17T23:58:25.038 INFO:tasks.workunit.client.0.smithi196.stdout:6/335: dread d2/d7/d2b/f3d [0,4194304] 0 2024-03-17T23:58:25.038 INFO:tasks.workunit.client.0.smithi196.stdout:9/377: dread d9/df/d14/f2e [0,4194304] 0 2024-03-17T23:58:25.039 INFO:tasks.workunit.client.0.smithi196.stdout:4/314: stat d1/d1b/l3c 0 2024-03-17T23:58:25.041 INFO:tasks.workunit.client.0.smithi196.stdout:6/336: truncate d2/d14/d35/d63/f38 1108553 0 2024-03-17T23:58:25.043 INFO:tasks.workunit.client.0.smithi196.stdout:7/387: unlink da/l10 0 2024-03-17T23:58:25.045 INFO:tasks.workunit.client.0.smithi196.stdout:0/382: rmdir d5/d23/d24/d28/d47/d60 0 2024-03-17T23:58:25.047 INFO:tasks.workunit.client.0.smithi196.stdout:4/315: mkdir d1/d68 0 2024-03-17T23:58:25.050 INFO:tasks.workunit.client.0.smithi196.stdout:1/319: creat d1/db/dd/f72 x:0 0 0 2024-03-17T23:58:25.052 INFO:tasks.workunit.client.0.smithi196.stdout:4/316: symlink d1/d61/l69 0 2024-03-17T23:58:25.053 INFO:tasks.workunit.client.0.smithi196.stdout:7/388: link da/d15/c74 da/d15/d1d/d4c/c83 0 2024-03-17T23:58:25.056 INFO:tasks.workunit.client.0.smithi196.stdout:6/337: dwrite d2/d14/d35/d63/f6b [0,4194304] 0 2024-03-17T23:58:25.057 INFO:tasks.workunit.client.0.smithi196.stdout:6/338: stat d2/f45 0 2024-03-17T23:58:25.059 INFO:tasks.workunit.client.0.smithi196.stdout:4/317: creat d1/d11/f6a x:0 0 0 2024-03-17T23:58:25.059 INFO:tasks.workunit.client.0.smithi196.stdout:1/320: creat d1/db/f73 x:0 0 0 2024-03-17T23:58:25.061 INFO:tasks.workunit.client.0.smithi196.stdout:0/383: dwrite d5/d23/d24/d28/f55 [0,4194304] 0 2024-03-17T23:58:25.064 INFO:tasks.workunit.client.0.smithi196.stdout:9/378: dwrite d9/df/d14/f6b [0,4194304] 0 2024-03-17T23:58:25.070 INFO:tasks.workunit.client.0.smithi196.stdout:6/339: symlink d2/d22/l72 0 2024-03-17T23:58:25.071 INFO:tasks.workunit.client.0.smithi196.stdout:6/340: dread - d2/d14/d42/f59 zero size 2024-03-17T23:58:25.071 INFO:tasks.workunit.client.0.smithi196.stdout:7/389: getdents da/d4d/d78/d81 0 2024-03-17T23:58:25.072 INFO:tasks.workunit.client.0.smithi196.stdout:1/321: write d1/f4 [2330848,102061] 0 2024-03-17T23:58:25.075 INFO:tasks.workunit.client.0.smithi196.stdout:7/390: unlink da/d15/d1d/d29/f76 0 2024-03-17T23:58:25.077 INFO:tasks.workunit.client.0.smithi196.stdout:1/322: mkdir d1/d13/d23/d47/d48/d74 0 2024-03-17T23:58:25.083 INFO:tasks.workunit.client.0.smithi196.stdout:9/379: creat d9/df/d4a/d5b/d62/f79 x:0 0 0 2024-03-17T23:58:25.084 INFO:tasks.workunit.client.0.smithi196.stdout:0/384: creat d5/d23/d24/f6e x:0 0 0 2024-03-17T23:58:25.087 INFO:tasks.workunit.client.0.smithi196.stdout:9/380: readlink d9/d38/l43 0 2024-03-17T23:58:25.089 INFO:tasks.workunit.client.0.smithi196.stdout:0/385: mknod d5/d23/d24/d28/d47/d52/d66/c6f 0 2024-03-17T23:58:25.090 INFO:tasks.workunit.client.0.smithi196.stdout:7/391: dread da/f5c [0,4194304] 0 2024-03-17T23:58:25.093 INFO:tasks.workunit.client.0.smithi196.stdout:9/381: dread - d9/d38/d60/f68 zero size 2024-03-17T23:58:25.093 INFO:tasks.workunit.client.0.smithi196.stdout:6/341: dwrite d2/d7/d2b/f3d [0,4194304] 0 2024-03-17T23:58:25.095 INFO:tasks.workunit.client.0.smithi196.stdout:4/318: dwrite d1/de/d50/f60 [0,4194304] 0 2024-03-17T23:58:25.096 INFO:tasks.workunit.client.0.smithi196.stdout:7/392: creat da/d3e/d7f/f84 x:0 0 0 2024-03-17T23:58:25.097 INFO:tasks.workunit.client.0.smithi196.stdout:9/382: chown d9/d38/d60/f61 39939543 1 2024-03-17T23:58:25.099 INFO:tasks.workunit.client.0.smithi196.stdout:9/383: fsync d9/d33/f5f 0 2024-03-17T23:58:25.099 INFO:tasks.workunit.client.0.smithi196.stdout:7/393: fsync da/d15/d1d/d29/f36 0 2024-03-17T23:58:25.099 INFO:tasks.workunit.client.0.smithi196.stdout:6/342: write d2/d14/f20 [1938863,114496] 0 2024-03-17T23:58:25.099 INFO:tasks.workunit.client.0.smithi196.stdout:4/319: creat d1/d68/f6b x:0 0 0 2024-03-17T23:58:25.102 INFO:tasks.workunit.client.0.smithi196.stdout:9/384: chown d9/df/d4a/d5b/d62 3363241 1 2024-03-17T23:58:25.102 INFO:tasks.workunit.client.0.smithi196.stdout:4/320: write d1/f1d [4249877,90194] 0 2024-03-17T23:58:25.104 INFO:tasks.workunit.client.0.smithi196.stdout:9/385: truncate d9/d38/d60/f48 336664 0 2024-03-17T23:58:25.108 INFO:tasks.workunit.client.0.smithi196.stdout:6/343: symlink d2/d66/l73 0 2024-03-17T23:58:25.109 INFO:tasks.workunit.client.0.smithi196.stdout:7/394: stat da/d3e/l7a 0 2024-03-17T23:58:25.109 INFO:tasks.workunit.client.0.smithi196.stdout:4/321: symlink d1/d1b/l6c 0 2024-03-17T23:58:25.110 INFO:tasks.workunit.client.0.smithi196.stdout:9/386: fdatasync d9/d12/f16 0 2024-03-17T23:58:25.112 INFO:tasks.workunit.client.0.smithi196.stdout:9/387: write d9/d12/f16 [467605,41053] 0 2024-03-17T23:58:25.112 INFO:tasks.workunit.client.0.smithi196.stdout:1/323: dread d1/f16 [0,4194304] 0 2024-03-17T23:58:25.112 INFO:tasks.workunit.client.0.smithi196.stdout:6/344: fdatasync d2/d14/f71 0 2024-03-17T23:58:25.113 INFO:tasks.workunit.client.0.smithi196.stdout:7/395: write da/d4d/f77 [804030,41048] 0 2024-03-17T23:58:25.114 INFO:tasks.workunit.client.0.smithi196.stdout:9/388: chown d9/df/d4a 2855992 1 2024-03-17T23:58:25.115 INFO:tasks.workunit.client.0.smithi196.stdout:4/322: mknod d1/d11/c6d 0 2024-03-17T23:58:25.115 INFO:tasks.workunit.client.0.smithi196.stdout:7/396: readlink da/d3e/l7a 0 2024-03-17T23:58:25.116 INFO:tasks.workunit.client.0.smithi196.stdout:9/389: fsync d9/d12/d59/f6e 0 2024-03-17T23:58:25.117 INFO:tasks.workunit.client.0.smithi196.stdout:1/324: chown d1/d13/d23/f36 53040813 1 2024-03-17T23:58:25.126 INFO:tasks.workunit.client.0.smithi196.stdout:4/323: dwrite d1/d26/f3b [0,4194304] 0 2024-03-17T23:58:25.126 INFO:tasks.workunit.client.0.smithi196.stdout:0/386: dread d5/f18 [0,4194304] 0 2024-03-17T23:58:25.128 INFO:tasks.workunit.client.0.smithi196.stdout:9/390: creat d9/df/d4a/d5b/d62/f7a x:0 0 0 2024-03-17T23:58:25.131 INFO:tasks.workunit.client.0.smithi196.stdout:6/345: link d2/d14/l24 d2/d66/l74 0 2024-03-17T23:58:25.133 INFO:tasks.workunit.client.0.smithi196.stdout:1/325: mkdir d1/db/dd/d34/d6a/d75 0 2024-03-17T23:58:25.137 INFO:tasks.workunit.client.0.smithi196.stdout:6/346: write d2/d22/f4c [300954,78104] 0 2024-03-17T23:58:25.139 INFO:tasks.workunit.client.0.smithi196.stdout:4/324: creat d1/d26/d33/d3f/f6e x:0 0 0 2024-03-17T23:58:25.142 INFO:tasks.workunit.client.0.smithi196.stdout:1/326: chown d1/db/dd/d34/f42 38295827 1 2024-03-17T23:58:25.145 INFO:tasks.workunit.client.0.smithi196.stdout:6/347: write d2/d14/d35/f6d [95504,48708] 0 2024-03-17T23:58:25.148 INFO:tasks.workunit.client.0.smithi196.stdout:7/397: dread da/d15/d1a/f37 [0,4194304] 0 2024-03-17T23:58:25.149 INFO:tasks.workunit.client.0.smithi196.stdout:0/387: dwrite d5/d23/d24/d59/f65 [0,4194304] 0 2024-03-17T23:58:25.152 INFO:tasks.workunit.client.0.smithi196.stdout:4/325: dread d1/d11/f12 [0,4194304] 0 2024-03-17T23:58:25.153 INFO:tasks.workunit.client.0.smithi196.stdout:4/326: chown d1/f1d 110436550 1 2024-03-17T23:58:25.155 INFO:tasks.workunit.client.0.smithi196.stdout:9/391: truncate d9/d12/f3c 219733 0 2024-03-17T23:58:25.156 INFO:tasks.workunit.client.0.smithi196.stdout:7/398: rmdir da 39 2024-03-17T23:58:25.159 INFO:tasks.workunit.client.0.smithi196.stdout:4/327: creat d1/de/d50/d55/f6f x:0 0 0 2024-03-17T23:58:25.160 INFO:tasks.workunit.client.0.smithi196.stdout:4/328: read d1/f1d [2454852,8868] 0 2024-03-17T23:58:25.161 INFO:tasks.workunit.client.0.smithi196.stdout:1/327: rename d1/d13/d23/d47/c65 to d1/db/dd/d34/d6a/c76 0 2024-03-17T23:58:25.161 INFO:tasks.workunit.client.0.smithi196.stdout:4/329: rename d1 to d1/de/d50/d55/d4a/d70 22 2024-03-17T23:58:25.163 INFO:tasks.workunit.client.0.smithi196.stdout:9/392: dread d9/df/d4a/f5a [0,4194304] 0 2024-03-17T23:58:25.166 INFO:tasks.workunit.client.0.smithi196.stdout:4/330: creat d1/d68/f71 x:0 0 0 2024-03-17T23:58:25.166 INFO:tasks.workunit.client.0.smithi196.stdout:7/399: mkdir da/d3e/d45/d4f/d85 0 2024-03-17T23:58:25.172 INFO:tasks.workunit.client.0.smithi196.stdout:7/400: dread da/d15/d1d/d29/f53 [0,4194304] 0 2024-03-17T23:58:25.172 INFO:tasks.workunit.client.0.smithi196.stdout:9/393: dwrite d9/d38/d60/f48 [0,4194304] 0 2024-03-17T23:58:25.174 INFO:tasks.workunit.client.0.smithi196.stdout:7/401: write da/d15/d1d/d29/d54/d57/f7e [590540,25419] 0 2024-03-17T23:58:25.175 INFO:tasks.workunit.client.0.smithi196.stdout:7/402: write da/d15/f25 [5579782,103957] 0 2024-03-17T23:58:25.178 INFO:tasks.workunit.client.0.smithi196.stdout:0/388: truncate d5/d23/f4a 97074 0 2024-03-17T23:58:25.182 INFO:tasks.workunit.client.0.smithi196.stdout:6/348: dread d2/d14/d42/f4b [4194304,4194304] 0 2024-03-17T23:58:25.184 INFO:tasks.workunit.client.0.smithi196.stdout:6/349: chown d2/d14/d50/d68/f70 1747680 1 2024-03-17T23:58:25.184 INFO:tasks.workunit.client.0.smithi196.stdout:9/394: creat d9/df/f7b x:0 0 0 2024-03-17T23:58:25.185 INFO:tasks.workunit.client.0.smithi196.stdout:0/389: link d5/d23/d24/f6e d5/d23/d24/d28/d47/f70 0 2024-03-17T23:58:25.187 INFO:tasks.workunit.client.0.smithi196.stdout:4/331: getdents d1/d1b 0 2024-03-17T23:58:25.188 INFO:tasks.workunit.client.0.smithi196.stdout:7/403: rename da/d4d to da/d3e/d45/d86 0 2024-03-17T23:58:25.191 INFO:tasks.workunit.client.0.smithi196.stdout:9/395: unlink d9/df/l74 0 2024-03-17T23:58:25.192 INFO:tasks.workunit.client.0.smithi196.stdout:0/390: creat d5/d23/d24/d30/f71 x:0 0 0 2024-03-17T23:58:25.194 INFO:tasks.workunit.client.0.smithi196.stdout:0/391: chown d5/d23/f2d 35 1 2024-03-17T23:58:25.194 INFO:tasks.workunit.client.0.smithi196.stdout:0/392: chown d5/d23/l6d 1573346 1 2024-03-17T23:58:25.197 INFO:tasks.workunit.client.0.smithi196.stdout:4/332: unlink d1/de/l53 0 2024-03-17T23:58:25.198 INFO:tasks.workunit.client.0.smithi196.stdout:7/404: mknod da/d3e/d45/d4f/d75/c87 0 2024-03-17T23:58:25.198 INFO:tasks.workunit.client.0.smithi196.stdout:4/333: dread - d1/d68/f6b zero size 2024-03-17T23:58:25.204 INFO:tasks.workunit.client.0.smithi196.stdout:8/283: sync 2024-03-17T23:58:25.206 INFO:tasks.workunit.client.0.smithi196.stdout:8/284: read - de/d2b/d30/d33/f3d zero size 2024-03-17T23:58:25.208 INFO:tasks.workunit.client.0.smithi196.stdout:4/334: dread d1/f2c [0,4194304] 0 2024-03-17T23:58:25.209 INFO:tasks.workunit.client.0.smithi196.stdout:8/285: write de/f39 [856241,79708] 0 2024-03-17T23:58:25.209 INFO:tasks.workunit.client.0.smithi196.stdout:6/350: getdents d2 0 2024-03-17T23:58:25.210 INFO:tasks.workunit.client.0.smithi196.stdout:0/393: mkdir d5/d23/d24/d72 0 2024-03-17T23:58:25.212 INFO:tasks.workunit.client.0.smithi196.stdout:4/335: chown d1/l17 3540744 1 2024-03-17T23:58:25.214 INFO:tasks.workunit.client.0.smithi196.stdout:7/405: unlink da/d15/d1d/d29/c31 0 2024-03-17T23:58:25.223 INFO:tasks.workunit.client.0.smithi196.stdout:4/336: chown d1/de/l14 19773 1 2024-03-17T23:58:25.224 INFO:tasks.workunit.client.0.smithi196.stdout:4/337: read d1/fd [501624,18745] 0 2024-03-17T23:58:25.225 INFO:tasks.workunit.client.0.smithi196.stdout:4/338: chown d1/d11/l4c 8569 1 2024-03-17T23:58:25.227 INFO:tasks.workunit.client.0.smithi196.stdout:9/396: dwrite d9/d12/f3c [0,4194304] 0 2024-03-17T23:58:25.229 INFO:tasks.workunit.client.0.smithi196.stdout:8/286: dwrite f7 [0,4194304] 0 2024-03-17T23:58:25.232 INFO:tasks.workunit.client.0.smithi196.stdout:4/339: creat d1/d26/d33/f72 x:0 0 0 2024-03-17T23:58:25.232 INFO:tasks.workunit.client.0.smithi196.stdout:4/340: readlink d1/d11/l4c 0 2024-03-17T23:58:25.233 INFO:tasks.workunit.client.0.smithi196.stdout:0/394: dread d5/d23/d24/d28/d47/d52/f42 [0,4194304] 0 2024-03-17T23:58:25.233 INFO:tasks.workunit.client.0.smithi196.stdout:0/395: stat d5 0 2024-03-17T23:58:25.236 INFO:tasks.workunit.client.0.smithi196.stdout:7/406: link da/d15/d1d/d4c/f7d da/d3e/d45/d86/f88 0 2024-03-17T23:58:25.240 INFO:tasks.workunit.client.0.smithi196.stdout:0/396: rename d5/d23/l6d to d5/d23/d24/d28/d47/d52/l73 0 2024-03-17T23:58:25.240 INFO:tasks.workunit.client.0.smithi196.stdout:7/407: chown da/d3e/d45/d4f 3948 1 2024-03-17T23:58:25.243 INFO:tasks.workunit.client.0.smithi196.stdout:9/397: dwrite d9/d12/d59/f63 [0,4194304] 0 2024-03-17T23:58:25.248 INFO:tasks.workunit.client.0.smithi196.stdout:8/287: creat de/d2b/f4e x:0 0 0 2024-03-17T23:58:25.248 INFO:tasks.workunit.client.0.smithi196.stdout:4/341: dwrite d1/fd [4194304,4194304] 0 2024-03-17T23:58:25.249 INFO:tasks.workunit.client.0.smithi196.stdout:8/288: read de/d2b/d30/d33/f48 [3037874,99292] 0 2024-03-17T23:58:25.255 INFO:tasks.workunit.client.0.smithi196.stdout:9/398: creat d9/df/d4a/d5b/d62/f7c x:0 0 0 2024-03-17T23:58:25.256 INFO:tasks.workunit.client.0.smithi196.stdout:9/399: write d9/d33/f42 [164727,98165] 0 2024-03-17T23:58:25.260 INFO:tasks.workunit.client.0.smithi196.stdout:9/400: dread d9/df/d14/f6b [0,4194304] 0 2024-03-17T23:58:25.262 INFO:tasks.workunit.client.0.smithi196.stdout:7/408: write da/d15/d1d/f23 [5106741,102056] 0 2024-03-17T23:58:25.262 INFO:tasks.workunit.client.0.smithi196.stdout:4/342: chown d1/de/c31 2747446 1 2024-03-17T23:58:25.263 INFO:tasks.workunit.client.0.smithi196.stdout:8/289: creat de/d10/d35/f4f x:0 0 0 2024-03-17T23:58:25.265 INFO:tasks.workunit.client.0.smithi196.stdout:0/397: creat d5/d23/f74 x:0 0 0 2024-03-17T23:58:25.269 INFO:tasks.workunit.client.0.smithi196.stdout:7/409: unlink da/d15/l18 0 2024-03-17T23:58:25.269 INFO:tasks.workunit.client.0.smithi196.stdout:7/410: fdatasync da/f1c 0 2024-03-17T23:58:25.269 INFO:tasks.workunit.client.0.smithi196.stdout:0/398: fsync d5/f13 0 2024-03-17T23:58:25.270 INFO:tasks.workunit.client.0.smithi196.stdout:0/399: readlink d5/l48 0 2024-03-17T23:58:25.270 INFO:tasks.workunit.client.0.smithi196.stdout:4/343: symlink d1/d26/d33/l73 0 2024-03-17T23:58:25.272 INFO:tasks.workunit.client.0.smithi196.stdout:7/411: creat da/d3e/d6d/f89 x:0 0 0 2024-03-17T23:58:25.273 INFO:tasks.workunit.client.0.smithi196.stdout:4/344: mkdir d1/d68/d74 0 2024-03-17T23:58:25.274 INFO:tasks.workunit.client.0.smithi196.stdout:7/412: write da/d15/d1d/d29/d54/f7b [297120,7420] 0 2024-03-17T23:58:25.276 INFO:tasks.workunit.client.0.smithi196.stdout:7/413: fsync da/d15/d1a/f44 0 2024-03-17T23:58:25.276 INFO:tasks.workunit.client.0.smithi196.stdout:8/290: truncate de/d2b/d30/d33/f37 1001059 0 2024-03-17T23:58:25.277 INFO:tasks.workunit.client.0.smithi196.stdout:9/401: getdents d9/d12/d59 0 2024-03-17T23:58:25.278 INFO:tasks.workunit.client.0.smithi196.stdout:0/400: mknod d5/d23/d24/d28/d63/c75 0 2024-03-17T23:58:25.279 INFO:tasks.workunit.client.0.smithi196.stdout:0/401: fdatasync d5/d23/d24/d28/f2e 0 2024-03-17T23:58:25.280 INFO:tasks.workunit.client.0.smithi196.stdout:8/291: creat de/d2b/d30/f50 x:0 0 0 2024-03-17T23:58:25.282 INFO:tasks.workunit.client.0.smithi196.stdout:0/402: mknod d5/d23/d24/d28/d63/c76 0 2024-03-17T23:58:25.282 INFO:tasks.workunit.client.0.smithi196.stdout:0/403: chown d5/d23/d24/d30 9 1 2024-03-17T23:58:25.283 INFO:tasks.workunit.client.0.smithi196.stdout:7/414: creat da/d3e/f8a x:0 0 0 2024-03-17T23:58:25.284 INFO:tasks.workunit.client.0.smithi196.stdout:0/404: write d5/d23/d24/f5f [1012880,48548] 0 2024-03-17T23:58:25.285 INFO:tasks.workunit.client.0.smithi196.stdout:7/415: readlink da/d3e/d45/d4f/d43/l49 0 2024-03-17T23:58:25.286 INFO:tasks.workunit.client.0.smithi196.stdout:7/416: dread - da/d15/d1a/d5e/f5f zero size 2024-03-17T23:58:25.286 INFO:tasks.workunit.client.0.smithi196.stdout:8/292: unlink de/l20 0 2024-03-17T23:58:25.287 INFO:tasks.workunit.client.0.smithi196.stdout:8/293: stat de/f1d 0 2024-03-17T23:58:25.287 INFO:tasks.workunit.client.0.smithi196.stdout:7/417: write da/d3e/f8a [185583,21870] 0 2024-03-17T23:58:25.288 INFO:tasks.workunit.client.0.smithi196.stdout:0/405: symlink d5/d23/l77 0 2024-03-17T23:58:25.292 INFO:tasks.workunit.client.0.smithi196.stdout:7/418: creat da/d3e/d7f/f8b x:0 0 0 2024-03-17T23:58:25.295 INFO:tasks.workunit.client.0.smithi196.stdout:9/402: truncate d9/df/d14/f5c 49658 0 2024-03-17T23:58:25.297 INFO:tasks.workunit.client.0.smithi196.stdout:9/403: chown d9/d12/c58 45088 1 2024-03-17T23:58:25.300 INFO:tasks.workunit.client.0.smithi196.stdout:8/294: dwrite de/d10/f1a [0,4194304] 0 2024-03-17T23:58:25.305 INFO:tasks.workunit.client.0.smithi196.stdout:0/406: dwrite d5/d23/d24/f5f [0,4194304] 0 2024-03-17T23:58:25.311 INFO:tasks.workunit.client.0.smithi196.stdout:9/404: creat d9/d12/d59/f7d x:0 0 0 2024-03-17T23:58:25.314 INFO:tasks.workunit.client.0.smithi196.stdout:0/407: write d5/d23/d24/d28/f26 [8896928,101734] 0 2024-03-17T23:58:25.315 INFO:tasks.workunit.client.0.smithi196.stdout:7/419: creat da/d15/f8c x:0 0 0 2024-03-17T23:58:25.315 INFO:tasks.workunit.client.0.smithi196.stdout:9/405: rmdir d9/df/d4a/d5b/d6d 39 2024-03-17T23:58:25.322 INFO:tasks.workunit.client.0.smithi196.stdout:0/408: mknod d5/d23/d24/d28/d47/c78 0 2024-03-17T23:58:25.322 INFO:tasks.workunit.client.0.smithi196.stdout:7/420: read da/d3e/d45/f73 [3682932,63350] 0 2024-03-17T23:58:25.322 INFO:tasks.workunit.client.0.smithi196.stdout:9/406: creat d9/df/d14/d27/f7e x:0 0 0 2024-03-17T23:58:25.323 INFO:tasks.workunit.client.0.smithi196.stdout:9/407: dread - d9/d38/f76 zero size 2024-03-17T23:58:25.323 INFO:tasks.workunit.client.0.smithi196.stdout:8/295: dwrite f7 [4194304,4194304] 0 2024-03-17T23:58:25.328 INFO:tasks.workunit.client.0.smithi196.stdout:9/408: truncate d9/df/d14/d27/f7e 684633 0 2024-03-17T23:58:25.329 INFO:tasks.workunit.client.0.smithi196.stdout:9/409: symlink d9/d38/d60/l7f 0 2024-03-17T23:58:25.329 INFO:tasks.workunit.client.0.smithi196.stdout:0/409: dread - d5/d23/d24/d28/d47/d52/f3f zero size 2024-03-17T23:58:25.329 INFO:tasks.workunit.client.0.smithi196.stdout:0/410: write d5/f13 [1032336,51104] 0 2024-03-17T23:58:25.331 INFO:tasks.workunit.client.0.smithi196.stdout:9/410: creat d9/df/d4a/f80 x:0 0 0 2024-03-17T23:58:25.332 INFO:tasks.workunit.client.0.smithi196.stdout:8/296: fdatasync de/ff 0 2024-03-17T23:58:25.334 INFO:tasks.workunit.client.0.smithi196.stdout:8/297: read de/d10/f3b [2817095,42373] 0 2024-03-17T23:58:25.336 INFO:tasks.workunit.client.0.smithi196.stdout:9/411: creat d9/d38/d60/d5e/f81 x:0 0 0 2024-03-17T23:58:25.340 INFO:tasks.workunit.client.0.smithi196.stdout:0/411: creat d5/d23/f79 x:0 0 0 2024-03-17T23:58:25.342 INFO:tasks.workunit.client.0.smithi196.stdout:0/412: stat d5/l11 0 2024-03-17T23:58:25.342 INFO:tasks.workunit.client.0.smithi196.stdout:7/421: dwrite da/d15/d1d/d4c/f61 [0,4194304] 0 2024-03-17T23:58:25.351 INFO:tasks.workunit.client.0.smithi196.stdout:8/298: dwrite de/d10/f24 [0,4194304] 0 2024-03-17T23:58:25.352 INFO:tasks.workunit.client.0.smithi196.stdout:9/412: dwrite d9/f69 [0,4194304] 0 2024-03-17T23:58:25.355 INFO:tasks.workunit.client.0.smithi196.stdout:8/299: creat de/d2b/d30/f51 x:0 0 0 2024-03-17T23:58:25.360 INFO:tasks.workunit.client.0.smithi196.stdout:7/422: dwrite da/d15/d1d/d4c/f4e [0,4194304] 0 2024-03-17T23:58:25.364 INFO:tasks.workunit.client.0.smithi196.stdout:7/423: chown da/d15/d1d/d29/d54/c58 5 1 2024-03-17T23:58:25.365 INFO:tasks.workunit.client.0.smithi196.stdout:8/300: dwrite de/d2b/d30/f50 [0,4194304] 0 2024-03-17T23:58:25.366 INFO:tasks.workunit.client.0.smithi196.stdout:9/413: rename d9/df/d14/d3d/f53 to d9/d33/f82 0 2024-03-17T23:58:25.368 INFO:tasks.workunit.client.0.smithi196.stdout:9/414: fdatasync d9/df/d14/d3d/f3e 0 2024-03-17T23:58:25.369 INFO:tasks.workunit.client.0.smithi196.stdout:9/415: fdatasync d9/df/d4a/d5b/d62/f79 0 2024-03-17T23:58:25.375 INFO:tasks.workunit.client.0.smithi196.stdout:8/301: write de/d2b/d30/f51 [368285,97167] 0 2024-03-17T23:58:25.376 INFO:tasks.workunit.client.0.smithi196.stdout:8/302: stat de/l1e 0 2024-03-17T23:58:25.379 INFO:tasks.workunit.client.0.smithi196.stdout:8/303: write de/d2b/f38 [5652123,45765] 0 2024-03-17T23:58:25.380 INFO:tasks.workunit.client.0.smithi196.stdout:0/413: dwrite d5/d23/f4a [0,4194304] 0 2024-03-17T23:58:25.383 INFO:tasks.workunit.client.0.smithi196.stdout:9/416: link d9/df/d14/d27/c64 d9/d33/c83 0 2024-03-17T23:58:25.385 INFO:tasks.workunit.client.0.smithi196.stdout:0/414: unlink d5/d23/d24/d28/c68 0 2024-03-17T23:58:25.387 INFO:tasks.workunit.client.0.smithi196.stdout:9/417: truncate d9/d12/d59/f7d 707189 0 2024-03-17T23:58:25.388 INFO:tasks.workunit.client.0.smithi196.stdout:0/415: write d5/d23/d24/d28/f37 [6466019,98184] 0 2024-03-17T23:58:25.389 INFO:tasks.workunit.client.0.smithi196.stdout:7/424: dwrite da/d15/d1d/d4c/f6c [0,4194304] 0 2024-03-17T23:58:25.396 INFO:tasks.workunit.client.0.smithi196.stdout:8/304: dread de/d10/f1b [0,4194304] 0 2024-03-17T23:58:25.398 INFO:tasks.workunit.client.0.smithi196.stdout:9/418: rename d9/df/d14/d27/c64 to d9/df/d4a/d5b/d6d/c84 0 2024-03-17T23:58:25.400 INFO:tasks.workunit.client.0.smithi196.stdout:8/305: creat de/d10/d35/f52 x:0 0 0 2024-03-17T23:58:25.406 INFO:tasks.workunit.client.0.smithi196.stdout:9/419: mkdir d9/d38/d60/d85 0 2024-03-17T23:58:25.406 INFO:tasks.workunit.client.0.smithi196.stdout:0/416: rename d5/d23/c56 to d5/d23/d24/d30/d4e/c7a 0 2024-03-17T23:58:25.414 INFO:tasks.workunit.client.0.smithi196.stdout:0/417: creat d5/d23/d24/d28/d47/d52/d61/f7b x:0 0 0 2024-03-17T23:58:25.415 INFO:tasks.workunit.client.0.smithi196.stdout:9/420: mknod d9/d38/d60/d85/c86 0 2024-03-17T23:58:25.417 INFO:tasks.workunit.client.0.smithi196.stdout:9/421: chown d9/df/d55/l6c 8145467 1 2024-03-17T23:58:25.417 INFO:tasks.workunit.client.0.smithi196.stdout:8/306: dread de/f1f [4194304,4194304] 0 2024-03-17T23:58:25.418 INFO:tasks.workunit.client.0.smithi196.stdout:9/422: readlink d9/d38/l43 0 2024-03-17T23:58:25.418 INFO:tasks.workunit.client.0.smithi196.stdout:0/418: symlink d5/d23/d24/d28/l7c 0 2024-03-17T23:58:25.420 INFO:tasks.workunit.client.0.smithi196.stdout:0/419: write d5/f13 [643415,47920] 0 2024-03-17T23:58:25.420 INFO:tasks.workunit.client.0.smithi196.stdout:8/307: mknod de/d2b/d30/d33/c53 0 2024-03-17T23:58:25.421 INFO:tasks.workunit.client.0.smithi196.stdout:8/308: chown de/f13 99360281 1 2024-03-17T23:58:25.423 INFO:tasks.workunit.client.0.smithi196.stdout:7/425: dread f8 [4194304,4194304] 0 2024-03-17T23:58:25.424 INFO:tasks.workunit.client.0.smithi196.stdout:8/309: mkdir de/d10/d54 0 2024-03-17T23:58:25.426 INFO:tasks.workunit.client.0.smithi196.stdout:0/420: rename d5/d23/d24/d28/d47/d52/l43 to d5/d23/d24/d28/l7d 0 2024-03-17T23:58:25.427 INFO:tasks.workunit.client.0.smithi196.stdout:8/310: rmdir de/d10 39 2024-03-17T23:58:25.429 INFO:tasks.workunit.client.0.smithi196.stdout:7/426: creat da/d3e/d45/d60/f8d x:0 0 0 2024-03-17T23:58:25.430 INFO:tasks.workunit.client.0.smithi196.stdout:0/421: creat d5/d23/d24/d28/d47/d52/f7e x:0 0 0 2024-03-17T23:58:25.431 INFO:tasks.workunit.client.0.smithi196.stdout:9/423: dwrite d9/df/f36 [0,4194304] 0 2024-03-17T23:58:25.432 INFO:tasks.workunit.client.0.smithi196.stdout:8/311: creat de/d2b/d3c/f55 x:0 0 0 2024-03-17T23:58:25.434 INFO:tasks.workunit.client.0.smithi196.stdout:0/422: chown d5/d23/d24/d28/c39 71992515 1 2024-03-17T23:58:25.435 INFO:tasks.workunit.client.0.smithi196.stdout:8/312: write de/d2b/f47 [873466,108805] 0 2024-03-17T23:58:25.436 INFO:tasks.workunit.client.0.smithi196.stdout:7/427: symlink da/d15/d1d/d4c/l8e 0 2024-03-17T23:58:25.437 INFO:tasks.workunit.client.0.smithi196.stdout:0/423: chown d5/d23/d24/d28/d47/d52/d61/f7b 2289 1 2024-03-17T23:58:25.438 INFO:tasks.workunit.client.0.smithi196.stdout:0/424: fsync d5/d23/d24/d30/f71 0 2024-03-17T23:58:25.440 INFO:tasks.workunit.client.0.smithi196.stdout:7/428: write da/d15/f17 [2753622,66476] 0 2024-03-17T23:58:25.441 INFO:tasks.workunit.client.0.smithi196.stdout:8/313: creat de/d10/d35/d3e/f56 x:0 0 0 2024-03-17T23:58:25.444 INFO:tasks.workunit.client.0.smithi196.stdout:7/429: mkdir da/d3e/d45/d4f/d43/d8f 0 2024-03-17T23:58:25.445 INFO:tasks.workunit.client.0.smithi196.stdout:0/425: dread d5/d23/d24/d28/f55 [0,4194304] 0 2024-03-17T23:58:25.446 INFO:tasks.workunit.client.0.smithi196.stdout:0/426: read d5/f13 [2966972,16697] 0 2024-03-17T23:58:25.446 INFO:tasks.workunit.client.0.smithi196.stdout:9/424: getdents d9/df/d14/d3d 0 2024-03-17T23:58:25.450 INFO:tasks.workunit.client.0.smithi196.stdout:9/425: symlink d9/d12/d59/l87 0 2024-03-17T23:58:25.451 INFO:tasks.workunit.client.0.smithi196.stdout:9/426: chown d9/df/d14/d3d 12866 1 2024-03-17T23:58:25.453 INFO:tasks.workunit.client.0.smithi196.stdout:7/430: symlink da/d3e/d45/d4f/d43/d8f/l90 0 2024-03-17T23:58:25.455 INFO:tasks.workunit.client.0.smithi196.stdout:7/431: fsync da/d15/d1d/d4c/f6c 0 2024-03-17T23:58:25.456 INFO:tasks.workunit.client.0.smithi196.stdout:9/427: dread d9/df/d14/d27/f7e [0,4194304] 0 2024-03-17T23:58:25.456 INFO:tasks.workunit.client.0.smithi196.stdout:0/427: dwrite d5/d23/f33 [4194304,4194304] 0 2024-03-17T23:58:25.457 INFO:tasks.workunit.client.0.smithi196.stdout:0/428: stat d5/d23/d24/c4b 0 2024-03-17T23:58:25.458 INFO:tasks.workunit.client.0.smithi196.stdout:7/432: write da/d3e/d45/d4f/d43/f66 [516856,65362] 0 2024-03-17T23:58:25.462 INFO:tasks.workunit.client.0.smithi196.stdout:9/428: write d9/df/d14/f1c [1632971,109266] 0 2024-03-17T23:58:25.468 INFO:tasks.workunit.client.0.smithi196.stdout:0/429: rename d5/d23/d24/d28/d47/d52/d49/f67 to d5/d23/d24/d28/d47/d52/d61/d6c/f7f 0 2024-03-17T23:58:25.470 INFO:tasks.workunit.client.0.smithi196.stdout:9/429: mknod d9/d33/c88 0 2024-03-17T23:58:25.471 INFO:tasks.workunit.client.0.smithi196.stdout:0/430: symlink d5/d23/d24/d30/d4e/l80 0 2024-03-17T23:58:25.472 INFO:tasks.workunit.client.0.smithi196.stdout:7/433: rmdir da/d82 0 2024-03-17T23:58:25.473 INFO:tasks.workunit.client.0.smithi196.stdout:9/430: mkdir d9/df/d4a/d89 0 2024-03-17T23:58:25.473 INFO:tasks.workunit.client.0.smithi196.stdout:0/431: rmdir d5/d23/d24/d28/d47/d52/d61 39 2024-03-17T23:58:25.474 INFO:tasks.workunit.client.0.smithi196.stdout:9/431: unlink d9/d33/f82 0 2024-03-17T23:58:25.476 INFO:tasks.workunit.client.0.smithi196.stdout:7/434: creat da/f91 x:0 0 0 2024-03-17T23:58:25.476 INFO:tasks.workunit.client.0.smithi196.stdout:0/432: mknod d5/d23/d24/d28/d47/d52/d61/d6c/c81 0 2024-03-17T23:58:25.477 INFO:tasks.workunit.client.0.smithi196.stdout:0/433: stat d5/f1c 0 2024-03-17T23:58:25.479 INFO:tasks.workunit.client.0.smithi196.stdout:9/432: rename d9/f69 to d9/f8a 0 2024-03-17T23:58:25.482 INFO:tasks.workunit.client.0.smithi196.stdout:7/435: fsync da/d15/d1d/d29/f5a 0 2024-03-17T23:58:25.484 INFO:tasks.workunit.client.0.smithi196.stdout:9/433: creat d9/df/d14/d3d/f8b x:0 0 0 2024-03-17T23:58:25.486 INFO:tasks.workunit.client.0.smithi196.stdout:9/434: write d9/df/f36 [4161909,30564] 0 2024-03-17T23:58:25.486 INFO:tasks.workunit.client.0.smithi196.stdout:7/436: creat da/d3e/d45/d86/d78/d81/f92 x:0 0 0 2024-03-17T23:58:25.487 INFO:tasks.workunit.client.0.smithi196.stdout:0/434: dwrite d5/d23/d24/d28/f37 [4194304,4194304] 0 2024-03-17T23:58:25.488 INFO:tasks.workunit.client.0.smithi196.stdout:9/435: write d9/df/d4a/d5b/d62/f79 [851192,55564] 0 2024-03-17T23:58:25.488 INFO:tasks.workunit.client.0.smithi196.stdout:7/437: readlink da/l42 0 2024-03-17T23:58:25.490 INFO:tasks.workunit.client.0.smithi196.stdout:9/436: readlink d9/d38/d60/l4f 0 2024-03-17T23:58:25.490 INFO:tasks.workunit.client.0.smithi196.stdout:7/438: write da/f5c [1507935,25837] 0 2024-03-17T23:58:25.492 INFO:tasks.workunit.client.0.smithi196.stdout:7/439: stat da/d15/f8c 0 2024-03-17T23:58:25.493 INFO:tasks.workunit.client.0.smithi196.stdout:9/437: mkdir d9/df/d4a/d8c 0 2024-03-17T23:58:25.495 INFO:tasks.workunit.client.0.smithi196.stdout:0/435: mkdir d5/d23/d24/d28/d47/d52/d61/d6c/d82 0 2024-03-17T23:58:25.499 INFO:tasks.workunit.client.0.smithi196.stdout:7/440: mkdir da/d15/d1d/d29/d54/d57/d93 0 2024-03-17T23:58:25.500 INFO:tasks.workunit.client.0.smithi196.stdout:0/436: creat d5/d23/d24/d28/d47/d52/d49/f83 x:0 0 0 2024-03-17T23:58:25.502 INFO:tasks.workunit.client.0.smithi196.stdout:0/437: readlink d5/d23/d24/d28/l53 0 2024-03-17T23:58:25.502 INFO:tasks.workunit.client.0.smithi196.stdout:9/438: dwrite d9/d12/f16 [4194304,4194304] 0 2024-03-17T23:58:25.504 INFO:tasks.workunit.client.0.smithi196.stdout:7/441: rename da/d15/d1d/d29/l38 to da/d15/d1d/d2e/l94 0 2024-03-17T23:58:25.505 INFO:tasks.workunit.client.0.smithi196.stdout:9/439: rmdir d9/d38 39 2024-03-17T23:58:25.506 INFO:tasks.workunit.client.0.smithi196.stdout:0/438: creat d5/d23/d24/d28/d47/d52/d61/f84 x:0 0 0 2024-03-17T23:58:25.515 INFO:tasks.workunit.client.0.smithi196.stdout:9/440: dread d9/d38/d60/f48 [0,4194304] 0 2024-03-17T23:58:25.518 INFO:tasks.workunit.client.0.smithi196.stdout:9/441: symlink d9/df/l8d 0 2024-03-17T23:58:25.520 INFO:tasks.workunit.client.0.smithi196.stdout:0/439: getdents d5/d23/d24/d28/d47/d52/d61 0 2024-03-17T23:58:25.521 INFO:tasks.workunit.client.0.smithi196.stdout:7/442: dread da/d15/d1d/f32 [0,4194304] 0 2024-03-17T23:58:25.522 INFO:tasks.workunit.client.0.smithi196.stdout:0/440: mkdir d5/d23/d85 0 2024-03-17T23:58:25.525 INFO:tasks.workunit.client.0.smithi196.stdout:9/442: truncate d9/d38/d60/f48 3975550 0 2024-03-17T23:58:25.529 INFO:tasks.workunit.client.0.smithi196.stdout:9/443: getdents d9 0 2024-03-17T23:58:25.531 INFO:tasks.workunit.client.0.smithi196.stdout:0/441: dread d5/d23/f2d [0,4194304] 0 2024-03-17T23:58:25.531 INFO:tasks.workunit.client.0.smithi196.stdout:7/443: dwrite da/d15/d1a/f44 [4194304,4194304] 0 2024-03-17T23:58:25.533 INFO:tasks.workunit.client.0.smithi196.stdout:9/444: mkdir d9/d38/d60/d85/d8e 0 2024-03-17T23:58:25.534 INFO:tasks.workunit.client.0.smithi196.stdout:0/442: dread d5/d23/d24/d28/f41 [0,4194304] 0 2024-03-17T23:58:25.536 INFO:tasks.workunit.client.0.smithi196.stdout:7/444: creat da/d3e/d45/d4f/d75/f95 x:0 0 0 2024-03-17T23:58:25.537 INFO:tasks.workunit.client.0.smithi196.stdout:9/445: creat d9/df/d4a/f8f x:0 0 0 2024-03-17T23:58:25.538 INFO:tasks.workunit.client.0.smithi196.stdout:9/446: chown d9/d38/d60/d5e/f56 316988 1 2024-03-17T23:58:25.538 INFO:tasks.workunit.client.0.smithi196.stdout:0/443: unlink d5/d23/d24/d30/d4e/l80 0 2024-03-17T23:58:25.539 INFO:tasks.workunit.client.0.smithi196.stdout:9/447: write d9/d12/f21 [1695554,74692] 0 2024-03-17T23:58:25.540 INFO:tasks.workunit.client.0.smithi196.stdout:0/444: readlink d5/d23/d24/d28/l53 0 2024-03-17T23:58:25.541 INFO:tasks.workunit.client.0.smithi196.stdout:7/445: creat da/d3e/d45/d86/f96 x:0 0 0 2024-03-17T23:58:25.542 INFO:tasks.workunit.client.0.smithi196.stdout:7/446: write da/f1c [855887,61417] 0 2024-03-17T23:58:25.546 INFO:tasks.workunit.client.0.smithi196.stdout:7/447: symlink da/d15/d1a/d5e/d70/l97 0 2024-03-17T23:58:25.547 INFO:tasks.workunit.client.0.smithi196.stdout:0/445: truncate d5/d23/d24/d28/f2e 1253083 0 2024-03-17T23:58:25.548 INFO:tasks.workunit.client.0.smithi196.stdout:7/448: readlink da/l2b 0 2024-03-17T23:58:25.549 INFO:tasks.workunit.client.0.smithi196.stdout:0/446: symlink d5/d23/d24/d30/l86 0 2024-03-17T23:58:25.550 INFO:tasks.workunit.client.0.smithi196.stdout:9/448: dwrite d9/d38/f3f [0,4194304] 0 2024-03-17T23:58:25.552 INFO:tasks.workunit.client.0.smithi196.stdout:7/449: truncate da/d3e/d45/d86/f96 578458 0 2024-03-17T23:58:25.553 INFO:tasks.workunit.client.0.smithi196.stdout:7/450: fsync da/d15/d1d/d29/f36 0 2024-03-17T23:58:25.555 INFO:tasks.workunit.client.0.smithi196.stdout:0/447: unlink d5/d23/d24/d28/l7c 0 2024-03-17T23:58:25.558 INFO:tasks.workunit.client.0.smithi196.stdout:7/451: rename da/d15/d1a/f37 to da/d3e/d45/d86/f98 0 2024-03-17T23:58:25.559 INFO:tasks.workunit.client.0.smithi196.stdout:7/452: stat da/d3e/d45/d86/d78/d81/f92 0 2024-03-17T23:58:25.560 INFO:tasks.workunit.client.0.smithi196.stdout:7/453: stat da/d15/d1d/f2d 0 2024-03-17T23:58:25.561 INFO:tasks.workunit.client.0.smithi196.stdout:7/454: write da/d3e/d6d/f89 [430959,58970] 0 2024-03-17T23:58:25.561 INFO:tasks.workunit.client.0.smithi196.stdout:9/449: link d9/d12/f3c d9/d38/d60/f90 0 2024-03-17T23:58:25.562 INFO:tasks.workunit.client.0.smithi196.stdout:9/450: write f5 [4929823,29926] 0 2024-03-17T23:58:25.563 INFO:tasks.workunit.client.0.smithi196.stdout:0/448: rename d5/d23/d24/d28/c39 to d5/d23/d24/d28/d47/d52/d61/d6c/d82/c87 0 2024-03-17T23:58:25.566 INFO:tasks.workunit.client.0.smithi196.stdout:2/457: sync 2024-03-17T23:58:25.567 INFO:tasks.workunit.client.0.smithi196.stdout:5/340: sync 2024-03-17T23:58:25.569 INFO:tasks.workunit.client.0.smithi196.stdout:7/455: creat da/d3e/d45/d60/f99 x:0 0 0 2024-03-17T23:58:25.570 INFO:tasks.workunit.client.0.smithi196.stdout:9/451: chown d9/l37 1635 1 2024-03-17T23:58:25.572 INFO:tasks.workunit.client.0.smithi196.stdout:9/452: chown d9/df/d14/d27 1 1 2024-03-17T23:58:25.573 INFO:tasks.workunit.client.0.smithi196.stdout:5/341: creat d6/d17/d23/f74 x:0 0 0 2024-03-17T23:58:25.574 INFO:tasks.workunit.client.0.smithi196.stdout:0/449: dwrite d5/d23/d24/d28/f37 [4194304,4194304] 0 2024-03-17T23:58:25.575 INFO:tasks.workunit.client.0.smithi196.stdout:7/456: truncate da/d15/d1d/d29/d54/f7b 366893 0 2024-03-17T23:58:25.578 INFO:tasks.workunit.client.0.smithi196.stdout:9/453: creat d9/df/d14/d3d/f91 x:0 0 0 2024-03-17T23:58:25.580 INFO:tasks.workunit.client.0.smithi196.stdout:5/342: creat d6/d17/d1f/f75 x:0 0 0 2024-03-17T23:58:25.581 INFO:tasks.workunit.client.0.smithi196.stdout:5/343: dread - d6/d17/d23/f74 zero size 2024-03-17T23:58:25.582 INFO:tasks.workunit.client.0.smithi196.stdout:2/458: truncate d17/d28/d30/d72/d81/fa4 821323 0 2024-03-17T23:58:25.583 INFO:tasks.workunit.client.0.smithi196.stdout:7/457: creat da/d15/d1a/d5e/d70/f9a x:0 0 0 2024-03-17T23:58:25.586 INFO:tasks.workunit.client.0.smithi196.stdout:5/344: mknod d6/d17/d35/c76 0 2024-03-17T23:58:25.586 INFO:tasks.workunit.client.0.smithi196.stdout:2/459: write d17/d28/d30/d72/d81/fa1 [373914,60656] 0 2024-03-17T23:58:25.589 INFO:tasks.workunit.client.0.smithi196.stdout:5/345: fsync d6/d15/d16/f4a 0 2024-03-17T23:58:25.590 INFO:tasks.workunit.client.0.smithi196.stdout:2/460: write d17/d22/d59/f78 [622627,72298] 0 2024-03-17T23:58:25.591 INFO:tasks.workunit.client.0.smithi196.stdout:9/454: dwrite d9/df/d14/d3d/f3e [4194304,4194304] 0 2024-03-17T23:58:25.594 INFO:tasks.workunit.client.0.smithi196.stdout:7/458: getdents da/d3e/d45/d86/d78 0 2024-03-17T23:58:25.595 INFO:tasks.workunit.client.0.smithi196.stdout:9/455: write d9/df/d14/d3d/f3e [3572210,112930] 0 2024-03-17T23:58:25.597 INFO:tasks.workunit.client.0.smithi196.stdout:9/456: truncate d9/d12/d59/f65 801791 0 2024-03-17T23:58:25.601 INFO:tasks.workunit.client.0.smithi196.stdout:0/450: write d5/f18 [750533,91517] 0 2024-03-17T23:58:25.603 INFO:tasks.workunit.client.0.smithi196.stdout:7/459: mkdir da/d15/d1d/d29/d54/d9b 0 2024-03-17T23:58:25.606 INFO:tasks.workunit.client.0.smithi196.stdout:5/346: link d6/d2a/f31 d6/d2d/d33/d3b/f77 0 2024-03-17T23:58:25.606 INFO:tasks.workunit.client.0.smithi196.stdout:7/460: rename da/c35 to da/d3e/d45/d86/d78/c9c 0 2024-03-17T23:58:25.607 INFO:tasks.workunit.client.0.smithi196.stdout:7/461: chown da/d15/d1d/d29 433885 1 2024-03-17T23:58:25.609 INFO:tasks.workunit.client.0.smithi196.stdout:9/457: write d9/df/d14/f2e [281023,113018] 0 2024-03-17T23:58:25.609 INFO:tasks.workunit.client.0.smithi196.stdout:5/347: write d6/d17/d35/f41 [739221,53042] 0 2024-03-17T23:58:25.611 INFO:tasks.workunit.client.0.smithi196.stdout:9/458: readlink d9/d12/d59/l87 0 2024-03-17T23:58:25.613 INFO:tasks.workunit.client.0.smithi196.stdout:9/459: chown d9/df/d14/d27 48273 1 2024-03-17T23:58:25.613 INFO:tasks.workunit.client.0.smithi196.stdout:5/348: fsync d6/d15/f27 0 2024-03-17T23:58:25.616 INFO:tasks.workunit.client.0.smithi196.stdout:7/462: rename da/d15/d1d/d4c/f5b to da/d15/d1d/d4c/f9d 0 2024-03-17T23:58:25.617 INFO:tasks.workunit.client.0.smithi196.stdout:9/460: write d9/df/d14/f72 [769079,129745] 0 2024-03-17T23:58:25.618 INFO:tasks.workunit.client.0.smithi196.stdout:0/451: dwrite d5/d23/d24/d30/f6b [0,4194304] 0 2024-03-17T23:58:25.618 INFO:tasks.workunit.client.0.smithi196.stdout:7/463: fsync da/d3e/d7f/f84 0 2024-03-17T23:58:25.619 INFO:tasks.workunit.client.0.smithi196.stdout:7/464: chown da/l19 3539 1 2024-03-17T23:58:25.621 INFO:tasks.workunit.client.0.smithi196.stdout:5/349: rename d6/d2d/d33/d3b/c3d to d6/d17/d1f/d5c/c78 0 2024-03-17T23:58:25.622 INFO:tasks.workunit.client.0.smithi196.stdout:7/465: truncate da/d15/d1a/f44 8612718 0 2024-03-17T23:58:25.624 INFO:tasks.workunit.client.0.smithi196.stdout:5/350: write d6/d17/d35/f41 [880768,97788] 0 2024-03-17T23:58:25.625 INFO:tasks.workunit.client.0.smithi196.stdout:9/461: fsync d9/df/d14/d27/f4c 0 2024-03-17T23:58:25.627 INFO:tasks.workunit.client.0.smithi196.stdout:0/452: rmdir d5/d23/d24/d28/d47/d52/d49 39 2024-03-17T23:58:25.627 INFO:tasks.workunit.client.0.smithi196.stdout:5/351: write d6/d17/d3f/f67 [4948749,102028] 0 2024-03-17T23:58:25.629 INFO:tasks.workunit.client.0.smithi196.stdout:9/462: truncate d9/df/d14/f72 1743336 0 2024-03-17T23:58:25.632 INFO:tasks.workunit.client.0.smithi196.stdout:7/466: mkdir da/d3e/d45/d4f/d43/d9e 0 2024-03-17T23:58:25.633 INFO:tasks.workunit.client.0.smithi196.stdout:9/463: dread d9/df/d14/d27/f4c [0,4194304] 0 2024-03-17T23:58:25.634 INFO:tasks.workunit.client.0.smithi196.stdout:9/464: chown d9/d38/l43 192164177 1 2024-03-17T23:58:25.634 INFO:tasks.workunit.client.0.smithi196.stdout:5/352: mknod d6/d15/c79 0 2024-03-17T23:58:25.637 INFO:tasks.workunit.client.0.smithi196.stdout:5/353: read f0 [903366,49420] 0 2024-03-17T23:58:25.637 INFO:tasks.workunit.client.0.smithi196.stdout:9/465: write d9/df/d14/d3d/f3e [5069504,10160] 0 2024-03-17T23:58:25.637 INFO:tasks.workunit.client.0.smithi196.stdout:7/467: mkdir da/d3e/d45/d86/d78/d9f 0 2024-03-17T23:58:25.638 INFO:tasks.workunit.client.0.smithi196.stdout:9/466: fdatasync d9/df/d14/d3d/f8b 0 2024-03-17T23:58:25.644 INFO:tasks.workunit.client.0.smithi196.stdout:7/468: mknod da/ca0 0 2024-03-17T23:58:25.644 INFO:tasks.workunit.client.0.smithi196.stdout:0/453: link d5/d23/d24/l38 d5/d23/d24/d28/d47/d52/d49/l88 0 2024-03-17T23:58:25.646 INFO:tasks.workunit.client.0.smithi196.stdout:9/467: getdents d9/d38/d60/d5e 0 2024-03-17T23:58:25.647 INFO:tasks.workunit.client.0.smithi196.stdout:7/469: mknod da/d15/ca1 0 2024-03-17T23:58:25.647 INFO:tasks.workunit.client.0.smithi196.stdout:9/468: chown d9/df/d4a/f80 184989 1 2024-03-17T23:58:25.650 INFO:tasks.workunit.client.0.smithi196.stdout:0/454: link d5/d23/l77 d5/d23/d24/d28/d47/d52/d61/l89 0 2024-03-17T23:58:25.652 INFO:tasks.workunit.client.0.smithi196.stdout:7/470: truncate da/d3e/d45/d86/f88 127947 0 2024-03-17T23:58:25.652 INFO:tasks.workunit.client.0.smithi196.stdout:9/469: link d9/d12/c1f d9/df/d4a/d5b/d6d/c92 0 2024-03-17T23:58:25.653 INFO:tasks.workunit.client.0.smithi196.stdout:9/470: readlink d9/df/d14/l50 0 2024-03-17T23:58:25.655 INFO:tasks.workunit.client.0.smithi196.stdout:7/471: chown da/d3e/l40 225796 1 2024-03-17T23:58:25.655 INFO:tasks.workunit.client.0.smithi196.stdout:0/455: dread d5/d23/d24/d28/d47/f50 [0,4194304] 0 2024-03-17T23:58:25.657 INFO:tasks.workunit.client.0.smithi196.stdout:9/471: creat d9/d38/f93 x:0 0 0 2024-03-17T23:58:25.658 INFO:tasks.workunit.client.0.smithi196.stdout:0/456: fdatasync d5/d23/d24/d28/d47/d52/f42 0 2024-03-17T23:58:25.660 INFO:tasks.workunit.client.0.smithi196.stdout:9/472: symlink d9/df/d4a/d89/l94 0 2024-03-17T23:58:25.660 INFO:tasks.workunit.client.0.smithi196.stdout:0/457: write d5/d23/d24/d28/f37 [3915268,20154] 0 2024-03-17T23:58:25.663 INFO:tasks.workunit.client.0.smithi196.stdout:9/473: chown d9/df/d14/d3d/c46 3 1 2024-03-17T23:58:25.664 INFO:tasks.workunit.client.0.smithi196.stdout:7/472: dwrite da/f13 [0,4194304] 0 2024-03-17T23:58:25.664 INFO:tasks.workunit.client.0.smithi196.stdout:9/474: fdatasync d9/d33/f5f 0 2024-03-17T23:58:25.665 INFO:tasks.workunit.client.0.smithi196.stdout:0/458: unlink d5/d23/d24/d59/f65 0 2024-03-17T23:58:25.666 INFO:tasks.workunit.client.0.smithi196.stdout:9/475: chown d9/d12/d59/f7d 438 1 2024-03-17T23:58:25.667 INFO:tasks.workunit.client.0.smithi196.stdout:7/473: readlink da/d15/d1a/d5e/d70/l97 0 2024-03-17T23:58:25.668 INFO:tasks.workunit.client.0.smithi196.stdout:9/476: write d9/df/d14/d27/f3a [626690,115046] 0 2024-03-17T23:58:25.672 INFO:tasks.workunit.client.0.smithi196.stdout:7/474: mkdir da/d3e/d45/d4f/d43/d9e/da2 0 2024-03-17T23:58:25.676 INFO:tasks.workunit.client.0.smithi196.stdout:0/459: dwrite d5/d23/d24/d28/d47/d52/d49/f83 [0,4194304] 0 2024-03-17T23:58:25.682 INFO:tasks.workunit.client.0.smithi196.stdout:0/460: symlink d5/l8a 0 2024-03-17T23:58:25.683 INFO:tasks.workunit.client.0.smithi196.stdout:0/461: readlink d5/d23/l34 0 2024-03-17T23:58:25.687 INFO:tasks.workunit.client.0.smithi196.stdout:0/462: rename d5/d23/d24/d28/d63 to d5/d23/d24/d59/d8b 0 2024-03-17T23:58:25.688 INFO:tasks.workunit.client.0.smithi196.stdout:7/475: dwrite da/f5c [0,4194304] 0 2024-03-17T23:58:25.693 INFO:tasks.workunit.client.0.smithi196.stdout:7/476: symlink da/d3e/d45/la3 0 2024-03-17T23:58:25.693 INFO:tasks.workunit.client.0.smithi196.stdout:7/477: chown l9 525 1 2024-03-17T23:58:25.693 INFO:tasks.workunit.client.0.smithi196.stdout:0/463: truncate d5/d23/d24/d28/f2e 1327833 0 2024-03-17T23:58:25.694 INFO:tasks.workunit.client.0.smithi196.stdout:7/478: chown da/d3e/d45/d4f/d43/c48 262 1 2024-03-17T23:58:25.694 INFO:tasks.workunit.client.0.smithi196.stdout:0/464: dread - d5/d23/d24/d30/f71 zero size 2024-03-17T23:58:25.696 INFO:tasks.workunit.client.0.smithi196.stdout:7/479: truncate da/d3e/d6d/f89 1100822 0 2024-03-17T23:58:25.699 INFO:tasks.workunit.client.0.smithi196.stdout:7/480: rename da/d15/d1d/d29/d54 to da/d3e/d45/d86/d78/da4 0 2024-03-17T23:58:25.702 INFO:tasks.workunit.client.0.smithi196.stdout:7/481: mkdir da/d15/d1a/d5e/da5 0 2024-03-17T23:58:25.703 INFO:tasks.workunit.client.0.smithi196.stdout:0/465: write d5/d23/d24/f6e [768917,11119] 0 2024-03-17T23:58:25.707 INFO:tasks.workunit.client.0.smithi196.stdout:0/466: getdents d5/d23 0 2024-03-17T23:58:25.711 INFO:tasks.workunit.client.0.smithi196.stdout:7/482: dwrite da/d15/d1d/f2d [4194304,4194304] 0 2024-03-17T23:58:25.713 INFO:tasks.workunit.client.0.smithi196.stdout:0/467: rename d5/d23/d24/d30/f5d to d5/d23/d24/d30/d4e/f8c 0 2024-03-17T23:58:25.713 INFO:tasks.workunit.client.0.smithi196.stdout:7/483: stat da 0 2024-03-17T23:58:25.715 INFO:tasks.workunit.client.0.smithi196.stdout:0/468: mknod d5/d23/d24/d28/d47/d52/d61/d6c/d82/c8d 0 2024-03-17T23:58:25.716 INFO:tasks.workunit.client.0.smithi196.stdout:7/484: creat da/fa6 x:0 0 0 2024-03-17T23:58:25.717 INFO:tasks.workunit.client.0.smithi196.stdout:7/485: stat da/d3e/d45/d4f/d43/l4b 0 2024-03-17T23:58:25.718 INFO:tasks.workunit.client.0.smithi196.stdout:0/469: rmdir d5/d23/d24/d28/d47/d52/d61/d6c/d82 39 2024-03-17T23:58:25.718 INFO:tasks.workunit.client.0.smithi196.stdout:7/486: read da/f5c [349419,93361] 0 2024-03-17T23:58:25.719 INFO:tasks.workunit.client.0.smithi196.stdout:0/470: write d5/d23/f4a [4678130,24670] 0 2024-03-17T23:58:25.724 INFO:tasks.workunit.client.0.smithi196.stdout:7/487: rename da/d3e/d45/d86/d78/da4/d57 to da/d15/da7 0 2024-03-17T23:58:25.729 INFO:tasks.workunit.client.0.smithi196.stdout:0/471: dwrite d5/d23/d24/f2f [0,4194304] 0 2024-03-17T23:58:25.737 INFO:tasks.workunit.client.0.smithi196.stdout:7/488: rename da/d3e/d45/d86 to da/d3e/d45/d4f/d75/da8 0 2024-03-17T23:58:25.737 INFO:tasks.workunit.client.0.smithi196.stdout:0/472: creat d5/d23/d24/d72/f8e x:0 0 0 2024-03-17T23:58:25.737 INFO:tasks.workunit.client.0.smithi196.stdout:7/489: dread - da/d15/da7/f68 zero size 2024-03-17T23:58:25.738 INFO:tasks.workunit.client.0.smithi196.stdout:7/490: read da/f13 [1277241,10534] 0 2024-03-17T23:58:25.740 INFO:tasks.workunit.client.0.smithi196.stdout:0/473: unlink d5/d23/d24/d28/l2a 0 2024-03-17T23:58:25.748 INFO:tasks.workunit.client.0.smithi196.stdout:7/491: dwrite da/d15/da7/f68 [0,4194304] 0 2024-03-17T23:58:25.751 INFO:tasks.workunit.client.0.smithi196.stdout:7/492: write da/d15/f8c [511945,6156] 0 2024-03-17T23:58:25.754 INFO:tasks.workunit.client.0.smithi196.stdout:7/493: mknod da/d3e/d45/d4f/d75/da8/d78/da4/ca9 0 2024-03-17T23:58:25.755 INFO:tasks.workunit.client.0.smithi196.stdout:0/474: dread d5/f1c [0,4194304] 0 2024-03-17T23:58:25.756 INFO:tasks.workunit.client.0.smithi196.stdout:7/494: creat da/d15/d1a/faa x:0 0 0 2024-03-17T23:58:25.757 INFO:tasks.workunit.client.0.smithi196.stdout:0/475: chown d5/d23/d24/d59/d8b/f6a 93 1 2024-03-17T23:58:25.766 INFO:tasks.workunit.client.0.smithi196.stdout:0/476: dwrite d5/d23/f2d [0,4194304] 0 2024-03-17T23:58:25.771 INFO:tasks.workunit.client.0.smithi196.stdout:0/477: unlink d5/d23/d24/d30/f71 0 2024-03-17T23:58:25.772 INFO:tasks.workunit.client.0.smithi196.stdout:7/495: dwrite da/d3e/d45/d4f/d75/da8/f88 [0,4194304] 0 2024-03-17T23:58:25.786 INFO:tasks.workunit.client.0.smithi196.stdout:0/478: dread d5/d23/d24/d28/d47/d52/d49/f83 [0,4194304] 0 2024-03-17T23:58:25.791 INFO:tasks.workunit.client.0.smithi196.stdout:0/479: mknod d5/d23/d24/c8f 0 2024-03-17T23:58:25.794 INFO:tasks.workunit.client.0.smithi196.stdout:7/496: dwrite da/d15/d1a/d5e/f62 [0,4194304] 0 2024-03-17T23:58:25.794 INFO:tasks.workunit.client.0.smithi196.stdout:0/480: unlink d5/l8a 0 2024-03-17T23:58:25.806 INFO:tasks.workunit.client.0.smithi196.stdout:0/481: dwrite d5/d23/d24/f5f [0,4194304] 0 2024-03-17T23:58:25.813 INFO:tasks.workunit.client.0.smithi196.stdout:0/482: creat d5/d23/d24/d30/f90 x:0 0 0 2024-03-17T23:58:25.813 INFO:tasks.workunit.client.0.smithi196.stdout:0/483: dread - d5/d23/d24/d72/f8e zero size 2024-03-17T23:58:25.814 INFO:tasks.workunit.client.0.smithi196.stdout:1/328: sync 2024-03-17T23:58:25.814 INFO:tasks.workunit.client.0.smithi196.stdout:3/464: sync 2024-03-17T23:58:25.815 INFO:tasks.workunit.client.0.smithi196.stdout:3/465: read - d7/f2c zero size 2024-03-17T23:58:25.816 INFO:tasks.workunit.client.0.smithi196.stdout:0/484: symlink d5/d23/d24/d28/d47/d52/d49/l91 0 2024-03-17T23:58:25.816 INFO:tasks.workunit.client.0.smithi196.stdout:1/329: fsync d1/db/dd/d34/f55 0 2024-03-17T23:58:25.817 INFO:tasks.workunit.client.0.smithi196.stdout:7/497: dread da/d15/f25 [0,4194304] 0 2024-03-17T23:58:25.819 INFO:tasks.workunit.client.0.smithi196.stdout:7/498: write da/d3e/d7f/f8b [521650,75615] 0 2024-03-17T23:58:25.822 INFO:tasks.workunit.client.0.smithi196.stdout:1/330: unlink d1/d13/f5a 0 2024-03-17T23:58:25.829 INFO:tasks.workunit.client.0.smithi196.stdout:0/485: write d5/f10 [1692191,109146] 0 2024-03-17T23:58:25.829 INFO:tasks.workunit.client.0.smithi196.stdout:7/499: creat da/d3e/d45/d4f/d43/d9e/fab x:0 0 0 2024-03-17T23:58:25.830 INFO:tasks.workunit.client.0.smithi196.stdout:1/331: getdents d1/db/dd/d43/d64 0 2024-03-17T23:58:25.832 INFO:tasks.workunit.client.0.smithi196.stdout:3/466: dread d7/d29/f63 [0,4194304] 0 2024-03-17T23:58:25.832 INFO:tasks.workunit.client.0.smithi196.stdout:1/332: readlink d1/d13/d23/d47/d48/l4f 0 2024-03-17T23:58:25.832 INFO:tasks.workunit.client.0.smithi196.stdout:0/486: mkdir d5/d92 0 2024-03-17T23:58:25.833 INFO:tasks.workunit.client.0.smithi196.stdout:7/500: creat da/d15/d1a/fac x:0 0 0 2024-03-17T23:58:25.833 INFO:tasks.workunit.client.0.smithi196.stdout:3/467: read - d7/d19/d78/f95 zero size 2024-03-17T23:58:25.836 INFO:tasks.workunit.client.0.smithi196.stdout:7/501: write da/d15/d1d/d4c/f51 [4548168,40821] 0 2024-03-17T23:58:25.837 INFO:tasks.workunit.client.0.smithi196.stdout:3/468: truncate d7/d29/f87 419469 0 2024-03-17T23:58:25.841 INFO:tasks.workunit.client.0.smithi196.stdout:3/469: dread d7/d19/d26/f47 [0,4194304] 0 2024-03-17T23:58:25.843 INFO:tasks.workunit.client.0.smithi196.stdout:0/487: dwrite d5/f1c [4194304,4194304] 0 2024-03-17T23:58:25.847 INFO:tasks.workunit.client.0.smithi196.stdout:0/488: creat d5/d23/d24/d30/f93 x:0 0 0 2024-03-17T23:58:25.850 INFO:tasks.workunit.client.0.smithi196.stdout:0/489: dread d5/d23/d24/d28/f41 [0,4194304] 0 2024-03-17T23:58:25.851 INFO:tasks.workunit.client.0.smithi196.stdout:1/333: dwrite d1/d13/d23/d47/f52 [0,4194304] 0 2024-03-17T23:58:25.854 INFO:tasks.workunit.client.0.smithi196.stdout:1/334: truncate d1/db/dd/f67 785736 0 2024-03-17T23:58:25.857 INFO:tasks.workunit.client.0.smithi196.stdout:1/335: mknod d1/db/dd/d43/c77 0 2024-03-17T23:58:25.858 INFO:tasks.workunit.client.0.smithi196.stdout:3/470: dwrite d7/d19/d26/d2b/d3c/f52 [0,4194304] 0 2024-03-17T23:58:25.859 INFO:tasks.workunit.client.0.smithi196.stdout:3/471: truncate d7/f58 553207 0 2024-03-17T23:58:25.898 INFO:tasks.workunit.client.0.smithi196.stdout:0/490: truncate d5/f44 968484 0 2024-03-17T23:58:25.899 INFO:tasks.workunit.client.0.smithi196.stdout:1/336: chown d1/db/c1e 6 1 2024-03-17T23:58:25.899 INFO:tasks.workunit.client.0.smithi196.stdout:1/337: chown d1/db 14942 1 2024-03-17T23:58:25.902 INFO:tasks.workunit.client.0.smithi196.stdout:3/472: mkdir d7/d19/d26/d2b/d3c/d3d/d99 0 2024-03-17T23:58:25.903 INFO:tasks.workunit.client.0.smithi196.stdout:1/338: stat d1/c22 0 2024-03-17T23:58:25.904 INFO:tasks.workunit.client.0.smithi196.stdout:3/473: dread - d7/d33/f90 zero size 2024-03-17T23:58:25.909 INFO:tasks.workunit.client.0.smithi196.stdout:0/491: dwrite d5/d23/f2d [0,4194304] 0 2024-03-17T23:58:25.915 INFO:tasks.workunit.client.0.smithi196.stdout:3/474: dwrite d7/d19/d26/d2b/f67 [0,4194304] 0 2024-03-17T23:58:25.919 INFO:tasks.workunit.client.0.smithi196.stdout:0/492: dread d5/d23/d24/d28/d47/d52/f42 [0,4194304] 0 2024-03-17T23:58:25.919 INFO:tasks.workunit.client.0.smithi196.stdout:1/339: dread d1/f25 [0,4194304] 0 2024-03-17T23:58:25.923 INFO:tasks.workunit.client.0.smithi196.stdout:0/493: mkdir d5/d23/d24/d59/d94 0 2024-03-17T23:58:25.932 INFO:tasks.workunit.client.0.smithi196.stdout:1/340: write d1/d13/f18 [1563610,32328] 0 2024-03-17T23:58:25.938 INFO:tasks.workunit.client.0.smithi196.stdout:0/494: dwrite d5/d23/d24/d28/d47/d52/f42 [4194304,4194304] 0 2024-03-17T23:58:25.941 INFO:tasks.workunit.client.0.smithi196.stdout:3/475: dwrite d7/d19/d26/d2b/d3c/f77 [0,4194304] 0 2024-03-17T23:58:25.948 INFO:tasks.workunit.client.0.smithi196.stdout:0/495: mknod d5/d23/d24/d59/d8b/c95 0 2024-03-17T23:58:25.952 INFO:tasks.workunit.client.0.smithi196.stdout:1/341: link d1/db/dd/d34/c5b d1/c78 0 2024-03-17T23:58:25.952 INFO:tasks.workunit.client.0.smithi196.stdout:3/476: chown d7/d19/d26/d2b/d3c/d3d/d7d 47028233 1 2024-03-17T23:58:25.954 INFO:tasks.workunit.client.0.smithi196.stdout:3/477: dread - d7/d19/d26/d2b/d3c/f76 zero size 2024-03-17T23:58:25.954 INFO:tasks.workunit.client.0.smithi196.stdout:0/496: write d5/d23/d24/d28/d47/d52/d49/f83 [2804932,32285] 0 2024-03-17T23:58:25.956 INFO:tasks.workunit.client.0.smithi196.stdout:0/497: stat d5/d23/d24/d28/d47/d52/d61/d6c 0 2024-03-17T23:58:25.957 INFO:tasks.workunit.client.0.smithi196.stdout:1/342: rmdir d1/db/dd/d43/d64 0 2024-03-17T23:58:25.960 INFO:tasks.workunit.client.0.smithi196.stdout:3/478: mknod d7/c9a 0 2024-03-17T23:58:25.963 INFO:tasks.workunit.client.0.smithi196.stdout:3/479: mkdir d7/d29/d9b 0 2024-03-17T23:58:25.965 INFO:tasks.workunit.client.0.smithi196.stdout:1/343: dwrite d1/d13/f3b [0,4194304] 0 2024-03-17T23:58:25.967 INFO:tasks.workunit.client.0.smithi196.stdout:0/498: truncate d5/d23/d24/d28/d47/d52/d61/d6c/f7f 1524607 0 2024-03-17T23:58:25.968 INFO:tasks.workunit.client.0.smithi196.stdout:1/344: rmdir d1/d13 39 2024-03-17T23:58:25.970 INFO:tasks.workunit.client.0.smithi196.stdout:3/480: creat d7/d19/d26/f9c x:0 0 0 2024-03-17T23:58:25.975 INFO:tasks.workunit.client.0.smithi196.stdout:0/499: getdents d5/d23/d24/d28/d47/d52/d66 0 2024-03-17T23:58:25.976 INFO:tasks.workunit.client.0.smithi196.stdout:1/345: dread d1/d13/d23/f36 [0,4194304] 0 2024-03-17T23:58:25.976 INFO:tasks.workunit.client.0.smithi196.stdout:1/346: readlink d1/d13/d23/l2d 0 2024-03-17T23:58:25.979 INFO:tasks.workunit.client.0.smithi196.stdout:1/347: getdents d1/db/dd/d34/d6a/d75 0 2024-03-17T23:58:25.984 INFO:tasks.workunit.client.0.smithi196.stdout:0/500: dwrite d5/d23/d24/d28/d47/d52/f54 [0,4194304] 0 2024-03-17T23:58:25.988 INFO:tasks.workunit.client.0.smithi196.stdout:3/481: write d7/ff [300198,9684] 0 2024-03-17T23:58:25.989 INFO:tasks.workunit.client.0.smithi196.stdout:3/482: chown d7/d19/d26/f9c 1633126854 1 2024-03-17T23:58:25.991 INFO:tasks.workunit.client.0.smithi196.stdout:3/483: readlink d7/d33/l6b 0 2024-03-17T23:58:25.992 INFO:tasks.workunit.client.0.smithi196.stdout:3/484: dread - d7/d19/d26/d2b/d3c/f76 zero size 2024-03-17T23:58:25.994 INFO:tasks.workunit.client.0.smithi196.stdout:1/348: truncate d1/d13/d23/d47/f52 3553914 0 2024-03-17T23:58:25.995 INFO:tasks.workunit.client.0.smithi196.stdout:3/485: dread d7/d19/d26/d2b/d3c/d3d/f43 [0,4194304] 0 2024-03-17T23:58:25.995 INFO:tasks.workunit.client.0.smithi196.stdout:0/501: truncate d5/d23/d24/f2f 3696002 0 2024-03-17T23:58:25.997 INFO:tasks.workunit.client.0.smithi196.stdout:1/349: creat d1/d13/d23/d47/d48/f79 x:0 0 0 2024-03-17T23:58:25.998 INFO:tasks.workunit.client.0.smithi196.stdout:0/502: chown d5/d23/d24/d28/l27 3789389 1 2024-03-17T23:58:25.999 INFO:tasks.workunit.client.0.smithi196.stdout:1/350: write d1/d13/f18 [3848989,50300] 0 2024-03-17T23:58:26.001 INFO:tasks.workunit.client.0.smithi196.stdout:3/486: dread d7/fb [0,4194304] 0 2024-03-17T23:58:26.002 INFO:tasks.workunit.client.0.smithi196.stdout:3/487: chown d7/l6f 566123 1 2024-03-17T23:58:26.002 INFO:tasks.workunit.client.0.smithi196.stdout:0/503: creat d5/d23/d24/d28/f96 x:0 0 0 2024-03-17T23:58:26.004 INFO:tasks.workunit.client.0.smithi196.stdout:0/504: chown d5/d23/d24/d28/d47/f50 178708 1 2024-03-17T23:58:26.005 INFO:tasks.workunit.client.0.smithi196.stdout:0/505: chown d5/d23/d24/f5f 9 1 2024-03-17T23:58:26.005 INFO:tasks.workunit.client.0.smithi196.stdout:1/351: creat d1/db/dd/d34/f7a x:0 0 0 2024-03-17T23:58:26.005 INFO:tasks.workunit.client.0.smithi196.stdout:0/506: chown d5/f64 86844 1 2024-03-17T23:58:26.008 INFO:tasks.workunit.client.0.smithi196.stdout:1/352: creat d1/d13/d23/d47/d48/f7b x:0 0 0 2024-03-17T23:58:26.009 INFO:tasks.workunit.client.0.smithi196.stdout:0/507: mknod d5/d23/d24/d28/d47/d52/d66/c97 0 2024-03-17T23:58:26.012 INFO:tasks.workunit.client.0.smithi196.stdout:3/488: dwrite d7/ff [4194304,4194304] 0 2024-03-17T23:58:26.012 INFO:tasks.workunit.client.0.smithi196.stdout:1/353: creat d1/f7c x:0 0 0 2024-03-17T23:58:26.013 INFO:tasks.workunit.client.0.smithi196.stdout:0/508: getdents d5/d23 0 2024-03-17T23:58:26.015 INFO:tasks.workunit.client.0.smithi196.stdout:0/509: mknod d5/d23/c98 0 2024-03-17T23:58:26.016 INFO:tasks.workunit.client.0.smithi196.stdout:1/354: creat d1/db/dd/d34/d6a/d75/f7d x:0 0 0 2024-03-17T23:58:26.017 INFO:tasks.workunit.client.0.smithi196.stdout:0/510: write d5/d23/d24/d28/d47/d52/f7e [518664,70541] 0 2024-03-17T23:58:26.019 INFO:tasks.workunit.client.0.smithi196.stdout:3/489: creat d7/d19/d26/f9d x:0 0 0 2024-03-17T23:58:26.027 INFO:tasks.workunit.client.0.smithi196.stdout:3/490: rmdir d7/d19/d78/d83 0 2024-03-17T23:58:26.030 INFO:tasks.workunit.client.0.smithi196.stdout:3/491: mkdir d7/d19/d26/d2b/d3c/d9e 0 2024-03-17T23:58:26.032 INFO:tasks.workunit.client.0.smithi196.stdout:3/492: stat d7/d19/d26/d48/d98 0 2024-03-17T23:58:26.038 INFO:tasks.workunit.client.0.smithi196.stdout:1/355: truncate d1/db/f15 1501222 0 2024-03-17T23:58:26.039 INFO:tasks.workunit.client.0.smithi196.stdout:1/356: chown d1/db/dd/d34/d6a/d75 1 1 2024-03-17T23:58:26.042 INFO:tasks.workunit.client.0.smithi196.stdout:1/357: mkdir d1/d13/d23/d47/d48/d7e 0 2024-03-17T23:58:26.043 INFO:tasks.workunit.client.0.smithi196.stdout:1/358: dread - d1/db/f73 zero size 2024-03-17T23:58:26.045 INFO:tasks.workunit.client.0.smithi196.stdout:1/359: dread - d1/d13/d23/d47/d48/f7b zero size 2024-03-17T23:58:26.046 INFO:tasks.workunit.client.0.smithi196.stdout:3/493: dwrite d7/f8 [0,4194304] 0 2024-03-17T23:58:26.049 INFO:tasks.workunit.client.0.smithi196.stdout:1/360: getdents d1/d13/d23/d62/d71 0 2024-03-17T23:58:26.050 INFO:tasks.workunit.client.0.smithi196.stdout:1/361: rmdir d1/db 39 2024-03-17T23:58:26.056 INFO:tasks.workunit.client.0.smithi196.stdout:3/494: dwrite d7/d19/f32 [0,4194304] 0 2024-03-17T23:58:26.097 INFO:tasks.workunit.client.0.smithi196.stdout:6/351: sync 2024-03-17T23:58:26.103 INFO:tasks.workunit.client.0.smithi196.stdout:6/352: read - d2/d7/d2b/f4a zero size 2024-03-17T23:58:26.106 INFO:tasks.workunit.client.0.smithi196.stdout:1/362: dwrite d1/db/f1f [0,4194304] 0 2024-03-17T23:58:26.106 INFO:tasks.workunit.client.0.smithi196.stdout:6/353: read d2/d22/f6f [1516129,21059] 0 2024-03-17T23:58:26.106 INFO:tasks.workunit.client.0.smithi196.stdout:3/495: link d7/d33/d81/f8d d7/d19/d26/d2b/d3c/d9e/f9f 0 2024-03-17T23:58:26.108 INFO:tasks.workunit.client.0.smithi196.stdout:3/496: read - d7/d19/f97 zero size 2024-03-17T23:58:26.109 INFO:tasks.workunit.client.0.smithi196.stdout:3/497: readlink d7/d19/d26/d2b/l46 0 2024-03-17T23:58:26.109 INFO:tasks.workunit.client.0.smithi196.stdout:6/354: mkdir d2/d14/d75 0 2024-03-17T23:58:26.111 INFO:tasks.workunit.client.0.smithi196.stdout:1/363: write d1/db/dd/d43/f4a [3810652,10357] 0 2024-03-17T23:58:26.112 INFO:tasks.workunit.client.0.smithi196.stdout:1/364: read - d1/db/dd/d34/d6a/d75/f7d zero size 2024-03-17T23:58:26.116 INFO:tasks.workunit.client.0.smithi196.stdout:1/365: mknod d1/d13/d2a/c7f 0 2024-03-17T23:58:26.121 INFO:tasks.workunit.client.0.smithi196.stdout:6/355: dwrite d2/f45 [4194304,4194304] 0 2024-03-17T23:58:26.127 INFO:tasks.workunit.client.0.smithi196.stdout:3/498: dwrite d7/d19/f32 [4194304,4194304] 0 2024-03-17T23:58:26.132 INFO:tasks.workunit.client.0.smithi196.stdout:6/356: fsync d2/fd 0 2024-03-17T23:58:26.132 INFO:tasks.workunit.client.0.smithi196.stdout:1/366: dwrite d1/db/f15 [0,4194304] 0 2024-03-17T23:58:26.132 INFO:tasks.workunit.client.0.smithi196.stdout:3/499: truncate d7/d19/d26/d2b/d3c/d3d/f6a 4605316 0 2024-03-17T23:58:26.139 INFO:tasks.workunit.client.0.smithi196.stdout:6/357: creat d2/d40/f76 x:0 0 0 2024-03-17T23:58:26.143 INFO:tasks.workunit.client.0.smithi196.stdout:6/358: unlink d2/d7/cb 0 2024-03-17T23:58:26.143 INFO:tasks.workunit.client.0.smithi196.stdout:3/500: creat d7/d19/d78/d93/fa0 x:0 0 0 2024-03-17T23:58:26.146 INFO:tasks.workunit.client.0.smithi196.stdout:3/501: write d7/d19/d26/d2b/f42 [713198,87403] 0 2024-03-17T23:58:26.149 INFO:tasks.workunit.client.0.smithi196.stdout:3/502: symlink d7/d19/d26/d48/d98/la1 0 2024-03-17T23:58:26.153 INFO:tasks.workunit.client.0.smithi196.stdout:3/503: creat d7/d19/fa2 x:0 0 0 2024-03-17T23:58:26.153 INFO:tasks.workunit.client.0.smithi196.stdout:6/359: dwrite d2/ff [4194304,4194304] 0 2024-03-17T23:58:26.154 INFO:tasks.workunit.client.0.smithi196.stdout:3/504: fsync d7/d19/d26/f9d 0 2024-03-17T23:58:26.155 INFO:tasks.workunit.client.0.smithi196.stdout:1/367: dread d1/f4d [0,4194304] 0 2024-03-17T23:58:26.158 INFO:tasks.workunit.client.0.smithi196.stdout:6/360: getdents d2/d14/d35 0 2024-03-17T23:58:26.159 INFO:tasks.workunit.client.0.smithi196.stdout:1/368: chown d1/db/dd/c46 5 1 2024-03-17T23:58:26.160 INFO:tasks.workunit.client.0.smithi196.stdout:6/361: symlink d2/d66/l77 0 2024-03-17T23:58:26.162 INFO:tasks.workunit.client.0.smithi196.stdout:6/362: chown d2/d14/d35/d63/f6b 987 1 2024-03-17T23:58:26.164 INFO:tasks.workunit.client.0.smithi196.stdout:3/505: dwrite d7/d19/d26/f9d [0,4194304] 0 2024-03-17T23:58:26.165 INFO:tasks.workunit.client.0.smithi196.stdout:3/506: dread - d7/d19/d26/d2b/d3c/f76 zero size 2024-03-17T23:58:26.167 INFO:tasks.workunit.client.0.smithi196.stdout:3/507: creat d7/d29/d9b/fa3 x:0 0 0 2024-03-17T23:58:26.169 INFO:tasks.workunit.client.0.smithi196.stdout:3/508: creat d7/d29/fa4 x:0 0 0 2024-03-17T23:58:26.177 INFO:tasks.workunit.client.0.smithi196.stdout:3/509: creat d7/d19/fa5 x:0 0 0 2024-03-17T23:58:26.178 INFO:tasks.workunit.client.0.smithi196.stdout:1/369: dread d1/db/dd/d43/f4a [0,4194304] 0 2024-03-17T23:58:26.179 INFO:tasks.workunit.client.0.smithi196.stdout:3/510: dread - d7/d33/f90 zero size 2024-03-17T23:58:26.181 INFO:tasks.workunit.client.0.smithi196.stdout:1/370: write d1/f9 [704725,41308] 0 2024-03-17T23:58:26.182 INFO:tasks.workunit.client.0.smithi196.stdout:3/511: creat d7/d19/d26/d48/d98/fa6 x:0 0 0 2024-03-17T23:58:26.183 INFO:tasks.workunit.client.0.smithi196.stdout:6/363: dwrite d2/d14/f1d [0,4194304] 0 2024-03-17T23:58:26.184 INFO:tasks.workunit.client.0.smithi196.stdout:3/512: read - d7/d33/f91 zero size 2024-03-17T23:58:26.186 INFO:tasks.workunit.client.0.smithi196.stdout:6/364: truncate d2/d66/f69 268124 0 2024-03-17T23:58:26.187 INFO:tasks.workunit.client.0.smithi196.stdout:3/513: unlink d7/d33/l82 0 2024-03-17T23:58:26.189 INFO:tasks.workunit.client.0.smithi196.stdout:6/365: creat d2/d66/f78 x:0 0 0 2024-03-17T23:58:26.189 INFO:tasks.workunit.client.0.smithi196.stdout:3/514: dread - d7/d19/d26/d2b/d3c/f7b zero size 2024-03-17T23:58:26.191 INFO:tasks.workunit.client.0.smithi196.stdout:1/371: dwrite d1/db/dd/f72 [0,4194304] 0 2024-03-17T23:58:26.196 INFO:tasks.workunit.client.0.smithi196.stdout:6/366: getdents d2/d14/d42 0 2024-03-17T23:58:26.200 INFO:tasks.workunit.client.0.smithi196.stdout:6/367: creat d2/d7/f79 x:0 0 0 2024-03-17T23:58:26.203 INFO:tasks.workunit.client.0.smithi196.stdout:6/368: write d2/d7/d2b/f67 [305331,90045] 0 2024-03-17T23:58:26.203 INFO:tasks.workunit.client.0.smithi196.stdout:3/515: truncate d7/d19/f32 4074643 0 2024-03-17T23:58:26.203 INFO:tasks.workunit.client.0.smithi196.stdout:1/372: dwrite d1/d13/d4c/f61 [0,4194304] 0 2024-03-17T23:58:26.210 INFO:tasks.workunit.client.0.smithi196.stdout:1/373: rename d1/d13/f6b to d1/d13/d23/d47/d48/f80 0 2024-03-17T23:58:26.211 INFO:tasks.workunit.client.0.smithi196.stdout:3/516: symlink d7/la7 0 2024-03-17T23:58:26.212 INFO:tasks.workunit.client.0.smithi196.stdout:3/517: chown d7/d19/d26/f37 599 1 2024-03-17T23:58:26.213 INFO:tasks.workunit.client.0.smithi196.stdout:1/374: truncate d1/d13/d23/f37 885167 0 2024-03-17T23:58:26.213 INFO:tasks.workunit.client.0.smithi196.stdout:6/369: dread d2/d22/f19 [0,4194304] 0 2024-03-17T23:58:26.214 INFO:tasks.workunit.client.0.smithi196.stdout:1/375: write d1/f4 [2096282,100249] 0 2024-03-17T23:58:26.214 INFO:tasks.workunit.client.0.smithi196.stdout:3/518: write d7/d19/d26/d48/f6c [520562,70618] 0 2024-03-17T23:58:26.215 INFO:tasks.workunit.client.0.smithi196.stdout:6/370: fsync d2/d14/d35/d63/f38 0 2024-03-17T23:58:26.218 INFO:tasks.workunit.client.0.smithi196.stdout:3/519: rename d7/d19/l51 to d7/d19/d26/d2b/d3c/d3d/la8 0 2024-03-17T23:58:26.221 INFO:tasks.workunit.client.0.smithi196.stdout:1/376: getdents d1/d13/d23 0 2024-03-17T23:58:26.224 INFO:tasks.workunit.client.0.smithi196.stdout:3/520: mkdir d7/d19/d78/da9 0 2024-03-17T23:58:26.225 INFO:tasks.workunit.client.0.smithi196.stdout:8/314: sync 2024-03-17T23:58:26.225 INFO:tasks.workunit.client.0.smithi196.stdout:5/354: sync 2024-03-17T23:58:26.225 INFO:tasks.workunit.client.0.smithi196.stdout:3/521: chown d7/d19/d26/d2b/f55 0 1 2024-03-17T23:58:26.225 INFO:tasks.workunit.client.0.smithi196.stdout:9/477: sync 2024-03-17T23:58:26.225 INFO:tasks.workunit.client.0.smithi196.stdout:4/345: sync 2024-03-17T23:58:26.226 INFO:tasks.workunit.client.0.smithi196.stdout:7/502: sync 2024-03-17T23:58:26.226 INFO:tasks.workunit.client.0.smithi196.stdout:2/461: sync 2024-03-17T23:58:26.226 INFO:tasks.workunit.client.0.smithi196.stdout:1/377: rmdir d1/db/dd 39 2024-03-17T23:58:26.228 INFO:tasks.workunit.client.0.smithi196.stdout:5/355: chown d6/d2d/d33/d3b 1641411 1 2024-03-17T23:58:26.228 INFO:tasks.workunit.client.0.smithi196.stdout:6/371: truncate d2/d22/f3f 3613055 0 2024-03-17T23:58:26.230 INFO:tasks.workunit.client.0.smithi196.stdout:3/522: unlink d7/l2a 0 2024-03-17T23:58:26.231 INFO:tasks.workunit.client.0.smithi196.stdout:4/346: rmdir d1/d26/d57 39 2024-03-17T23:58:26.233 INFO:tasks.workunit.client.0.smithi196.stdout:7/503: dread da/d15/da7/f68 [0,4194304] 0 2024-03-17T23:58:26.233 INFO:tasks.workunit.client.0.smithi196.stdout:4/347: write d1/d26/d33/f72 [766187,32060] 0 2024-03-17T23:58:26.233 INFO:tasks.workunit.client.0.smithi196.stdout:9/478: symlink d9/d12/d59/l95 0 2024-03-17T23:58:26.234 INFO:tasks.workunit.client.0.smithi196.stdout:5/356: symlink d6/d17/d3f/l7a 0 2024-03-17T23:58:26.235 INFO:tasks.workunit.client.0.smithi196.stdout:5/357: dread - d6/d15/d16/f71 zero size 2024-03-17T23:58:26.238 INFO:tasks.workunit.client.0.smithi196.stdout:6/372: symlink d2/d40/l7a 0 2024-03-17T23:58:26.240 INFO:tasks.workunit.client.0.smithi196.stdout:8/315: mknod de/d2b/c57 0 2024-03-17T23:58:26.242 INFO:tasks.workunit.client.0.smithi196.stdout:3/523: chown d7/d19/d26/d2b/d3c/d3d/c71 318 1 2024-03-17T23:58:26.245 INFO:tasks.workunit.client.0.smithi196.stdout:8/316: write de/d2b/d30/f3a [110356,71622] 0 2024-03-17T23:58:26.246 INFO:tasks.workunit.client.0.smithi196.stdout:5/358: symlink d6/d17/d23/l7b 0 2024-03-17T23:58:26.246 INFO:tasks.workunit.client.0.smithi196.stdout:8/317: write de/d10/f2e [805103,3892] 0 2024-03-17T23:58:26.246 INFO:tasks.workunit.client.0.smithi196.stdout:3/524: readlink d7/d19/d26/d2b/d3c/l86 0 2024-03-17T23:58:26.248 INFO:tasks.workunit.client.0.smithi196.stdout:6/373: rename d2/d22 to d2/d14/d75/d7b 0 2024-03-17T23:58:26.248 INFO:tasks.workunit.client.0.smithi196.stdout:5/359: stat d6/d2d/d33/d3b/c5b 0 2024-03-17T23:58:26.250 INFO:tasks.workunit.client.0.smithi196.stdout:2/462: creat d17/d28/d30/fb4 x:0 0 0 2024-03-17T23:58:26.250 INFO:tasks.workunit.client.0.smithi196.stdout:4/348: dwrite d1/d26/d33/d40/f5e [0,4194304] 0 2024-03-17T23:58:26.254 INFO:tasks.workunit.client.0.smithi196.stdout:3/525: dread - d7/d33/f56 zero size 2024-03-17T23:58:26.254 INFO:tasks.workunit.client.0.smithi196.stdout:8/318: unlink de/d2b/d3c/l46 0 2024-03-17T23:58:26.255 INFO:tasks.workunit.client.0.smithi196.stdout:9/479: dwrite d9/d12/d59/f63 [4194304,4194304] 0 2024-03-17T23:58:26.257 INFO:tasks.workunit.client.0.smithi196.stdout:3/526: chown d7/d19/d26/d2b/d3c/d9e/f9f 14 1 2024-03-17T23:58:26.258 INFO:tasks.workunit.client.0.smithi196.stdout:8/319: truncate de/d2b/d30/d33/f48 5175598 0 2024-03-17T23:58:26.260 INFO:tasks.workunit.client.0.smithi196.stdout:8/320: write de/d2b/d3c/f55 [163464,55834] 0 2024-03-17T23:58:26.260 INFO:tasks.workunit.client.0.smithi196.stdout:5/360: unlink f2 0 2024-03-17T23:58:26.265 INFO:tasks.workunit.client.0.smithi196.stdout:7/504: getdents da/d15 0 2024-03-17T23:58:26.265 INFO:tasks.workunit.client.0.smithi196.stdout:4/349: stat d1/de/f4b 0 2024-03-17T23:58:26.267 INFO:tasks.workunit.client.0.smithi196.stdout:3/527: dread d7/d19/d26/f5c [0,4194304] 0 2024-03-17T23:58:26.269 INFO:tasks.workunit.client.0.smithi196.stdout:2/463: write d17/d1f/f5d [1029532,58778] 0 2024-03-17T23:58:26.271 INFO:tasks.workunit.client.0.smithi196.stdout:2/464: chown d17/d19/d44/d52 7653948 1 2024-03-17T23:58:26.271 INFO:tasks.workunit.client.0.smithi196.stdout:4/350: creat d1/d1b/f75 x:0 0 0 2024-03-17T23:58:26.273 INFO:tasks.workunit.client.0.smithi196.stdout:5/361: dwrite d6/ff [0,4194304] 0 2024-03-17T23:58:26.275 INFO:tasks.workunit.client.0.smithi196.stdout:9/480: rename d9/df/d14/d3d/c78 to d9/df/d14/c96 0 2024-03-17T23:58:26.281 INFO:tasks.workunit.client.0.smithi196.stdout:7/505: symlink da/d3e/d45/d4f/d85/lad 0 2024-03-17T23:58:26.281 INFO:tasks.workunit.client.0.smithi196.stdout:2/465: dwrite d17/d22/d3d/f48 [0,4194304] 0 2024-03-17T23:58:26.281 INFO:tasks.workunit.client.0.smithi196.stdout:3/528: creat d7/d19/d78/da9/faa x:0 0 0 2024-03-17T23:58:26.283 INFO:tasks.workunit.client.0.smithi196.stdout:3/529: truncate d7/d19/d26/d48/f6c 1362455 0 2024-03-17T23:58:26.284 INFO:tasks.workunit.client.0.smithi196.stdout:3/530: chown d7/d19/d26/d2b/c2d 75140 1 2024-03-17T23:58:26.289 INFO:tasks.workunit.client.0.smithi196.stdout:6/374: rename d2/d7/d2b/f3d to d2/d14/d75/d7b/f7c 0 2024-03-17T23:58:26.294 INFO:tasks.workunit.client.0.smithi196.stdout:2/466: unlink d17/d22/d59/cab 0 2024-03-17T23:58:26.295 INFO:tasks.workunit.client.0.smithi196.stdout:5/362: mknod d6/d15/c7c 0 2024-03-17T23:58:26.296 INFO:tasks.workunit.client.0.smithi196.stdout:7/506: rename da/d3e/d45/d60 to da/d15/da7/dae 0 2024-03-17T23:58:26.298 INFO:tasks.workunit.client.0.smithi196.stdout:4/351: dwrite d1/de/f4b [0,4194304] 0 2024-03-17T23:58:26.302 INFO:tasks.workunit.client.0.smithi196.stdout:2/467: symlink d17/d1f/lb5 0 2024-03-17T23:58:26.303 INFO:tasks.workunit.client.0.smithi196.stdout:2/468: write f4 [598059,130334] 0 2024-03-17T23:58:26.304 INFO:tasks.workunit.client.0.smithi196.stdout:3/531: dwrite d7/d29/f87 [0,4194304] 0 2024-03-17T23:58:26.307 INFO:tasks.workunit.client.0.smithi196.stdout:5/363: mkdir d6/d17/d1f/d7d 0 2024-03-17T23:58:26.308 INFO:tasks.workunit.client.0.smithi196.stdout:5/364: readlink d6/d17/d3f/l61 0 2024-03-17T23:58:26.310 INFO:tasks.workunit.client.0.smithi196.stdout:7/507: rmdir da/d3e/d45 39 2024-03-17T23:58:26.310 INFO:tasks.workunit.client.0.smithi196.stdout:4/352: rmdir d1/de/d50/d55 39 2024-03-17T23:58:26.312 INFO:tasks.workunit.client.0.smithi196.stdout:2/469: symlink d17/d22/da0/lb6 0 2024-03-17T23:58:26.315 INFO:tasks.workunit.client.0.smithi196.stdout:3/532: rename d7/d33/f5b to d7/d19/d26/d2b/d3c/d3d/fab 0 2024-03-17T23:58:26.317 INFO:tasks.workunit.client.0.smithi196.stdout:9/481: getdents d9/df/d4a 0 2024-03-17T23:58:26.318 INFO:tasks.workunit.client.0.smithi196.stdout:5/365: read d6/d2a/f31 [1859646,100559] 0 2024-03-17T23:58:26.319 INFO:tasks.workunit.client.0.smithi196.stdout:7/508: dread da/d3e/d6d/f89 [0,4194304] 0 2024-03-17T23:58:26.321 INFO:tasks.workunit.client.0.smithi196.stdout:9/482: creat d9/df/d14/d27/f97 x:0 0 0 2024-03-17T23:58:26.323 INFO:tasks.workunit.client.0.smithi196.stdout:4/353: creat d1/de/d50/d55/f76 x:0 0 0 2024-03-17T23:58:26.325 INFO:tasks.workunit.client.0.smithi196.stdout:2/470: dwrite d17/d28/d30/d3b/fac [0,4194304] 0 2024-03-17T23:58:26.327 INFO:tasks.workunit.client.0.smithi196.stdout:5/366: mkdir d6/d17/d23/d7e 0 2024-03-17T23:58:26.328 INFO:tasks.workunit.client.0.smithi196.stdout:7/509: truncate da/d15/da7/dae/f8d 50337 0 2024-03-17T23:58:26.332 INFO:tasks.workunit.client.0.smithi196.stdout:9/483: dwrite f5 [0,4194304] 0 2024-03-17T23:58:26.335 INFO:tasks.workunit.client.0.smithi196.stdout:4/354: mkdir d1/d1b/d77 0 2024-03-17T23:58:26.336 INFO:tasks.workunit.client.0.smithi196.stdout:2/471: mknod d17/d22/da0/cb7 0 2024-03-17T23:58:26.336 INFO:tasks.workunit.client.0.smithi196.stdout:3/533: write d7/d19/d26/d2b/d3c/d3d/f43 [489295,119042] 0 2024-03-17T23:58:26.337 INFO:tasks.workunit.client.0.smithi196.stdout:5/367: symlink d6/d17/d3f/d4e/d69/l7f 0 2024-03-17T23:58:26.339 INFO:tasks.workunit.client.0.smithi196.stdout:3/534: read - d7/d29/d9b/fa3 zero size 2024-03-17T23:58:26.342 INFO:tasks.workunit.client.0.smithi196.stdout:3/535: truncate d7/f2c 76635 0 2024-03-17T23:58:26.343 INFO:tasks.workunit.client.0.smithi196.stdout:9/484: dwrite d9/f44 [4194304,4194304] 0 2024-03-17T23:58:26.346 INFO:tasks.workunit.client.0.smithi196.stdout:9/485: write d9/df/d14/d3d/f8b [844418,64185] 0 2024-03-17T23:58:26.346 INFO:tasks.workunit.client.0.smithi196.stdout:4/355: rename d1/d26/d33/f45 to d1/d26/d57/f78 0 2024-03-17T23:58:26.349 INFO:tasks.workunit.client.0.smithi196.stdout:7/510: write da/d15/d1d/d29/f5a [1518794,4227] 0 2024-03-17T23:58:26.350 INFO:tasks.workunit.client.0.smithi196.stdout:7/511: readlink da/d15/l28 0 2024-03-17T23:58:26.351 INFO:tasks.workunit.client.0.smithi196.stdout:5/368: truncate d6/d2d/d33/d3b/f77 4563890 0 2024-03-17T23:58:26.353 INFO:tasks.workunit.client.0.smithi196.stdout:4/356: write d1/d1b/f59 [1422196,110585] 0 2024-03-17T23:58:26.354 INFO:tasks.workunit.client.0.smithi196.stdout:3/536: rename d7/d19/d26/d48/d98/la1 to d7/d19/d26/lac 0 2024-03-17T23:58:26.357 INFO:tasks.workunit.client.0.smithi196.stdout:5/369: read d6/d17/d1f/f3c [1100885,27493] 0 2024-03-17T23:58:26.358 INFO:tasks.workunit.client.0.smithi196.stdout:3/537: write d7/d19/d26/f64 [780516,11284] 0 2024-03-17T23:58:26.359 INFO:tasks.workunit.client.0.smithi196.stdout:5/370: chown d6/d2a/f47 15 1 2024-03-17T23:58:26.360 INFO:tasks.workunit.client.0.smithi196.stdout:4/357: creat d1/d1b/f79 x:0 0 0 2024-03-17T23:58:26.362 INFO:tasks.workunit.client.0.smithi196.stdout:9/486: rename d9/df/d14/f1c to d9/d38/d60/d85/f98 0 2024-03-17T23:58:26.362 INFO:tasks.workunit.client.0.smithi196.stdout:7/512: dread da/d15/d1a/d5e/f62 [0,4194304] 0 2024-03-17T23:58:26.362 INFO:tasks.workunit.client.0.smithi196.stdout:4/358: write d1/de/d50/d55/f76 [936935,51672] 0 2024-03-17T23:58:26.366 INFO:tasks.workunit.client.0.smithi196.stdout:7/513: symlink da/d15/d1a/d5e/laf 0 2024-03-17T23:58:26.367 INFO:tasks.workunit.client.0.smithi196.stdout:3/538: symlink d7/d19/d26/d2b/d3c/d9e/lad 0 2024-03-17T23:58:26.368 INFO:tasks.workunit.client.0.smithi196.stdout:9/487: mkdir d9/d38/d60/d85/d8e/d99 0 2024-03-17T23:58:26.369 INFO:tasks.workunit.client.0.smithi196.stdout:3/539: chown d7/d19/d26/d2b/c6d 188 1 2024-03-17T23:58:26.371 INFO:tasks.workunit.client.0.smithi196.stdout:4/359: rename d1/d26/f39 to d1/d26/d33/d3f/f7a 0 2024-03-17T23:58:26.371 INFO:tasks.workunit.client.0.smithi196.stdout:9/488: write d9/df/d14/f72 [1518752,57752] 0 2024-03-17T23:58:26.373 INFO:tasks.workunit.client.0.smithi196.stdout:9/489: readlink d9/d38/d60/l7f 0 2024-03-17T23:58:26.375 INFO:tasks.workunit.client.0.smithi196.stdout:9/490: chown d9/d38/d60/l77 0 1 2024-03-17T23:58:26.376 INFO:tasks.workunit.client.0.smithi196.stdout:7/514: dwrite da/d15/d1d/d29/f79 [0,4194304] 0 2024-03-17T23:58:26.377 INFO:tasks.workunit.client.0.smithi196.stdout:3/540: rename d7/d19/d26/d2b/d3c/d9e/lad to d7/d33/lae 0 2024-03-17T23:58:26.385 INFO:tasks.workunit.client.0.smithi196.stdout:3/541: creat d7/d19/d26/d48/d4d/faf x:0 0 0 2024-03-17T23:58:26.386 INFO:tasks.workunit.client.0.smithi196.stdout:7/515: getdents da/d15/da7/dae 0 2024-03-17T23:58:26.387 INFO:tasks.workunit.client.0.smithi196.stdout:3/542: write d7/d19/d26/d2b/d3c/d3d/f43 [827570,74033] 0 2024-03-17T23:58:26.388 INFO:tasks.workunit.client.0.smithi196.stdout:7/516: stat da/d15/da7/dae 0 2024-03-17T23:58:26.390 INFO:tasks.workunit.client.0.smithi196.stdout:9/491: dwrite d9/d33/f5f [0,4194304] 0 2024-03-17T23:58:26.390 INFO:tasks.workunit.client.0.smithi196.stdout:3/543: creat d7/d19/d26/d48/d4d/fb0 x:0 0 0 2024-03-17T23:58:26.394 INFO:tasks.workunit.client.0.smithi196.stdout:3/544: symlink d7/d19/d78/d93/lb1 0 2024-03-17T23:58:26.395 INFO:tasks.workunit.client.0.smithi196.stdout:3/545: creat d7/d33/fb2 x:0 0 0 2024-03-17T23:58:26.396 INFO:tasks.workunit.client.0.smithi196.stdout:3/546: chown d7/d19/d78/d93/lb1 9583 1 2024-03-17T23:58:26.397 INFO:tasks.workunit.client.0.smithi196.stdout:7/517: dread da/d3e/d45/d4f/d43/f67 [0,4194304] 0 2024-03-17T23:58:26.400 INFO:tasks.workunit.client.0.smithi196.stdout:7/518: creat da/d3e/d45/d4f/d43/d8f/fb0 x:0 0 0 2024-03-17T23:58:26.400 INFO:tasks.workunit.client.0.smithi196.stdout:3/547: link d7/d19/l1a d7/d19/lb3 0 2024-03-17T23:58:26.401 INFO:tasks.workunit.client.0.smithi196.stdout:7/519: chown da/d15/d1a/d5e/f62 13 1 2024-03-17T23:58:26.409 INFO:tasks.workunit.client.0.smithi196.stdout:7/520: dwrite da/d3e/d45/d4f/d43/d9e/fab [0,4194304] 0 2024-03-17T23:58:26.420 INFO:tasks.workunit.client.0.smithi196.stdout:3/548: dread d7/d19/d26/d2b/f6e [0,4194304] 0 2024-03-17T23:58:26.427 INFO:tasks.workunit.client.0.smithi196.stdout:3/549: dwrite d7/f8 [0,4194304] 0 2024-03-17T23:58:26.429 INFO:tasks.workunit.client.0.smithi196.stdout:3/550: fsync d7/fd 0 2024-03-17T23:58:26.432 INFO:tasks.workunit.client.0.smithi196.stdout:3/551: read d7/d29/f94 [79766,72069] 0 2024-03-17T23:58:26.433 INFO:tasks.workunit.client.0.smithi196.stdout:7/521: dread da/d3e/d45/f73 [0,4194304] 0 2024-03-17T23:58:26.433 INFO:tasks.workunit.client.0.smithi196.stdout:7/522: stat da/l19 0 2024-03-17T23:58:26.434 INFO:tasks.workunit.client.0.smithi196.stdout:3/552: write d7/d19/d26/d48/f6c [1271091,118584] 0 2024-03-17T23:58:26.435 INFO:tasks.workunit.client.0.smithi196.stdout:7/523: write da/d15/d1a/d5e/d70/f80 [496242,64631] 0 2024-03-17T23:58:26.436 INFO:tasks.workunit.client.0.smithi196.stdout:7/524: fsync da/d3e/f8a 0 2024-03-17T23:58:26.436 INFO:tasks.workunit.client.0.smithi196.stdout:3/553: truncate d7/d19/d26/f64 1680050 0 2024-03-17T23:58:26.438 INFO:tasks.workunit.client.0.smithi196.stdout:3/554: symlink d7/d19/d78/d93/lb4 0 2024-03-17T23:58:26.443 INFO:tasks.workunit.client.0.smithi196.stdout:3/555: mknod d7/d19/d26/d48/cb5 0 2024-03-17T23:58:26.446 INFO:tasks.workunit.client.0.smithi196.stdout:7/525: dwrite da/d15/d1a/f44 [0,4194304] 0 2024-03-17T23:58:26.450 INFO:tasks.workunit.client.0.smithi196.stdout:3/556: write d7/d19/f28 [702863,46684] 0 2024-03-17T23:58:26.451 INFO:tasks.workunit.client.0.smithi196.stdout:7/526: link da/d15/ca1 da/d3e/cb1 0 2024-03-17T23:58:26.456 INFO:tasks.workunit.client.0.smithi196.stdout:7/527: link da/d15/da7/dae/f8d da/d3e/d7f/fb2 0 2024-03-17T23:58:26.457 INFO:tasks.workunit.client.0.smithi196.stdout:3/557: creat d7/d19/d26/d2b/d3c/d3d/d99/fb6 x:0 0 0 2024-03-17T23:58:26.457 INFO:tasks.workunit.client.0.smithi196.stdout:7/528: rename da/d15 to da/d15/da7/dae/db3 22 2024-03-17T23:58:26.458 INFO:tasks.workunit.client.0.smithi196.stdout:3/558: dread - d7/d19/fa2 zero size 2024-03-17T23:58:26.460 INFO:tasks.workunit.client.0.smithi196.stdout:3/559: read d7/f1f [464031,130341] 0 2024-03-17T23:58:26.460 INFO:tasks.workunit.client.0.smithi196.stdout:7/529: read da/f5c [3070771,108614] 0 2024-03-17T23:58:26.461 INFO:tasks.workunit.client.0.smithi196.stdout:3/560: stat d7/d19/fa5 0 2024-03-17T23:58:26.462 INFO:tasks.workunit.client.0.smithi196.stdout:3/561: creat d7/d19/d78/fb7 x:0 0 0 2024-03-17T23:58:26.464 INFO:tasks.workunit.client.0.smithi196.stdout:3/562: creat d7/d29/fb8 x:0 0 0 2024-03-17T23:58:26.470 INFO:tasks.workunit.client.0.smithi196.stdout:7/530: truncate da/d15/f27 1701221 0 2024-03-17T23:58:26.471 INFO:tasks.workunit.client.0.smithi196.stdout:7/531: fsync da/d15/d1a/f44 0 2024-03-17T23:58:26.472 INFO:tasks.workunit.client.0.smithi196.stdout:7/532: chown da/d3e/d45/d4f/d43/c48 24 1 2024-03-17T23:58:26.474 INFO:tasks.workunit.client.0.smithi196.stdout:7/533: getdents da/d15/d1a 0 2024-03-17T23:58:26.477 INFO:tasks.workunit.client.0.smithi196.stdout:7/534: dread da/d15/d1d/d2e/f69 [0,4194304] 0 2024-03-17T23:58:26.479 INFO:tasks.workunit.client.0.smithi196.stdout:7/535: mkdir da/d3e/d45/d4f/db4 0 2024-03-17T23:58:26.485 INFO:tasks.workunit.client.0.smithi196.stdout:7/536: dwrite da/d15/d1d/d29/f36 [0,4194304] 0 2024-03-17T23:58:26.487 INFO:tasks.workunit.client.0.smithi196.stdout:0/511: sync 2024-03-17T23:58:26.487 INFO:tasks.workunit.client.0.smithi196.stdout:7/537: write da/d3e/d45/d4f/d75/da8/f96 [365071,49640] 0 2024-03-17T23:58:26.498 INFO:tasks.workunit.client.0.smithi196.stdout:7/538: mkdir da/d15/d1d/d29/db5 0 2024-03-17T23:58:26.498 INFO:tasks.workunit.client.0.smithi196.stdout:7/539: readlink da/d15/d1d/l34 0 2024-03-17T23:58:26.500 INFO:tasks.workunit.client.0.smithi196.stdout:0/512: rename d5/d23/d24/d28/d47/d52/d49/l88 to d5/d23/d24/d59/d94/l99 0 2024-03-17T23:58:26.500 INFO:tasks.workunit.client.0.smithi196.stdout:7/540: write da/d15/d1d/f32 [4048872,56458] 0 2024-03-17T23:58:26.502 INFO:tasks.workunit.client.0.smithi196.stdout:0/513: creat d5/d23/d24/d59/f9a x:0 0 0 2024-03-17T23:58:26.509 INFO:tasks.workunit.client.0.smithi196.stdout:7/541: dwrite da/d15/d1d/d4c/f61 [0,4194304] 0 2024-03-17T23:58:26.513 INFO:tasks.workunit.client.0.smithi196.stdout:0/514: dwrite d5/f13 [4194304,4194304] 0 2024-03-17T23:58:26.515 INFO:tasks.workunit.client.0.smithi196.stdout:0/515: chown d5/d23/d24/d30/d4e 1230 1 2024-03-17T23:58:26.515 INFO:tasks.workunit.client.0.smithi196.stdout:0/516: write d5/f10 [674042,64016] 0 2024-03-17T23:58:26.517 INFO:tasks.workunit.client.0.smithi196.stdout:0/517: stat d5/d23/l77 0 2024-03-17T23:58:26.518 INFO:tasks.workunit.client.0.smithi196.stdout:0/518: write d5/d23/d24/d72/f8e [431728,29592] 0 2024-03-17T23:58:26.521 INFO:tasks.workunit.client.0.smithi196.stdout:0/519: mkdir d5/d23/d24/d30/d4e/d9b 0 2024-03-17T23:58:26.522 INFO:tasks.workunit.client.0.smithi196.stdout:0/520: write d5/d23/d24/d30/d4e/f8c [8980252,12340] 0 2024-03-17T23:58:26.525 INFO:tasks.workunit.client.0.smithi196.stdout:0/521: creat d5/d23/d85/f9c x:0 0 0 2024-03-17T23:58:26.527 INFO:tasks.workunit.client.0.smithi196.stdout:0/522: symlink d5/d23/d24/d28/d47/d52/d66/l9d 0 2024-03-17T23:58:26.528 INFO:tasks.workunit.client.0.smithi196.stdout:0/523: stat d5/d23/d24/l38 0 2024-03-17T23:58:26.528 INFO:tasks.workunit.client.0.smithi196.stdout:0/524: chown d5/c1d 6496428 1 2024-03-17T23:58:26.530 INFO:tasks.workunit.client.0.smithi196.stdout:0/525: write d5/d23/d24/d59/d8b/f6a [723485,93289] 0 2024-03-17T23:58:26.530 INFO:tasks.workunit.client.0.smithi196.stdout:0/526: truncate d5/d23/d85/f9c 789253 0 2024-03-17T23:58:26.533 INFO:tasks.workunit.client.0.smithi196.stdout:0/527: unlink d5/f3d 0 2024-03-17T23:58:26.535 INFO:tasks.workunit.client.0.smithi196.stdout:0/528: creat d5/d23/d24/d59/f9e x:0 0 0 2024-03-17T23:58:26.537 INFO:tasks.workunit.client.0.smithi196.stdout:0/529: rmdir d5/d92 0 2024-03-17T23:58:26.546 INFO:tasks.workunit.client.0.smithi196.stdout:0/530: truncate d5/d23/d24/d28/f26 2969046 0 2024-03-17T23:58:26.548 INFO:tasks.workunit.client.0.smithi196.stdout:0/531: dread d5/d23/d85/f9c [0,4194304] 0 2024-03-17T23:58:26.548 INFO:tasks.workunit.client.0.smithi196.stdout:0/532: stat d5/d23/l34 0 2024-03-17T23:58:26.550 INFO:tasks.workunit.client.0.smithi196.stdout:0/533: mkdir d5/d23/d24/d9f 0 2024-03-17T23:58:26.551 INFO:tasks.workunit.client.0.smithi196.stdout:0/534: creat d5/d23/d24/d28/fa0 x:0 0 0 2024-03-17T23:58:26.552 INFO:tasks.workunit.client.0.smithi196.stdout:0/535: write d5/f64 [662547,117571] 0 2024-03-17T23:58:26.557 INFO:tasks.workunit.client.0.smithi196.stdout:0/536: dread d5/d23/f2d [0,4194304] 0 2024-03-17T23:58:26.559 INFO:tasks.workunit.client.0.smithi196.stdout:0/537: creat d5/d23/d24/d30/fa1 x:0 0 0 2024-03-17T23:58:26.559 INFO:tasks.workunit.client.0.smithi196.stdout:0/538: dread - d5/d23/f74 zero size 2024-03-17T23:58:26.562 INFO:tasks.workunit.client.0.smithi196.stdout:0/539: creat d5/d23/d24/d28/d47/fa2 x:0 0 0 2024-03-17T23:58:26.563 INFO:tasks.workunit.client.0.smithi196.stdout:0/540: truncate d5/d23/d24/d30/f90 877636 0 2024-03-17T23:58:26.565 INFO:tasks.workunit.client.0.smithi196.stdout:0/541: truncate d5/f44 1086925 0 2024-03-17T23:58:26.575 INFO:tasks.workunit.client.0.smithi196.stdout:0/542: truncate d5/d23/d24/f2c 3540290 0 2024-03-17T23:58:26.577 INFO:tasks.workunit.client.0.smithi196.stdout:0/543: mkdir d5/d23/d24/da3 0 2024-03-17T23:58:26.579 INFO:tasks.workunit.client.0.smithi196.stdout:0/544: write d5/d23/d24/d28/d47/d52/d61/f84 [693745,36418] 0 2024-03-17T23:58:26.586 INFO:tasks.workunit.client.0.smithi196.stdout:0/545: fsync d5/d23/d24/f2c 0 2024-03-17T23:58:26.587 INFO:tasks.workunit.client.0.smithi196.stdout:0/546: write d5/d23/d24/f5f [3819653,12] 0 2024-03-17T23:58:26.590 INFO:tasks.workunit.client.0.smithi196.stdout:0/547: read d5/d23/d24/d30/f90 [849706,29350] 0 2024-03-17T23:58:26.591 INFO:tasks.workunit.client.0.smithi196.stdout:0/548: write d5/d23/d24/d59/d8b/f6a [1216826,121287] 0 2024-03-17T23:58:26.602 INFO:tasks.workunit.client.0.smithi196.stdout:0/549: dread d5/d23/d24/d28/f55 [0,4194304] 0 2024-03-17T23:58:26.608 INFO:tasks.workunit.client.0.smithi196.stdout:0/550: dwrite d5/f18 [0,4194304] 0 2024-03-17T23:58:26.615 INFO:tasks.workunit.client.0.smithi196.stdout:0/551: getdents d5/d23/d24/d30/d4e/d9b 0 2024-03-17T23:58:26.616 INFO:tasks.workunit.client.0.smithi196.stdout:0/552: write d5/d23/d24/d28/f96 [645073,41881] 0 2024-03-17T23:58:26.621 INFO:tasks.workunit.client.0.smithi196.stdout:0/553: rename d5/d23/d24/d28/d47/d52/l73 to d5/la4 0 2024-03-17T23:58:26.623 INFO:tasks.workunit.client.0.smithi196.stdout:0/554: creat d5/d23/d24/da3/fa5 x:0 0 0 2024-03-17T23:58:26.631 INFO:tasks.workunit.client.0.smithi196.stdout:0/555: getdents d5 0 2024-03-17T23:58:26.638 INFO:tasks.workunit.client.0.smithi196.stdout:0/556: dwrite d5/d23/f74 [0,4194304] 0 2024-03-17T23:58:26.640 INFO:tasks.workunit.client.0.smithi196.stdout:0/557: write d5/d23/d24/d28/d47/d52/f54 [3285821,726] 0 2024-03-17T23:58:26.643 INFO:tasks.workunit.client.0.smithi196.stdout:0/558: getdents d5/d23/d24/d30/d4e/d9b 0 2024-03-17T23:58:26.644 INFO:tasks.workunit.client.0.smithi196.stdout:0/559: rename d5 to d5/d23/d24/d28/d47/da6 22 2024-03-17T23:58:26.645 INFO:tasks.workunit.client.0.smithi196.stdout:0/560: symlink d5/la7 0 2024-03-17T23:58:26.650 INFO:tasks.workunit.client.0.smithi196.stdout:0/561: rename d5/d23/d24/d30/d4e/d9b to d5/d23/d24/da8 0 2024-03-17T23:58:26.650 INFO:tasks.workunit.client.0.smithi196.stdout:0/562: fsync d5/d23/d24/d28/d47/fa2 0 2024-03-17T23:58:26.652 INFO:tasks.workunit.client.0.smithi196.stdout:0/563: creat d5/d23/d24/d30/fa9 x:0 0 0 2024-03-17T23:58:26.655 INFO:tasks.workunit.client.0.smithi196.stdout:0/564: rename d5/d23/d24/d28/d47/d52/d61/f84 to d5/faa 0 2024-03-17T23:58:26.657 INFO:tasks.workunit.client.0.smithi196.stdout:0/565: mkdir d5/d23/d24/d28/dab 0 2024-03-17T23:58:26.662 INFO:tasks.workunit.client.0.smithi196.stdout:1/378: sync 2024-03-17T23:58:26.664 INFO:tasks.workunit.client.0.smithi196.stdout:1/379: chown d1/db/dd/d34/d6a/d75 1 1 2024-03-17T23:58:26.665 INFO:tasks.workunit.client.0.smithi196.stdout:1/380: fsync d1/db/dd/f5d 0 2024-03-17T23:58:26.666 INFO:tasks.workunit.client.0.smithi196.stdout:1/381: truncate d1/db/f14 4670621 0 2024-03-17T23:58:26.668 INFO:tasks.workunit.client.0.smithi196.stdout:1/382: mknod d1/d13/d23/d62/d71/c81 0 2024-03-17T23:58:26.670 INFO:tasks.workunit.client.0.smithi196.stdout:1/383: chown d1/c78 197323472 1 2024-03-17T23:58:26.672 INFO:tasks.workunit.client.0.smithi196.stdout:1/384: creat d1/d13/d23/f82 x:0 0 0 2024-03-17T23:58:26.673 INFO:tasks.workunit.client.0.smithi196.stdout:1/385: chown d1/d13/d4c/f61 0 1 2024-03-17T23:58:26.673 INFO:tasks.workunit.client.0.smithi196.stdout:0/566: truncate d5/d23/f2d 4405629 0 2024-03-17T23:58:26.674 INFO:tasks.workunit.client.0.smithi196.stdout:1/386: fdatasync d1/d13/d23/d47/f63 0 2024-03-17T23:58:26.682 INFO:tasks.workunit.client.0.smithi196.stdout:0/567: unlink d5/d23/f2d 0 2024-03-17T23:58:26.683 INFO:tasks.workunit.client.0.smithi196.stdout:1/387: write d1/db/fe [5260902,99914] 0 2024-03-17T23:58:26.684 INFO:tasks.workunit.client.0.smithi196.stdout:0/568: write d5/f1c [5672611,128440] 0 2024-03-17T23:58:26.686 INFO:tasks.workunit.client.0.smithi196.stdout:0/569: rmdir d5/d23/d24/d30 39 2024-03-17T23:58:26.688 INFO:tasks.workunit.client.0.smithi196.stdout:0/570: unlink d5/d23/d24/d28/d47/d52/d49/l91 0 2024-03-17T23:58:26.689 INFO:tasks.workunit.client.0.smithi196.stdout:0/571: chown d5/d23/d24/d28/d47/d52/f54 1417 1 2024-03-17T23:58:26.690 INFO:tasks.workunit.client.0.smithi196.stdout:0/572: chown d5/d23/d24/d28/f26 591567 1 2024-03-17T23:58:26.691 INFO:tasks.workunit.client.0.smithi196.stdout:0/573: chown d5/d23/d24 5363 1 2024-03-17T23:58:26.698 INFO:tasks.workunit.client.0.smithi196.stdout:0/574: dwrite d5/d23/d24/d59/f9e [0,4194304] 0 2024-03-17T23:58:26.708 INFO:tasks.workunit.client.0.smithi196.stdout:0/575: getdents d5/d23/d24/d59/d94 0 2024-03-17T23:58:26.711 INFO:tasks.workunit.client.0.smithi196.stdout:0/576: mkdir d5/d23/d24/d28/d47/d52/dac 0 2024-03-17T23:58:26.711 INFO:tasks.workunit.client.0.smithi196.stdout:0/577: readlink d5/d23/l77 0 2024-03-17T23:58:26.712 INFO:tasks.workunit.client.0.smithi196.stdout:0/578: truncate d5/d23/f74 4575245 0 2024-03-17T23:58:26.718 INFO:tasks.workunit.client.0.smithi196.stdout:0/579: dwrite d5/d23/d24/d28/d47/d52/d49/f83 [0,4194304] 0 2024-03-17T23:58:26.725 INFO:tasks.workunit.client.0.smithi196.stdout:0/580: dwrite d5/f1c [0,4194304] 0 2024-03-17T23:58:26.731 INFO:tasks.workunit.client.0.smithi196.stdout:0/581: unlink d5/d23/d24/d59/d94/l99 0 2024-03-17T23:58:26.732 INFO:tasks.workunit.client.0.smithi196.stdout:0/582: stat d5/d23/d24/d28/d47/d52/d66/c97 0 2024-03-17T23:58:26.732 INFO:tasks.workunit.client.0.smithi196.stdout:0/583: chown d5/f10 3 1 2024-03-17T23:58:26.738 INFO:tasks.workunit.client.0.smithi196.stdout:0/584: dwrite d5/f64 [0,4194304] 0 2024-03-17T23:58:26.741 INFO:tasks.workunit.client.0.smithi196.stdout:0/585: mknod d5/d23/d24/da3/cad 0 2024-03-17T23:58:26.747 INFO:tasks.workunit.client.0.smithi196.stdout:0/586: creat d5/d23/d24/d28/d47/d52/dac/fae x:0 0 0 2024-03-17T23:58:26.749 INFO:tasks.workunit.client.0.smithi196.stdout:0/587: creat d5/d23/d24/d28/d47/d52/d66/faf x:0 0 0 2024-03-17T23:58:26.752 INFO:tasks.workunit.client.0.smithi196.stdout:0/588: mkdir d5/d23/d24/d28/d47/d52/d66/db0 0 2024-03-17T23:58:26.753 INFO:tasks.workunit.client.0.smithi196.stdout:0/589: chown d5/la4 11 1 2024-03-17T23:58:26.753 INFO:tasks.workunit.client.0.smithi196.stdout:0/590: chown d5/f44 3032567 1 2024-03-17T23:58:26.755 INFO:tasks.workunit.client.0.smithi196.stdout:0/591: fdatasync d5/d23/d24/f2c 0 2024-03-17T23:58:26.757 INFO:tasks.workunit.client.0.smithi196.stdout:0/592: creat d5/d23/d24/d59/d94/fb1 x:0 0 0 2024-03-17T23:58:26.759 INFO:tasks.workunit.client.0.smithi196.stdout:0/593: mknod d5/d23/cb2 0 2024-03-17T23:58:26.762 INFO:tasks.workunit.client.0.smithi196.stdout:0/594: unlink d5/d23/d24/d28/d47/f50 0 2024-03-17T23:58:26.763 INFO:tasks.workunit.client.0.smithi196.stdout:0/595: truncate d5/d23/d24/f5e 1043471 0 2024-03-17T23:58:26.768 INFO:tasks.workunit.client.0.smithi196.stdout:0/596: dread d5/f1c [0,4194304] 0 2024-03-17T23:58:26.772 INFO:tasks.workunit.client.0.smithi196.stdout:0/597: write d5/d23/d24/d28/d47/f70 [1134033,59849] 0 2024-03-17T23:58:26.781 INFO:tasks.workunit.client.0.smithi196.stdout:0/598: dread d5/f10 [0,4194304] 0 2024-03-17T23:58:26.783 INFO:tasks.workunit.client.0.smithi196.stdout:0/599: write d5/d23/d24/f5f [1536850,28882] 0 2024-03-17T23:58:26.795 INFO:tasks.workunit.client.0.smithi196.stdout:0/600: dwrite d5/d23/d85/f9c [0,4194304] 0 2024-03-17T23:58:26.797 INFO:tasks.workunit.client.0.smithi196.stdout:0/601: symlink d5/d23/d24/d72/lb3 0 2024-03-17T23:58:26.803 INFO:tasks.workunit.client.0.smithi196.stdout:0/602: write d5/d23/d24/d30/f90 [311819,41631] 0 2024-03-17T23:58:26.806 INFO:tasks.workunit.client.0.smithi196.stdout:0/603: write d5/d23/d24/d28/d47/d52/f54 [4814051,123526] 0 2024-03-17T23:58:26.808 INFO:tasks.workunit.client.0.smithi196.stdout:0/604: getdents d5/d23/d24/da8 0 2024-03-17T23:58:26.809 INFO:tasks.workunit.client.0.smithi196.stdout:0/605: fsync d5/d23/d24/d28/d47/d52/d66/faf 0 2024-03-17T23:58:26.813 INFO:tasks.workunit.client.0.smithi196.stdout:0/606: creat d5/d23/d24/d28/d47/d52/d61/d6c/fb4 x:0 0 0 2024-03-17T23:58:26.815 INFO:tasks.workunit.client.0.smithi196.stdout:0/607: mkdir d5/d23/d24/d59/d94/db5 0 2024-03-17T23:58:26.817 INFO:tasks.workunit.client.0.smithi196.stdout:8/321: sync 2024-03-17T23:58:26.818 INFO:tasks.workunit.client.0.smithi196.stdout:0/608: rename d5/d23/d24/d28/d47/d52/d61/f7b to d5/d23/d24/fb6 0 2024-03-17T23:58:26.820 INFO:tasks.workunit.client.0.smithi196.stdout:8/322: symlink de/d10/l58 0 2024-03-17T23:58:26.821 INFO:tasks.workunit.client.0.smithi196.stdout:0/609: read d5/faa [280502,129959] 0 2024-03-17T23:58:26.821 INFO:tasks.workunit.client.0.smithi196.stdout:8/323: dread - de/d10/d35/d3e/f4c zero size 2024-03-17T23:58:26.822 INFO:tasks.workunit.client.0.smithi196.stdout:8/324: read de/d10/f24 [2918699,120559] 0 2024-03-17T23:58:26.828 INFO:tasks.workunit.client.0.smithi196.stdout:0/610: dwrite d5/d23/d24/f5f [4194304,4194304] 0 2024-03-17T23:58:26.833 INFO:tasks.workunit.client.0.smithi196.stdout:0/611: rmdir d5/d23/d24/d28/dab 0 2024-03-17T23:58:26.834 INFO:tasks.workunit.client.0.smithi196.stdout:0/612: truncate d5/f18 4866991 0 2024-03-17T23:58:26.843 INFO:tasks.workunit.client.0.smithi196.stdout:0/613: dwrite d5/d23/d24/d30/fa9 [0,4194304] 0 2024-03-17T23:58:26.844 INFO:tasks.workunit.client.0.smithi196.stdout:0/614: write d5/d23/d24/d28/f37 [8113832,94974] 0 2024-03-17T23:58:26.847 INFO:tasks.workunit.client.0.smithi196.stdout:8/325: dread f6 [0,4194304] 0 2024-03-17T23:58:26.847 INFO:tasks.workunit.client.0.smithi196.stdout:0/615: creat d5/d23/fb7 x:0 0 0 2024-03-17T23:58:26.848 INFO:tasks.workunit.client.0.smithi196.stdout:8/326: chown de/c32 1 1 2024-03-17T23:58:26.850 INFO:tasks.workunit.client.0.smithi196.stdout:0/616: truncate d5/d23/d24/d28/d47/d52/dac/fae 984344 0 2024-03-17T23:58:26.851 INFO:tasks.workunit.client.0.smithi196.stdout:8/327: mknod de/c59 0 2024-03-17T23:58:26.854 INFO:tasks.workunit.client.0.smithi196.stdout:8/328: creat de/d2b/d30/d33/f5a x:0 0 0 2024-03-17T23:58:26.864 INFO:tasks.workunit.client.0.smithi196.stdout:8/329: truncate de/f19 877341 0 2024-03-17T23:58:26.865 INFO:tasks.workunit.client.0.smithi196.stdout:0/617: dwrite d5/d23/d24/d30/d4e/f8c [0,4194304] 0 2024-03-17T23:58:26.872 INFO:tasks.workunit.client.0.smithi196.stdout:8/330: dwrite de/d2b/d30/d33/f45 [0,4194304] 0 2024-03-17T23:58:26.876 INFO:tasks.workunit.client.0.smithi196.stdout:0/618: dwrite d5/d23/d24/d30/fa9 [0,4194304] 0 2024-03-17T23:58:26.879 INFO:tasks.workunit.client.0.smithi196.stdout:8/331: dread f6 [0,4194304] 0 2024-03-17T23:58:26.883 INFO:tasks.workunit.client.0.smithi196.stdout:0/619: read d5/d23/d24/d28/f2e [1263638,47171] 0 2024-03-17T23:58:26.885 INFO:tasks.workunit.client.0.smithi196.stdout:0/620: chown d5/d23/d24/d28/d47/d52/dac/fae 213 1 2024-03-17T23:58:26.885 INFO:tasks.workunit.client.0.smithi196.stdout:8/332: creat de/f5b x:0 0 0 2024-03-17T23:58:26.888 INFO:tasks.workunit.client.0.smithi196.stdout:8/333: mkdir de/d10/d54/d5c 0 2024-03-17T23:58:26.889 INFO:tasks.workunit.client.0.smithi196.stdout:8/334: fdatasync de/d10/f2e 0 2024-03-17T23:58:26.891 INFO:tasks.workunit.client.0.smithi196.stdout:8/335: mkdir de/d2b/d3c/d5d 0 2024-03-17T23:58:26.893 INFO:tasks.workunit.client.0.smithi196.stdout:8/336: mkdir de/d5e 0 2024-03-17T23:58:26.894 INFO:tasks.workunit.client.0.smithi196.stdout:8/337: creat de/d10/d35/d3e/f5f x:0 0 0 2024-03-17T23:58:26.896 INFO:tasks.workunit.client.0.smithi196.stdout:8/338: creat de/d5e/f60 x:0 0 0 2024-03-17T23:58:26.898 INFO:tasks.workunit.client.0.smithi196.stdout:8/339: symlink de/d2b/d3c/d5d/l61 0 2024-03-17T23:58:26.898 INFO:tasks.workunit.client.0.smithi196.stdout:8/340: readlink de/l1e 0 2024-03-17T23:58:26.900 INFO:tasks.workunit.client.0.smithi196.stdout:8/341: mknod de/d10/c62 0 2024-03-17T23:58:26.901 INFO:tasks.workunit.client.0.smithi196.stdout:8/342: symlink de/d2b/l63 0 2024-03-17T23:58:26.904 INFO:tasks.workunit.client.0.smithi196.stdout:8/343: getdents de/d2b/d30 0 2024-03-17T23:58:26.905 INFO:tasks.workunit.client.0.smithi196.stdout:0/621: dread d5/d23/d24/d28/f37 [4194304,4194304] 0 2024-03-17T23:58:26.912 INFO:tasks.workunit.client.0.smithi196.stdout:0/622: dwrite d5/d23/d24/d30/d4e/f8c [0,4194304] 0 2024-03-17T23:58:26.915 INFO:tasks.workunit.client.0.smithi196.stdout:0/623: unlink d5/d23/d24/d59/d8b/c76 0 2024-03-17T23:58:26.916 INFO:tasks.workunit.client.0.smithi196.stdout:0/624: write d5/d23/f5c [400279,125801] 0 2024-03-17T23:58:26.918 INFO:tasks.workunit.client.0.smithi196.stdout:0/625: unlink d5/d23/d24/d28/fa0 0 2024-03-17T23:58:26.952 INFO:tasks.workunit.client.0.smithi196.stdout:2/472: sync 2024-03-17T23:58:26.953 INFO:tasks.workunit.client.0.smithi196.stdout:6/375: sync 2024-03-17T23:58:26.955 INFO:tasks.workunit.client.0.smithi196.stdout:0/626: creat d5/fb8 x:0 0 0 2024-03-17T23:58:26.955 INFO:tasks.workunit.client.0.smithi196.stdout:2/473: symlink d17/lb8 0 2024-03-17T23:58:26.956 INFO:tasks.workunit.client.0.smithi196.stdout:6/376: mknod d2/d40/c7d 0 2024-03-17T23:58:26.957 INFO:tasks.workunit.client.0.smithi196.stdout:2/474: write d17/d22/d59/f78 [880716,39107] 0 2024-03-17T23:58:26.958 INFO:tasks.workunit.client.0.smithi196.stdout:2/475: stat d17/d19/f31 0 2024-03-17T23:58:26.961 INFO:tasks.workunit.client.0.smithi196.stdout:6/377: symlink d2/d14/d42/l7e 0 2024-03-17T23:58:26.961 INFO:tasks.workunit.client.0.smithi196.stdout:0/627: symlink d5/d23/d24/d28/d47/lb9 0 2024-03-17T23:58:26.966 INFO:tasks.workunit.client.0.smithi196.stdout:2/476: dwrite d17/d19/f1d [0,4194304] 0 2024-03-17T23:58:26.970 INFO:tasks.workunit.client.0.smithi196.stdout:0/628: link d5/d23/d24/d30/c46 d5/d23/d24/d28/d47/d52/d66/cba 0 2024-03-17T23:58:26.970 INFO:tasks.workunit.client.0.smithi196.stdout:6/378: dwrite d2/d14/d35/d63/f6b [0,4194304] 0 2024-03-17T23:58:26.971 INFO:tasks.workunit.client.0.smithi196.stdout:2/477: mknod d17/d28/dae/cb9 0 2024-03-17T23:58:26.978 INFO:tasks.workunit.client.0.smithi196.stdout:0/629: mkdir d5/d23/d24/da3/dbb 0 2024-03-17T23:58:26.978 INFO:tasks.workunit.client.0.smithi196.stdout:6/379: creat d2/d14/d75/d7b/d49/f7f x:0 0 0 2024-03-17T23:58:26.979 INFO:tasks.workunit.client.0.smithi196.stdout:2/478: creat d17/d19/d44/d52/fba x:0 0 0 2024-03-17T23:58:26.986 INFO:tasks.workunit.client.0.smithi196.stdout:2/479: creat d17/d22/fbb x:0 0 0 2024-03-17T23:58:26.992 INFO:tasks.workunit.client.0.smithi196.stdout:6/380: dread d2/d7/f32 [0,4194304] 0 2024-03-17T23:58:26.993 INFO:tasks.workunit.client.0.smithi196.stdout:0/630: truncate d5/faa 662792 0 2024-03-17T23:58:26.994 INFO:tasks.workunit.client.0.smithi196.stdout:2/480: dwrite d17/d22/d3d/f48 [0,4194304] 0 2024-03-17T23:58:26.996 INFO:tasks.workunit.client.0.smithi196.stdout:0/631: fdatasync d5/f10 0 2024-03-17T23:58:26.997 INFO:tasks.workunit.client.0.smithi196.stdout:2/481: symlink d17/d19/lbc 0 2024-03-17T23:58:27.004 INFO:tasks.workunit.client.0.smithi196.stdout:6/381: dwrite d2/d7/d2b/f6e [0,4194304] 0 2024-03-17T23:58:27.005 INFO:tasks.workunit.client.0.smithi196.stdout:0/632: dread d5/d23/d24/d28/d47/d52/f7e [0,4194304] 0 2024-03-17T23:58:27.010 INFO:tasks.workunit.client.0.smithi196.stdout:0/633: readlink d5/l35 0 2024-03-17T23:58:27.014 INFO:tasks.workunit.client.0.smithi196.stdout:2/482: dwrite d17/d19/f4e [0,4194304] 0 2024-03-17T23:58:27.014 INFO:tasks.workunit.client.0.smithi196.stdout:6/382: dread d2/d7/d2b/f6e [0,4194304] 0 2024-03-17T23:58:27.019 INFO:tasks.workunit.client.0.smithi196.stdout:0/634: getdents d5/d23/d24/d28/d47/d52/d61/d6c 0 2024-03-17T23:58:27.019 INFO:tasks.workunit.client.0.smithi196.stdout:2/483: symlink d17/d22/lbd 0 2024-03-17T23:58:27.022 INFO:tasks.workunit.client.0.smithi196.stdout:6/383: dread d2/f2a [0,4194304] 0 2024-03-17T23:58:27.023 INFO:tasks.workunit.client.0.smithi196.stdout:0/635: symlink d5/d23/d24/d28/d47/d52/d66/lbc 0 2024-03-17T23:58:27.027 INFO:tasks.workunit.client.0.smithi196.stdout:0/636: getdents d5/d23/d24/d28/d47/d52/d61/d6c 0 2024-03-17T23:58:27.030 INFO:tasks.workunit.client.0.smithi196.stdout:0/637: mknod d5/d23/d24/d30/cbd 0 2024-03-17T23:58:27.034 INFO:tasks.workunit.client.0.smithi196.stdout:2/484: dread d17/d28/d30/f6b [0,4194304] 0 2024-03-17T23:58:27.034 INFO:tasks.workunit.client.0.smithi196.stdout:0/638: creat d5/d23/d24/da3/dbb/fbe x:0 0 0 2024-03-17T23:58:27.036 INFO:tasks.workunit.client.0.smithi196.stdout:2/485: dread - d17/d28/d30/d72/fb2 zero size 2024-03-17T23:58:27.036 INFO:tasks.workunit.client.0.smithi196.stdout:0/639: write d5/d23/f33 [761442,99134] 0 2024-03-17T23:58:27.038 INFO:tasks.workunit.client.0.smithi196.stdout:0/640: stat d5/d23/d24/d28/f41 0 2024-03-17T23:58:27.041 INFO:tasks.workunit.client.0.smithi196.stdout:6/384: dwrite d2/d14/d75/d7b/f4c [0,4194304] 0 2024-03-17T23:58:27.042 INFO:tasks.workunit.client.0.smithi196.stdout:2/486: getdents d17/d22 0 2024-03-17T23:58:27.043 INFO:tasks.workunit.client.0.smithi196.stdout:0/641: rename d5/d23/d24/da3/cad to d5/cbf 0 2024-03-17T23:58:27.044 INFO:tasks.workunit.client.0.smithi196.stdout:6/385: rmdir d2/d14/d75/d7b 39 2024-03-17T23:58:27.046 INFO:tasks.workunit.client.0.smithi196.stdout:0/642: write d5/d23/d24/d28/d47/d52/f3f [494257,29206] 0 2024-03-17T23:58:27.050 INFO:tasks.workunit.client.0.smithi196.stdout:2/487: mkdir d17/d22/d3d/d8f/dbe 0 2024-03-17T23:58:27.052 INFO:tasks.workunit.client.0.smithi196.stdout:6/386: rename d2/d7/d2b/f2f to d2/d14/d50/f80 0 2024-03-17T23:58:27.053 INFO:tasks.workunit.client.0.smithi196.stdout:0/643: symlink d5/d23/d24/da3/lc0 0 2024-03-17T23:58:27.054 INFO:tasks.workunit.client.0.smithi196.stdout:6/387: creat d2/d14/d35/f81 x:0 0 0 2024-03-17T23:58:27.056 INFO:tasks.workunit.client.0.smithi196.stdout:0/644: creat d5/d23/d24/d28/d47/d52/d66/db0/fc1 x:0 0 0 2024-03-17T23:58:27.060 INFO:tasks.workunit.client.0.smithi196.stdout:0/645: mknod d5/d23/d24/d9f/cc2 0 2024-03-17T23:58:27.063 INFO:tasks.workunit.client.0.smithi196.stdout:0/646: symlink d5/d23/d24/d28/d47/d52/d61/lc3 0 2024-03-17T23:58:27.064 INFO:tasks.workunit.client.0.smithi196.stdout:5/371: sync 2024-03-17T23:58:27.064 INFO:tasks.workunit.client.0.smithi196.stdout:4/360: sync 2024-03-17T23:58:27.064 INFO:tasks.workunit.client.0.smithi196.stdout:3/563: sync 2024-03-17T23:58:27.064 INFO:tasks.workunit.client.0.smithi196.stdout:9/492: sync 2024-03-17T23:58:27.064 INFO:tasks.workunit.client.0.smithi196.stdout:7/542: sync 2024-03-17T23:58:27.064 INFO:tasks.workunit.client.0.smithi196.stdout:1/388: sync 2024-03-17T23:58:27.066 INFO:tasks.workunit.client.0.smithi196.stdout:3/564: fdatasync d7/f8 0 2024-03-17T23:58:27.069 INFO:tasks.workunit.client.0.smithi196.stdout:5/372: mkdir d6/d2d/d33/d3b/d80 0 2024-03-17T23:58:27.070 INFO:tasks.workunit.client.0.smithi196.stdout:6/388: dwrite d2/d7/d2b/f6e [0,4194304] 0 2024-03-17T23:58:27.078 INFO:tasks.workunit.client.0.smithi196.stdout:9/493: dwrite d9/df/d14/f6b [4194304,4194304] 0 2024-03-17T23:58:27.078 INFO:tasks.workunit.client.0.smithi196.stdout:7/543: creat da/d15/d1d/d2e/fb6 x:0 0 0 2024-03-17T23:58:27.078 INFO:tasks.workunit.client.0.smithi196.stdout:0/647: dread d5/d23/d24/d30/d4e/f8c [0,4194304] 0 2024-03-17T23:58:27.084 INFO:tasks.workunit.client.0.smithi196.stdout:9/494: write d9/df/d4a/d5b/d6d/f73 [293204,19794] 0 2024-03-17T23:58:27.084 INFO:tasks.workunit.client.0.smithi196.stdout:2/488: dread d17/d22/d3d/f53 [0,4194304] 0 2024-03-17T23:58:27.084 INFO:tasks.workunit.client.0.smithi196.stdout:3/565: mknod d7/d19/d78/d8b/cb9 0 2024-03-17T23:58:27.085 INFO:tasks.workunit.client.0.smithi196.stdout:7/544: chown da/d15/d1a/d5e/d70/l97 1641 1 2024-03-17T23:58:27.086 INFO:tasks.workunit.client.0.smithi196.stdout:3/566: chown d7/d19/d78 143 1 2024-03-17T23:58:27.088 INFO:tasks.workunit.client.0.smithi196.stdout:1/389: mknod d1/d13/d23/d70/c83 0 2024-03-17T23:58:27.093 INFO:tasks.workunit.client.0.smithi196.stdout:0/648: rename d5/l4d to d5/d23/d24/d28/d47/d52/d61/lc4 0 2024-03-17T23:58:27.093 INFO:tasks.workunit.client.0.smithi196.stdout:7/545: chown da/d15/c74 183 1 2024-03-17T23:58:27.094 INFO:tasks.workunit.client.0.smithi196.stdout:9/495: creat d9/f9a x:0 0 0 2024-03-17T23:58:27.095 INFO:tasks.workunit.client.0.smithi196.stdout:4/361: dread d1/de/f2d [0,4194304] 0 2024-03-17T23:58:27.096 INFO:tasks.workunit.client.0.smithi196.stdout:9/496: fsync d9/d12/f3c 0 2024-03-17T23:58:27.098 INFO:tasks.workunit.client.0.smithi196.stdout:7/546: unlink da/d3e/d6d/c7c 0 2024-03-17T23:58:27.102 INFO:tasks.workunit.client.0.smithi196.stdout:9/497: chown d9/d12/d59/c70 26740 1 2024-03-17T23:58:27.102 INFO:tasks.workunit.client.0.smithi196.stdout:7/547: chown da/d15/d1a/l6a 489 1 2024-03-17T23:58:27.102 INFO:tasks.workunit.client.0.smithi196.stdout:3/567: dwrite d7/d19/d26/d2b/d3c/d3d/f6a [0,4194304] 0 2024-03-17T23:58:27.108 INFO:tasks.workunit.client.0.smithi196.stdout:4/362: symlink d1/d61/l7b 0 2024-03-17T23:58:27.109 INFO:tasks.workunit.client.0.smithi196.stdout:6/389: truncate d2/f3e 2266871 0 2024-03-17T23:58:27.110 INFO:tasks.workunit.client.0.smithi196.stdout:2/489: write d17/d28/d30/f90 [761169,88006] 0 2024-03-17T23:58:27.110 INFO:tasks.workunit.client.0.smithi196.stdout:1/390: getdents d1/db/dd/d34/d6a/d75 0 2024-03-17T23:58:27.125 INFO:tasks.workunit.client.0.smithi196.stdout:0/649: unlink d5/d23/d24/d28/d47/d52/d49/f83 0 2024-03-17T23:58:27.127 INFO:tasks.workunit.client.0.smithi196.stdout:4/363: write d1/de/f56 [1046256,115147] 0 2024-03-17T23:58:27.129 INFO:tasks.workunit.client.0.smithi196.stdout:2/490: symlink d17/d28/d30/d71/lbf 0 2024-03-17T23:58:27.129 INFO:tasks.workunit.client.0.smithi196.stdout:6/390: write d2/d66/f69 [1065002,91502] 0 2024-03-17T23:58:27.135 INFO:tasks.workunit.client.0.smithi196.stdout:4/364: symlink d1/d26/d57/l7c 0 2024-03-17T23:58:27.138 INFO:tasks.workunit.client.0.smithi196.stdout:6/391: creat d2/d14/d42/d57/f82 x:0 0 0 2024-03-17T23:58:27.143 INFO:tasks.workunit.client.0.smithi196.stdout:3/568: write d7/d33/f56 [476968,120999] 0 2024-03-17T23:58:27.147 INFO:tasks.workunit.client.0.smithi196.stdout:4/365: rename d1/de/l14 to d1/d26/l7d 0 2024-03-17T23:58:27.147 INFO:tasks.workunit.client.0.smithi196.stdout:0/650: write d5/f44 [1084738,11732] 0 2024-03-17T23:58:27.160 INFO:tasks.workunit.client.0.smithi196.stdout:2/491: dwrite f16 [0,4194304] 0 2024-03-17T23:58:27.162 INFO:tasks.workunit.client.0.smithi196.stdout:7/548: dwrite da/d3e/d45/d4f/d75/da8/f88 [0,4194304] 0 2024-03-17T23:58:27.164 INFO:tasks.workunit.client.0.smithi196.stdout:1/391: dwrite d1/d13/d23/d47/f52 [0,4194304] 0 2024-03-17T23:58:27.167 INFO:tasks.workunit.client.0.smithi196.stdout:3/569: dwrite d7/d19/d26/f37 [0,4194304] 0 2024-03-17T23:58:27.168 INFO:tasks.workunit.client.0.smithi196.stdout:0/651: link d5/d23/d24/d28/d47/d52/f54 d5/d23/d24/da8/fc5 0 2024-03-17T23:58:27.171 INFO:tasks.workunit.client.0.smithi196.stdout:1/392: dread - d1/db/dd/f56 zero size 2024-03-17T23:58:27.171 INFO:tasks.workunit.client.0.smithi196.stdout:0/652: write d5/d23/d24/da3/fa5 [412012,93628] 0 2024-03-17T23:58:27.172 INFO:tasks.workunit.client.0.smithi196.stdout:1/393: chown d1/d13 359807 1 2024-03-17T23:58:27.173 INFO:tasks.workunit.client.0.smithi196.stdout:6/392: dread d2/d14/f1d [0,4194304] 0 2024-03-17T23:58:27.175 INFO:tasks.workunit.client.0.smithi196.stdout:0/653: truncate d5/d23/d24/d28/d47/fa2 1024719 0 2024-03-17T23:58:27.175 INFO:tasks.workunit.client.0.smithi196.stdout:6/393: read - d2/d40/f76 zero size 2024-03-17T23:58:27.175 INFO:tasks.workunit.client.0.smithi196.stdout:2/492: read d17/d19/f41 [2233246,113082] 0 2024-03-17T23:58:27.177 INFO:tasks.workunit.client.0.smithi196.stdout:7/549: creat da/fb7 x:0 0 0 2024-03-17T23:58:27.177 INFO:tasks.workunit.client.0.smithi196.stdout:2/493: fdatasync d17/d28/d30/fb4 0 2024-03-17T23:58:27.179 INFO:tasks.workunit.client.0.smithi196.stdout:1/394: write d1/f25 [2532731,41132] 0 2024-03-17T23:58:27.181 INFO:tasks.workunit.client.0.smithi196.stdout:3/570: write d7/f16 [4790031,89733] 0 2024-03-17T23:58:27.184 INFO:tasks.workunit.client.0.smithi196.stdout:2/494: creat d17/d19/d93/fc0 x:0 0 0 2024-03-17T23:58:27.184 INFO:tasks.workunit.client.0.smithi196.stdout:0/654: write d5/d23/d24/d28/d47/d52/f7e [886085,17116] 0 2024-03-17T23:58:27.185 INFO:tasks.workunit.client.0.smithi196.stdout:3/571: unlink d7/d33/l6b 0 2024-03-17T23:58:27.185 INFO:tasks.workunit.client.0.smithi196.stdout:1/395: truncate d1/db/dd/d34/d6a/d75/f7d 60539 0 2024-03-17T23:58:27.185 INFO:tasks.workunit.client.0.smithi196.stdout:2/495: dread - d17/d19/d44/d52/f9b zero size 2024-03-17T23:58:27.187 INFO:tasks.workunit.client.0.smithi196.stdout:2/496: read - d17/d22/d59/f80 zero size 2024-03-17T23:58:27.187 INFO:tasks.workunit.client.0.smithi196.stdout:0/655: symlink d5/d23/d24/da8/lc6 0 2024-03-17T23:58:27.187 INFO:tasks.workunit.client.0.smithi196.stdout:7/550: dread da/d15/d1d/f2c [0,4194304] 0 2024-03-17T23:58:27.189 INFO:tasks.workunit.client.0.smithi196.stdout:3/572: creat d7/d19/d26/d2b/d3c/d3d/d7d/fba x:0 0 0 2024-03-17T23:58:27.189 INFO:tasks.workunit.client.0.smithi196.stdout:0/656: rmdir d5 39 2024-03-17T23:58:27.190 INFO:tasks.workunit.client.0.smithi196.stdout:3/573: truncate d7/d29/f94 1465201 0 2024-03-17T23:58:27.191 INFO:tasks.workunit.client.0.smithi196.stdout:1/396: creat d1/d13/d23/d47/d48/d74/f84 x:0 0 0 2024-03-17T23:58:27.191 INFO:tasks.workunit.client.0.smithi196.stdout:3/574: fsync d7/d19/f23 0 2024-03-17T23:58:27.193 INFO:tasks.workunit.client.0.smithi196.stdout:2/497: symlink d17/d28/d30/lc1 0 2024-03-17T23:58:27.194 INFO:tasks.workunit.client.0.smithi196.stdout:0/657: rmdir d5/d23/d24/d30/d4e 39 2024-03-17T23:58:27.196 INFO:tasks.workunit.client.0.smithi196.stdout:2/498: rmdir d17/d22/d3d 39 2024-03-17T23:58:27.196 INFO:tasks.workunit.client.0.smithi196.stdout:3/575: truncate d7/d29/d9b/fa3 197882 0 2024-03-17T23:58:27.197 INFO:tasks.workunit.client.0.smithi196.stdout:0/658: symlink d5/d23/lc7 0 2024-03-17T23:58:27.199 INFO:tasks.workunit.client.0.smithi196.stdout:1/397: dread d1/d13/d23/d47/d48/f54 [0,4194304] 0 2024-03-17T23:58:27.199 INFO:tasks.workunit.client.0.smithi196.stdout:7/551: dwrite da/d15/f8c [0,4194304] 0 2024-03-17T23:58:27.199 INFO:tasks.workunit.client.0.smithi196.stdout:3/576: mknod d7/d33/cbb 0 2024-03-17T23:58:27.201 INFO:tasks.workunit.client.0.smithi196.stdout:2/499: dread d17/d28/d30/d71/f88 [0,4194304] 0 2024-03-17T23:58:27.202 INFO:tasks.workunit.client.0.smithi196.stdout:3/577: truncate d7/f1f 4863647 0 2024-03-17T23:58:27.202 INFO:tasks.workunit.client.0.smithi196.stdout:3/578: dread - d7/d33/fb2 zero size 2024-03-17T23:58:27.203 INFO:tasks.workunit.client.0.smithi196.stdout:0/659: truncate d5/d23/d24/d28/d47/d52/f54 5578023 0 2024-03-17T23:58:27.203 INFO:tasks.workunit.client.0.smithi196.stdout:3/579: readlink d7/d19/l75 0 2024-03-17T23:58:27.204 INFO:tasks.workunit.client.0.smithi196.stdout:0/660: readlink d5/d23/l77 0 2024-03-17T23:58:27.205 INFO:tasks.workunit.client.0.smithi196.stdout:1/398: rmdir d1/d13/d23/d47 39 2024-03-17T23:58:27.206 INFO:tasks.workunit.client.0.smithi196.stdout:2/500: fdatasync d17/f70 0 2024-03-17T23:58:27.210 INFO:tasks.workunit.client.0.smithi196.stdout:3/580: creat d7/d19/d78/d93/fbc x:0 0 0 2024-03-17T23:58:27.212 INFO:tasks.workunit.client.0.smithi196.stdout:3/581: chown d7/d19/c8f 7 1 2024-03-17T23:58:27.212 INFO:tasks.workunit.client.0.smithi196.stdout:0/661: creat d5/d23/d24/d59/d94/fc8 x:0 0 0 2024-03-17T23:58:27.213 INFO:tasks.workunit.client.0.smithi196.stdout:7/552: dwrite da/f91 [0,4194304] 0 2024-03-17T23:58:27.214 INFO:tasks.workunit.client.0.smithi196.stdout:3/582: chown d7/d19/f30 719057 1 2024-03-17T23:58:27.215 INFO:tasks.workunit.client.0.smithi196.stdout:7/553: dread - da/d15/d1a/faa zero size 2024-03-17T23:58:27.217 INFO:tasks.workunit.client.0.smithi196.stdout:7/554: chown da/d3e/d7f/f84 31315 1 2024-03-17T23:58:27.224 INFO:tasks.workunit.client.0.smithi196.stdout:3/583: symlink d7/d33/lbd 0 2024-03-17T23:58:27.224 INFO:tasks.workunit.client.0.smithi196.stdout:1/399: dread d1/d13/d4c/f61 [0,4194304] 0 2024-03-17T23:58:27.225 INFO:tasks.workunit.client.0.smithi196.stdout:2/501: creat d17/d22/da0/fc2 x:0 0 0 2024-03-17T23:58:27.229 INFO:tasks.workunit.client.0.smithi196.stdout:0/662: rename d5/d23/d24/d28/d47/d52/d66 to d5/d23/d24/d28/dc9 0 2024-03-17T23:58:27.230 INFO:tasks.workunit.client.0.smithi196.stdout:0/663: dread - d5/fb8 zero size 2024-03-17T23:58:27.232 INFO:tasks.workunit.client.0.smithi196.stdout:2/502: creat d17/d28/d96/fc3 x:0 0 0 2024-03-17T23:58:27.233 INFO:tasks.workunit.client.0.smithi196.stdout:0/664: truncate d5/d23/d24/d30/f90 945727 0 2024-03-17T23:58:27.235 INFO:tasks.workunit.client.0.smithi196.stdout:7/555: dread da/d3e/d45/d4f/d75/da8/f98 [0,4194304] 0 2024-03-17T23:58:27.237 INFO:tasks.workunit.client.0.smithi196.stdout:3/584: creat d7/d19/d26/fbe x:0 0 0 2024-03-17T23:58:27.237 INFO:tasks.workunit.client.0.smithi196.stdout:1/400: write d1/db/dd/d34/f42 [517013,121633] 0 2024-03-17T23:58:27.239 INFO:tasks.workunit.client.0.smithi196.stdout:0/665: dread d5/f1c [4194304,4194304] 0 2024-03-17T23:58:27.239 INFO:tasks.workunit.client.0.smithi196.stdout:3/585: chown d7/d19/d26/d2b/c2d 2403810 1 2024-03-17T23:58:27.240 INFO:tasks.workunit.client.0.smithi196.stdout:1/401: write d1/f25 [4605861,110419] 0 2024-03-17T23:58:27.240 INFO:tasks.workunit.client.0.smithi196.stdout:7/556: creat da/d3e/d45/d4f/d85/fb8 x:0 0 0 2024-03-17T23:58:27.242 INFO:tasks.workunit.client.0.smithi196.stdout:0/666: dread - d5/d23/d24/da3/dbb/fbe zero size 2024-03-17T23:58:27.245 INFO:tasks.workunit.client.0.smithi196.stdout:3/586: chown d7/d19/d26/d2b/c8c 740693150 1 2024-03-17T23:58:27.248 INFO:tasks.workunit.client.0.smithi196.stdout:2/503: dwrite d17/d28/d30/d72/d81/fa1 [0,4194304] 0 2024-03-17T23:58:27.248 INFO:tasks.workunit.client.0.smithi196.stdout:3/587: creat d7/d19/d78/da9/fbf x:0 0 0 2024-03-17T23:58:27.251 INFO:tasks.workunit.client.0.smithi196.stdout:0/667: fsync d5/d23/d24/d28/d47/d52/d61/d6c/f7f 0 2024-03-17T23:58:27.252 INFO:tasks.workunit.client.0.smithi196.stdout:2/504: mknod d17/d28/d96/cc4 0 2024-03-17T23:58:27.254 INFO:tasks.workunit.client.0.smithi196.stdout:3/588: rename d7/d19/d78/da9/fbf to d7/d19/d78/d93/fc0 0 2024-03-17T23:58:27.255 INFO:tasks.workunit.client.0.smithi196.stdout:0/668: creat d5/d23/d85/fca x:0 0 0 2024-03-17T23:58:27.256 INFO:tasks.workunit.client.0.smithi196.stdout:2/505: dread - d17/d22/d3d/f91 zero size 2024-03-17T23:58:27.257 INFO:tasks.workunit.client.0.smithi196.stdout:3/589: mknod d7/d19/d78/da9/cc1 0 2024-03-17T23:58:27.259 INFO:tasks.workunit.client.0.smithi196.stdout:0/669: mknod d5/d23/d24/d28/dc9/ccb 0 2024-03-17T23:58:27.260 INFO:tasks.workunit.client.0.smithi196.stdout:3/590: write d7/d19/d26/d2b/d3c/d3d/f43 [548377,113454] 0 2024-03-17T23:58:27.265 INFO:tasks.workunit.client.0.smithi196.stdout:1/402: truncate d1/d13/f18 1114277 0 2024-03-17T23:58:27.265 INFO:tasks.workunit.client.0.smithi196.stdout:8/344: sync 2024-03-17T23:58:27.265 INFO:tasks.workunit.client.0.smithi196.stdout:1/403: truncate d1/f7c 541232 0 2024-03-17T23:58:27.265 INFO:tasks.workunit.client.0.smithi196.stdout:1/404: fsync d1/db/dd/f72 0 2024-03-17T23:58:27.266 INFO:tasks.workunit.client.0.smithi196.stdout:7/557: truncate da/d3e/d45/d4f/d75/da8/f88 1933647 0 2024-03-17T23:58:27.267 INFO:tasks.workunit.client.0.smithi196.stdout:3/591: write d7/d29/f94 [2471062,99446] 0 2024-03-17T23:58:27.268 INFO:tasks.workunit.client.0.smithi196.stdout:8/345: creat de/d2b/d3c/d5d/f64 x:0 0 0 2024-03-17T23:58:27.270 INFO:tasks.workunit.client.0.smithi196.stdout:3/592: dread d7/d19/d26/d2b/d3c/d9e/f9f [0,4194304] 0 2024-03-17T23:58:27.273 INFO:tasks.workunit.client.0.smithi196.stdout:2/506: link d17/d22/f6e d17/d19/fc5 0 2024-03-17T23:58:27.277 INFO:tasks.workunit.client.0.smithi196.stdout:0/670: write d5/d23/d24/da8/fc5 [2388417,72348] 0 2024-03-17T23:58:27.278 INFO:tasks.workunit.client.0.smithi196.stdout:3/593: symlink d7/d33/d81/lc2 0 2024-03-17T23:58:27.281 INFO:tasks.workunit.client.0.smithi196.stdout:0/671: truncate d5/d23/d24/d28/dc9/db0/fc1 791460 0 2024-03-17T23:58:27.282 INFO:tasks.workunit.client.0.smithi196.stdout:2/507: chown f2 590590692 1 2024-03-17T23:58:27.282 INFO:tasks.workunit.client.0.smithi196.stdout:0/672: chown d5/c6 412146 1 2024-03-17T23:58:27.283 INFO:tasks.workunit.client.0.smithi196.stdout:0/673: readlink d5/d23/lc7 0 2024-03-17T23:58:27.283 INFO:tasks.workunit.client.0.smithi196.stdout:1/405: creat d1/f85 x:0 0 0 2024-03-17T23:58:27.284 INFO:tasks.workunit.client.0.smithi196.stdout:0/674: write d5/d23/d24/d28/d47/d52/dac/fae [1247484,108955] 0 2024-03-17T23:58:27.285 INFO:tasks.workunit.client.0.smithi196.stdout:7/558: creat da/d3e/fb9 x:0 0 0 2024-03-17T23:58:27.293 INFO:tasks.workunit.client.0.smithi196.stdout:7/559: symlink da/d3e/d45/d4f/d75/da8/d78/lba 0 2024-03-17T23:58:27.297 INFO:tasks.workunit.client.0.smithi196.stdout:1/406: dread d1/f4d [0,4194304] 0 2024-03-17T23:58:27.297 INFO:tasks.workunit.client.0.smithi196.stdout:8/346: dwrite de/d2b/d30/d33/f3d [0,4194304] 0 2024-03-17T23:58:27.298 INFO:tasks.workunit.client.0.smithi196.stdout:3/594: truncate d7/d19/d26/d2b/f67 3745208 0 2024-03-17T23:58:27.305 INFO:tasks.workunit.client.0.smithi196.stdout:2/508: dread d17/d22/f9c [0,4194304] 0 2024-03-17T23:58:27.310 INFO:tasks.workunit.client.0.smithi196.stdout:8/347: mkdir de/d2b/d3c/d5d/d65 0 2024-03-17T23:58:27.311 INFO:tasks.workunit.client.0.smithi196.stdout:1/407: creat d1/db/dd/d34/f86 x:0 0 0 2024-03-17T23:58:27.313 INFO:tasks.workunit.client.0.smithi196.stdout:7/560: dwrite da/d15/d1d/f2c [0,4194304] 0 2024-03-17T23:58:27.314 INFO:tasks.workunit.client.0.smithi196.stdout:2/509: chown d17/d68/la3 155 1 2024-03-17T23:58:27.316 INFO:tasks.workunit.client.0.smithi196.stdout:8/348: mknod de/d2b/d3c/d5d/d65/c66 0 2024-03-17T23:58:27.319 INFO:tasks.workunit.client.0.smithi196.stdout:1/408: truncate d1/d13/d23/d47/d48/f7b 286221 0 2024-03-17T23:58:27.320 INFO:tasks.workunit.client.0.smithi196.stdout:1/409: dread - d1/fa zero size 2024-03-17T23:58:27.325 INFO:tasks.workunit.client.0.smithi196.stdout:7/561: dwrite da/d3e/d45/d4f/d75/da8/f77 [0,4194304] 0 2024-03-17T23:58:27.326 INFO:tasks.workunit.client.0.smithi196.stdout:8/349: dread de/f2d [0,4194304] 0 2024-03-17T23:58:27.328 INFO:tasks.workunit.client.0.smithi196.stdout:1/410: creat d1/d13/d23/d47/d48/d7e/f87 x:0 0 0 2024-03-17T23:58:27.330 INFO:tasks.workunit.client.0.smithi196.stdout:3/595: write d7/d19/d26/d2b/d3c/d3d/fab [172547,105774] 0 2024-03-17T23:58:27.340 INFO:tasks.workunit.client.0.smithi196.stdout:3/596: link d7/d19/d26/d2b/d3c/d3d/c68 d7/d19/d78/d93/cc3 0 2024-03-17T23:58:27.340 INFO:tasks.workunit.client.0.smithi196.stdout:8/350: dwrite de/f39 [0,4194304] 0 2024-03-17T23:58:27.342 INFO:tasks.workunit.client.0.smithi196.stdout:2/510: dwrite d17/d19/fc5 [0,4194304] 0 2024-03-17T23:58:27.343 INFO:tasks.workunit.client.0.smithi196.stdout:3/597: fdatasync d7/d19/d26/d2b/d3c/d9e/f9f 0 2024-03-17T23:58:27.345 INFO:tasks.workunit.client.0.smithi196.stdout:3/598: readlink d7/d19/d26/d2b/d3c/l86 0 2024-03-17T23:58:27.351 INFO:tasks.workunit.client.0.smithi196.stdout:7/562: dwrite da/d15/d1d/d4c/f7d [0,4194304] 0 2024-03-17T23:58:27.357 INFO:tasks.workunit.client.0.smithi196.stdout:3/599: dwrite d7/d19/f73 [0,4194304] 0 2024-03-17T23:58:27.359 INFO:tasks.workunit.client.0.smithi196.stdout:7/563: creat da/d3e/d45/d4f/d43/d9e/fbb x:0 0 0 2024-03-17T23:58:27.360 INFO:tasks.workunit.client.0.smithi196.stdout:8/351: dwrite de/d2b/d30/d33/f45 [0,4194304] 0 2024-03-17T23:58:27.371 INFO:tasks.workunit.client.0.smithi196.stdout:3/600: mkdir d7/d19/dc4 0 2024-03-17T23:58:27.371 INFO:tasks.workunit.client.0.smithi196.stdout:2/511: rename d17/d22/da0/fc2 to d17/d28/fc6 0 2024-03-17T23:58:27.378 INFO:tasks.workunit.client.0.smithi196.stdout:7/564: link da/d15/d1d/f2d da/d3e/d7f/fbc 0 2024-03-17T23:58:27.378 INFO:tasks.workunit.client.0.smithi196.stdout:2/512: rmdir d17/d19/d44/d52 39 2024-03-17T23:58:27.379 INFO:tasks.workunit.client.0.smithi196.stdout:2/513: chown d17/d19/f31 1955719 1 2024-03-17T23:58:27.379 INFO:tasks.workunit.client.0.smithi196.stdout:3/601: creat d7/d33/d81/fc5 x:0 0 0 2024-03-17T23:58:27.381 INFO:tasks.workunit.client.0.smithi196.stdout:2/514: chown d17/d28/d30/d71/f88 0 1 2024-03-17T23:58:27.384 INFO:tasks.workunit.client.0.smithi196.stdout:7/565: dwrite da/d3e/d45/d4f/d75/da8/d78/da4/f7b [0,4194304] 0 2024-03-17T23:58:27.387 INFO:tasks.workunit.client.0.smithi196.stdout:8/352: truncate de/d10/f14 1108558 0 2024-03-17T23:58:27.388 INFO:tasks.workunit.client.0.smithi196.stdout:2/515: fdatasync d17/d22/f64 0 2024-03-17T23:58:27.389 INFO:tasks.workunit.client.0.smithi196.stdout:7/566: rename da/d15/d1d/d2e/c3d to da/d15/d1a/d5e/d70/cbd 0 2024-03-17T23:58:27.390 INFO:tasks.workunit.client.0.smithi196.stdout:7/567: fsync da/f1c 0 2024-03-17T23:58:27.391 INFO:tasks.workunit.client.0.smithi196.stdout:8/353: creat de/d10/d54/f67 x:0 0 0 2024-03-17T23:58:27.392 INFO:tasks.workunit.client.0.smithi196.stdout:2/516: mkdir d17/d22/da0/dc7 0 2024-03-17T23:58:27.393 INFO:tasks.workunit.client.0.smithi196.stdout:2/517: chown d17/d19/lbc 0 1 2024-03-17T23:58:27.397 INFO:tasks.workunit.client.0.smithi196.stdout:2/518: write d17/d28/d30/fb4 [153464,17906] 0 2024-03-17T23:58:27.399 INFO:tasks.workunit.client.0.smithi196.stdout:3/602: write d7/d19/d26/d2b/d3c/d9e/f9f [2032083,115750] 0 2024-03-17T23:58:27.404 INFO:tasks.workunit.client.0.smithi196.stdout:3/603: symlink d7/d19/d26/d48/lc6 0 2024-03-17T23:58:27.405 INFO:tasks.workunit.client.0.smithi196.stdout:7/568: dwrite da/d3e/d7f/f84 [0,4194304] 0 2024-03-17T23:58:27.406 INFO:tasks.workunit.client.0.smithi196.stdout:8/354: dwrite de/f13 [0,4194304] 0 2024-03-17T23:58:27.414 INFO:tasks.workunit.client.0.smithi196.stdout:2/519: creat d17/d19/d93/fc8 x:0 0 0 2024-03-17T23:58:27.414 INFO:tasks.workunit.client.0.smithi196.stdout:8/355: rmdir de/d2b/d3c 39 2024-03-17T23:58:27.414 INFO:tasks.workunit.client.0.smithi196.stdout:8/356: stat de/d10/f2c 0 2024-03-17T23:58:27.414 INFO:tasks.workunit.client.0.smithi196.stdout:8/357: stat de/d10/d43 0 2024-03-17T23:58:27.415 INFO:tasks.workunit.client.0.smithi196.stdout:2/520: dread d17/d28/d30/f94 [0,4194304] 0 2024-03-17T23:58:27.416 INFO:tasks.workunit.client.0.smithi196.stdout:2/521: stat d17/d19/d44/f8c 0 2024-03-17T23:58:27.417 INFO:tasks.workunit.client.0.smithi196.stdout:7/569: mknod da/d3e/d45/d4f/d75/cbe 0 2024-03-17T23:58:27.418 INFO:tasks.workunit.client.0.smithi196.stdout:2/522: symlink d17/d28/d30/d3b/lc9 0 2024-03-17T23:58:27.420 INFO:tasks.workunit.client.0.smithi196.stdout:7/570: creat da/d3e/d45/d4f/fbf x:0 0 0 2024-03-17T23:58:27.422 INFO:tasks.workunit.client.0.smithi196.stdout:2/523: rename d17/d22/d3d/f91 to d17/d28/dae/fca 0 2024-03-17T23:58:27.422 INFO:tasks.workunit.client.0.smithi196.stdout:2/524: chown d17/d22/d3d/l6a 6545777 1 2024-03-17T23:58:27.423 INFO:tasks.workunit.client.0.smithi196.stdout:7/571: creat da/d15/fc0 x:0 0 0 2024-03-17T23:58:27.425 INFO:tasks.workunit.client.0.smithi196.stdout:3/604: truncate d7/ff 7723114 0 2024-03-17T23:58:27.426 INFO:tasks.workunit.client.0.smithi196.stdout:8/358: truncate de/d10/f24 2565771 0 2024-03-17T23:58:27.428 INFO:tasks.workunit.client.0.smithi196.stdout:7/572: chown da/d3e/d45/d4f/d75/da8/d78/c9c 49916 1 2024-03-17T23:58:27.428 INFO:tasks.workunit.client.0.smithi196.stdout:7/573: chown da/d3e/fb9 93997 1 2024-03-17T23:58:27.429 INFO:tasks.workunit.client.0.smithi196.stdout:3/605: unlink d7/d19/d26/f5c 0 2024-03-17T23:58:27.430 INFO:tasks.workunit.client.0.smithi196.stdout:8/359: rename de/d2b/d30/d33/f45 to de/d2b/d30/f68 0 2024-03-17T23:58:27.431 INFO:tasks.workunit.client.0.smithi196.stdout:2/525: creat d17/d19/d44/fcb x:0 0 0 2024-03-17T23:58:27.433 INFO:tasks.workunit.client.0.smithi196.stdout:2/526: stat d17/d28/d30/d71/l98 0 2024-03-17T23:58:27.435 INFO:tasks.workunit.client.0.smithi196.stdout:7/574: link da/d3e/c46 da/d15/d1d/d29/db5/cc1 0 2024-03-17T23:58:27.436 INFO:tasks.workunit.client.0.smithi196.stdout:8/360: creat de/d2b/d3c/f69 x:0 0 0 2024-03-17T23:58:27.437 INFO:tasks.workunit.client.0.smithi196.stdout:2/527: chown d17/d22/fa6 11 1 2024-03-17T23:58:27.440 INFO:tasks.workunit.client.0.smithi196.stdout:7/575: read da/d3e/d45/d4f/d75/da8/f59 [1263581,53338] 0 2024-03-17T23:58:27.441 INFO:tasks.workunit.client.0.smithi196.stdout:3/606: dwrite d7/d19/d26/fbe [0,4194304] 0 2024-03-17T23:58:27.445 INFO:tasks.workunit.client.0.smithi196.stdout:8/361: dread de/d2b/d30/f3a [0,4194304] 0 2024-03-17T23:58:27.452 INFO:tasks.workunit.client.0.smithi196.stdout:7/576: symlink da/d3e/d45/d4f/d75/da8/lc2 0 2024-03-17T23:58:27.453 INFO:tasks.workunit.client.0.smithi196.stdout:3/607: creat d7/d19/d26/d2b/d3c/d3d/d7d/fc7 x:0 0 0 2024-03-17T23:58:27.455 INFO:tasks.workunit.client.0.smithi196.stdout:8/362: link de/d2b/d3c/f69 de/d2b/d3c/f6a 0 2024-03-17T23:58:27.456 INFO:tasks.workunit.client.0.smithi196.stdout:7/577: rmdir da/d15/da7/dae 39 2024-03-17T23:58:27.458 INFO:tasks.workunit.client.0.smithi196.stdout:3/608: readlink d7/d19/d26/lac 0 2024-03-17T23:58:27.459 INFO:tasks.workunit.client.0.smithi196.stdout:2/528: dwrite d17/d19/f60 [4194304,4194304] 0 2024-03-17T23:58:27.460 INFO:tasks.workunit.client.0.smithi196.stdout:3/609: fdatasync d7/d33/d81/fc5 0 2024-03-17T23:58:27.460 INFO:tasks.workunit.client.0.smithi196.stdout:7/578: write da/d3e/d45/d4f/d43/d9e/fab [3057548,25335] 0 2024-03-17T23:58:27.463 INFO:tasks.workunit.client.0.smithi196.stdout:5/373: sync 2024-03-17T23:58:27.466 INFO:tasks.workunit.client.0.smithi196.stdout:8/363: truncate de/d10/f2e 2059875 0 2024-03-17T23:58:27.471 INFO:tasks.workunit.client.0.smithi196.stdout:7/579: rename da/d15/l28 to da/d15/lc3 0 2024-03-17T23:58:27.475 INFO:tasks.workunit.client.0.smithi196.stdout:5/374: truncate f0 2598949 0 2024-03-17T23:58:27.478 INFO:tasks.workunit.client.0.smithi196.stdout:8/364: mknod de/d10/d54/c6b 0 2024-03-17T23:58:27.478 INFO:tasks.workunit.client.0.smithi196.stdout:7/580: mkdir da/d15/d1d/d29/dc4 0 2024-03-17T23:58:27.483 INFO:tasks.workunit.client.0.smithi196.stdout:3/610: dread d7/d19/d26/d2b/d3c/f52 [0,4194304] 0 2024-03-17T23:58:27.483 INFO:tasks.workunit.client.0.smithi196.stdout:8/365: mkdir de/d10/d35/d3e/d6c 0 2024-03-17T23:58:27.484 INFO:tasks.workunit.client.0.smithi196.stdout:5/375: dwrite d6/d2d/d33/d3b/f6d [0,4194304] 0 2024-03-17T23:58:27.484 INFO:tasks.workunit.client.0.smithi196.stdout:7/581: mkdir da/d15/d1a/d5e/d70/dc5 0 2024-03-17T23:58:27.491 INFO:tasks.workunit.client.0.smithi196.stdout:8/366: mknod de/d2b/d3c/d5d/c6d 0 2024-03-17T23:58:27.492 INFO:tasks.workunit.client.0.smithi196.stdout:7/582: mkdir da/d3e/d7f/dc6 0 2024-03-17T23:58:27.495 INFO:tasks.workunit.client.0.smithi196.stdout:3/611: dwrite d7/d19/d26/f9d [0,4194304] 0 2024-03-17T23:58:27.497 INFO:tasks.workunit.client.0.smithi196.stdout:5/376: rename d6/d15/d16 to d6/d17/d1f/d7d/d81 0 2024-03-17T23:58:27.501 INFO:tasks.workunit.client.0.smithi196.stdout:2/529: truncate d17/d28/d30/d3b/fac 3369591 0 2024-03-17T23:58:27.503 INFO:tasks.workunit.client.0.smithi196.stdout:8/367: creat de/d10/d43/f6e x:0 0 0 2024-03-17T23:58:27.505 INFO:tasks.workunit.client.0.smithi196.stdout:3/612: unlink d7/d19/d26/d2b/d3c/d3d/d7d/fba 0 2024-03-17T23:58:27.507 INFO:tasks.workunit.client.0.smithi196.stdout:5/377: dread f4 [0,4194304] 0 2024-03-17T23:58:27.508 INFO:tasks.workunit.client.0.smithi196.stdout:5/378: dread - d6/d17/d1f/f50 zero size 2024-03-17T23:58:27.508 INFO:tasks.workunit.client.0.smithi196.stdout:8/368: mknod de/d10/c6f 0 2024-03-17T23:58:27.510 INFO:tasks.workunit.client.0.smithi196.stdout:3/613: mkdir d7/d33/d81/dc8 0 2024-03-17T23:58:27.511 INFO:tasks.workunit.client.0.smithi196.stdout:8/369: creat de/d5e/f70 x:0 0 0 2024-03-17T23:58:27.511 INFO:tasks.workunit.client.0.smithi196.stdout:8/370: fsync f3 0 2024-03-17T23:58:27.512 INFO:tasks.workunit.client.0.smithi196.stdout:5/379: symlink d6/d17/d23/d53/l82 0 2024-03-17T23:58:27.513 INFO:tasks.workunit.client.0.smithi196.stdout:8/371: read - de/d2b/d3c/f6a zero size 2024-03-17T23:58:27.514 INFO:tasks.workunit.client.0.smithi196.stdout:2/530: rename d17/d68/c9a to d17/d22/ccc 0 2024-03-17T23:58:27.516 INFO:tasks.workunit.client.0.smithi196.stdout:5/380: unlink d6/d17/d3f/f67 0 2024-03-17T23:58:27.517 INFO:tasks.workunit.client.0.smithi196.stdout:8/372: mkdir de/d10/d43/d71 0 2024-03-17T23:58:27.518 INFO:tasks.workunit.client.0.smithi196.stdout:5/381: read d6/d17/d1f/f29 [4159022,96897] 0 2024-03-17T23:58:27.519 INFO:tasks.workunit.client.0.smithi196.stdout:3/614: symlink d7/d19/d26/lc9 0 2024-03-17T23:58:27.524 INFO:tasks.workunit.client.0.smithi196.stdout:8/373: rmdir de/d2b/d30 39 2024-03-17T23:58:27.525 INFO:tasks.workunit.client.0.smithi196.stdout:8/374: fdatasync de/d10/d35/d3e/f56 0 2024-03-17T23:58:27.527 INFO:tasks.workunit.client.0.smithi196.stdout:3/615: mkdir d7/d19/d78/dca 0 2024-03-17T23:58:27.528 INFO:tasks.workunit.client.0.smithi196.stdout:3/616: chown d7/d33/f49 7 1 2024-03-17T23:58:27.531 INFO:tasks.workunit.client.0.smithi196.stdout:3/617: symlink d7/d19/d78/dca/lcb 0 2024-03-17T23:58:27.535 INFO:tasks.workunit.client.0.smithi196.stdout:2/531: write d17/f70 [880759,17937] 0 2024-03-17T23:58:27.536 INFO:tasks.workunit.client.0.smithi196.stdout:5/382: write d6/f10 [73891,64509] 0 2024-03-17T23:58:27.541 INFO:tasks.workunit.client.0.smithi196.stdout:2/532: rename d17/d19/f35 to d17/d28/d30/fcd 0 2024-03-17T23:58:27.543 INFO:tasks.workunit.client.0.smithi196.stdout:2/533: chown d17/d19/d44/c99 7409 1 2024-03-17T23:58:27.544 INFO:tasks.workunit.client.0.smithi196.stdout:3/618: dwrite d7/f11 [0,4194304] 0 2024-03-17T23:58:27.546 INFO:tasks.workunit.client.0.smithi196.stdout:3/619: dread - d7/d19/d26/d2b/d3c/d3d/d7d/fc7 zero size 2024-03-17T23:58:27.547 INFO:tasks.workunit.client.0.smithi196.stdout:5/383: rename d6/d2d/c2f to d6/d17/d23/d53/c83 0 2024-03-17T23:58:27.548 INFO:tasks.workunit.client.0.smithi196.stdout:3/620: readlink d7/d33/lbd 0 2024-03-17T23:58:27.548 INFO:tasks.workunit.client.0.smithi196.stdout:2/534: fsync d17/d28/d30/f62 0 2024-03-17T23:58:27.549 INFO:tasks.workunit.client.0.smithi196.stdout:3/621: chown d7/l12 10721379 1 2024-03-17T23:58:27.550 INFO:tasks.workunit.client.0.smithi196.stdout:3/622: truncate d7/d19/fa5 1029472 0 2024-03-17T23:58:27.552 INFO:tasks.workunit.client.0.smithi196.stdout:5/384: read f0 [1870955,26805] 0 2024-03-17T23:58:27.552 INFO:tasks.workunit.client.0.smithi196.stdout:2/535: stat d17/d22/l95 0 2024-03-17T23:58:27.552 INFO:tasks.workunit.client.0.smithi196.stdout:5/385: read - d6/d2a/f47 zero size 2024-03-17T23:58:27.553 INFO:tasks.workunit.client.0.smithi196.stdout:3/623: creat d7/d19/d26/d48/fcc x:0 0 0 2024-03-17T23:58:27.555 INFO:tasks.workunit.client.0.smithi196.stdout:2/536: mkdir d17/dce 0 2024-03-17T23:58:27.556 INFO:tasks.workunit.client.0.smithi196.stdout:5/386: mkdir d6/d2d/d33/d84 0 2024-03-17T23:58:27.556 INFO:tasks.workunit.client.0.smithi196.stdout:3/624: mkdir d7/d19/d26/d2b/dcd 0 2024-03-17T23:58:27.558 INFO:tasks.workunit.client.0.smithi196.stdout:3/625: symlink d7/d19/d78/lce 0 2024-03-17T23:58:27.562 INFO:tasks.workunit.client.0.smithi196.stdout:2/537: truncate d17/d28/d30/f62 1706674 0 2024-03-17T23:58:27.565 INFO:tasks.workunit.client.0.smithi196.stdout:5/387: truncate d6/d2d/f30 1048612 0 2024-03-17T23:58:27.567 INFO:tasks.workunit.client.0.smithi196.stdout:2/538: write d17/d28/f46 [12465,39549] 0 2024-03-17T23:58:27.568 INFO:tasks.workunit.client.0.smithi196.stdout:2/539: read - d17/d19/d93/fc8 zero size 2024-03-17T23:58:27.572 INFO:tasks.workunit.client.0.smithi196.stdout:5/388: dwrite d6/ff [0,4194304] 0 2024-03-17T23:58:27.573 INFO:tasks.workunit.client.0.smithi196.stdout:5/389: stat d6/d17/d3f/d4e/d69/c44 0 2024-03-17T23:58:27.574 INFO:tasks.workunit.client.0.smithi196.stdout:5/390: write d6/f10 [3828340,74081] 0 2024-03-17T23:58:27.576 INFO:tasks.workunit.client.0.smithi196.stdout:5/391: fsync d6/d2d/d33/d3b/d65/f4d 0 2024-03-17T23:58:27.632 INFO:tasks.workunit.client.0.smithi196.stdout:9/498: sync 2024-03-17T23:58:27.633 INFO:tasks.workunit.client.0.smithi196.stdout:4/366: sync 2024-03-17T23:58:27.644 INFO:tasks.workunit.client.0.smithi196.stdout:9/499: dwrite d9/d38/d60/d5e/f81 [0,4194304] 0 2024-03-17T23:58:27.667 INFO:tasks.workunit.client.0.smithi196.stdout:9/500: dread d9/df/f36 [0,4194304] 0 2024-03-17T23:58:27.691 INFO:tasks.workunit.client.0.smithi196.stdout:2/540: rmdir d17/d28/d30/d72/d81 39 2024-03-17T23:58:27.692 INFO:tasks.workunit.client.0.smithi196.stdout:5/392: creat d6/d17/d35/f85 x:0 0 0 2024-03-17T23:58:27.693 INFO:tasks.workunit.client.0.smithi196.stdout:4/367: chown d1/d26/l30 258362 1 2024-03-17T23:58:27.694 INFO:tasks.workunit.client.0.smithi196.stdout:5/393: chown d6/d17/d1f/f50 3221 1 2024-03-17T23:58:27.696 INFO:tasks.workunit.client.0.smithi196.stdout:9/501: creat d9/d38/d60/f9b x:0 0 0 2024-03-17T23:58:27.697 INFO:tasks.workunit.client.0.smithi196.stdout:5/394: fdatasync f4 0 2024-03-17T23:58:27.698 INFO:tasks.workunit.client.0.smithi196.stdout:5/395: stat d6/d17/d23 0 2024-03-17T23:58:27.703 INFO:tasks.workunit.client.0.smithi196.stdout:9/502: truncate d9/df/d14/d27/f31 1508533 0 2024-03-17T23:58:27.706 INFO:tasks.workunit.client.0.smithi196.stdout:5/396: rename d6/f1a to d6/d17/d23/d53/f86 0 2024-03-17T23:58:27.707 INFO:tasks.workunit.client.0.smithi196.stdout:5/397: dread - d6/d17/d23/d53/f54 zero size 2024-03-17T23:58:27.709 INFO:tasks.workunit.client.0.smithi196.stdout:2/541: creat d17/d28/d30/fcf x:0 0 0 2024-03-17T23:58:27.717 INFO:tasks.workunit.client.0.smithi196.stdout:9/503: getdents d9/df/d4a/d5b/d6d 0 2024-03-17T23:58:27.717 INFO:tasks.workunit.client.0.smithi196.stdout:5/398: dwrite d6/d17/d23/f74 [0,4194304] 0 2024-03-17T23:58:27.718 INFO:tasks.workunit.client.0.smithi196.stdout:9/504: chown d9/df/d55/l6c 29 1 2024-03-17T23:58:27.719 INFO:tasks.workunit.client.0.smithi196.stdout:9/505: write f5 [5343270,67915] 0 2024-03-17T23:58:27.720 INFO:tasks.workunit.client.0.smithi196.stdout:4/368: truncate d1/d26/d33/d40/f5e 609829 0 2024-03-17T23:58:27.722 INFO:tasks.workunit.client.0.smithi196.stdout:4/369: fsync d1/de/d50/f60 0 2024-03-17T23:58:27.723 INFO:tasks.workunit.client.0.smithi196.stdout:5/399: chown d6/d2a/f31 93185 1 2024-03-17T23:58:27.724 INFO:tasks.workunit.client.0.smithi196.stdout:5/400: dread - d6/d2a/f47 zero size 2024-03-17T23:58:27.728 INFO:tasks.workunit.client.0.smithi196.stdout:4/370: rmdir d1/d26/d33/d3f 39 2024-03-17T23:58:27.729 INFO:tasks.workunit.client.0.smithi196.stdout:5/401: symlink d6/d2d/d33/l87 0 2024-03-17T23:58:27.731 INFO:tasks.workunit.client.0.smithi196.stdout:2/542: dread d17/d19/f31 [0,4194304] 0 2024-03-17T23:58:27.731 INFO:tasks.workunit.client.0.smithi196.stdout:9/506: symlink d9/df/l9c 0 2024-03-17T23:58:27.732 INFO:tasks.workunit.client.0.smithi196.stdout:4/371: dread d1/d11/f1c [0,4194304] 0 2024-03-17T23:58:27.733 INFO:tasks.workunit.client.0.smithi196.stdout:9/507: fsync d9/d33/f52 0 2024-03-17T23:58:27.734 INFO:tasks.workunit.client.0.smithi196.stdout:9/508: readlink d9/df/d14/d3d/l67 0 2024-03-17T23:58:27.736 INFO:tasks.workunit.client.0.smithi196.stdout:5/402: unlink d6/d17/d1f/d7d/d81/f24 0 2024-03-17T23:58:27.740 INFO:tasks.workunit.client.0.smithi196.stdout:9/509: symlink d9/d38/d60/d85/d8e/l9d 0 2024-03-17T23:58:27.741 INFO:tasks.workunit.client.0.smithi196.stdout:5/403: symlink d6/d17/d3f/d4e/l88 0 2024-03-17T23:58:27.741 INFO:tasks.workunit.client.0.smithi196.stdout:9/510: dread - d9/df/d14/d27/f97 zero size 2024-03-17T23:58:27.741 INFO:tasks.workunit.client.0.smithi196.stdout:2/543: mknod d17/d28/d30/d72/d81/cd0 0 2024-03-17T23:58:27.744 INFO:tasks.workunit.client.0.smithi196.stdout:4/372: rename d1/d68/f71 to d1/d26/f7e 0 2024-03-17T23:58:27.745 INFO:tasks.workunit.client.0.smithi196.stdout:4/373: stat d1/d1b/f75 0 2024-03-17T23:58:27.746 INFO:tasks.workunit.client.0.smithi196.stdout:5/404: mkdir d6/d17/d1f/d7d/d89 0 2024-03-17T23:58:27.751 INFO:tasks.workunit.client.0.smithi196.stdout:4/374: link d1/d11/l5b d1/d1b/l7f 0 2024-03-17T23:58:27.751 INFO:tasks.workunit.client.0.smithi196.stdout:9/511: dwrite d9/df/d14/f6b [4194304,4194304] 0 2024-03-17T23:58:27.752 INFO:tasks.workunit.client.0.smithi196.stdout:9/512: write d9/d12/f21 [2715183,41656] 0 2024-03-17T23:58:27.753 INFO:tasks.workunit.client.0.smithi196.stdout:5/405: creat d6/f8a x:0 0 0 2024-03-17T23:58:27.756 INFO:tasks.workunit.client.0.smithi196.stdout:9/513: truncate d9/d38/d60/f9b 907978 0 2024-03-17T23:58:27.758 INFO:tasks.workunit.client.0.smithi196.stdout:9/514: truncate f6 776489 0 2024-03-17T23:58:27.762 INFO:tasks.workunit.client.0.smithi196.stdout:9/515: mkdir d9/df/d14/d27/d9e 0 2024-03-17T23:58:27.762 INFO:tasks.workunit.client.0.smithi196.stdout:2/544: write d17/d28/d30/d72/fb3 [5027143,85527] 0 2024-03-17T23:58:27.762 INFO:tasks.workunit.client.0.smithi196.stdout:5/406: dread d6/d17/d23/f74 [0,4194304] 0 2024-03-17T23:58:27.763 INFO:tasks.workunit.client.0.smithi196.stdout:4/375: creat d1/d26/f80 x:0 0 0 2024-03-17T23:58:27.765 INFO:tasks.workunit.client.0.smithi196.stdout:9/516: write d9/df/d4a/d5b/d6d/f73 [1319900,90734] 0 2024-03-17T23:58:27.768 INFO:tasks.workunit.client.0.smithi196.stdout:4/376: mknod d1/d1b/c81 0 2024-03-17T23:58:27.769 INFO:tasks.workunit.client.0.smithi196.stdout:5/407: rmdir d6/d17/d35 39 2024-03-17T23:58:27.773 INFO:tasks.workunit.client.0.smithi196.stdout:2/545: dread d17/f2a [0,4194304] 0 2024-03-17T23:58:27.776 INFO:tasks.workunit.client.0.smithi196.stdout:2/546: write d17/d19/d44/d52/f84 [4031425,23638] 0 2024-03-17T23:58:27.776 INFO:tasks.workunit.client.0.smithi196.stdout:4/377: rename d1/d26/d57/c64 to d1/c82 0 2024-03-17T23:58:27.778 INFO:tasks.workunit.client.0.smithi196.stdout:5/408: dwrite d6/fb [4194304,4194304] 0 2024-03-17T23:58:27.786 INFO:tasks.workunit.client.0.smithi196.stdout:4/378: dwrite d1/d11/f19 [0,4194304] 0 2024-03-17T23:58:27.786 INFO:tasks.workunit.client.0.smithi196.stdout:9/517: truncate d9/d12/f16 1897288 0 2024-03-17T23:58:27.789 INFO:tasks.workunit.client.0.smithi196.stdout:9/518: symlink d9/df/d4a/d5b/d62/l9f 0 2024-03-17T23:58:27.790 INFO:tasks.workunit.client.0.smithi196.stdout:4/379: dread d1/d11/f1c [0,4194304] 0 2024-03-17T23:58:27.795 INFO:tasks.workunit.client.0.smithi196.stdout:4/380: creat d1/d1b/d77/f83 x:0 0 0 2024-03-17T23:58:27.798 INFO:tasks.workunit.client.0.smithi196.stdout:5/409: dread d6/fd [0,4194304] 0 2024-03-17T23:58:27.800 INFO:tasks.workunit.client.0.smithi196.stdout:4/381: unlink d1/l48 0 2024-03-17T23:58:27.801 INFO:tasks.workunit.client.0.smithi196.stdout:9/519: dwrite d9/df/d4a/d5b/d62/f7c [0,4194304] 0 2024-03-17T23:58:27.802 INFO:tasks.workunit.client.0.smithi196.stdout:5/410: write d6/d17/d35/f66 [590133,38915] 0 2024-03-17T23:58:27.803 INFO:tasks.workunit.client.0.smithi196.stdout:4/382: mknod d1/d68/c84 0 2024-03-17T23:58:27.807 INFO:tasks.workunit.client.0.smithi196.stdout:9/520: mknod d9/df/d4a/d89/ca0 0 2024-03-17T23:58:27.812 INFO:tasks.workunit.client.0.smithi196.stdout:5/411: mkdir d6/d2d/d33/d3b/d8b 0 2024-03-17T23:58:27.815 INFO:tasks.workunit.client.0.smithi196.stdout:4/383: mkdir d1/d26/d33/d85 0 2024-03-17T23:58:27.815 INFO:tasks.workunit.client.0.smithi196.stdout:9/521: dwrite d9/fd [8388608,4194304] 0 2024-03-17T23:58:27.817 INFO:tasks.workunit.client.0.smithi196.stdout:5/412: unlink d6/d2d/f3a 0 2024-03-17T23:58:27.820 INFO:tasks.workunit.client.0.smithi196.stdout:6/394: sync 2024-03-17T23:58:27.822 INFO:tasks.workunit.client.0.smithi196.stdout:5/413: creat d6/d17/d1f/d7d/d81/f8c x:0 0 0 2024-03-17T23:58:27.824 INFO:tasks.workunit.client.0.smithi196.stdout:6/395: symlink d2/d14/d35/l83 0 2024-03-17T23:58:27.829 INFO:tasks.workunit.client.0.smithi196.stdout:6/396: creat d2/d7/d2b/f84 x:0 0 0 2024-03-17T23:58:27.830 INFO:tasks.workunit.client.0.smithi196.stdout:5/414: symlink d6/d2d/l8d 0 2024-03-17T23:58:27.831 INFO:tasks.workunit.client.0.smithi196.stdout:4/384: dwrite d1/d26/d33/d3f/f7a [0,4194304] 0 2024-03-17T23:58:27.831 INFO:tasks.workunit.client.0.smithi196.stdout:5/415: chown d6/d17/c42 2830920 1 2024-03-17T23:58:27.836 INFO:tasks.workunit.client.0.smithi196.stdout:4/385: rename d1/d26/d33/d40/l44 to d1/de/d50/d55/l86 0 2024-03-17T23:58:27.837 INFO:tasks.workunit.client.0.smithi196.stdout:5/416: symlink d6/d2d/d33/d84/l8e 0 2024-03-17T23:58:27.840 INFO:tasks.workunit.client.0.smithi196.stdout:6/397: dwrite d2/d14/d42/d57/f82 [0,4194304] 0 2024-03-17T23:58:27.851 INFO:tasks.workunit.client.0.smithi196.stdout:9/522: dread d9/d12/f16 [0,4194304] 0 2024-03-17T23:58:27.852 INFO:tasks.workunit.client.0.smithi196.stdout:9/523: read - d9/d38/f93 zero size 2024-03-17T23:58:27.853 INFO:tasks.workunit.client.0.smithi196.stdout:6/398: link d2/d40/c5e d2/d14/d50/c85 0 2024-03-17T23:58:27.857 INFO:tasks.workunit.client.0.smithi196.stdout:9/524: dread d9/d12/d59/f7d [0,4194304] 0 2024-03-17T23:58:27.857 INFO:tasks.workunit.client.0.smithi196.stdout:4/386: dread d1/d11/f3d [0,4194304] 0 2024-03-17T23:58:27.859 INFO:tasks.workunit.client.0.smithi196.stdout:5/417: truncate d6/fb 5168776 0 2024-03-17T23:58:27.859 INFO:tasks.workunit.client.0.smithi196.stdout:5/418: stat d6/d2d/d33 0 2024-03-17T23:58:27.860 INFO:tasks.workunit.client.0.smithi196.stdout:9/525: truncate d9/d12/f3c 4384445 0 2024-03-17T23:58:27.861 INFO:tasks.workunit.client.0.smithi196.stdout:5/419: dread - d6/d17/f26 zero size 2024-03-17T23:58:27.863 INFO:tasks.workunit.client.0.smithi196.stdout:9/526: mknod d9/d38/d60/ca1 0 2024-03-17T23:58:27.864 INFO:tasks.workunit.client.0.smithi196.stdout:4/387: getdents d1/de 0 2024-03-17T23:58:27.864 INFO:tasks.workunit.client.0.smithi196.stdout:9/527: chown d9/d38/f76 72649 1 2024-03-17T23:58:27.866 INFO:tasks.workunit.client.0.smithi196.stdout:9/528: rmdir d9/df/d4a/d5b/d6d 39 2024-03-17T23:58:27.868 INFO:tasks.workunit.client.0.smithi196.stdout:9/529: write d9/df/d4a/d5b/d62/f79 [1576876,46933] 0 2024-03-17T23:58:27.869 INFO:tasks.workunit.client.0.smithi196.stdout:6/399: dread d2/d14/d35/d63/f6b [0,4194304] 0 2024-03-17T23:58:27.869 INFO:tasks.workunit.client.0.smithi196.stdout:4/388: link d1/d26/d33/d3f/f7a d1/d68/f87 0 2024-03-17T23:58:27.871 INFO:tasks.workunit.client.0.smithi196.stdout:4/389: fdatasync d1/f36 0 2024-03-17T23:58:27.875 INFO:tasks.workunit.client.0.smithi196.stdout:9/530: truncate d9/df/d14/d27/f7e 1126860 0 2024-03-17T23:58:27.877 INFO:tasks.workunit.client.0.smithi196.stdout:9/531: dread - d9/df/d4a/f80 zero size 2024-03-17T23:58:27.878 INFO:tasks.workunit.client.0.smithi196.stdout:6/400: stat d2/d14/d75/d7b/f3f 0 2024-03-17T23:58:27.878 INFO:tasks.workunit.client.0.smithi196.stdout:9/532: dread - d9/df/d4a/f8f zero size 2024-03-17T23:58:27.879 INFO:tasks.workunit.client.0.smithi196.stdout:4/390: creat d1/d26/d33/f88 x:0 0 0 2024-03-17T23:58:27.880 INFO:tasks.workunit.client.0.smithi196.stdout:5/420: dwrite d6/d2d/d33/d3b/f77 [0,4194304] 0 2024-03-17T23:58:27.884 INFO:tasks.workunit.client.0.smithi196.stdout:6/401: creat d2/d14/d50/d68/f86 x:0 0 0 2024-03-17T23:58:27.885 INFO:tasks.workunit.client.0.smithi196.stdout:5/421: creat d6/d17/d23/d53/f8f x:0 0 0 2024-03-17T23:58:27.887 INFO:tasks.workunit.client.0.smithi196.stdout:5/422: write d6/d17/d1f/d7d/d81/f71 [551380,57456] 0 2024-03-17T23:58:27.888 INFO:tasks.workunit.client.0.smithi196.stdout:5/423: dread - d6/d17/d3f/d4e/f73 zero size 2024-03-17T23:58:27.888 INFO:tasks.workunit.client.0.smithi196.stdout:4/391: rename d1/d11/f19 to d1/d26/d33/d40/f89 0 2024-03-17T23:58:27.890 INFO:tasks.workunit.client.0.smithi196.stdout:9/533: truncate d9/df/d14/d27/f49 903884 0 2024-03-17T23:58:27.893 INFO:tasks.workunit.client.0.smithi196.stdout:6/402: creat d2/d14/d5b/f87 x:0 0 0 2024-03-17T23:58:27.893 INFO:tasks.workunit.client.0.smithi196.stdout:9/534: truncate d9/df/d4a/d5b/d62/f7a 392269 0 2024-03-17T23:58:27.894 INFO:tasks.workunit.client.0.smithi196.stdout:5/424: rename d6/d17/d35/l46 to d6/d2d/d33/d84/l90 0 2024-03-17T23:58:27.895 INFO:tasks.workunit.client.0.smithi196.stdout:5/425: write d6/f64 [278763,9629] 0 2024-03-17T23:58:27.896 INFO:tasks.workunit.client.0.smithi196.stdout:9/535: creat d9/d38/d60/d5e/fa2 x:0 0 0 2024-03-17T23:58:27.898 INFO:tasks.workunit.client.0.smithi196.stdout:5/426: write d6/d17/d1f/d7d/d81/f8c [30803,31142] 0 2024-03-17T23:58:27.898 INFO:tasks.workunit.client.0.smithi196.stdout:9/536: write d9/df/d14/d3d/f91 [91659,60411] 0 2024-03-17T23:58:27.899 INFO:tasks.workunit.client.0.smithi196.stdout:4/392: dread d1/d1b/f5f [0,4194304] 0 2024-03-17T23:58:27.902 INFO:tasks.workunit.client.0.smithi196.stdout:5/427: mknod d6/d2d/d33/d3b/c91 0 2024-03-17T23:58:27.905 INFO:tasks.workunit.client.0.smithi196.stdout:6/403: dwrite f1 [0,4194304] 0 2024-03-17T23:58:27.905 INFO:tasks.workunit.client.0.smithi196.stdout:4/393: creat d1/f8a x:0 0 0 2024-03-17T23:58:27.905 INFO:tasks.workunit.client.0.smithi196.stdout:9/537: dread d9/df/d14/d3d/f8b [0,4194304] 0 2024-03-17T23:58:27.906 INFO:tasks.workunit.client.0.smithi196.stdout:4/394: readlink d1/d1b/l6c 0 2024-03-17T23:58:27.907 INFO:tasks.workunit.client.0.smithi196.stdout:5/428: getdents d6/d2d/d33/d3b/d80 0 2024-03-17T23:58:27.909 INFO:tasks.workunit.client.0.smithi196.stdout:4/395: truncate d1/f5a 1041496 0 2024-03-17T23:58:27.909 INFO:tasks.workunit.client.0.smithi196.stdout:9/538: write d9/d38/d60/f61 [7848095,90764] 0 2024-03-17T23:58:27.910 INFO:tasks.workunit.client.0.smithi196.stdout:9/539: mknod d9/d38/d60/ca3 0 2024-03-17T23:58:27.912 INFO:tasks.workunit.client.0.smithi196.stdout:9/540: write d9/d12/d59/f6e [227923,90364] 0 2024-03-17T23:58:27.914 INFO:tasks.workunit.client.0.smithi196.stdout:6/404: link d2/d40/l7a d2/d7/d2b/l88 0 2024-03-17T23:58:27.917 INFO:tasks.workunit.client.0.smithi196.stdout:9/541: unlink d9/d38/d60/c66 0 2024-03-17T23:58:27.921 INFO:tasks.workunit.client.0.smithi196.stdout:6/405: rename d2/d7/l61 to d2/d14/d50/l89 0 2024-03-17T23:58:27.922 INFO:tasks.workunit.client.0.smithi196.stdout:5/429: dwrite d6/d17/f48 [0,4194304] 0 2024-03-17T23:58:27.922 INFO:tasks.workunit.client.0.smithi196.stdout:4/396: dwrite d1/de/f21 [0,4194304] 0 2024-03-17T23:58:27.926 INFO:tasks.workunit.client.0.smithi196.stdout:6/406: symlink d2/d14/d50/d68/l8a 0 2024-03-17T23:58:27.928 INFO:tasks.workunit.client.0.smithi196.stdout:6/407: chown d2/d14/d35 36 1 2024-03-17T23:58:27.928 INFO:tasks.workunit.client.0.smithi196.stdout:4/397: write d1/d26/f7e [39439,69944] 0 2024-03-17T23:58:27.930 INFO:tasks.workunit.client.0.smithi196.stdout:9/542: rename d9/d38/d60/f68 to d9/df/d4a/d5b/fa4 0 2024-03-17T23:58:27.930 INFO:tasks.workunit.client.0.smithi196.stdout:9/543: chown d9/d38 33 1 2024-03-17T23:58:27.932 INFO:tasks.workunit.client.0.smithi196.stdout:9/544: chown d9/df/d4a/d8c 58872279 1 2024-03-17T23:58:27.932 INFO:tasks.workunit.client.0.smithi196.stdout:4/398: getdents d1/de 0 2024-03-17T23:58:27.943 INFO:tasks.workunit.client.0.smithi196.stdout:9/545: mkdir d9/df/d4a/d5b/da5 0 2024-03-17T23:58:27.945 INFO:tasks.workunit.client.0.smithi196.stdout:4/399: mkdir d1/d26/d8b 0 2024-03-17T23:58:27.946 INFO:tasks.workunit.client.0.smithi196.stdout:4/400: dread - d1/d1b/d77/f83 zero size 2024-03-17T23:58:27.947 INFO:tasks.workunit.client.0.smithi196.stdout:5/430: write d6/d17/d1f/f3c [2707421,120005] 0 2024-03-17T23:58:27.950 INFO:tasks.workunit.client.0.smithi196.stdout:5/431: chown d6/d17/f48 1290491 1 2024-03-17T23:58:27.950 INFO:tasks.workunit.client.0.smithi196.stdout:4/401: truncate d1/d68/f87 306235 0 2024-03-17T23:58:27.952 INFO:tasks.workunit.client.0.smithi196.stdout:5/432: symlink d6/d2d/d33/d3b/d65/l92 0 2024-03-17T23:58:27.953 INFO:tasks.workunit.client.0.smithi196.stdout:4/402: truncate d1/f1d 173670 0 2024-03-17T23:58:27.957 INFO:tasks.workunit.client.0.smithi196.stdout:5/433: rename d6/d17/d35/f41 to d6/d2d/f93 0 2024-03-17T23:58:27.959 INFO:tasks.workunit.client.0.smithi196.stdout:4/403: getdents d1/d61 0 2024-03-17T23:58:27.962 INFO:tasks.workunit.client.0.smithi196.stdout:4/404: mkdir d1/d26/d57/d8c 0 2024-03-17T23:58:27.963 INFO:tasks.workunit.client.0.smithi196.stdout:9/546: dread d9/d33/f5f [0,4194304] 0 2024-03-17T23:58:27.964 INFO:tasks.workunit.client.0.smithi196.stdout:4/405: write d1/d26/d33/f72 [14493,67089] 0 2024-03-17T23:58:27.965 INFO:tasks.workunit.client.0.smithi196.stdout:4/406: fdatasync d1/f36 0 2024-03-17T23:58:27.970 INFO:tasks.workunit.client.0.smithi196.stdout:5/434: dwrite d6/fa [0,4194304] 0 2024-03-17T23:58:27.971 INFO:tasks.workunit.client.0.smithi196.stdout:5/435: fsync d6/d17/d1f/f75 0 2024-03-17T23:58:27.975 INFO:tasks.workunit.client.0.smithi196.stdout:4/407: link d1/d1b/f5f d1/de/d50/d55/d4a/f8d 0 2024-03-17T23:58:27.977 INFO:tasks.workunit.client.0.smithi196.stdout:5/436: mknod d6/d17/d23/d53/c94 0 2024-03-17T23:58:27.979 INFO:tasks.workunit.client.0.smithi196.stdout:5/437: write d6/d2d/f55 [839250,117742] 0 2024-03-17T23:58:27.980 INFO:tasks.workunit.client.0.smithi196.stdout:4/408: rename d1/fd to d1/d26/f8e 0 2024-03-17T23:58:27.982 INFO:tasks.workunit.client.0.smithi196.stdout:9/547: dwrite d9/df/f34 [0,4194304] 0 2024-03-17T23:58:27.984 INFO:tasks.workunit.client.0.smithi196.stdout:5/438: symlink d6/d2d/d33/d84/l95 0 2024-03-17T23:58:27.985 INFO:tasks.workunit.client.0.smithi196.stdout:4/409: creat d1/d61/f8f x:0 0 0 2024-03-17T23:58:27.986 INFO:tasks.workunit.client.0.smithi196.stdout:5/439: write d6/d17/d1f/f50 [809682,96954] 0 2024-03-17T23:58:27.998 INFO:tasks.workunit.client.0.smithi196.stdout:5/440: link d6/d2a/f31 d6/d2d/f96 0 2024-03-17T23:58:27.998 INFO:tasks.workunit.client.0.smithi196.stdout:4/410: dwrite d1/d1b/f79 [0,4194304] 0 2024-03-17T23:58:27.999 INFO:tasks.workunit.client.0.smithi196.stdout:5/441: dread d6/d17/d1f/f3c [0,4194304] 0 2024-03-17T23:58:28.000 INFO:tasks.workunit.client.0.smithi196.stdout:5/442: chown d6/d17/d35/f4f 385223 1 2024-03-17T23:58:28.009 INFO:tasks.workunit.client.0.smithi196.stdout:4/411: dwrite d1/d26/d33/f88 [0,4194304] 0 2024-03-17T23:58:28.010 INFO:tasks.workunit.client.0.smithi196.stdout:5/443: dwrite d6/d17/d1f/d7d/d81/f4a [0,4194304] 0 2024-03-17T23:58:28.012 INFO:tasks.workunit.client.0.smithi196.stdout:1/411: sync 2024-03-17T23:58:28.012 INFO:tasks.workunit.client.0.smithi196.stdout:0/675: sync 2024-03-17T23:58:28.022 INFO:tasks.workunit.client.0.smithi196.stdout:4/412: rename d1/d26/d57/f78 to d1/d1b/d77/f90 0 2024-03-17T23:58:28.023 INFO:tasks.workunit.client.0.smithi196.stdout:5/444: mkdir d6/d17/d23/d53/d97 0 2024-03-17T23:58:28.025 INFO:tasks.workunit.client.0.smithi196.stdout:1/412: symlink d1/d13/d23/d62/d71/l88 0 2024-03-17T23:58:28.025 INFO:tasks.workunit.client.0.smithi196.stdout:5/445: dread - d6/d17/f6c zero size 2024-03-17T23:58:28.025 INFO:tasks.workunit.client.0.smithi196.stdout:9/548: dwrite d9/d12/f16 [0,4194304] 0 2024-03-17T23:58:28.028 INFO:tasks.workunit.client.0.smithi196.stdout:4/413: symlink d1/d68/l91 0 2024-03-17T23:58:28.029 INFO:tasks.workunit.client.0.smithi196.stdout:0/676: creat d5/d23/d24/d59/d94/db5/fcc x:0 0 0 2024-03-17T23:58:28.031 INFO:tasks.workunit.client.0.smithi196.stdout:9/549: write d9/df/d14/d3d/f8b [863991,52947] 0 2024-03-17T23:58:28.033 INFO:tasks.workunit.client.0.smithi196.stdout:5/446: unlink d6/d17/d23/d53/c83 0 2024-03-17T23:58:28.035 INFO:tasks.workunit.client.0.smithi196.stdout:1/413: fsync d1/d13/f18 0 2024-03-17T23:58:28.037 INFO:tasks.workunit.client.0.smithi196.stdout:4/414: rename d1/f3a to d1/d26/d33/d85/f92 0 2024-03-17T23:58:28.038 INFO:tasks.workunit.client.0.smithi196.stdout:0/677: mknod d5/d23/d24/da3/ccd 0 2024-03-17T23:58:28.039 INFO:tasks.workunit.client.0.smithi196.stdout:5/447: mkdir d6/d17/d23/d53/d98 0 2024-03-17T23:58:28.046 INFO:tasks.workunit.client.0.smithi196.stdout:4/415: mknod d1/de/c93 0 2024-03-17T23:58:28.047 INFO:tasks.workunit.client.0.smithi196.stdout:0/678: mkdir d5/d23/d85/dce 0 2024-03-17T23:58:28.049 INFO:tasks.workunit.client.0.smithi196.stdout:0/679: fsync d5/d23/d24/d59/d94/db5/fcc 0 2024-03-17T23:58:28.050 INFO:tasks.workunit.client.0.smithi196.stdout:4/416: symlink d1/d1b/d77/l94 0 2024-03-17T23:58:28.051 INFO:tasks.workunit.client.0.smithi196.stdout:0/680: chown d5/d23/d24/d30/cbd 140363829 1 2024-03-17T23:58:28.053 INFO:tasks.workunit.client.0.smithi196.stdout:0/681: fsync d5/d23/d24/d28/d47/d52/f54 0 2024-03-17T23:58:28.053 INFO:tasks.workunit.client.0.smithi196.stdout:1/414: dwrite d1/d13/f18 [0,4194304] 0 2024-03-17T23:58:28.055 INFO:tasks.workunit.client.0.smithi196.stdout:1/415: readlink d1/d13/d23/l26 0 2024-03-17T23:58:28.057 INFO:tasks.workunit.client.0.smithi196.stdout:0/682: creat d5/d23/d24/d59/d8b/fcf x:0 0 0 2024-03-17T23:58:28.063 INFO:tasks.workunit.client.0.smithi196.stdout:1/416: symlink d1/d13/d4c/l89 0 2024-03-17T23:58:28.064 INFO:tasks.workunit.client.0.smithi196.stdout:5/448: truncate d6/d17/d1f/f50 21984 0 2024-03-17T23:58:28.064 INFO:tasks.workunit.client.0.smithi196.stdout:4/417: truncate d1/f2c 4136311 0 2024-03-17T23:58:28.065 INFO:tasks.workunit.client.0.smithi196.stdout:0/683: creat d5/d23/d24/d59/d94/db5/fd0 x:0 0 0 2024-03-17T23:58:28.067 INFO:tasks.workunit.client.0.smithi196.stdout:4/418: truncate d1/d26/d33/d3f/f6e 225901 0 2024-03-17T23:58:28.067 INFO:tasks.workunit.client.0.smithi196.stdout:0/684: symlink d5/ld1 0 2024-03-17T23:58:28.069 INFO:tasks.workunit.client.0.smithi196.stdout:0/685: stat d5/d23/d24/d28/d47/d52 0 2024-03-17T23:58:28.070 INFO:tasks.workunit.client.0.smithi196.stdout:0/686: stat d5/fa 0 2024-03-17T23:58:28.071 INFO:tasks.workunit.client.0.smithi196.stdout:4/419: readlink d1/d11/l5b 0 2024-03-17T23:58:28.072 INFO:tasks.workunit.client.0.smithi196.stdout:1/417: dwrite d1/d13/f3b [0,4194304] 0 2024-03-17T23:58:28.074 INFO:tasks.workunit.client.0.smithi196.stdout:4/420: creat d1/d11/f95 x:0 0 0 2024-03-17T23:58:28.082 INFO:tasks.workunit.client.0.smithi196.stdout:4/421: dread d1/d68/f87 [0,4194304] 0 2024-03-17T23:58:28.086 INFO:tasks.workunit.client.0.smithi196.stdout:1/418: dread d1/f16 [0,4194304] 0 2024-03-17T23:58:28.087 INFO:tasks.workunit.client.0.smithi196.stdout:5/449: dwrite d6/d2d/f96 [0,4194304] 0 2024-03-17T23:58:28.088 INFO:tasks.workunit.client.0.smithi196.stdout:1/419: write d1/d13/d23/d47/f63 [700987,31851] 0 2024-03-17T23:58:28.088 INFO:tasks.workunit.client.0.smithi196.stdout:5/450: chown d6/d17/d3f 83800 1 2024-03-17T23:58:28.090 INFO:tasks.workunit.client.0.smithi196.stdout:1/420: write d1/db/dd/d34/f42 [588126,49334] 0 2024-03-17T23:58:28.091 INFO:tasks.workunit.client.0.smithi196.stdout:5/451: chown d6/d17/d23/l59 11520 1 2024-03-17T23:58:28.093 INFO:tasks.workunit.client.0.smithi196.stdout:1/421: unlink d1/d13/l59 0 2024-03-17T23:58:28.095 INFO:tasks.workunit.client.0.smithi196.stdout:1/422: chown d1/db/dd/f72 11464690 1 2024-03-17T23:58:28.095 INFO:tasks.workunit.client.0.smithi196.stdout:4/422: dread d1/d26/d33/d40/f5e [0,4194304] 0 2024-03-17T23:58:28.095 INFO:tasks.workunit.client.0.smithi196.stdout:5/452: creat d6/d17/f99 x:0 0 0 2024-03-17T23:58:28.096 INFO:tasks.workunit.client.0.smithi196.stdout:1/423: fsync d1/d13/d23/f49 0 2024-03-17T23:58:28.097 INFO:tasks.workunit.client.0.smithi196.stdout:5/453: chown d6/d2d/d33/l4b 1157 1 2024-03-17T23:58:28.100 INFO:tasks.workunit.client.0.smithi196.stdout:1/424: creat d1/db/dd/d34/f8a x:0 0 0 2024-03-17T23:58:28.100 INFO:tasks.workunit.client.0.smithi196.stdout:1/425: chown d1/db/dd/d34/l6e 955244648 1 2024-03-17T23:58:28.103 INFO:tasks.workunit.client.0.smithi196.stdout:1/426: getdents d1/db 0 2024-03-17T23:58:28.105 INFO:tasks.workunit.client.0.smithi196.stdout:1/427: dread - d1/db/dd/d34/f7a zero size 2024-03-17T23:58:28.106 INFO:tasks.workunit.client.0.smithi196.stdout:4/423: write d1/f1d [451829,41451] 0 2024-03-17T23:58:28.107 INFO:tasks.workunit.client.0.smithi196.stdout:5/454: dwrite d6/d17/d1f/d7d/d81/f8c [0,4194304] 0 2024-03-17T23:58:28.118 INFO:tasks.workunit.client.0.smithi196.stdout:1/428: dwrite d1/db/dd/f72 [0,4194304] 0 2024-03-17T23:58:28.120 INFO:tasks.workunit.client.0.smithi196.stdout:4/424: symlink d1/d26/d33/l96 0 2024-03-17T23:58:28.123 INFO:tasks.workunit.client.0.smithi196.stdout:4/425: mkdir d1/d26/d57/d8c/d97 0 2024-03-17T23:58:28.131 INFO:tasks.workunit.client.0.smithi196.stdout:5/455: dread f1 [0,4194304] 0 2024-03-17T23:58:28.134 INFO:tasks.workunit.client.0.smithi196.stdout:5/456: mknod d6/d17/d3f/d4e/d69/c9a 0 2024-03-17T23:58:28.136 INFO:tasks.workunit.client.0.smithi196.stdout:4/426: dwrite d1/d26/d33/d85/f92 [0,4194304] 0 2024-03-17T23:58:28.138 INFO:tasks.workunit.client.0.smithi196.stdout:5/457: creat d6/d2d/d33/f9b x:0 0 0 2024-03-17T23:58:28.139 INFO:tasks.workunit.client.0.smithi196.stdout:4/427: mknod d1/d11/c98 0 2024-03-17T23:58:28.142 INFO:tasks.workunit.client.0.smithi196.stdout:5/458: mkdir d6/d2d/d9c 0 2024-03-17T23:58:28.142 INFO:tasks.workunit.client.0.smithi196.stdout:5/459: chown d6/d2d/d33/c72 49716882 1 2024-03-17T23:58:28.147 INFO:tasks.workunit.client.0.smithi196.stdout:5/460: dread d6/fe [0,4194304] 0 2024-03-17T23:58:28.147 INFO:tasks.workunit.client.0.smithi196.stdout:4/428: link d1/d26/l29 d1/de/d50/l99 0 2024-03-17T23:58:28.150 INFO:tasks.workunit.client.0.smithi196.stdout:4/429: symlink d1/d26/d33/d85/l9a 0 2024-03-17T23:58:28.158 INFO:tasks.workunit.client.0.smithi196.stdout:5/461: dwrite d6/d17/f6c [0,4194304] 0 2024-03-17T23:58:28.160 INFO:tasks.workunit.client.0.smithi196.stdout:4/430: dwrite d1/d26/d33/d3f/f6e [0,4194304] 0 2024-03-17T23:58:28.165 INFO:tasks.workunit.client.0.smithi196.stdout:4/431: mknod d1/d1b/c9b 0 2024-03-17T23:58:28.171 INFO:tasks.workunit.client.0.smithi196.stdout:4/432: dread d1/d26/d33/d3f/f6e [0,4194304] 0 2024-03-17T23:58:28.171 INFO:tasks.workunit.client.0.smithi196.stdout:4/433: chown d1/f36 5124753 1 2024-03-17T23:58:28.172 INFO:tasks.workunit.client.0.smithi196.stdout:4/434: stat d1/de/f21 0 2024-03-17T23:58:28.173 INFO:tasks.workunit.client.0.smithi196.stdout:4/435: truncate d1/de/d50/d55/f6f 589434 0 2024-03-17T23:58:28.175 INFO:tasks.workunit.client.0.smithi196.stdout:5/462: write d6/fb [2439920,39020] 0 2024-03-17T23:58:28.177 INFO:tasks.workunit.client.0.smithi196.stdout:4/436: creat d1/d68/d74/f9c x:0 0 0 2024-03-17T23:58:28.177 INFO:tasks.workunit.client.0.smithi196.stdout:5/463: rmdir d6/d2d 39 2024-03-17T23:58:28.179 INFO:tasks.workunit.client.0.smithi196.stdout:5/464: creat d6/d17/d1f/d7d/d81/f9d x:0 0 0 2024-03-17T23:58:28.180 INFO:tasks.workunit.client.0.smithi196.stdout:5/465: fsync d6/d17/d23/d53/f54 0 2024-03-17T23:58:28.181 INFO:tasks.workunit.client.0.smithi196.stdout:4/437: link d1/d1b/c81 d1/de/d50/c9d 0 2024-03-17T23:58:28.181 INFO:tasks.workunit.client.0.smithi196.stdout:5/466: read - d6/d2a/f47 zero size 2024-03-17T23:58:28.181 INFO:tasks.workunit.client.0.smithi196.stdout:4/438: chown d1/d26/d33/d3f/f6e 60511 1 2024-03-17T23:58:28.182 INFO:tasks.workunit.client.0.smithi196.stdout:5/467: write d6/d17/d1f/d7d/d81/f8c [2865593,87702] 0 2024-03-17T23:58:28.203 INFO:tasks.workunit.client.0.smithi196.stdout:7/583: sync 2024-03-17T23:58:28.208 INFO:tasks.workunit.client.0.smithi196.stdout:7/584: rmdir da/d3e/d45/d4f/d75 39 2024-03-17T23:58:28.210 INFO:tasks.workunit.client.0.smithi196.stdout:4/439: creat d1/de/d50/f9e x:0 0 0 2024-03-17T23:58:28.211 INFO:tasks.workunit.client.0.smithi196.stdout:7/585: symlink da/d3e/d7f/lc7 0 2024-03-17T23:58:28.212 INFO:tasks.workunit.client.0.smithi196.stdout:5/468: mknod d6/d2d/c9e 0 2024-03-17T23:58:28.215 INFO:tasks.workunit.client.0.smithi196.stdout:5/469: creat d6/d17/d23/f9f x:0 0 0 2024-03-17T23:58:28.216 INFO:tasks.workunit.client.0.smithi196.stdout:5/470: stat d6/d17/d1f/d7d/d81/c5d 0 2024-03-17T23:58:28.216 INFO:tasks.workunit.client.0.smithi196.stdout:7/586: creat da/d15/d1a/d5e/da5/fc8 x:0 0 0 2024-03-17T23:58:28.220 INFO:tasks.workunit.client.0.smithi196.stdout:7/587: unlink da/d15/ca1 0 2024-03-17T23:58:28.223 INFO:tasks.workunit.client.0.smithi196.stdout:5/471: write d6/d17/d1f/f29 [83077,16888] 0 2024-03-17T23:58:28.224 INFO:tasks.workunit.client.0.smithi196.stdout:7/588: mknod da/d3e/d45/d4f/d85/cc9 0 2024-03-17T23:58:28.225 INFO:tasks.workunit.client.0.smithi196.stdout:4/440: dwrite d1/d26/d33/d40/f5e [0,4194304] 0 2024-03-17T23:58:28.228 INFO:tasks.workunit.client.0.smithi196.stdout:4/441: mknod d1/de/d50/d55/c9f 0 2024-03-17T23:58:28.230 INFO:tasks.workunit.client.0.smithi196.stdout:5/472: rename d6/d17/d3f/d4e/d70 to d6/d2d/d33/d3b/d80/da0 0 2024-03-17T23:58:28.231 INFO:tasks.workunit.client.0.smithi196.stdout:4/442: mknod d1/d26/d33/d40/ca0 0 2024-03-17T23:58:28.235 INFO:tasks.workunit.client.0.smithi196.stdout:4/443: mkdir d1/d26/d33/d40/da1 0 2024-03-17T23:58:28.236 INFO:tasks.workunit.client.0.smithi196.stdout:4/444: write d1/de/d50/f9e [827616,57552] 0 2024-03-17T23:58:28.241 INFO:tasks.workunit.client.0.smithi196.stdout:4/445: rename d1/l27 to d1/de/d50/la2 0 2024-03-17T23:58:28.243 INFO:tasks.workunit.client.0.smithi196.stdout:4/446: fdatasync d1/f2c 0 2024-03-17T23:58:28.244 INFO:tasks.workunit.client.0.smithi196.stdout:5/473: dread d6/d2d/f30 [0,4194304] 0 2024-03-17T23:58:28.244 INFO:tasks.workunit.client.0.smithi196.stdout:4/447: stat d1 0 2024-03-17T23:58:28.246 INFO:tasks.workunit.client.0.smithi196.stdout:7/589: dread da/f5c [0,4194304] 0 2024-03-17T23:58:28.247 INFO:tasks.workunit.client.0.smithi196.stdout:7/590: chown da/d15/d1a/f20 479 1 2024-03-17T23:58:28.248 INFO:tasks.workunit.client.0.smithi196.stdout:5/474: unlink d6/d17/d3f/d4e/d69/c5f 0 2024-03-17T23:58:28.252 INFO:tasks.workunit.client.0.smithi196.stdout:7/591: mknod da/d15/cca 0 2024-03-17T23:58:28.253 INFO:tasks.workunit.client.0.smithi196.stdout:7/592: chown l9 1 1 2024-03-17T23:58:28.254 INFO:tasks.workunit.client.0.smithi196.stdout:4/448: dwrite d1/d26/f7e [0,4194304] 0 2024-03-17T23:58:28.257 INFO:tasks.workunit.client.0.smithi196.stdout:4/449: creat d1/d68/d74/fa3 x:0 0 0 2024-03-17T23:58:28.262 INFO:tasks.workunit.client.0.smithi196.stdout:7/593: unlink da/d3e/d45/d4f/d43/d9e/fab 0 2024-03-17T23:58:28.263 INFO:tasks.workunit.client.0.smithi196.stdout:5/475: truncate d6/d17/f6c 2189896 0 2024-03-17T23:58:28.265 INFO:tasks.workunit.client.0.smithi196.stdout:5/476: creat d6/d17/d23/d53/fa1 x:0 0 0 2024-03-17T23:58:28.267 INFO:tasks.workunit.client.0.smithi196.stdout:5/477: chown d6/d17/f34 29377 1 2024-03-17T23:58:28.269 INFO:tasks.workunit.client.0.smithi196.stdout:4/450: dwrite d1/de/f56 [0,4194304] 0 2024-03-17T23:58:28.270 INFO:tasks.workunit.client.0.smithi196.stdout:7/594: rename da/d3e/d45/d4f/d75/da8/f77 to da/d15/d1a/d5e/d70/dc5/fcb 0 2024-03-17T23:58:28.271 INFO:tasks.workunit.client.0.smithi196.stdout:5/478: rmdir d6/d2d 39 2024-03-17T23:58:28.272 INFO:tasks.workunit.client.0.smithi196.stdout:4/451: readlink d1/de/l16 0 2024-03-17T23:58:28.273 INFO:tasks.workunit.client.0.smithi196.stdout:4/452: chown d1/d11/l5b 8221833 1 2024-03-17T23:58:28.273 INFO:tasks.workunit.client.0.smithi196.stdout:5/479: symlink d6/d17/d35/la2 0 2024-03-17T23:58:28.275 INFO:tasks.workunit.client.0.smithi196.stdout:7/595: creat da/d3e/d45/d4f/d75/da8/d78/fcc x:0 0 0 2024-03-17T23:58:28.277 INFO:tasks.workunit.client.0.smithi196.stdout:5/480: unlink d6/d17/d1f/f29 0 2024-03-17T23:58:28.281 INFO:tasks.workunit.client.0.smithi196.stdout:5/481: creat d6/d17/d1f/d5c/fa3 x:0 0 0 2024-03-17T23:58:28.285 INFO:tasks.workunit.client.0.smithi196.stdout:4/453: link d1/d1b/c81 d1/d26/d57/d8c/ca4 0 2024-03-17T23:58:28.285 INFO:tasks.workunit.client.0.smithi196.stdout:4/454: chown d1/d26/f8e 3 1 2024-03-17T23:58:28.288 INFO:tasks.workunit.client.0.smithi196.stdout:5/482: rename d6/d17/d1f/d7d/d81/f71 to d6/fa4 0 2024-03-17T23:58:28.290 INFO:tasks.workunit.client.0.smithi196.stdout:4/455: creat d1/d26/d33/d85/fa5 x:0 0 0 2024-03-17T23:58:28.292 INFO:tasks.workunit.client.0.smithi196.stdout:4/456: creat d1/d11/fa6 x:0 0 0 2024-03-17T23:58:28.294 INFO:tasks.workunit.client.0.smithi196.stdout:4/457: fsync d1/d26/d33/d40/f5e 0 2024-03-17T23:58:28.295 INFO:tasks.workunit.client.0.smithi196.stdout:4/458: chown d1/d26/d33/f5c 1 1 2024-03-17T23:58:28.297 INFO:tasks.workunit.client.0.smithi196.stdout:7/596: dread da/f1c [0,4194304] 0 2024-03-17T23:58:28.298 INFO:tasks.workunit.client.0.smithi196.stdout:4/459: creat d1/fa7 x:0 0 0 2024-03-17T23:58:28.299 INFO:tasks.workunit.client.0.smithi196.stdout:7/597: stat da/d3e/d45/d4f/d75/da8/d78/da4/d9b 0 2024-03-17T23:58:28.301 INFO:tasks.workunit.client.0.smithi196.stdout:4/460: creat d1/d26/d57/d8c/d97/fa8 x:0 0 0 2024-03-17T23:58:28.305 INFO:tasks.workunit.client.0.smithi196.stdout:7/598: creat da/d3e/d45/d4f/d75/da8/d78/d9f/fcd x:0 0 0 2024-03-17T23:58:28.308 INFO:tasks.workunit.client.0.smithi196.stdout:7/599: creat da/d15/d1d/d4c/fce x:0 0 0 2024-03-17T23:58:28.309 INFO:tasks.workunit.client.0.smithi196.stdout:4/461: getdents d1/d26/d33 0 2024-03-17T23:58:28.310 INFO:tasks.workunit.client.0.smithi196.stdout:7/600: unlink da/d15/d1a/l1e 0 2024-03-17T23:58:28.316 INFO:tasks.workunit.client.0.smithi196.stdout:4/462: dwrite d1/de/f4b [0,4194304] 0 2024-03-17T23:58:28.319 INFO:tasks.workunit.client.0.smithi196.stdout:4/463: symlink d1/d11/la9 0 2024-03-17T23:58:28.320 INFO:tasks.workunit.client.0.smithi196.stdout:4/464: write d1/de/f21 [876994,16016] 0 2024-03-17T23:58:28.323 INFO:tasks.workunit.client.0.smithi196.stdout:4/465: mknod d1/d26/d8b/caa 0 2024-03-17T23:58:28.327 INFO:tasks.workunit.client.0.smithi196.stdout:4/466: mknod d1/de/d50/cab 0 2024-03-17T23:58:28.329 INFO:tasks.workunit.client.0.smithi196.stdout:4/467: mkdir d1/d26/d57/dac 0 2024-03-17T23:58:28.332 INFO:tasks.workunit.client.0.smithi196.stdout:7/601: dwrite da/d3e/d7f/fb2 [0,4194304] 0 2024-03-17T23:58:28.338 INFO:tasks.workunit.client.0.smithi196.stdout:4/468: rename d1/f5a to d1/d26/d33/d40/fad 0 2024-03-17T23:58:28.338 INFO:tasks.workunit.client.0.smithi196.stdout:7/602: symlink da/d15/d1d/d2e/lcf 0 2024-03-17T23:58:28.342 INFO:tasks.workunit.client.0.smithi196.stdout:4/469: symlink d1/d26/d57/dac/lae 0 2024-03-17T23:58:28.343 INFO:tasks.workunit.client.0.smithi196.stdout:4/470: readlink d1/d1b/l6c 0 2024-03-17T23:58:28.343 INFO:tasks.workunit.client.0.smithi196.stdout:4/471: chown d1/d61/l7b 254478 1 2024-03-17T23:58:28.344 INFO:tasks.workunit.client.0.smithi196.stdout:7/603: mknod da/d3e/d45/d4f/d43/cd0 0 2024-03-17T23:58:28.349 INFO:tasks.workunit.client.0.smithi196.stdout:4/472: dread d1/d26/d33/d40/f5e [0,4194304] 0 2024-03-17T23:58:28.352 INFO:tasks.workunit.client.0.smithi196.stdout:7/604: dwrite da/d15/d1d/d2e/fb6 [0,4194304] 0 2024-03-17T23:58:28.354 INFO:tasks.workunit.client.0.smithi196.stdout:7/605: dread - da/d15/d1a/d5e/da5/fc8 zero size 2024-03-17T23:58:28.358 INFO:tasks.workunit.client.0.smithi196.stdout:7/606: creat da/d3e/d45/d4f/d75/fd1 x:0 0 0 2024-03-17T23:58:28.358 INFO:tasks.workunit.client.0.smithi196.stdout:4/473: dwrite d1/f58 [0,4194304] 0 2024-03-17T23:58:28.362 INFO:tasks.workunit.client.0.smithi196.stdout:7/607: symlink da/d3e/d45/d4f/d43/d9e/ld2 0 2024-03-17T23:58:28.362 INFO:tasks.workunit.client.0.smithi196.stdout:4/474: mknod d1/de/d50/d55/d4a/caf 0 2024-03-17T23:58:28.364 INFO:tasks.workunit.client.0.smithi196.stdout:4/475: symlink d1/de/lb0 0 2024-03-17T23:58:28.365 INFO:tasks.workunit.client.0.smithi196.stdout:7/608: mknod da/d3e/d45/d4f/d43/d9e/da2/cd3 0 2024-03-17T23:58:28.371 INFO:tasks.workunit.client.0.smithi196.stdout:4/476: dwrite d1/d26/f7e [0,4194304] 0 2024-03-17T23:58:28.378 INFO:tasks.workunit.client.0.smithi196.stdout:4/477: write d1/d68/f87 [632161,101319] 0 2024-03-17T23:58:28.381 INFO:tasks.workunit.client.0.smithi196.stdout:4/478: unlink d1/de/d50/f60 0 2024-03-17T23:58:28.384 INFO:tasks.workunit.client.0.smithi196.stdout:4/479: dread d1/de/d50/d55/d4a/f8d [0,4194304] 0 2024-03-17T23:58:28.385 INFO:tasks.workunit.client.0.smithi196.stdout:4/480: readlink d1/d26/d33/l96 0 2024-03-17T23:58:28.386 INFO:tasks.workunit.client.0.smithi196.stdout:4/481: chown d1/de/d50/l99 3036911 1 2024-03-17T23:58:28.395 INFO:tasks.workunit.client.0.smithi196.stdout:4/482: dwrite d1/d1b/d77/f83 [0,4194304] 0 2024-03-17T23:58:28.399 INFO:tasks.workunit.client.0.smithi196.stdout:4/483: unlink d1/l1f 0 2024-03-17T23:58:28.400 INFO:tasks.workunit.client.0.smithi196.stdout:4/484: dread - d1/d68/d74/f9c zero size 2024-03-17T23:58:28.414 INFO:tasks.workunit.client.0.smithi196.stdout:8/375: sync 2024-03-17T23:58:28.414 INFO:tasks.workunit.client.0.smithi196.stdout:2/547: sync 2024-03-17T23:58:28.414 INFO:tasks.workunit.client.0.smithi196.stdout:3/626: sync 2024-03-17T23:58:28.415 INFO:tasks.workunit.client.0.smithi196.stdout:4/485: mknod d1/d26/d57/cb1 0 2024-03-17T23:58:28.416 INFO:tasks.workunit.client.0.smithi196.stdout:2/548: creat d17/d19/d93/fd1 x:0 0 0 2024-03-17T23:58:28.418 INFO:tasks.workunit.client.0.smithi196.stdout:2/549: symlink d17/d28/dae/ld2 0 2024-03-17T23:58:28.420 INFO:tasks.workunit.client.0.smithi196.stdout:3/627: rename d7/d19/l1a to d7/d19/d26/d48/d4d/lcf 0 2024-03-17T23:58:28.423 INFO:tasks.workunit.client.0.smithi196.stdout:4/486: dwrite d1/de/f56 [0,4194304] 0 2024-03-17T23:58:28.424 INFO:tasks.workunit.client.0.smithi196.stdout:2/550: unlink d17/d22/c57 0 2024-03-17T23:58:28.429 INFO:tasks.workunit.client.0.smithi196.stdout:2/551: creat d17/d22/d59/fd3 x:0 0 0 2024-03-17T23:58:28.435 INFO:tasks.workunit.client.0.smithi196.stdout:2/552: getdents d17/d22 0 2024-03-17T23:58:28.436 INFO:tasks.workunit.client.0.smithi196.stdout:3/628: dread d7/d29/f94 [0,4194304] 0 2024-03-17T23:58:28.437 INFO:tasks.workunit.client.0.smithi196.stdout:4/487: dwrite d1/d26/d33/d3f/f6e [0,4194304] 0 2024-03-17T23:58:28.438 INFO:tasks.workunit.client.0.smithi196.stdout:2/553: chown d17/d19/c3e 97030756 1 2024-03-17T23:58:28.440 INFO:tasks.workunit.client.0.smithi196.stdout:4/488: mkdir d1/d26/d57/dac/db2 0 2024-03-17T23:58:28.442 INFO:tasks.workunit.client.0.smithi196.stdout:2/554: chown d17/d28/d30/l45 65475 1 2024-03-17T23:58:28.443 INFO:tasks.workunit.client.0.smithi196.stdout:4/489: creat d1/de/d50/d55/fb3 x:0 0 0 2024-03-17T23:58:28.446 INFO:tasks.workunit.client.0.smithi196.stdout:4/490: creat d1/d1b/d77/fb4 x:0 0 0 2024-03-17T23:58:28.447 INFO:tasks.workunit.client.0.smithi196.stdout:4/491: truncate d1/f8a 668174 0 2024-03-17T23:58:28.447 INFO:tasks.workunit.client.0.smithi196.stdout:2/555: mknod d17/d28/d30/cd4 0 2024-03-17T23:58:28.451 INFO:tasks.workunit.client.0.smithi196.stdout:3/629: dread d7/d19/f73 [0,4194304] 0 2024-03-17T23:58:28.453 INFO:tasks.workunit.client.0.smithi196.stdout:3/630: stat d7/d19/d26/d2b/dcd 0 2024-03-17T23:58:28.455 INFO:tasks.workunit.client.0.smithi196.stdout:2/556: rename d17/d28/d30/d3b/l49 to d17/d19/d44/d52/ld5 0 2024-03-17T23:58:28.456 INFO:tasks.workunit.client.0.smithi196.stdout:3/631: unlink d7/d19/d26/fbe 0 2024-03-17T23:58:28.458 INFO:tasks.workunit.client.0.smithi196.stdout:3/632: truncate d7/d33/f90 826608 0 2024-03-17T23:58:28.458 INFO:tasks.workunit.client.0.smithi196.stdout:4/492: rename d1/de/d50/d55/f76 to d1/d26/d57/dac/fb5 0 2024-03-17T23:58:28.462 INFO:tasks.workunit.client.0.smithi196.stdout:3/633: getdents d7/d19/d78/dca 0 2024-03-17T23:58:28.467 INFO:tasks.workunit.client.0.smithi196.stdout:3/634: unlink d7/d19/d26/d48/d4d/lcf 0 2024-03-17T23:58:28.467 INFO:tasks.workunit.client.0.smithi196.stdout:4/493: dread d1/de/f2d [0,4194304] 0 2024-03-17T23:58:28.469 INFO:tasks.workunit.client.0.smithi196.stdout:3/635: mknod d7/d19/d78/d8b/cd0 0 2024-03-17T23:58:28.472 INFO:tasks.workunit.client.0.smithi196.stdout:3/636: creat d7/d19/d78/da9/fd1 x:0 0 0 2024-03-17T23:58:28.473 INFO:tasks.workunit.client.0.smithi196.stdout:4/494: getdents d1/d68 0 2024-03-17T23:58:28.475 INFO:tasks.workunit.client.0.smithi196.stdout:3/637: unlink d7/f1f 0 2024-03-17T23:58:28.476 INFO:tasks.workunit.client.0.smithi196.stdout:2/557: dread d17/d19/f4e [0,4194304] 0 2024-03-17T23:58:28.476 INFO:tasks.workunit.client.0.smithi196.stdout:3/638: rmdir d7 39 2024-03-17T23:58:28.477 INFO:tasks.workunit.client.0.smithi196.stdout:4/495: mknod d1/d26/d57/dac/db2/cb6 0 2024-03-17T23:58:28.479 INFO:tasks.workunit.client.0.smithi196.stdout:2/558: unlink d17/d22/d59/f78 0 2024-03-17T23:58:28.483 INFO:tasks.workunit.client.0.smithi196.stdout:4/496: dread d1/d26/d57/dac/fb5 [0,4194304] 0 2024-03-17T23:58:28.484 INFO:tasks.workunit.client.0.smithi196.stdout:2/559: rename d17/d22/l2f to d17/d1f/ld6 0 2024-03-17T23:58:28.485 INFO:tasks.workunit.client.0.smithi196.stdout:3/639: mknod d7/d19/d78/da9/cd2 0 2024-03-17T23:58:28.487 INFO:tasks.workunit.client.0.smithi196.stdout:4/497: creat d1/de/d50/d55/fb7 x:0 0 0 2024-03-17T23:58:28.488 INFO:tasks.workunit.client.0.smithi196.stdout:3/640: truncate d7/d19/d78/d93/fbc 176678 0 2024-03-17T23:58:28.495 INFO:tasks.workunit.client.0.smithi196.stdout:3/641: dwrite d7/d33/d81/f8d [0,4194304] 0 2024-03-17T23:58:28.500 INFO:tasks.workunit.client.0.smithi196.stdout:2/560: dread - d17/d22/fbb zero size 2024-03-17T23:58:28.506 INFO:tasks.workunit.client.0.smithi196.stdout:3/642: truncate d7/d19/d78/d93/fa0 427474 0 2024-03-17T23:58:28.508 INFO:tasks.workunit.client.0.smithi196.stdout:2/561: dread f13 [0,4194304] 0 2024-03-17T23:58:28.508 INFO:tasks.workunit.client.0.smithi196.stdout:3/643: chown d7/d19/f32 14510 1 2024-03-17T23:58:28.512 INFO:tasks.workunit.client.0.smithi196.stdout:3/644: chown d7/d19/d26/c59 125066127 1 2024-03-17T23:58:28.515 INFO:tasks.workunit.client.0.smithi196.stdout:3/645: creat d7/d33/d81/dc8/fd3 x:0 0 0 2024-03-17T23:58:28.516 INFO:tasks.workunit.client.0.smithi196.stdout:2/562: link d17/d19/d44/d52/ld5 d17/d22/d3d/d8f/ld7 0 2024-03-17T23:58:28.520 INFO:tasks.workunit.client.0.smithi196.stdout:2/563: mknod d17/cd8 0 2024-03-17T23:58:28.520 INFO:tasks.workunit.client.0.smithi196.stdout:3/646: link d7/d19/d26/f2f d7/d19/d78/dca/fd4 0 2024-03-17T23:58:28.522 INFO:tasks.workunit.client.0.smithi196.stdout:3/647: dread d7/d19/d78/d93/fbc [0,4194304] 0 2024-03-17T23:58:28.523 INFO:tasks.workunit.client.0.smithi196.stdout:3/648: chown d7/d19/d26/d48/d4d/l70 669365542 1 2024-03-17T23:58:28.524 INFO:tasks.workunit.client.0.smithi196.stdout:2/564: rename d17/d1f/l34 to d17/d28/d30/d71/ld9 0 2024-03-17T23:58:28.524 INFO:tasks.workunit.client.0.smithi196.stdout:2/565: dread - d17/d19/d44/fcb zero size 2024-03-17T23:58:28.525 INFO:tasks.workunit.client.0.smithi196.stdout:2/566: stat d17/d19/d44/fb1 0 2024-03-17T23:58:28.525 INFO:tasks.workunit.client.0.smithi196.stdout:3/649: readlink d7/d19/d78/l84 0 2024-03-17T23:58:28.526 INFO:tasks.workunit.client.0.smithi196.stdout:2/567: chown d17/d28/d30/lc1 3 1 2024-03-17T23:58:28.535 INFO:tasks.workunit.client.0.smithi196.stdout:2/568: dwrite d17/d22/fa6 [0,4194304] 0 2024-03-17T23:58:28.537 INFO:tasks.workunit.client.0.smithi196.stdout:3/650: write d7/d19/d78/f8e [317151,95161] 0 2024-03-17T23:58:28.537 INFO:tasks.workunit.client.0.smithi196.stdout:2/569: rmdir d17/d19/d93 39 2024-03-17T23:58:28.545 INFO:tasks.workunit.client.0.smithi196.stdout:3/651: link d7/d19/d26/c36 d7/d19/d26/d2b/d3c/cd5 0 2024-03-17T23:58:28.546 INFO:tasks.workunit.client.0.smithi196.stdout:2/570: dwrite d17/f18 [0,4194304] 0 2024-03-17T23:58:28.560 INFO:tasks.workunit.client.0.smithi196.stdout:3/652: dwrite d7/d19/d26/f47 [0,4194304] 0 2024-03-17T23:58:28.561 INFO:tasks.workunit.client.0.smithi196.stdout:3/653: write d7/d19/d78/f95 [764673,2951] 0 2024-03-17T23:58:28.564 INFO:tasks.workunit.client.0.smithi196.stdout:3/654: creat d7/d19/d26/d2b/d3c/d3d/fd6 x:0 0 0 2024-03-17T23:58:28.565 INFO:tasks.workunit.client.0.smithi196.stdout:3/655: write d7/f21 [2433146,96820] 0 2024-03-17T23:58:28.565 INFO:tasks.workunit.client.0.smithi196.stdout:6/408: sync 2024-03-17T23:58:28.569 INFO:tasks.workunit.client.0.smithi196.stdout:3/656: rename d7/d19/f32 to d7/d19/d26/d2b/d3c/d3d/d99/fd7 0 2024-03-17T23:58:28.571 INFO:tasks.workunit.client.0.smithi196.stdout:6/409: link d2/f3e d2/d40/f8b 0 2024-03-17T23:58:28.573 INFO:tasks.workunit.client.0.smithi196.stdout:6/410: write d2/d14/d35/d63/f3a [153521,92298] 0 2024-03-17T23:58:28.573 INFO:tasks.workunit.client.0.smithi196.stdout:2/571: dread d17/d28/d30/d3b/f4a [0,4194304] 0 2024-03-17T23:58:28.574 INFO:tasks.workunit.client.0.smithi196.stdout:6/411: chown d2/d14/d35/d63/f6c 183 1 2024-03-17T23:58:28.575 INFO:tasks.workunit.client.0.smithi196.stdout:6/412: read - d2/d14/d35/f81 zero size 2024-03-17T23:58:28.606 INFO:tasks.workunit.client.0.smithi196.stdout:6/413: mkdir d2/d14/d8c 0 2024-03-17T23:58:28.610 INFO:tasks.workunit.client.0.smithi196.stdout:2/572: dwrite d17/d28/fc6 [0,4194304] 0 2024-03-17T23:58:28.614 INFO:tasks.workunit.client.0.smithi196.stdout:3/657: write d7/d19/d78/d93/fbc [975447,52635] 0 2024-03-17T23:58:28.615 INFO:tasks.workunit.client.0.smithi196.stdout:3/658: chown d7/d19/d78/da9/cd2 1720659 1 2024-03-17T23:58:28.624 INFO:tasks.workunit.client.0.smithi196.stdout:2/573: dread d17/d22/f9c [0,4194304] 0 2024-03-17T23:58:28.625 INFO:tasks.workunit.client.0.smithi196.stdout:6/414: dread d2/d14/f1d [0,4194304] 0 2024-03-17T23:58:28.626 INFO:tasks.workunit.client.0.smithi196.stdout:6/415: chown d2/d14/d75/d7b/d49/f7f 115860 1 2024-03-17T23:58:28.629 INFO:tasks.workunit.client.0.smithi196.stdout:6/416: creat d2/d14/d42/d57/d5f/f8d x:0 0 0 2024-03-17T23:58:28.632 INFO:tasks.workunit.client.0.smithi196.stdout:6/417: truncate d2/d14/d75/d7b/f6f 4967215 0 2024-03-17T23:58:28.634 INFO:tasks.workunit.client.0.smithi196.stdout:2/574: dwrite d17/d19/d93/fc8 [0,4194304] 0 2024-03-17T23:58:28.636 INFO:tasks.workunit.client.0.smithi196.stdout:6/418: unlink d2/ff 0 2024-03-17T23:58:28.638 INFO:tasks.workunit.client.0.smithi196.stdout:2/575: rmdir d17/d28/d30/d71 39 2024-03-17T23:58:28.642 INFO:tasks.workunit.client.0.smithi196.stdout:6/419: mknod d2/d14/d75/d7b/d49/c8e 0 2024-03-17T23:58:28.643 INFO:tasks.workunit.client.0.smithi196.stdout:2/576: dread d17/f2a [0,4194304] 0 2024-03-17T23:58:28.643 INFO:tasks.workunit.client.0.smithi196.stdout:6/420: readlink d2/d14/d42/l7e 0 2024-03-17T23:58:28.647 INFO:tasks.workunit.client.0.smithi196.stdout:2/577: creat d17/fda x:0 0 0 2024-03-17T23:58:28.649 INFO:tasks.workunit.client.0.smithi196.stdout:6/421: dread d2/d14/d42/d57/f82 [0,4194304] 0 2024-03-17T23:58:28.650 INFO:tasks.workunit.client.0.smithi196.stdout:6/422: fdatasync d2/d14/d42/d57/d5f/f8d 0 2024-03-17T23:58:28.653 INFO:tasks.workunit.client.0.smithi196.stdout:6/423: truncate d2/d40/f5a 4819793 0 2024-03-17T23:58:28.655 INFO:tasks.workunit.client.0.smithi196.stdout:6/424: creat d2/d14/d42/f8f x:0 0 0 2024-03-17T23:58:28.657 INFO:tasks.workunit.client.0.smithi196.stdout:6/425: mkdir d2/d66/d90 0 2024-03-17T23:58:28.658 INFO:tasks.workunit.client.0.smithi196.stdout:2/578: dwrite d17/d22/da0/f7b [0,4194304] 0 2024-03-17T23:58:28.662 INFO:tasks.workunit.client.0.smithi196.stdout:6/426: unlink d2/d14/d35/d63/f6b 0 2024-03-17T23:58:28.666 INFO:tasks.workunit.client.0.smithi196.stdout:6/427: read d2/d14/d75/d7b/f3f [3356743,129892] 0 2024-03-17T23:58:28.667 INFO:tasks.workunit.client.0.smithi196.stdout:6/428: dread - d2/d14/d50/f80 zero size 2024-03-17T23:58:28.670 INFO:tasks.workunit.client.0.smithi196.stdout:6/429: chown d2/d40/l7a 118281 1 2024-03-17T23:58:28.671 INFO:tasks.workunit.client.0.smithi196.stdout:2/579: write d17/d1f/fa9 [8313646,125064] 0 2024-03-17T23:58:28.674 INFO:tasks.workunit.client.0.smithi196.stdout:2/580: creat d17/fdb x:0 0 0 2024-03-17T23:58:28.678 INFO:tasks.workunit.client.0.smithi196.stdout:6/430: dwrite d2/d14/d42/f4b [0,4194304] 0 2024-03-17T23:58:28.682 INFO:tasks.workunit.client.0.smithi196.stdout:6/431: creat d2/d14/d8c/f91 x:0 0 0 2024-03-17T23:58:28.683 INFO:tasks.workunit.client.0.smithi196.stdout:2/581: dwrite d17/d19/d93/fc0 [0,4194304] 0 2024-03-17T23:58:28.686 INFO:tasks.workunit.client.0.smithi196.stdout:2/582: fdatasync d17/d22/d3d/f53 0 2024-03-17T23:58:28.686 INFO:tasks.workunit.client.0.smithi196.stdout:6/432: mkdir d2/d14/d75/d92 0 2024-03-17T23:58:28.688 INFO:tasks.workunit.client.0.smithi196.stdout:2/583: chown d17/d68/la3 152 1 2024-03-17T23:58:28.689 INFO:tasks.workunit.client.0.smithi196.stdout:6/433: symlink d2/d14/d75/d92/l93 0 2024-03-17T23:58:28.690 INFO:tasks.workunit.client.0.smithi196.stdout:2/584: chown d17/d22/lb0 345 1 2024-03-17T23:58:28.691 INFO:tasks.workunit.client.0.smithi196.stdout:6/434: write d2/d14/d42/d57/d5f/f8d [635614,93159] 0 2024-03-17T23:58:28.692 INFO:tasks.workunit.client.0.smithi196.stdout:2/585: creat d17/d22/d3d/d8f/fdc x:0 0 0 2024-03-17T23:58:28.694 INFO:tasks.workunit.client.0.smithi196.stdout:6/435: rename d2/c6 to d2/d14/d50/c94 0 2024-03-17T23:58:28.695 INFO:tasks.workunit.client.0.smithi196.stdout:6/436: dread - d2/d14/f47 zero size 2024-03-17T23:58:28.698 INFO:tasks.workunit.client.0.smithi196.stdout:6/437: dread d2/d14/d35/f6d [0,4194304] 0 2024-03-17T23:58:28.701 INFO:tasks.workunit.client.0.smithi196.stdout:6/438: symlink d2/d14/d42/l95 0 2024-03-17T23:58:28.703 INFO:tasks.workunit.client.0.smithi196.stdout:6/439: symlink d2/d14/d42/d57/d5f/l96 0 2024-03-17T23:58:28.705 INFO:tasks.workunit.client.0.smithi196.stdout:6/440: read d2/d40/f5a [2973066,79239] 0 2024-03-17T23:58:28.707 INFO:tasks.workunit.client.0.smithi196.stdout:2/586: dwrite f2 [0,4194304] 0 2024-03-17T23:58:28.708 INFO:tasks.workunit.client.0.smithi196.stdout:6/441: creat d2/d66/d90/f97 x:0 0 0 2024-03-17T23:58:28.711 INFO:tasks.workunit.client.0.smithi196.stdout:2/587: chown f16 469654920 1 2024-03-17T23:58:28.712 INFO:tasks.workunit.client.0.smithi196.stdout:6/442: creat d2/d14/d8c/f98 x:0 0 0 2024-03-17T23:58:28.713 INFO:tasks.workunit.client.0.smithi196.stdout:2/588: creat d17/d28/d96/fdd x:0 0 0 2024-03-17T23:58:28.715 INFO:tasks.workunit.client.0.smithi196.stdout:2/589: write d17/d28/f29 [3373235,129068] 0 2024-03-17T23:58:28.715 INFO:tasks.workunit.client.0.smithi196.stdout:6/443: symlink d2/d14/d50/l99 0 2024-03-17T23:58:28.721 INFO:tasks.workunit.client.0.smithi196.stdout:2/590: fsync d17/d28/d30/d72/fb3 0 2024-03-17T23:58:28.722 INFO:tasks.workunit.client.0.smithi196.stdout:2/591: chown d17/d28/d30/d72/fb2 11 1 2024-03-17T23:58:28.724 INFO:tasks.workunit.client.0.smithi196.stdout:2/592: rmdir d17/d22 39 2024-03-17T23:58:28.725 INFO:tasks.workunit.client.0.smithi196.stdout:6/444: dwrite d2/d14/d42/d57/d5f/f8d [0,4194304] 0 2024-03-17T23:58:28.727 INFO:tasks.workunit.client.0.smithi196.stdout:6/445: fdatasync d2/fd 0 2024-03-17T23:58:28.731 INFO:tasks.workunit.client.0.smithi196.stdout:6/446: mkdir d2/d7/d2b/d9a 0 2024-03-17T23:58:28.731 INFO:tasks.workunit.client.0.smithi196.stdout:2/593: link l12 d17/d22/d3d/lde 0 2024-03-17T23:58:28.738 INFO:tasks.workunit.client.0.smithi196.stdout:6/447: dwrite d2/d14/d35/d63/f38 [0,4194304] 0 2024-03-17T23:58:28.745 INFO:tasks.workunit.client.0.smithi196.stdout:6/448: getdents d2/d7/d2b 0 2024-03-17T23:58:28.748 INFO:tasks.workunit.client.0.smithi196.stdout:6/449: symlink d2/d14/d42/l9b 0 2024-03-17T23:58:28.761 INFO:tasks.workunit.client.0.smithi196.stdout:9/550: sync 2024-03-17T23:58:28.762 INFO:tasks.workunit.client.0.smithi196.stdout:6/450: chown d2/d14/d42/l95 98729063 1 2024-03-17T23:58:28.762 INFO:tasks.workunit.client.0.smithi196.stdout:2/594: dwrite d17/f2a [0,4194304] 0 2024-03-17T23:58:28.765 INFO:tasks.workunit.client.0.smithi196.stdout:6/451: dread - d2/d14/d50/d68/f70 zero size 2024-03-17T23:58:28.768 INFO:tasks.workunit.client.0.smithi196.stdout:9/551: creat d9/df/d14/d27/fa6 x:0 0 0 2024-03-17T23:58:28.769 INFO:tasks.workunit.client.0.smithi196.stdout:6/452: creat d2/d14/d50/d68/f9c x:0 0 0 2024-03-17T23:58:28.772 INFO:tasks.workunit.client.0.smithi196.stdout:2/595: write d17/d22/f64 [993029,74376] 0 2024-03-17T23:58:28.773 INFO:tasks.workunit.client.0.smithi196.stdout:9/552: creat d9/df/d4a/d5b/d6d/fa7 x:0 0 0 2024-03-17T23:58:28.775 INFO:tasks.workunit.client.0.smithi196.stdout:6/453: truncate d2/d14/d75/d7b/f19 964531 0 2024-03-17T23:58:28.776 INFO:tasks.workunit.client.0.smithi196.stdout:2/596: fdatasync d17/d28/d30/f6b 0 2024-03-17T23:58:28.776 INFO:tasks.workunit.client.0.smithi196.stdout:6/454: write f1 [725060,76386] 0 2024-03-17T23:58:28.777 INFO:tasks.workunit.client.0.smithi196.stdout:9/553: mkdir d9/df/d4a/d5b/d6d/da8 0 2024-03-17T23:58:28.780 INFO:tasks.workunit.client.0.smithi196.stdout:6/455: rename d2/d40 to d2/d7/d9d 0 2024-03-17T23:58:28.780 INFO:tasks.workunit.client.0.smithi196.stdout:2/597: mknod d17/d1f/cdf 0 2024-03-17T23:58:28.781 INFO:tasks.workunit.client.0.smithi196.stdout:9/554: unlink d9/d38/d60/f26 0 2024-03-17T23:58:28.782 INFO:tasks.workunit.client.0.smithi196.stdout:6/456: write d2/d14/f1d [4836572,123535] 0 2024-03-17T23:58:28.784 INFO:tasks.workunit.client.0.smithi196.stdout:9/555: symlink d9/d33/la9 0 2024-03-17T23:58:28.786 INFO:tasks.workunit.client.0.smithi196.stdout:9/556: fsync d9/d33/f42 0 2024-03-17T23:58:28.787 INFO:tasks.workunit.client.0.smithi196.stdout:2/598: mkdir d17/d28/d30/d71/de0 0 2024-03-17T23:58:28.788 INFO:tasks.workunit.client.0.smithi196.stdout:6/457: mkdir d2/d14/d75/d7b/d9e 0 2024-03-17T23:58:28.789 INFO:tasks.workunit.client.0.smithi196.stdout:2/599: fdatasync d17/d19/f31 0 2024-03-17T23:58:28.792 INFO:tasks.workunit.client.0.smithi196.stdout:2/600: truncate d17/d22/d59/fd3 934943 0 2024-03-17T23:58:28.794 INFO:tasks.workunit.client.0.smithi196.stdout:2/601: fsync d17/d22/da0/f7b 0 2024-03-17T23:58:28.795 INFO:tasks.workunit.client.0.smithi196.stdout:9/557: fsync d9/df/d4a/d5b/d6d/fa7 0 2024-03-17T23:58:28.797 INFO:tasks.workunit.client.0.smithi196.stdout:2/602: truncate d17/d28/dae/fca 309807 0 2024-03-17T23:58:28.798 INFO:tasks.workunit.client.0.smithi196.stdout:6/458: dwrite d2/d7/d2b/f84 [0,4194304] 0 2024-03-17T23:58:28.798 INFO:tasks.workunit.client.0.smithi196.stdout:2/603: fdatasync d17/d28/fc6 0 2024-03-17T23:58:28.807 INFO:tasks.workunit.client.0.smithi196.stdout:9/558: fsync d9/df/d14/f5c 0 2024-03-17T23:58:28.809 INFO:tasks.workunit.client.0.smithi196.stdout:9/559: symlink d9/d38/laa 0 2024-03-17T23:58:28.816 INFO:tasks.workunit.client.0.smithi196.stdout:9/560: dread d9/df/f34 [0,4194304] 0 2024-03-17T23:58:28.817 INFO:tasks.workunit.client.0.smithi196.stdout:6/459: dwrite d2/d66/d90/f97 [0,4194304] 0 2024-03-17T23:58:28.818 INFO:tasks.workunit.client.0.smithi196.stdout:6/460: chown d2/d14/d75/d7b 1 1 2024-03-17T23:58:28.819 INFO:tasks.workunit.client.0.smithi196.stdout:9/561: symlink d9/d12/d59/lab 0 2024-03-17T23:58:28.821 INFO:tasks.workunit.client.0.smithi196.stdout:2/604: dread d17/d19/d44/d52/f84 [0,4194304] 0 2024-03-17T23:58:28.822 INFO:tasks.workunit.client.0.smithi196.stdout:9/562: symlink d9/d38/d60/lac 0 2024-03-17T23:58:28.823 INFO:tasks.workunit.client.0.smithi196.stdout:9/563: readlink d9/df/l18 0 2024-03-17T23:58:28.824 INFO:tasks.workunit.client.0.smithi196.stdout:9/564: write d9/d12/d59/f65 [1253165,110473] 0 2024-03-17T23:58:28.829 INFO:tasks.workunit.client.0.smithi196.stdout:9/565: rename d9/df/f36 to d9/df/d4a/d5b/da5/fad 0 2024-03-17T23:58:28.829 INFO:tasks.workunit.client.0.smithi196.stdout:2/605: dwrite d17/fdb [0,4194304] 0 2024-03-17T23:58:28.836 INFO:tasks.workunit.client.0.smithi196.stdout:2/606: truncate d17/d28/d30/fcd 56493 0 2024-03-17T23:58:28.838 INFO:tasks.workunit.client.0.smithi196.stdout:9/566: dwrite d9/df/f34 [0,4194304] 0 2024-03-17T23:58:28.839 INFO:tasks.workunit.client.0.smithi196.stdout:2/607: dread d17/d28/d30/d71/f88 [0,4194304] 0 2024-03-17T23:58:28.840 INFO:tasks.workunit.client.0.smithi196.stdout:2/608: truncate d17/f38 4614265 0 2024-03-17T23:58:28.842 INFO:tasks.workunit.client.0.smithi196.stdout:2/609: creat d17/d1f/fe1 x:0 0 0 2024-03-17T23:58:28.843 INFO:tasks.workunit.client.0.smithi196.stdout:2/610: write d17/d22/d3d/d8f/fa5 [1707081,39907] 0 2024-03-17T23:58:28.845 INFO:tasks.workunit.client.0.smithi196.stdout:9/567: link d9/df/d14/d27/l71 d9/df/d14/d27/d9e/lae 0 2024-03-17T23:58:28.847 INFO:tasks.workunit.client.0.smithi196.stdout:2/611: creat d17/d19/d44/fe2 x:0 0 0 2024-03-17T23:58:28.851 INFO:tasks.workunit.client.0.smithi196.stdout:2/612: creat d17/d28/d30/d71/de0/fe3 x:0 0 0 2024-03-17T23:58:28.852 INFO:tasks.workunit.client.0.smithi196.stdout:9/568: dread d9/f44 [0,4194304] 0 2024-03-17T23:58:28.870 INFO:tasks.workunit.client.0.smithi196.stdout:2/613: dread d17/d19/f41 [4194304,4194304] 0 2024-03-17T23:58:28.871 INFO:tasks.workunit.client.0.smithi196.stdout:2/614: write d17/d22/da0/f5a [1448391,11729] 0 2024-03-17T23:58:28.874 INFO:tasks.workunit.client.0.smithi196.stdout:2/615: creat d17/d28/d30/d71/de0/fe4 x:0 0 0 2024-03-17T23:58:28.875 INFO:tasks.workunit.client.0.smithi196.stdout:2/616: rmdir d17/d28 39 2024-03-17T23:58:28.892 INFO:tasks.workunit.client.0.smithi196.stdout:2/617: dread d17/d28/d30/d72/d81/fa1 [0,4194304] 0 2024-03-17T23:58:28.893 INFO:tasks.workunit.client.0.smithi196.stdout:2/618: write d17/d22/d3d/d8f/fa5 [1689954,14081] 0 2024-03-17T23:58:28.896 INFO:tasks.workunit.client.0.smithi196.stdout:2/619: dread d17/d28/d30/fb4 [0,4194304] 0 2024-03-17T23:58:28.899 INFO:tasks.workunit.client.0.smithi196.stdout:2/620: read d17/d28/d30/f47 [190075,51072] 0 2024-03-17T23:58:28.900 INFO:tasks.workunit.client.0.smithi196.stdout:2/621: rmdir d17/d28 39 2024-03-17T23:58:28.901 INFO:tasks.workunit.client.0.smithi196.stdout:2/622: truncate d17/d22/d59/f80 616917 0 2024-03-17T23:58:28.902 INFO:tasks.workunit.client.0.smithi196.stdout:2/623: rmdir d17/d22 39 2024-03-17T23:58:28.906 INFO:tasks.workunit.client.0.smithi196.stdout:2/624: creat d17/d28/d30/d3b/fe5 x:0 0 0 2024-03-17T23:58:28.917 INFO:tasks.workunit.client.0.smithi196.stdout:2/625: dread f4 [0,4194304] 0 2024-03-17T23:58:28.918 INFO:tasks.workunit.client.0.smithi196.stdout:2/626: readlink d17/d22/da0/lb6 0 2024-03-17T23:58:28.920 INFO:tasks.workunit.client.0.smithi196.stdout:2/627: symlink d17/d28/d30/le6 0 2024-03-17T23:58:28.947 INFO:tasks.workunit.client.0.smithi196.stdout:0/687: sync 2024-03-17T23:58:28.948 INFO:tasks.workunit.client.0.smithi196.stdout:0/688: chown d5/d23/d24/d28/d47/d52/d61/lc3 16132615 1 2024-03-17T23:58:28.949 INFO:tasks.workunit.client.0.smithi196.stdout:0/689: fdatasync d5/d23/d24/d28/d47/d52/d61/d6c/fb4 0 2024-03-17T23:58:28.950 INFO:tasks.workunit.client.0.smithi196.stdout:0/690: fsync d5/d23/d24/d28/f41 0 2024-03-17T23:58:28.952 INFO:tasks.workunit.client.0.smithi196.stdout:0/691: mknod d5/d23/d24/d9f/cd2 0 2024-03-17T23:58:29.097 INFO:tasks.workunit.client.0.smithi196.stdout:1/429: sync 2024-03-17T23:58:29.107 INFO:tasks.workunit.client.0.smithi196.stdout:1/430: dread d1/f4d [0,4194304] 0 2024-03-17T23:58:29.109 INFO:tasks.workunit.client.0.smithi196.stdout:1/431: dread - d1/db/dd/d34/f8a zero size 2024-03-17T23:58:29.110 INFO:tasks.workunit.client.0.smithi196.stdout:1/432: chown d1/db/dd/d34/l6e 7 1 2024-03-17T23:58:29.111 INFO:tasks.workunit.client.0.smithi196.stdout:1/433: readlink d1/db/l20 0 2024-03-17T23:58:29.123 INFO:tasks.workunit.client.0.smithi196.stdout:1/434: dwrite d1/db/dd/f12 [0,4194304] 0 2024-03-17T23:58:29.123 INFO:tasks.workunit.client.0.smithi196.stdout:1/435: stat d1/db/dd/c2c 0 2024-03-17T23:58:29.127 INFO:tasks.workunit.client.0.smithi196.stdout:7/609: sync 2024-03-17T23:58:29.127 INFO:tasks.workunit.client.0.smithi196.stdout:5/483: sync 2024-03-17T23:58:29.127 INFO:tasks.workunit.client.0.smithi196.stdout:0/692: sync 2024-03-17T23:58:29.127 INFO:tasks.workunit.client.0.smithi196.stdout:1/436: creat d1/db/dd/d34/d6a/d75/f8b x:0 0 0 2024-03-17T23:58:29.128 INFO:tasks.workunit.client.0.smithi196.stdout:3/659: sync 2024-03-17T23:58:29.128 INFO:tasks.workunit.client.0.smithi196.stdout:9/569: sync 2024-03-17T23:58:29.128 INFO:tasks.workunit.client.0.smithi196.stdout:4/498: sync 2024-03-17T23:58:29.128 INFO:tasks.workunit.client.0.smithi196.stdout:8/376: sync 2024-03-17T23:58:29.128 INFO:tasks.workunit.client.0.smithi196.stdout:6/461: sync 2024-03-17T23:58:29.128 INFO:tasks.workunit.client.0.smithi196.stdout:2/628: sync 2024-03-17T23:58:29.129 INFO:tasks.workunit.client.0.smithi196.stdout:1/437: fdatasync d1/db/fe 0 2024-03-17T23:58:29.134 INFO:tasks.workunit.client.0.smithi196.stdout:0/693: mknod d5/d23/d24/d59/d94/db5/cd3 0 2024-03-17T23:58:29.134 INFO:tasks.workunit.client.0.smithi196.stdout:4/499: truncate d1/fa7 33571 0 2024-03-17T23:58:29.137 INFO:tasks.workunit.client.0.smithi196.stdout:2/629: write d17/d28/d30/fcf [823177,78383] 0 2024-03-17T23:58:29.137 INFO:tasks.workunit.client.0.smithi196.stdout:7/610: mkdir da/d15/d1d/d29/dc4/dd4 0 2024-03-17T23:58:29.138 INFO:tasks.workunit.client.0.smithi196.stdout:1/438: dread d1/d13/f41 [0,4194304] 0 2024-03-17T23:58:29.139 INFO:tasks.workunit.client.0.smithi196.stdout:9/570: symlink d9/d38/d60/d85/d8e/d99/laf 0 2024-03-17T23:58:29.139 INFO:tasks.workunit.client.0.smithi196.stdout:3/660: read - d7/d19/d26/d2b/d3c/d3d/d99/fb6 zero size 2024-03-17T23:58:29.140 INFO:tasks.workunit.client.0.smithi196.stdout:4/500: write d1/f58 [3839049,7206] 0 2024-03-17T23:58:29.149 INFO:tasks.workunit.client.0.smithi196.stdout:5/484: write d6/d17/d1f/f50 [61756,101487] 0 2024-03-17T23:58:29.150 INFO:tasks.workunit.client.0.smithi196.stdout:6/462: dread d2/d7/d2b/f84 [0,4194304] 0 2024-03-17T23:58:29.154 INFO:tasks.workunit.client.0.smithi196.stdout:8/377: dwrite f6 [4194304,4194304] 0 2024-03-17T23:58:29.159 INFO:tasks.workunit.client.0.smithi196.stdout:9/571: dread d9/f25 [0,4194304] 0 2024-03-17T23:58:29.160 INFO:tasks.workunit.client.0.smithi196.stdout:2/630: creat d17/d28/d30/d3b/fe7 x:0 0 0 2024-03-17T23:58:29.161 INFO:tasks.workunit.client.0.smithi196.stdout:0/694: dread d5/d23/f74 [0,4194304] 0 2024-03-17T23:58:29.165 INFO:tasks.workunit.client.0.smithi196.stdout:3/661: creat d7/d33/d81/dc8/fd8 x:0 0 0 2024-03-17T23:58:29.166 INFO:tasks.workunit.client.0.smithi196.stdout:4/501: symlink d1/d1b/d77/lb8 0 2024-03-17T23:58:29.167 INFO:tasks.workunit.client.0.smithi196.stdout:4/502: fdatasync d1/d26/f7e 0 2024-03-17T23:58:29.171 INFO:tasks.workunit.client.0.smithi196.stdout:6/463: symlink d2/d14/d35/d63/l9f 0 2024-03-17T23:58:29.172 INFO:tasks.workunit.client.0.smithi196.stdout:3/662: dread d7/d19/d78/d93/fa0 [0,4194304] 0 2024-03-17T23:58:29.172 INFO:tasks.workunit.client.0.smithi196.stdout:8/378: dread - de/d10/f2c zero size 2024-03-17T23:58:29.175 INFO:tasks.workunit.client.0.smithi196.stdout:7/611: dread da/d3e/d45/d4f/d75/da8/f88 [0,4194304] 0 2024-03-17T23:58:29.176 INFO:tasks.workunit.client.0.smithi196.stdout:2/631: rmdir d17 39 2024-03-17T23:58:29.179 INFO:tasks.workunit.client.0.smithi196.stdout:0/695: symlink d5/d23/d24/d28/d47/d52/d61/d6c/d82/ld4 0 2024-03-17T23:58:29.180 INFO:tasks.workunit.client.0.smithi196.stdout:4/503: fsync d1/d26/d57/dac/fb5 0 2024-03-17T23:58:29.181 INFO:tasks.workunit.client.0.smithi196.stdout:5/485: truncate d6/d17/f6c 455837 0 2024-03-17T23:58:29.183 INFO:tasks.workunit.client.0.smithi196.stdout:6/464: mkdir d2/d14/d42/d57/d5f/da0 0 2024-03-17T23:58:29.183 INFO:tasks.workunit.client.0.smithi196.stdout:0/696: dread d5/d23/d24/d30/f90 [0,4194304] 0 2024-03-17T23:58:29.183 INFO:tasks.workunit.client.0.smithi196.stdout:4/504: write d1/d26/f3b [213713,79067] 0 2024-03-17T23:58:29.184 INFO:tasks.workunit.client.0.smithi196.stdout:5/486: readlink d6/d17/d3f/d4e/l88 0 2024-03-17T23:58:29.186 INFO:tasks.workunit.client.0.smithi196.stdout:9/572: mkdir d9/df/d14/db0 0 2024-03-17T23:58:29.187 INFO:tasks.workunit.client.0.smithi196.stdout:8/379: rmdir de/d10/d35/d3e 39 2024-03-17T23:58:29.188 INFO:tasks.workunit.client.0.smithi196.stdout:8/380: write de/f39 [2873740,57841] 0 2024-03-17T23:58:29.188 INFO:tasks.workunit.client.0.smithi196.stdout:7/612: symlink da/d15/d1a/d5e/da5/ld5 0 2024-03-17T23:58:29.192 INFO:tasks.workunit.client.0.smithi196.stdout:2/632: fsync d17/d22/d3d/d8f/fa5 0 2024-03-17T23:58:29.198 INFO:tasks.workunit.client.0.smithi196.stdout:3/663: fdatasync d7/d19/d26/d2b/f67 0 2024-03-17T23:58:29.207 INFO:tasks.workunit.client.0.smithi196.stdout:4/505: mknod d1/de/cb9 0 2024-03-17T23:58:29.209 INFO:tasks.workunit.client.0.smithi196.stdout:9/573: mkdir d9/df/d4a/d89/db1 0 2024-03-17T23:58:29.210 INFO:tasks.workunit.client.0.smithi196.stdout:0/697: dread d5/f13 [0,4194304] 0 2024-03-17T23:58:29.210 INFO:tasks.workunit.client.0.smithi196.stdout:7/613: dread da/f91 [0,4194304] 0 2024-03-17T23:58:29.212 INFO:tasks.workunit.client.0.smithi196.stdout:8/381: truncate de/d2b/d3c/f6a 328552 0 2024-03-17T23:58:29.214 INFO:tasks.workunit.client.0.smithi196.stdout:2/633: mknod d17/d28/d30/d72/d81/ce8 0 2024-03-17T23:58:29.216 INFO:tasks.workunit.client.0.smithi196.stdout:5/487: rename d6/d2d/d33/d3b/d8b to d6/d17/d3f/da5 0 2024-03-17T23:58:29.222 INFO:tasks.workunit.client.0.smithi196.stdout:4/506: symlink d1/d26/d57/d8c/lba 0 2024-03-17T23:58:29.222 INFO:tasks.workunit.client.0.smithi196.stdout:9/574: write d9/d33/f5f [3175138,24340] 0 2024-03-17T23:58:29.222 INFO:tasks.workunit.client.0.smithi196.stdout:8/382: rmdir de/d10 39 2024-03-17T23:58:29.222 INFO:tasks.workunit.client.0.smithi196.stdout:4/507: readlink d1/d26/d57/l63 0 2024-03-17T23:58:29.224 INFO:tasks.workunit.client.0.smithi196.stdout:7/614: unlink da/d3e/d45/d4f/d43/d9e/ld2 0 2024-03-17T23:58:29.224 INFO:tasks.workunit.client.0.smithi196.stdout:9/575: read d9/df/d4a/f5a [114560,122339] 0 2024-03-17T23:58:29.225 INFO:tasks.workunit.client.0.smithi196.stdout:3/664: rename d7/d33/d81 to d7/d19/d26/d48/d4d/dd9 0 2024-03-17T23:58:29.226 INFO:tasks.workunit.client.0.smithi196.stdout:5/488: symlink d6/d2d/d33/d3b/d80/da0/la6 0 2024-03-17T23:58:29.229 INFO:tasks.workunit.client.0.smithi196.stdout:0/698: dread d5/faa [0,4194304] 0 2024-03-17T23:58:29.229 INFO:tasks.workunit.client.0.smithi196.stdout:9/576: fsync d9/df/d14/d27/f97 0 2024-03-17T23:58:29.229 INFO:tasks.workunit.client.0.smithi196.stdout:8/383: mknod de/d2b/d3c/d5d/d65/c72 0 2024-03-17T23:58:29.231 INFO:tasks.workunit.client.0.smithi196.stdout:2/634: rename d17/d19/f31 to d17/d28/d30/d72/d81/fe9 0 2024-03-17T23:58:29.231 INFO:tasks.workunit.client.0.smithi196.stdout:5/489: dread d6/d17/d1f/f50 [0,4194304] 0 2024-03-17T23:58:29.232 INFO:tasks.workunit.client.0.smithi196.stdout:7/615: creat da/d3e/d45/d4f/d75/da8/d78/fd6 x:0 0 0 2024-03-17T23:58:29.234 INFO:tasks.workunit.client.0.smithi196.stdout:6/465: getdents d2/d14/d42/d57/d5f 0 2024-03-17T23:58:29.234 INFO:tasks.workunit.client.0.smithi196.stdout:5/490: stat d6/d17/d23/d53/c94 0 2024-03-17T23:58:29.237 INFO:tasks.workunit.client.0.smithi196.stdout:0/699: creat d5/d23/d24/da3/dbb/fd5 x:0 0 0 2024-03-17T23:58:29.240 INFO:tasks.workunit.client.0.smithi196.stdout:1/439: sync 2024-03-17T23:58:29.240 INFO:tasks.workunit.client.0.smithi196.stdout:7/616: symlink da/d3e/d45/d4f/d75/ld7 0 2024-03-17T23:58:29.241 INFO:tasks.workunit.client.0.smithi196.stdout:4/508: dwrite d1/d26/d33/d40/fad [0,4194304] 0 2024-03-17T23:58:29.242 INFO:tasks.workunit.client.0.smithi196.stdout:2/635: symlink d17/lea 0 2024-03-17T23:58:29.242 INFO:tasks.workunit.client.0.smithi196.stdout:3/665: dread d7/d19/d26/d2b/f42 [0,4194304] 0 2024-03-17T23:58:29.242 INFO:tasks.workunit.client.0.smithi196.stdout:8/384: creat de/d2b/d30/f73 x:0 0 0 2024-03-17T23:58:29.245 INFO:tasks.workunit.client.0.smithi196.stdout:7/617: write f8 [8845938,15736] 0 2024-03-17T23:58:29.246 INFO:tasks.workunit.client.0.smithi196.stdout:3/666: fsync d7/d29/f87 0 2024-03-17T23:58:29.246 INFO:tasks.workunit.client.0.smithi196.stdout:0/700: dread d5/d23/d24/d72/f8e [0,4194304] 0 2024-03-17T23:58:29.246 INFO:tasks.workunit.client.0.smithi196.stdout:4/509: dread - d1/d68/d74/fa3 zero size 2024-03-17T23:58:29.247 INFO:tasks.workunit.client.0.smithi196.stdout:1/440: read d1/d13/d23/f36 [1719335,107339] 0 2024-03-17T23:58:29.249 INFO:tasks.workunit.client.0.smithi196.stdout:3/667: dread - d7/d29/fb8 zero size 2024-03-17T23:58:29.251 INFO:tasks.workunit.client.0.smithi196.stdout:4/510: truncate d1/d26/d33/f5c 455305 0 2024-03-17T23:58:29.253 INFO:tasks.workunit.client.0.smithi196.stdout:5/491: dread d6/f1b [0,4194304] 0 2024-03-17T23:58:29.255 INFO:tasks.workunit.client.0.smithi196.stdout:9/577: getdents d9/df/d4a/d89/db1 0 2024-03-17T23:58:29.255 INFO:tasks.workunit.client.0.smithi196.stdout:6/466: read - d2/d14/d35/f52 zero size 2024-03-17T23:58:29.256 INFO:tasks.workunit.client.0.smithi196.stdout:2/636: rename d17/d22/da0/l73 to d17/d22/da0/dc7/leb 0 2024-03-17T23:58:29.258 INFO:tasks.workunit.client.0.smithi196.stdout:1/441: mknod d1/db/c8c 0 2024-03-17T23:58:29.258 INFO:tasks.workunit.client.0.smithi196.stdout:6/467: readlink d2/d66/l77 0 2024-03-17T23:58:29.259 INFO:tasks.workunit.client.0.smithi196.stdout:4/511: creat d1/d11/fbb x:0 0 0 2024-03-17T23:58:29.260 INFO:tasks.workunit.client.0.smithi196.stdout:5/492: mknod d6/d17/d23/ca7 0 2024-03-17T23:58:29.262 INFO:tasks.workunit.client.0.smithi196.stdout:6/468: read d2/d14/d75/d7b/f4c [4456605,75261] 0 2024-03-17T23:58:29.262 INFO:tasks.workunit.client.0.smithi196.stdout:7/618: mkdir da/d3e/d45/dd8 0 2024-03-17T23:58:29.262 INFO:tasks.workunit.client.0.smithi196.stdout:3/668: write d7/d19/f23 [696275,26745] 0 2024-03-17T23:58:29.263 INFO:tasks.workunit.client.0.smithi196.stdout:4/512: fsync d1/d26/d33/d85/fa5 0 2024-03-17T23:58:29.267 INFO:tasks.workunit.client.0.smithi196.stdout:6/469: dread - d2/d14/f47 zero size 2024-03-17T23:58:29.267 INFO:tasks.workunit.client.0.smithi196.stdout:0/701: dwrite d5/d23/d24/d28/d47/d52/d61/d6c/fb4 [0,4194304] 0 2024-03-17T23:58:29.269 INFO:tasks.workunit.client.0.smithi196.stdout:6/470: fdatasync d2/d7/d2b/f67 0 2024-03-17T23:58:29.276 INFO:tasks.workunit.client.0.smithi196.stdout:8/385: rename de/d2b/d3c/f69 to de/d2b/d3c/d5d/f74 0 2024-03-17T23:58:29.277 INFO:tasks.workunit.client.0.smithi196.stdout:4/513: rmdir d1/d26/d57/d8c 39 2024-03-17T23:58:29.278 INFO:tasks.workunit.client.0.smithi196.stdout:7/619: creat da/d15/d1a/d5e/da5/fd9 x:0 0 0 2024-03-17T23:58:29.280 INFO:tasks.workunit.client.0.smithi196.stdout:7/620: truncate da/d3e/d45/d4f/d75/da8/f59 5135286 0 2024-03-17T23:58:29.282 INFO:tasks.workunit.client.0.smithi196.stdout:6/471: mkdir d2/d14/d75/d7b/d49/da1 0 2024-03-17T23:58:29.282 INFO:tasks.workunit.client.0.smithi196.stdout:7/621: chown da/d15/d1a/d5e/f5f 67419 1 2024-03-17T23:58:29.289 INFO:tasks.workunit.client.0.smithi196.stdout:4/514: mknod d1/d1b/d77/cbc 0 2024-03-17T23:58:29.292 INFO:tasks.workunit.client.0.smithi196.stdout:1/442: creat d1/db/dd/d34/f8d x:0 0 0 2024-03-17T23:58:29.293 INFO:tasks.workunit.client.0.smithi196.stdout:2/637: link d17/d22/lbd d17/dce/lec 0 2024-03-17T23:58:29.295 INFO:tasks.workunit.client.0.smithi196.stdout:6/472: symlink d2/d66/la2 0 2024-03-17T23:58:29.295 INFO:tasks.workunit.client.0.smithi196.stdout:0/702: dread d5/d23/d24/d28/d47/d52/f42 [0,4194304] 0 2024-03-17T23:58:29.297 INFO:tasks.workunit.client.0.smithi196.stdout:2/638: stat d17/d28/d30/d71/l98 0 2024-03-17T23:58:29.300 INFO:tasks.workunit.client.0.smithi196.stdout:7/622: dwrite da/d3e/d45/d4f/d75/da8/d78/fd6 [0,4194304] 0 2024-03-17T23:58:29.301 INFO:tasks.workunit.client.0.smithi196.stdout:5/493: link d6/d17/d3f/l61 d6/la8 0 2024-03-17T23:58:29.301 INFO:tasks.workunit.client.0.smithi196.stdout:3/669: dread d7/d19/d26/d2b/d3c/f77 [0,4194304] 0 2024-03-17T23:58:29.304 INFO:tasks.workunit.client.0.smithi196.stdout:2/639: chown d17/d28/d30/cd4 4 1 2024-03-17T23:58:29.312 INFO:tasks.workunit.client.0.smithi196.stdout:4/515: dwrite d1/d26/d33/f66 [0,4194304] 0 2024-03-17T23:58:29.312 INFO:tasks.workunit.client.0.smithi196.stdout:7/623: chown da/d3e/d45/la3 99 1 2024-03-17T23:58:29.315 INFO:tasks.workunit.client.0.smithi196.stdout:8/386: dread de/d10/f1a [0,4194304] 0 2024-03-17T23:58:29.316 INFO:tasks.workunit.client.0.smithi196.stdout:3/670: chown d7/d33/lae 1535 1 2024-03-17T23:58:29.318 INFO:tasks.workunit.client.0.smithi196.stdout:6/473: rename d2/d14/d42/d57/c48 to d2/d14/d75/d7b/d9e/ca3 0 2024-03-17T23:58:29.319 INFO:tasks.workunit.client.0.smithi196.stdout:4/516: rmdir d1/d1b/d77 39 2024-03-17T23:58:29.320 INFO:tasks.workunit.client.0.smithi196.stdout:5/494: unlink d6/d2d/d33/d3b/d65/f4d 0 2024-03-17T23:58:29.321 INFO:tasks.workunit.client.0.smithi196.stdout:2/640: dwrite d17/f38 [0,4194304] 0 2024-03-17T23:58:29.323 INFO:tasks.workunit.client.0.smithi196.stdout:1/443: getdents d1/db 0 2024-03-17T23:58:29.328 INFO:tasks.workunit.client.0.smithi196.stdout:3/671: rename d7/l6f to d7/lda 0 2024-03-17T23:58:29.330 INFO:tasks.workunit.client.0.smithi196.stdout:4/517: creat d1/d26/d57/d8c/d97/fbd x:0 0 0 2024-03-17T23:58:29.330 INFO:tasks.workunit.client.0.smithi196.stdout:2/641: symlink d17/d28/d30/d72/d81/led 0 2024-03-17T23:58:29.331 INFO:tasks.workunit.client.0.smithi196.stdout:0/703: dwrite d5/d23/d24/d30/d4e/f8c [0,4194304] 0 2024-03-17T23:58:29.332 INFO:tasks.workunit.client.0.smithi196.stdout:1/444: unlink d1/d13/d23/d47/d48/l4f 0 2024-03-17T23:58:29.332 INFO:tasks.workunit.client.0.smithi196.stdout:1/445: readlink d1/l58 0 2024-03-17T23:58:29.338 INFO:tasks.workunit.client.0.smithi196.stdout:7/624: truncate da/d3e/d45/d4f/d75/da8/d78/fd6 3268030 0 2024-03-17T23:58:29.340 INFO:tasks.workunit.client.0.smithi196.stdout:3/672: symlink d7/d19/d26/d2b/ldb 0 2024-03-17T23:58:29.341 INFO:tasks.workunit.client.0.smithi196.stdout:0/704: creat d5/d23/d85/fd6 x:0 0 0 2024-03-17T23:58:29.342 INFO:tasks.workunit.client.0.smithi196.stdout:1/446: mknod d1/d13/d23/d62/d71/c8e 0 2024-03-17T23:58:29.343 INFO:tasks.workunit.client.0.smithi196.stdout:8/387: link de/d10/f14 de/d10/d43/f75 0 2024-03-17T23:58:29.345 INFO:tasks.workunit.client.0.smithi196.stdout:5/495: dwrite f1 [0,4194304] 0 2024-03-17T23:58:29.345 INFO:tasks.workunit.client.0.smithi196.stdout:4/518: rename d1/d68/l91 to d1/d26/d57/dac/lbe 0 2024-03-17T23:58:29.346 INFO:tasks.workunit.client.0.smithi196.stdout:3/673: mkdir d7/d33/ddc 0 2024-03-17T23:58:29.346 INFO:tasks.workunit.client.0.smithi196.stdout:2/642: symlink d17/dce/lee 0 2024-03-17T23:58:29.348 INFO:tasks.workunit.client.0.smithi196.stdout:1/447: chown d1/d13/d23/d47/d48/f54 471971948 1 2024-03-17T23:58:29.350 INFO:tasks.workunit.client.0.smithi196.stdout:4/519: rmdir d1/de 39 2024-03-17T23:58:29.351 INFO:tasks.workunit.client.0.smithi196.stdout:8/388: rename de/d10/f1b to de/d2b/d3c/d5d/d65/f76 0 2024-03-17T23:58:29.353 INFO:tasks.workunit.client.0.smithi196.stdout:1/448: write d1/d13/d23/d47/d48/d7e/f87 [999503,102435] 0 2024-03-17T23:58:29.354 INFO:tasks.workunit.client.0.smithi196.stdout:7/625: dwrite da/d15/f17 [0,4194304] 0 2024-03-17T23:58:29.356 INFO:tasks.workunit.client.0.smithi196.stdout:8/389: chown de/d10/f2c 7 1 2024-03-17T23:58:29.371 INFO:tasks.workunit.client.0.smithi196.stdout:4/520: rename d1/d61/f8f to d1/d68/d74/fbf 0 2024-03-17T23:58:29.376 INFO:tasks.workunit.client.0.smithi196.stdout:3/674: dwrite d7/d29/fb8 [0,4194304] 0 2024-03-17T23:58:29.377 INFO:tasks.workunit.client.0.smithi196.stdout:8/390: creat de/d2b/d30/d33/f77 x:0 0 0 2024-03-17T23:58:29.379 INFO:tasks.workunit.client.0.smithi196.stdout:8/391: stat de/l28 0 2024-03-17T23:58:29.379 INFO:tasks.workunit.client.0.smithi196.stdout:2/643: dwrite d17/d28/d30/d71/de0/fe3 [0,4194304] 0 2024-03-17T23:58:29.379 INFO:tasks.workunit.client.0.smithi196.stdout:4/521: write d1/de/f21 [3248367,118286] 0 2024-03-17T23:58:29.383 INFO:tasks.workunit.client.0.smithi196.stdout:7/626: mkdir da/d3e/d45/d4f/dda 0 2024-03-17T23:58:29.384 INFO:tasks.workunit.client.0.smithi196.stdout:5/496: dwrite d6/f8a [0,4194304] 0 2024-03-17T23:58:29.390 INFO:tasks.workunit.client.0.smithi196.stdout:3/675: write d7/d33/fb2 [578819,94293] 0 2024-03-17T23:58:29.396 INFO:tasks.workunit.client.0.smithi196.stdout:4/522: fsync d1/de/d50/d55/d4a/f8d 0 2024-03-17T23:58:29.396 INFO:tasks.workunit.client.0.smithi196.stdout:2/644: readlink d17/d22/da0/dc7/leb 0 2024-03-17T23:58:29.397 INFO:tasks.workunit.client.0.smithi196.stdout:8/392: rename c8 to de/d2b/d30/d33/c78 0 2024-03-17T23:58:29.398 INFO:tasks.workunit.client.0.smithi196.stdout:1/449: dread d1/d13/d4c/f61 [0,4194304] 0 2024-03-17T23:58:29.403 INFO:tasks.workunit.client.0.smithi196.stdout:8/393: creat de/d2b/d3c/d5d/f79 x:0 0 0 2024-03-17T23:58:29.403 INFO:tasks.workunit.client.0.smithi196.stdout:5/497: dwrite d6/d17/d23/d53/f8f [0,4194304] 0 2024-03-17T23:58:29.405 INFO:tasks.workunit.client.0.smithi196.stdout:3/676: truncate d7/d19/d26/d2b/d3c/d9e/f9f 2491268 0 2024-03-17T23:58:29.406 INFO:tasks.workunit.client.0.smithi196.stdout:4/523: symlink d1/de/lc0 0 2024-03-17T23:58:29.408 INFO:tasks.workunit.client.0.smithi196.stdout:3/677: stat d7/d19/d78/da9/cd2 0 2024-03-17T23:58:29.409 INFO:tasks.workunit.client.0.smithi196.stdout:2/645: link d17/d28/d30/fcf d17/d28/d30/d71/de0/fef 0 2024-03-17T23:58:29.411 INFO:tasks.workunit.client.0.smithi196.stdout:8/394: getdents de/d10/d54/d5c 0 2024-03-17T23:58:29.412 INFO:tasks.workunit.client.0.smithi196.stdout:3/678: rmdir d7/d19/d26/d2b/d3c/d9e 39 2024-03-17T23:58:29.415 INFO:tasks.workunit.client.0.smithi196.stdout:3/679: chown d7/d29/fb8 0 1 2024-03-17T23:58:29.415 INFO:tasks.workunit.client.0.smithi196.stdout:1/450: dwrite d1/d13/d23/f82 [0,4194304] 0 2024-03-17T23:58:29.418 INFO:tasks.workunit.client.0.smithi196.stdout:3/680: write d7/d33/fb2 [162746,93094] 0 2024-03-17T23:58:29.424 INFO:tasks.workunit.client.0.smithi196.stdout:8/395: chown de/d10/d35/d3e/d6c 106 1 2024-03-17T23:58:29.424 INFO:tasks.workunit.client.0.smithi196.stdout:3/681: truncate d7/d19/d26/d48/d4d/dd9/dc8/fd8 836206 0 2024-03-17T23:58:29.425 INFO:tasks.workunit.client.0.smithi196.stdout:5/498: dwrite d6/d17/d1f/d7d/d81/f4a [0,4194304] 0 2024-03-17T23:58:29.426 INFO:tasks.workunit.client.0.smithi196.stdout:4/524: link d1/f2c d1/d26/d33/d40/da1/fc1 0 2024-03-17T23:58:29.428 INFO:tasks.workunit.client.0.smithi196.stdout:8/396: symlink de/d10/d54/l7a 0 2024-03-17T23:58:29.428 INFO:tasks.workunit.client.0.smithi196.stdout:4/525: truncate d1/d68/d74/fa3 295898 0 2024-03-17T23:58:29.429 INFO:tasks.workunit.client.0.smithi196.stdout:8/397: readlink de/d10/d35/l3f 0 2024-03-17T23:58:29.431 INFO:tasks.workunit.client.0.smithi196.stdout:4/526: chown d1/d26/f8e 99922 1 2024-03-17T23:58:29.433 INFO:tasks.workunit.client.0.smithi196.stdout:3/682: rename d7/d19/d26/d2b/d3c/d3d/fab to d7/d33/ddc/fdd 0 2024-03-17T23:58:29.433 INFO:tasks.workunit.client.0.smithi196.stdout:2/646: write d17/d28/d30/f62 [2724436,60809] 0 2024-03-17T23:58:29.436 INFO:tasks.workunit.client.0.smithi196.stdout:5/499: creat d6/d17/d1f/d5c/fa9 x:0 0 0 2024-03-17T23:58:29.438 INFO:tasks.workunit.client.0.smithi196.stdout:2/647: rmdir d17/d19/d93 39 2024-03-17T23:58:29.440 INFO:tasks.workunit.client.0.smithi196.stdout:4/527: dread d1/d26/d33/f72 [0,4194304] 0 2024-03-17T23:58:29.440 INFO:tasks.workunit.client.0.smithi196.stdout:1/451: dwrite d1/db/dd/f38 [0,4194304] 0 2024-03-17T23:58:29.443 INFO:tasks.workunit.client.0.smithi196.stdout:5/500: creat d6/d2d/d33/faa x:0 0 0 2024-03-17T23:58:29.447 INFO:tasks.workunit.client.0.smithi196.stdout:2/648: mkdir d17/d19/d44/d52/df0 0 2024-03-17T23:58:29.448 INFO:tasks.workunit.client.0.smithi196.stdout:1/452: symlink d1/db/l8f 0 2024-03-17T23:58:29.448 INFO:tasks.workunit.client.0.smithi196.stdout:5/501: symlink d6/d17/d3f/da5/lab 0 2024-03-17T23:58:29.452 INFO:tasks.workunit.client.0.smithi196.stdout:8/398: link de/d2b/d3c/d5d/f74 de/d2b/d30/f7b 0 2024-03-17T23:58:29.453 INFO:tasks.workunit.client.0.smithi196.stdout:5/502: write d6/f10 [1607255,106609] 0 2024-03-17T23:58:29.454 INFO:tasks.workunit.client.0.smithi196.stdout:8/399: fdatasync de/d2b/d3c/f55 0 2024-03-17T23:58:29.457 INFO:tasks.workunit.client.0.smithi196.stdout:1/453: creat d1/d13/d2a/f90 x:0 0 0 2024-03-17T23:58:29.458 INFO:tasks.workunit.client.0.smithi196.stdout:3/683: dwrite d7/d19/d26/f2f [4194304,4194304] 0 2024-03-17T23:58:29.461 INFO:tasks.workunit.client.0.smithi196.stdout:8/400: readlink de/l2a 0 2024-03-17T23:58:29.461 INFO:tasks.workunit.client.0.smithi196.stdout:4/528: link d1/d26/d57/dac/db2/cb6 d1/de/d50/d55/cc2 0 2024-03-17T23:58:29.462 INFO:tasks.workunit.client.0.smithi196.stdout:5/503: getdents d6/d17/d23/d53/d97 0 2024-03-17T23:58:29.464 INFO:tasks.workunit.client.0.smithi196.stdout:8/401: mkdir de/d2b/d30/d7c 0 2024-03-17T23:58:29.466 INFO:tasks.workunit.client.0.smithi196.stdout:2/649: rename d17/d22/d3d/d8f/fa7 to d17/d19/d44/ff1 0 2024-03-17T23:58:29.471 INFO:tasks.workunit.client.0.smithi196.stdout:3/684: creat d7/fde x:0 0 0 2024-03-17T23:58:29.471 INFO:tasks.workunit.client.0.smithi196.stdout:3/685: chown d7/d19/d78/d93/fa0 23 1 2024-03-17T23:58:29.472 INFO:tasks.workunit.client.0.smithi196.stdout:5/504: rename d6/d17/d1f/d7d/d81/f32 to d6/d17/d1f/fac 0 2024-03-17T23:58:29.472 INFO:tasks.workunit.client.0.smithi196.stdout:2/650: dread - d17/d19/f7c zero size 2024-03-17T23:58:29.474 INFO:tasks.workunit.client.0.smithi196.stdout:8/402: dwrite de/d10/f1a [4194304,4194304] 0 2024-03-17T23:58:29.475 INFO:tasks.workunit.client.0.smithi196.stdout:2/651: mkdir d17/d22/d3d/d8f/df2 0 2024-03-17T23:58:29.475 INFO:tasks.workunit.client.0.smithi196.stdout:8/403: chown de/d2b 3836193 1 2024-03-17T23:58:29.476 INFO:tasks.workunit.client.0.smithi196.stdout:5/505: creat d6/d17/d1f/d7d/d81/fad x:0 0 0 2024-03-17T23:58:29.476 INFO:tasks.workunit.client.0.smithi196.stdout:5/506: fdatasync d6/d17/d23/d53/f8f 0 2024-03-17T23:58:29.482 INFO:tasks.workunit.client.0.smithi196.stdout:2/652: dread - d17/d1f/f63 zero size 2024-03-17T23:58:29.482 INFO:tasks.workunit.client.0.smithi196.stdout:8/404: truncate f3 1281413 0 2024-03-17T23:58:29.489 INFO:tasks.workunit.client.0.smithi196.stdout:5/507: getdents d6/d2d/d33/d3b/d80 0 2024-03-17T23:58:29.490 INFO:tasks.workunit.client.0.smithi196.stdout:2/653: link d17/d28/d30/c67 d17/d22/d59/cf3 0 2024-03-17T23:58:29.491 INFO:tasks.workunit.client.0.smithi196.stdout:5/508: read d6/fe [239239,115299] 0 2024-03-17T23:58:29.495 INFO:tasks.workunit.client.0.smithi196.stdout:2/654: mkdir d17/d22/da0/dc7/df4 0 2024-03-17T23:58:29.496 INFO:tasks.workunit.client.0.smithi196.stdout:2/655: truncate d17/d19/d44/fe2 471406 0 2024-03-17T23:58:29.498 INFO:tasks.workunit.client.0.smithi196.stdout:5/509: creat d6/d17/d3f/fae x:0 0 0 2024-03-17T23:58:29.499 INFO:tasks.workunit.client.0.smithi196.stdout:5/510: readlink d6/d17/d23/d53/l82 0 2024-03-17T23:58:29.503 INFO:tasks.workunit.client.0.smithi196.stdout:2/656: dwrite d17/f38 [0,4194304] 0 2024-03-17T23:58:29.507 INFO:tasks.workunit.client.0.smithi196.stdout:5/511: dread d6/d17/d35/f4f [0,4194304] 0 2024-03-17T23:58:29.507 INFO:tasks.workunit.client.0.smithi196.stdout:5/512: readlink d6/d17/d3f/l7a 0 2024-03-17T23:58:29.508 INFO:tasks.workunit.client.0.smithi196.stdout:9/578: sync 2024-03-17T23:58:29.512 INFO:tasks.workunit.client.0.smithi196.stdout:9/579: stat d9/df/d4a/d5b/d6d/da8 0 2024-03-17T23:58:29.515 INFO:tasks.workunit.client.0.smithi196.stdout:9/580: rmdir d9/df/d14/d3d 39 2024-03-17T23:58:29.517 INFO:tasks.workunit.client.0.smithi196.stdout:8/405: dwrite de/d10/f2e [0,4194304] 0 2024-03-17T23:58:29.517 INFO:tasks.workunit.client.0.smithi196.stdout:5/513: rmdir d6/d17/d23/d53/d98 0 2024-03-17T23:58:29.518 INFO:tasks.workunit.client.0.smithi196.stdout:2/657: rename d17/d22/ccc to d17/d22/cf5 0 2024-03-17T23:58:29.521 INFO:tasks.workunit.client.0.smithi196.stdout:9/581: dread - d9/df/d4a/d5b/d6d/fa7 zero size 2024-03-17T23:58:29.521 INFO:tasks.workunit.client.0.smithi196.stdout:8/406: symlink de/d2b/d30/d33/l7d 0 2024-03-17T23:58:29.522 INFO:tasks.workunit.client.0.smithi196.stdout:5/514: rmdir d6/d2d/d33/d84 39 2024-03-17T23:58:29.523 INFO:tasks.workunit.client.0.smithi196.stdout:2/658: mknod d17/d22/d3d/d8f/dbe/cf6 0 2024-03-17T23:58:29.529 INFO:tasks.workunit.client.0.smithi196.stdout:8/407: mknod de/d2b/d3c/c7e 0 2024-03-17T23:58:29.532 INFO:tasks.workunit.client.0.smithi196.stdout:2/659: creat d17/ff7 x:0 0 0 2024-03-17T23:58:29.533 INFO:tasks.workunit.client.0.smithi196.stdout:9/582: link d9/d38/d60/f48 d9/d38/fb2 0 2024-03-17T23:58:29.534 INFO:tasks.workunit.client.0.smithi196.stdout:5/515: getdents d6/d2d/d33 0 2024-03-17T23:58:29.535 INFO:tasks.workunit.client.0.smithi196.stdout:8/408: fdatasync de/d2b/d30/d33/f37 0 2024-03-17T23:58:29.536 INFO:tasks.workunit.client.0.smithi196.stdout:8/409: dread - de/d5e/f70 zero size 2024-03-17T23:58:29.537 INFO:tasks.workunit.client.0.smithi196.stdout:2/660: fdatasync d17/d19/f69 0 2024-03-17T23:58:29.538 INFO:tasks.workunit.client.0.smithi196.stdout:5/516: unlink d6/fd 0 2024-03-17T23:58:29.539 INFO:tasks.workunit.client.0.smithi196.stdout:8/410: creat de/d2b/d3c/f7f x:0 0 0 2024-03-17T23:58:29.540 INFO:tasks.workunit.client.0.smithi196.stdout:9/583: creat d9/df/d4a/d89/db1/fb3 x:0 0 0 2024-03-17T23:58:29.540 INFO:tasks.workunit.client.0.smithi196.stdout:8/411: chown de/f15 105236936 1 2024-03-17T23:58:29.541 INFO:tasks.workunit.client.0.smithi196.stdout:2/661: mknod d17/d22/d3d/cf8 0 2024-03-17T23:58:29.542 INFO:tasks.workunit.client.0.smithi196.stdout:8/412: read - de/d2b/d3c/d5d/f64 zero size 2024-03-17T23:58:29.545 INFO:tasks.workunit.client.0.smithi196.stdout:2/662: symlink d17/d22/da0/dc7/lf9 0 2024-03-17T23:58:29.547 INFO:tasks.workunit.client.0.smithi196.stdout:8/413: unlink de/f1d 0 2024-03-17T23:58:29.549 INFO:tasks.workunit.client.0.smithi196.stdout:9/584: rename d9/df/d14/d3d/f91 to d9/df/d14/d27/d9e/fb4 0 2024-03-17T23:58:29.549 INFO:tasks.workunit.client.0.smithi196.stdout:5/517: getdents d6/d2d/d33/d3b/d80 0 2024-03-17T23:58:29.553 INFO:tasks.workunit.client.0.smithi196.stdout:8/414: rename de/f39 to de/d10/d35/d3e/d6c/f80 0 2024-03-17T23:58:29.554 INFO:tasks.workunit.client.0.smithi196.stdout:9/585: mknod d9/df/d4a/d89/cb5 0 2024-03-17T23:58:29.555 INFO:tasks.workunit.client.0.smithi196.stdout:2/663: symlink d17/d19/d44/lfa 0 2024-03-17T23:58:29.558 INFO:tasks.workunit.client.0.smithi196.stdout:5/518: read d6/d17/f6c [386482,57485] 0 2024-03-17T23:58:29.558 INFO:tasks.workunit.client.0.smithi196.stdout:2/664: write d17/d19/d44/d52/f9b [325783,128480] 0 2024-03-17T23:58:29.558 INFO:tasks.workunit.client.0.smithi196.stdout:9/586: creat d9/df/d4a/d5b/da5/fb6 x:0 0 0 2024-03-17T23:58:29.559 INFO:tasks.workunit.client.0.smithi196.stdout:8/415: mkdir de/d10/d54/d5c/d81 0 2024-03-17T23:58:29.562 INFO:tasks.workunit.client.0.smithi196.stdout:9/587: symlink d9/d38/d60/lb7 0 2024-03-17T23:58:29.562 INFO:tasks.workunit.client.0.smithi196.stdout:2/665: mknod d17/d19/cfb 0 2024-03-17T23:58:29.568 INFO:tasks.workunit.client.0.smithi196.stdout:8/416: dwrite f6 [4194304,4194304] 0 2024-03-17T23:58:29.569 INFO:tasks.workunit.client.0.smithi196.stdout:2/666: dread d17/d28/d30/d72/d81/fa4 [0,4194304] 0 2024-03-17T23:58:29.571 INFO:tasks.workunit.client.0.smithi196.stdout:8/417: creat de/d10/d43/d71/f82 x:0 0 0 2024-03-17T23:58:29.580 INFO:tasks.workunit.client.0.smithi196.stdout:8/418: dread de/f15 [0,4194304] 0 2024-03-17T23:58:29.584 INFO:tasks.workunit.client.0.smithi196.stdout:8/419: mknod de/d2b/d30/d33/c83 0 2024-03-17T23:58:29.584 INFO:tasks.workunit.client.0.smithi196.stdout:8/420: chown de/d10/c62 60353 1 2024-03-17T23:58:29.587 INFO:tasks.workunit.client.0.smithi196.stdout:8/421: unlink de/d10/l41 0 2024-03-17T23:58:29.588 INFO:tasks.workunit.client.0.smithi196.stdout:8/422: stat de/d2b/d30/d33/c44 0 2024-03-17T23:58:29.588 INFO:tasks.workunit.client.0.smithi196.stdout:8/423: fdatasync f6 0 2024-03-17T23:58:29.594 INFO:tasks.workunit.client.0.smithi196.stdout:8/424: dwrite de/d2b/d30/f51 [0,4194304] 0 2024-03-17T23:58:29.613 INFO:tasks.workunit.client.0.smithi196.stdout:8/425: write de/d2b/d3c/f6a [600733,52047] 0 2024-03-17T23:58:29.618 INFO:tasks.workunit.client.0.smithi196.stdout:8/426: dread de/d10/f1a [4194304,4194304] 0 2024-03-17T23:58:29.618 INFO:tasks.workunit.client.0.smithi196.stdout:8/427: chown de/d10/l58 1275164 1 2024-03-17T23:58:29.622 INFO:tasks.workunit.client.0.smithi196.stdout:8/428: write de/d10/f3b [5202152,72283] 0 2024-03-17T23:58:29.624 INFO:tasks.workunit.client.0.smithi196.stdout:8/429: rmdir de/d5e 39 2024-03-17T23:58:29.626 INFO:tasks.workunit.client.0.smithi196.stdout:8/430: unlink de/d2b/c57 0 2024-03-17T23:58:29.667 INFO:tasks.workunit.client.0.smithi196.stdout:6/474: sync 2024-03-17T23:58:29.668 INFO:tasks.workunit.client.0.smithi196.stdout:6/475: fdatasync d2/f2a 0 2024-03-17T23:58:29.676 INFO:tasks.workunit.client.0.smithi196.stdout:6/476: dwrite d2/d14/f1d [4194304,4194304] 0 2024-03-17T23:58:29.680 INFO:tasks.workunit.client.0.smithi196.stdout:6/477: symlink d2/d14/d75/la4 0 2024-03-17T23:58:29.683 INFO:tasks.workunit.client.0.smithi196.stdout:6/478: creat d2/d14/d75/d7b/d49/da1/fa5 x:0 0 0 2024-03-17T23:58:29.683 INFO:tasks.workunit.client.0.smithi196.stdout:6/479: stat d2/d7/d9d/f76 0 2024-03-17T23:58:29.707 INFO:tasks.workunit.client.0.smithi196.stdout:6/480: link d2/d7/d2b/c37 d2/d14/d42/d57/ca6 0 2024-03-17T23:58:29.709 INFO:tasks.workunit.client.0.smithi196.stdout:6/481: rename d2/d14/d42 to d2/d14/d42/d57/d5f/da7 22 2024-03-17T23:58:29.709 INFO:tasks.workunit.client.0.smithi196.stdout:6/482: readlink d2/d14/d42/l53 0 2024-03-17T23:58:29.719 INFO:tasks.workunit.client.0.smithi196.stdout:6/483: dwrite d2/d7/d2b/f4a [0,4194304] 0 2024-03-17T23:58:29.728 INFO:tasks.workunit.client.0.smithi196.stdout:6/484: creat d2/d66/fa8 x:0 0 0 2024-03-17T23:58:29.731 INFO:tasks.workunit.client.0.smithi196.stdout:6/485: read d2/d7/d2b/f6e [2890340,13268] 0 2024-03-17T23:58:29.734 INFO:tasks.workunit.client.0.smithi196.stdout:6/486: creat d2/d14/d75/d7b/d49/da1/fa9 x:0 0 0 2024-03-17T23:58:29.735 INFO:tasks.workunit.client.0.smithi196.stdout:6/487: fdatasync d2/d14/d35/d63/f3a 0 2024-03-17T23:58:29.741 INFO:tasks.workunit.client.0.smithi196.stdout:6/488: dread d2/d7/d2b/f84 [0,4194304] 0 2024-03-17T23:58:29.742 INFO:tasks.workunit.client.0.smithi196.stdout:6/489: dread - d2/d14/d50/d68/f70 zero size 2024-03-17T23:58:29.746 INFO:tasks.workunit.client.0.smithi196.stdout:6/490: getdents d2/d7/d2b/d9a 0 2024-03-17T23:58:29.747 INFO:tasks.workunit.client.0.smithi196.stdout:6/491: symlink d2/d14/d5b/laa 0 2024-03-17T23:58:29.777 INFO:tasks.workunit.client.0.smithi196.stdout:6/492: rename d2/d14/f71 to d2/d66/d90/fab 0 2024-03-17T23:58:29.778 INFO:tasks.workunit.client.0.smithi196.stdout:6/493: chown d2/d14/d35/l62 4940 1 2024-03-17T23:58:29.782 INFO:tasks.workunit.client.0.smithi196.stdout:6/494: creat d2/d14/d75/fac x:0 0 0 2024-03-17T23:58:29.786 INFO:tasks.workunit.client.0.smithi196.stdout:6/495: rmdir d2/d7/d2b/d9a 0 2024-03-17T23:58:29.787 INFO:tasks.workunit.client.0.smithi196.stdout:6/496: write d2/d14/d35/d63/f38 [2357945,61495] 0 2024-03-17T23:58:29.789 INFO:tasks.workunit.client.0.smithi196.stdout:6/497: mkdir d2/d14/d42/d57/dad 0 2024-03-17T23:58:29.792 INFO:tasks.workunit.client.0.smithi196.stdout:6/498: symlink d2/d7/d2b/lae 0 2024-03-17T23:58:29.799 INFO:tasks.workunit.client.0.smithi196.stdout:7/627: sync 2024-03-17T23:58:29.799 INFO:tasks.workunit.client.0.smithi196.stdout:0/705: sync 2024-03-17T23:58:29.801 INFO:tasks.workunit.client.0.smithi196.stdout:0/706: mknod d5/d23/d24/cd7 0 2024-03-17T23:58:29.803 INFO:tasks.workunit.client.0.smithi196.stdout:0/707: symlink d5/d23/d24/d28/d47/d52/dac/ld8 0 2024-03-17T23:58:29.804 INFO:tasks.workunit.client.0.smithi196.stdout:7/628: getdents da/d3e/d6d 0 2024-03-17T23:58:29.808 INFO:tasks.workunit.client.0.smithi196.stdout:0/708: rename d5/d23/d24/d28/d47/d52/d61/d6c/f7f to d5/d23/d24/d28/dc9/fd9 0 2024-03-17T23:58:29.809 INFO:tasks.workunit.client.0.smithi196.stdout:0/709: chown d5/d23/f33 230777 1 2024-03-17T23:58:29.813 INFO:tasks.workunit.client.0.smithi196.stdout:0/710: symlink d5/d23/d24/d28/d47/d52/d49/lda 0 2024-03-17T23:58:29.813 INFO:tasks.workunit.client.0.smithi196.stdout:6/499: dread d2/d7/d9d/f5a [0,4194304] 0 2024-03-17T23:58:29.815 INFO:tasks.workunit.client.0.smithi196.stdout:0/711: truncate d5/d23/d24/d28/dc9/faf 959884 0 2024-03-17T23:58:29.817 INFO:tasks.workunit.client.0.smithi196.stdout:6/500: unlink d2/d14/l24 0 2024-03-17T23:58:29.818 INFO:tasks.workunit.client.0.smithi196.stdout:6/501: dread - d2/d14/d8c/f91 zero size 2024-03-17T23:58:29.818 INFO:tasks.workunit.client.0.smithi196.stdout:0/712: symlink d5/d23/d24/d59/d94/ldb 0 2024-03-17T23:58:29.819 INFO:tasks.workunit.client.0.smithi196.stdout:0/713: chown d5/d23/f74 0 1 2024-03-17T23:58:29.820 INFO:tasks.workunit.client.0.smithi196.stdout:0/714: fsync d5/d23/d85/fca 0 2024-03-17T23:58:29.823 INFO:tasks.workunit.client.0.smithi196.stdout:6/502: link d2/d14/d35/d63/f3a d2/faf 0 2024-03-17T23:58:29.826 INFO:tasks.workunit.client.0.smithi196.stdout:6/503: mknod d2/cb0 0 2024-03-17T23:58:29.827 INFO:tasks.workunit.client.0.smithi196.stdout:0/715: creat d5/d23/d24/d30/d4e/fdc x:0 0 0 2024-03-17T23:58:29.830 INFO:tasks.workunit.client.0.smithi196.stdout:7/629: dread da/d15/d1d/d2e/fb6 [0,4194304] 0 2024-03-17T23:58:29.830 INFO:tasks.workunit.client.0.smithi196.stdout:6/504: dread d2/d66/f69 [0,4194304] 0 2024-03-17T23:58:29.833 INFO:tasks.workunit.client.0.smithi196.stdout:6/505: creat d2/d14/d75/d7b/fb1 x:0 0 0 2024-03-17T23:58:29.834 INFO:tasks.workunit.client.0.smithi196.stdout:6/506: stat d2/d14/d42/l95 0 2024-03-17T23:58:29.835 INFO:tasks.workunit.client.0.smithi196.stdout:7/630: creat da/d3e/fdb x:0 0 0 2024-03-17T23:58:29.851 INFO:tasks.workunit.client.0.smithi196.stdout:6/507: dwrite d2/d14/d75/d7b/f3f [0,4194304] 0 2024-03-17T23:58:29.851 INFO:tasks.workunit.client.0.smithi196.stdout:7/631: dwrite da/f13 [0,4194304] 0 2024-03-17T23:58:29.854 INFO:tasks.workunit.client.0.smithi196.stdout:7/632: write da/d15/d1a/d5e/d70/f9a [980292,34549] 0 2024-03-17T23:58:29.855 INFO:tasks.workunit.client.0.smithi196.stdout:6/508: write d2/d14/d75/fac [987475,90928] 0 2024-03-17T23:58:29.857 INFO:tasks.workunit.client.0.smithi196.stdout:7/633: truncate da/fa6 772313 0 2024-03-17T23:58:29.858 INFO:tasks.workunit.client.0.smithi196.stdout:7/634: chown da/d3e/d45/d4f/d75/f95 265329294 1 2024-03-17T23:58:29.858 INFO:tasks.workunit.client.0.smithi196.stdout:6/509: symlink d2/d7/d9d/lb2 0 2024-03-17T23:58:29.861 INFO:tasks.workunit.client.0.smithi196.stdout:6/510: rename d2/d14/d42/d57/dad to d2/d14/d5b/db3 0 2024-03-17T23:58:29.864 INFO:tasks.workunit.client.0.smithi196.stdout:6/511: creat d2/d14/d75/d7b/fb4 x:0 0 0 2024-03-17T23:58:29.866 INFO:tasks.workunit.client.0.smithi196.stdout:6/512: symlink d2/d7/lb5 0 2024-03-17T23:58:29.868 INFO:tasks.workunit.client.0.smithi196.stdout:7/635: truncate da/d15/d1d/d4c/f61 530071 0 2024-03-17T23:58:29.870 INFO:tasks.workunit.client.0.smithi196.stdout:7/636: mkdir da/d3e/ddc 0 2024-03-17T23:58:29.871 INFO:tasks.workunit.client.0.smithi196.stdout:6/513: getdents d2/d14/d75/d7b/d49 0 2024-03-17T23:58:29.872 INFO:tasks.workunit.client.0.smithi196.stdout:6/514: fdatasync d2/d14/d5b/f87 0 2024-03-17T23:58:29.873 INFO:tasks.workunit.client.0.smithi196.stdout:7/637: creat da/d3e/d45/d4f/d75/da8/d78/fdd x:0 0 0 2024-03-17T23:58:29.876 INFO:tasks.workunit.client.0.smithi196.stdout:7/638: creat da/d15/d1d/d29/fde x:0 0 0 2024-03-17T23:58:29.877 INFO:tasks.workunit.client.0.smithi196.stdout:6/515: creat d2/d66/d90/fb6 x:0 0 0 2024-03-17T23:58:29.879 INFO:tasks.workunit.client.0.smithi196.stdout:6/516: dread d2/d14/f5d [0,4194304] 0 2024-03-17T23:58:29.880 INFO:tasks.workunit.client.0.smithi196.stdout:6/517: chown d2/d14/d42/f64 4419789 1 2024-03-17T23:58:29.881 INFO:tasks.workunit.client.0.smithi196.stdout:6/518: fdatasync d2/d14/d35/f81 0 2024-03-17T23:58:29.882 INFO:tasks.workunit.client.0.smithi196.stdout:6/519: truncate d2/d14/d8c/f98 643387 0 2024-03-17T23:58:29.885 INFO:tasks.workunit.client.0.smithi196.stdout:6/520: creat d2/d14/fb7 x:0 0 0 2024-03-17T23:58:29.886 INFO:tasks.workunit.client.0.smithi196.stdout:6/521: chown d2/d14/d75/d7b/d9e 61472744 1 2024-03-17T23:58:29.888 INFO:tasks.workunit.client.0.smithi196.stdout:6/522: symlink d2/d14/d35/d63/lb8 0 2024-03-17T23:58:29.891 INFO:tasks.workunit.client.0.smithi196.stdout:6/523: fsync d2/d7/d9d/f8b 0 2024-03-17T23:58:29.892 INFO:tasks.workunit.client.0.smithi196.stdout:7/639: truncate da/d15/da7/dae/f8d 3047792 0 2024-03-17T23:58:29.895 INFO:tasks.workunit.client.0.smithi196.stdout:6/524: unlink d2/d14/d35/l83 0 2024-03-17T23:58:29.900 INFO:tasks.workunit.client.0.smithi196.stdout:7/640: rename da/d15/da7/dae to da/d3e/d6d/ddf 0 2024-03-17T23:58:29.903 INFO:tasks.workunit.client.0.smithi196.stdout:6/525: rename d2/d14/d35/d63/f3a to d2/d14/d5b/fb9 0 2024-03-17T23:58:29.905 INFO:tasks.workunit.client.0.smithi196.stdout:7/641: mknod da/d3e/d45/d4f/d43/ce0 0 2024-03-17T23:58:29.905 INFO:tasks.workunit.client.0.smithi196.stdout:6/526: write d2/d14/d42/d57/d5f/f8d [639660,33815] 0 2024-03-17T23:58:29.914 INFO:tasks.workunit.client.0.smithi196.stdout:7/642: dwrite da/d3e/d45/d4f/d43/f66 [0,4194304] 0 2024-03-17T23:58:29.918 INFO:tasks.workunit.client.0.smithi196.stdout:7/643: truncate da/d3e/d45/d4f/d43/d8f/fb0 595260 0 2024-03-17T23:58:29.919 INFO:tasks.workunit.client.0.smithi196.stdout:7/644: write da/f1c [2610512,90532] 0 2024-03-17T23:58:29.920 INFO:tasks.workunit.client.0.smithi196.stdout:6/527: dwrite d2/faf [0,4194304] 0 2024-03-17T23:58:29.921 INFO:tasks.workunit.client.0.smithi196.stdout:6/528: fdatasync d2/fd 0 2024-03-17T23:58:29.922 INFO:tasks.workunit.client.0.smithi196.stdout:6/529: chown d2/d66 119078655 1 2024-03-17T23:58:29.923 INFO:tasks.workunit.client.0.smithi196.stdout:7/645: creat da/d3e/d6d/ddf/fe1 x:0 0 0 2024-03-17T23:58:29.924 INFO:tasks.workunit.client.0.smithi196.stdout:6/530: rmdir d2/d14/d75/d7b/d9e 39 2024-03-17T23:58:29.924 INFO:tasks.workunit.client.0.smithi196.stdout:7/646: readlink da/d3e/d45/d4f/l5d 0 2024-03-17T23:58:29.928 INFO:tasks.workunit.client.0.smithi196.stdout:6/531: truncate d2/d14/f5d 272033 0 2024-03-17T23:58:29.930 INFO:tasks.workunit.client.0.smithi196.stdout:7/647: truncate da/d15/d1d/f2d 7505191 0 2024-03-17T23:58:29.930 INFO:tasks.workunit.client.0.smithi196.stdout:6/532: mkdir d2/d7/d9d/dba 0 2024-03-17T23:58:29.932 INFO:tasks.workunit.client.0.smithi196.stdout:6/533: stat d2/d66/l74 0 2024-03-17T23:58:29.933 INFO:tasks.workunit.client.0.smithi196.stdout:7/648: rename da/d15/d1a/fac to da/d3e/d7f/fe2 0 2024-03-17T23:58:29.934 INFO:tasks.workunit.client.0.smithi196.stdout:6/534: chown d2/d66/l73 1126606 1 2024-03-17T23:58:29.936 INFO:tasks.workunit.client.0.smithi196.stdout:7/649: read da/d15/d1d/f2c [2211152,39130] 0 2024-03-17T23:58:29.936 INFO:tasks.workunit.client.0.smithi196.stdout:6/535: rmdir d2/d14/d42/d57 39 2024-03-17T23:58:29.937 INFO:tasks.workunit.client.0.smithi196.stdout:7/650: write da/d3e/fdb [14067,100214] 0 2024-03-17T23:58:29.938 INFO:tasks.workunit.client.0.smithi196.stdout:7/651: chown da/d3e 52 1 2024-03-17T23:58:29.941 INFO:tasks.workunit.client.0.smithi196.stdout:7/652: truncate da/d15/fc0 405964 0 2024-03-17T23:58:29.942 INFO:tasks.workunit.client.0.smithi196.stdout:7/653: read f8 [2935259,125553] 0 2024-03-17T23:58:29.946 INFO:tasks.workunit.client.0.smithi196.stdout:6/536: write d2/d14/f47 [338000,58521] 0 2024-03-17T23:58:29.950 INFO:tasks.workunit.client.0.smithi196.stdout:6/537: getdents d2/d7/d9d/dba 0 2024-03-17T23:58:29.952 INFO:tasks.workunit.client.0.smithi196.stdout:7/654: dwrite da/d15/d1a/d5e/d70/f80 [0,4194304] 0 2024-03-17T23:58:29.954 INFO:tasks.workunit.client.0.smithi196.stdout:6/538: getdents d2/d7/d9d 0 2024-03-17T23:58:29.954 INFO:tasks.workunit.client.0.smithi196.stdout:6/539: chown d2/d14/d42 5903086 1 2024-03-17T23:58:29.955 INFO:tasks.workunit.client.0.smithi196.stdout:7/655: creat da/d15/d1a/d5e/d70/dc5/fe3 x:0 0 0 2024-03-17T23:58:29.961 INFO:tasks.workunit.client.0.smithi196.stdout:6/540: symlink d2/d14/d75/d7b/lbb 0 2024-03-17T23:58:29.965 INFO:tasks.workunit.client.0.smithi196.stdout:7/656: dwrite da/d15/da7/f7e [0,4194304] 0 2024-03-17T23:58:29.968 INFO:tasks.workunit.client.0.smithi196.stdout:6/541: dread d2/d14/d75/d7b/f3f [0,4194304] 0 2024-03-17T23:58:29.970 INFO:tasks.workunit.client.0.smithi196.stdout:7/657: rename da/d3e/d45/d4f/d43 to da/d3e/d45/dd8/de4 0 2024-03-17T23:58:29.971 INFO:tasks.workunit.client.0.smithi196.stdout:7/658: dread - da/d3e/d45/d4f/fbf zero size 2024-03-17T23:58:29.975 INFO:tasks.workunit.client.0.smithi196.stdout:7/659: unlink da/d15/lc3 0 2024-03-17T23:58:29.979 INFO:tasks.workunit.client.0.smithi196.stdout:7/660: creat da/d15/d1a/d5e/d70/dc5/fe5 x:0 0 0 2024-03-17T23:58:29.979 INFO:tasks.workunit.client.0.smithi196.stdout:6/542: link d2/d14/d75/d7b/f19 d2/fbc 0 2024-03-17T23:58:29.983 INFO:tasks.workunit.client.0.smithi196.stdout:6/543: mkdir d2/d14/d42/d57/d5f/dbd 0 2024-03-17T23:58:29.987 INFO:tasks.workunit.client.0.smithi196.stdout:6/544: rename d2/fd to d2/d7/d9d/fbe 0 2024-03-17T23:58:29.990 INFO:tasks.workunit.client.0.smithi196.stdout:6/545: creat d2/d14/d35/fbf x:0 0 0 2024-03-17T23:58:29.992 INFO:tasks.workunit.client.0.smithi196.stdout:6/546: mkdir d2/d14/d75/dc0 0 2024-03-17T23:58:29.993 INFO:tasks.workunit.client.0.smithi196.stdout:7/661: dread da/d15/d1a/d5e/f62 [0,4194304] 0 2024-03-17T23:58:29.994 INFO:tasks.workunit.client.0.smithi196.stdout:7/662: chown da/d3e/d45/dd8/de4/d9e 926900911 1 2024-03-17T23:58:29.994 INFO:tasks.workunit.client.0.smithi196.stdout:6/547: fdatasync d2/d66/d90/fab 0 2024-03-17T23:58:29.995 INFO:tasks.workunit.client.0.smithi196.stdout:6/548: stat d2/d14/d75/d92/l93 0 2024-03-17T23:58:29.997 INFO:tasks.workunit.client.0.smithi196.stdout:7/663: symlink da/d3e/d45/d4f/d75/da8/d78/da4/le6 0 2024-03-17T23:58:29.998 INFO:tasks.workunit.client.0.smithi196.stdout:6/549: creat d2/d14/d8c/fc1 x:0 0 0 2024-03-17T23:58:30.000 INFO:tasks.workunit.client.0.smithi196.stdout:7/664: mkdir da/d3e/d45/d4f/d75/de7 0 2024-03-17T23:58:30.001 INFO:tasks.workunit.client.0.smithi196.stdout:7/665: chown da/d15/d1a/d5e/da5 7227636 1 2024-03-17T23:58:30.001 INFO:tasks.workunit.client.0.smithi196.stdout:6/550: symlink d2/d14/d75/d7b/d49/da1/lc2 0 2024-03-17T23:58:30.006 INFO:tasks.workunit.client.0.smithi196.stdout:6/551: symlink d2/d14/d75/dc0/lc3 0 2024-03-17T23:58:30.007 INFO:tasks.workunit.client.0.smithi196.stdout:6/552: truncate d2/d7/d2b/f4a 5100373 0 2024-03-17T23:58:30.008 INFO:tasks.workunit.client.0.smithi196.stdout:6/553: rmdir d2/d14/d50/d68 39 2024-03-17T23:58:30.009 INFO:tasks.workunit.client.0.smithi196.stdout:7/666: write da/f5c [1725830,125118] 0 2024-03-17T23:58:30.009 INFO:tasks.workunit.client.0.smithi196.stdout:6/554: stat d2/d14/d75/d7b/fb1 0 2024-03-17T23:58:30.012 INFO:tasks.workunit.client.0.smithi196.stdout:6/555: creat d2/d14/d5b/fc4 x:0 0 0 2024-03-17T23:58:30.012 INFO:tasks.workunit.client.0.smithi196.stdout:6/556: fdatasync d2/faf 0 2024-03-17T23:58:30.013 INFO:tasks.workunit.client.0.smithi196.stdout:7/667: mknod da/d3e/d7f/dc6/ce8 0 2024-03-17T23:58:30.015 INFO:tasks.workunit.client.0.smithi196.stdout:6/557: mkdir d2/d14/d42/d57/d5f/dc5 0 2024-03-17T23:58:30.016 INFO:tasks.workunit.client.0.smithi196.stdout:6/558: truncate d2/d14/f47 1291450 0 2024-03-17T23:58:30.018 INFO:tasks.workunit.client.0.smithi196.stdout:6/559: creat d2/d14/d35/fc6 x:0 0 0 2024-03-17T23:58:30.021 INFO:tasks.workunit.client.0.smithi196.stdout:6/560: unlink d2/d14/d75/d7b/c3c 0 2024-03-17T23:58:30.026 INFO:tasks.workunit.client.0.smithi196.stdout:7/668: dread da/d15/d1a/f44 [0,4194304] 0 2024-03-17T23:58:30.026 INFO:tasks.workunit.client.0.smithi196.stdout:6/561: link d2/d14/d35/d63/c4d d2/d14/d42/d57/cc7 0 2024-03-17T23:58:30.027 INFO:tasks.workunit.client.0.smithi196.stdout:6/562: write d2/d66/d90/f97 [3875593,42133] 0 2024-03-17T23:58:30.027 INFO:tasks.workunit.client.0.smithi196.stdout:7/669: write da/d15/d1d/f3f [1814607,87585] 0 2024-03-17T23:58:30.028 INFO:tasks.workunit.client.0.smithi196.stdout:4/529: sync 2024-03-17T23:58:30.028 INFO:tasks.workunit.client.0.smithi196.stdout:1/454: sync 2024-03-17T23:58:30.028 INFO:tasks.workunit.client.0.smithi196.stdout:3/686: sync 2024-03-17T23:58:30.029 INFO:tasks.workunit.client.0.smithi196.stdout:6/563: write d2/f2a [200323,48568] 0 2024-03-17T23:58:30.030 INFO:tasks.workunit.client.0.smithi196.stdout:3/687: dread - d7/d19/d26/d2b/d3c/d3d/fd6 zero size 2024-03-17T23:58:30.032 INFO:tasks.workunit.client.0.smithi196.stdout:1/455: mkdir d1/d13/d91 0 2024-03-17T23:58:30.033 INFO:tasks.workunit.client.0.smithi196.stdout:6/564: write d2/d14/fb7 [585085,117262] 0 2024-03-17T23:58:30.034 INFO:tasks.workunit.client.0.smithi196.stdout:3/688: chown d7/d19/l27 9 1 2024-03-17T23:58:30.042 INFO:tasks.workunit.client.0.smithi196.stdout:6/565: read - d2/d14/d50/d68/f9c zero size 2024-03-17T23:58:30.043 INFO:tasks.workunit.client.0.smithi196.stdout:7/670: dwrite da/d3e/f8a [0,4194304] 0 2024-03-17T23:58:30.049 INFO:tasks.workunit.client.0.smithi196.stdout:6/566: rename d2/d14/d5b to d2/d14/d42/d57/dc8 0 2024-03-17T23:58:30.051 INFO:tasks.workunit.client.0.smithi196.stdout:4/530: dread d1/de/f56 [0,4194304] 0 2024-03-17T23:58:30.063 INFO:tasks.workunit.client.0.smithi196.stdout:6/567: dread d2/f2a [0,4194304] 0 2024-03-17T23:58:30.068 INFO:tasks.workunit.client.0.smithi196.stdout:1/456: dwrite d1/db/dd/d43/f4a [0,4194304] 0 2024-03-17T23:58:30.071 INFO:tasks.workunit.client.0.smithi196.stdout:6/568: getdents d2/d7/d9d 0 2024-03-17T23:58:30.072 INFO:tasks.workunit.client.0.smithi196.stdout:6/569: read d2/d14/d75/d7b/f3f [423427,85368] 0 2024-03-17T23:58:30.074 INFO:tasks.workunit.client.0.smithi196.stdout:6/570: readlink d2/d14/d42/d57/l31 0 2024-03-17T23:58:30.074 INFO:tasks.workunit.client.0.smithi196.stdout:7/671: dread da/d3e/d7f/fb2 [0,4194304] 0 2024-03-17T23:58:30.076 INFO:tasks.workunit.client.0.smithi196.stdout:3/689: dwrite d7/d19/d26/d2b/d3c/d9e/f9f [0,4194304] 0 2024-03-17T23:58:30.076 INFO:tasks.workunit.client.0.smithi196.stdout:1/457: rename d1 to d1/db/dd/d34/d6a/d75/d92 22 2024-03-17T23:58:30.079 INFO:tasks.workunit.client.0.smithi196.stdout:3/690: chown d7/d19/d78/l84 2520625 1 2024-03-17T23:58:30.082 INFO:tasks.workunit.client.0.smithi196.stdout:7/672: truncate da/d3e/d45/d4f/d75/da8/d78/fcc 241704 0 2024-03-17T23:58:30.085 INFO:tasks.workunit.client.0.smithi196.stdout:1/458: truncate d1/db/fe 4779188 0 2024-03-17T23:58:30.086 INFO:tasks.workunit.client.0.smithi196.stdout:7/673: fdatasync da/d15/f25 0 2024-03-17T23:58:30.087 INFO:tasks.workunit.client.0.smithi196.stdout:3/691: getdents d7/d33/ddc 0 2024-03-17T23:58:30.088 INFO:tasks.workunit.client.0.smithi196.stdout:4/531: dread d1/d1b/d77/f83 [0,4194304] 0 2024-03-17T23:58:30.089 INFO:tasks.workunit.client.0.smithi196.stdout:7/674: stat da/d15/d1d/d4c/c64 0 2024-03-17T23:58:30.094 INFO:tasks.workunit.client.0.smithi196.stdout:1/459: unlink d1/d13/d4c/f61 0 2024-03-17T23:58:30.095 INFO:tasks.workunit.client.0.smithi196.stdout:3/692: read - d7/d19/fa2 zero size 2024-03-17T23:58:30.095 INFO:tasks.workunit.client.0.smithi196.stdout:6/571: dwrite d2/f41 [0,4194304] 0 2024-03-17T23:58:30.096 INFO:tasks.workunit.client.0.smithi196.stdout:4/532: mknod d1/d26/d33/d40/cc3 0 2024-03-17T23:58:30.098 INFO:tasks.workunit.client.0.smithi196.stdout:1/460: write d1/d13/d23/d47/d48/f79 [708883,99920] 0 2024-03-17T23:58:30.099 INFO:tasks.workunit.client.0.smithi196.stdout:3/693: chown d7/d19/d26/d2b/d3c 6 1 2024-03-17T23:58:30.099 INFO:tasks.workunit.client.0.smithi196.stdout:4/533: write d1/de/d50/f9e [332045,42506] 0 2024-03-17T23:58:30.099 INFO:tasks.workunit.client.0.smithi196.stdout:6/572: read - d2/d14/d35/d63/f6c zero size 2024-03-17T23:58:30.100 INFO:tasks.workunit.client.0.smithi196.stdout:7/675: write da/d15/d1d/f2c [2119416,118037] 0 2024-03-17T23:58:30.103 INFO:tasks.workunit.client.0.smithi196.stdout:7/676: chown da/d3e/d45/d4f/d75/da8/d78/d9f/fcd 6 1 2024-03-17T23:58:30.109 INFO:tasks.workunit.client.0.smithi196.stdout:3/694: rmdir d7/d19/d78 39 2024-03-17T23:58:30.110 INFO:tasks.workunit.client.0.smithi196.stdout:4/534: rmdir d1/d26/d33 39 2024-03-17T23:58:30.111 INFO:tasks.workunit.client.0.smithi196.stdout:7/677: unlink da/d15/d1d/d4c/f9d 0 2024-03-17T23:58:30.114 INFO:tasks.workunit.client.0.smithi196.stdout:6/573: dwrite d2/d14/fb7 [0,4194304] 0 2024-03-17T23:58:30.115 INFO:tasks.workunit.client.0.smithi196.stdout:7/678: chown da/d3e/d45/d4f/d75/da8/lc2 179503 1 2024-03-17T23:58:30.121 INFO:tasks.workunit.client.0.smithi196.stdout:1/461: rename d1/db/dd/f38 to d1/db/dd/f93 0 2024-03-17T23:58:30.123 INFO:tasks.workunit.client.0.smithi196.stdout:3/695: chown d7/d19/d26/d48/d4d/l62 1453 1 2024-03-17T23:58:30.126 INFO:tasks.workunit.client.0.smithi196.stdout:4/535: dread d1/d26/d33/d3f/f7a [0,4194304] 0 2024-03-17T23:58:30.137 INFO:tasks.workunit.client.0.smithi196.stdout:7/679: creat da/d3e/d45/d4f/d75/da8/d78/d9f/fe9 x:0 0 0 2024-03-17T23:58:30.138 INFO:tasks.workunit.client.0.smithi196.stdout:7/680: write da/d3e/d6d/ddf/f99 [1046298,44590] 0 2024-03-17T23:58:30.139 INFO:tasks.workunit.client.0.smithi196.stdout:3/696: mknod d7/d19/d78/cdf 0 2024-03-17T23:58:30.144 INFO:tasks.workunit.client.0.smithi196.stdout:6/574: rename d2/d14/d35/d63/c21 to d2/d14/d75/cc9 0 2024-03-17T23:58:30.144 INFO:tasks.workunit.client.0.smithi196.stdout:3/697: truncate f6 1392311 0 2024-03-17T23:58:30.146 INFO:tasks.workunit.client.0.smithi196.stdout:3/698: chown d7/fb 364343 1 2024-03-17T23:58:30.148 INFO:tasks.workunit.client.0.smithi196.stdout:6/575: symlink d2/d66/lca 0 2024-03-17T23:58:30.151 INFO:tasks.workunit.client.0.smithi196.stdout:1/462: getdents d1/db/dd 0 2024-03-17T23:58:30.152 INFO:tasks.workunit.client.0.smithi196.stdout:3/699: rmdir d7/d19/d26/d2b/d3c/d9e 39 2024-03-17T23:58:30.153 INFO:tasks.workunit.client.0.smithi196.stdout:1/463: chown d1/d13/d23/d47/d48/d74/f84 32 1 2024-03-17T23:58:30.154 INFO:tasks.workunit.client.0.smithi196.stdout:6/576: creat d2/d14/d42/d57/dc8/db3/fcb x:0 0 0 2024-03-17T23:58:30.155 INFO:tasks.workunit.client.0.smithi196.stdout:4/536: dread d1/d26/d33/d40/da1/fc1 [0,4194304] 0 2024-03-17T23:58:30.156 INFO:tasks.workunit.client.0.smithi196.stdout:4/537: readlink d1/de/d50/l99 0 2024-03-17T23:58:30.156 INFO:tasks.workunit.client.0.smithi196.stdout:4/538: readlink d1/d26/l7d 0 2024-03-17T23:58:30.157 INFO:tasks.workunit.client.0.smithi196.stdout:4/539: stat d1/d1b/l3c 0 2024-03-17T23:58:30.160 INFO:tasks.workunit.client.0.smithi196.stdout:1/464: chown d1/db/f1f 694196 1 2024-03-17T23:58:30.165 INFO:tasks.workunit.client.0.smithi196.stdout:3/700: dwrite d7/d19/d26/d2b/d3c/f76 [0,4194304] 0 2024-03-17T23:58:30.168 INFO:tasks.workunit.client.0.smithi196.stdout:7/681: dread da/d3e/d7f/fbc [0,4194304] 0 2024-03-17T23:58:30.175 INFO:tasks.workunit.client.0.smithi196.stdout:6/577: mkdir d2/d14/dcc 0 2024-03-17T23:58:30.175 INFO:tasks.workunit.client.0.smithi196.stdout:1/465: mkdir d1/d13/d2a/d94 0 2024-03-17T23:58:30.176 INFO:tasks.workunit.client.0.smithi196.stdout:6/578: chown d2/d14/d35 0 1 2024-03-17T23:58:30.177 INFO:tasks.workunit.client.0.smithi196.stdout:1/466: read d1/f7c [507805,14378] 0 2024-03-17T23:58:30.178 INFO:tasks.workunit.client.0.smithi196.stdout:4/540: creat d1/d26/fc4 x:0 0 0 2024-03-17T23:58:30.178 INFO:tasks.workunit.client.0.smithi196.stdout:1/467: stat d1/db/dd/d34/d6a/d75/f7d 0 2024-03-17T23:58:30.179 INFO:tasks.workunit.client.0.smithi196.stdout:6/579: fdatasync d2/d7/d9d/f5a 0 2024-03-17T23:58:30.184 INFO:tasks.workunit.client.0.smithi196.stdout:1/468: symlink d1/db/dd/d43/l95 0 2024-03-17T23:58:30.186 INFO:tasks.workunit.client.0.smithi196.stdout:1/469: read d1/db/dd/d43/f4a [1634114,72332] 0 2024-03-17T23:58:30.188 INFO:tasks.workunit.client.0.smithi196.stdout:4/541: rename d1/de/cb9 to d1/d26/d57/dac/db2/cc5 0 2024-03-17T23:58:30.188 INFO:tasks.workunit.client.0.smithi196.stdout:3/701: write d7/ff [2637535,4437] 0 2024-03-17T23:58:30.191 INFO:tasks.workunit.client.0.smithi196.stdout:4/542: symlink d1/d11/lc6 0 2024-03-17T23:58:30.191 INFO:tasks.workunit.client.0.smithi196.stdout:1/470: truncate d1/db/dd/f56 17343 0 2024-03-17T23:58:30.192 INFO:tasks.workunit.client.0.smithi196.stdout:4/543: fsync d1/de/d50/f9e 0 2024-03-17T23:58:30.193 INFO:tasks.workunit.client.0.smithi196.stdout:1/471: write d1/db/dd/f72 [3116058,85899] 0 2024-03-17T23:58:30.195 INFO:tasks.workunit.client.0.smithi196.stdout:4/544: write d1/d26/d33/d40/fad [1233084,30037] 0 2024-03-17T23:58:30.199 INFO:tasks.workunit.client.0.smithi196.stdout:7/682: link da/d15/f25 da/d3e/d45/d4f/d75/fea 0 2024-03-17T23:58:30.202 INFO:tasks.workunit.client.0.smithi196.stdout:3/702: fdatasync d7/f2c 0 2024-03-17T23:58:30.202 INFO:tasks.workunit.client.0.smithi196.stdout:4/545: dread d1/d1b/d77/f90 [0,4194304] 0 2024-03-17T23:58:30.204 INFO:tasks.workunit.client.0.smithi196.stdout:3/703: chown d7/d33/f49 331426729 1 2024-03-17T23:58:30.205 INFO:tasks.workunit.client.0.smithi196.stdout:6/580: dread d2/d7/d9d/fbe [0,4194304] 0 2024-03-17T23:58:30.205 INFO:tasks.workunit.client.0.smithi196.stdout:7/683: fdatasync da/d3e/d45/d4f/d75/da8/f59 0 2024-03-17T23:58:30.209 INFO:tasks.workunit.client.0.smithi196.stdout:3/704: truncate d7/f80 437225 0 2024-03-17T23:58:30.211 INFO:tasks.workunit.client.0.smithi196.stdout:6/581: mkdir d2/d7/dcd 0 2024-03-17T23:58:30.212 INFO:tasks.workunit.client.0.smithi196.stdout:7/684: creat da/d3e/d7f/dc6/feb x:0 0 0 2024-03-17T23:58:30.215 INFO:tasks.workunit.client.0.smithi196.stdout:3/705: unlink d7/d29/f94 0 2024-03-17T23:58:30.216 INFO:tasks.workunit.client.0.smithi196.stdout:6/582: symlink d2/d14/d75/d92/lce 0 2024-03-17T23:58:30.218 INFO:tasks.workunit.client.0.smithi196.stdout:7/685: unlink da/d15/d1d/f2c 0 2024-03-17T23:58:30.219 INFO:tasks.workunit.client.0.smithi196.stdout:3/706: mkdir d7/d19/d78/d8b/de0 0 2024-03-17T23:58:30.219 INFO:tasks.workunit.client.0.smithi196.stdout:1/472: dwrite d1/f8 [0,4194304] 0 2024-03-17T23:58:30.222 INFO:tasks.workunit.client.0.smithi196.stdout:4/546: rename d1/d26/d33/d3f/c62 to d1/cc7 0 2024-03-17T23:58:30.222 INFO:tasks.workunit.client.0.smithi196.stdout:6/583: symlink d2/d14/d42/d57/d5f/lcf 0 2024-03-17T23:58:30.224 INFO:tasks.workunit.client.0.smithi196.stdout:1/473: mknod d1/d13/d23/d62/c96 0 2024-03-17T23:58:30.225 INFO:tasks.workunit.client.0.smithi196.stdout:3/707: mknod d7/d19/d26/d48/ce1 0 2024-03-17T23:58:30.226 INFO:tasks.workunit.client.0.smithi196.stdout:4/547: mkdir d1/d1b/d77/dc8 0 2024-03-17T23:58:30.227 INFO:tasks.workunit.client.0.smithi196.stdout:3/708: dread d7/d29/d9b/fa3 [0,4194304] 0 2024-03-17T23:58:30.227 INFO:tasks.workunit.client.0.smithi196.stdout:6/584: mknod d2/d66/d90/cd0 0 2024-03-17T23:58:30.228 INFO:tasks.workunit.client.0.smithi196.stdout:7/686: truncate da/d15/d1d/d4c/f61 694967 0 2024-03-17T23:58:30.230 INFO:tasks.workunit.client.0.smithi196.stdout:1/474: mknod d1/db/c97 0 2024-03-17T23:58:30.231 INFO:tasks.workunit.client.0.smithi196.stdout:1/475: chown d1/d13/d91 2747 1 2024-03-17T23:58:30.232 INFO:tasks.workunit.client.0.smithi196.stdout:6/585: creat d2/d14/d75/d92/fd1 x:0 0 0 2024-03-17T23:58:30.233 INFO:tasks.workunit.client.0.smithi196.stdout:6/586: read - d2/d7/d9d/f76 zero size 2024-03-17T23:58:30.234 INFO:tasks.workunit.client.0.smithi196.stdout:7/687: dread da/d3e/d6d/ddf/f8d [0,4194304] 0 2024-03-17T23:58:30.236 INFO:tasks.workunit.client.0.smithi196.stdout:3/709: rename d7/d19/d26/d2b/d3c/d3d/d7d/l7f to d7/d19/d26/d2b/d3c/d3d/d99/le2 0 2024-03-17T23:58:30.237 INFO:tasks.workunit.client.0.smithi196.stdout:1/476: chown d1/db/c44 90818303 1 2024-03-17T23:58:30.237 INFO:tasks.workunit.client.0.smithi196.stdout:3/710: fdatasync d7/d19/d26/d48/d98/fa6 0 2024-03-17T23:58:30.238 INFO:tasks.workunit.client.0.smithi196.stdout:7/688: creat da/d3e/ddc/fec x:0 0 0 2024-03-17T23:58:30.240 INFO:tasks.workunit.client.0.smithi196.stdout:3/711: fsync d7/d19/d78/da9/faa 0 2024-03-17T23:58:30.241 INFO:tasks.workunit.client.0.smithi196.stdout:7/689: write da/d15/d1a/d5e/da5/fc8 [994723,128865] 0 2024-03-17T23:58:30.241 INFO:tasks.workunit.client.0.smithi196.stdout:1/477: write d1/d13/d23/d47/d48/f54 [365608,76547] 0 2024-03-17T23:58:30.242 INFO:tasks.workunit.client.0.smithi196.stdout:3/712: fsync d7/d19/d78/f95 0 2024-03-17T23:58:30.248 INFO:tasks.workunit.client.0.smithi196.stdout:1/478: creat d1/db/dd/d43/f98 x:0 0 0 2024-03-17T23:58:30.248 INFO:tasks.workunit.client.0.smithi196.stdout:7/690: creat da/d3e/d45/d4f/fed x:0 0 0 2024-03-17T23:58:30.250 INFO:tasks.workunit.client.0.smithi196.stdout:4/548: dread d1/de/f4b [0,4194304] 0 2024-03-17T23:58:30.250 INFO:tasks.workunit.client.0.smithi196.stdout:1/479: write d1/f9 [2663690,128818] 0 2024-03-17T23:58:30.254 INFO:tasks.workunit.client.0.smithi196.stdout:7/691: write da/d15/d1a/d5e/da5/fc8 [811968,120581] 0 2024-03-17T23:58:30.254 INFO:tasks.workunit.client.0.smithi196.stdout:1/480: write d1/f4 [112022,115556] 0 2024-03-17T23:58:30.254 INFO:tasks.workunit.client.0.smithi196.stdout:3/713: getdents d7/d19/d26/d2b/d3c/d9e 0 2024-03-17T23:58:30.254 INFO:tasks.workunit.client.0.smithi196.stdout:7/692: dread da/d3e/fdb [0,4194304] 0 2024-03-17T23:58:30.255 INFO:tasks.workunit.client.0.smithi196.stdout:1/481: chown d1/c78 216 1 2024-03-17T23:58:30.259 INFO:tasks.workunit.client.0.smithi196.stdout:1/482: symlink d1/d13/d23/d47/d48/d7e/l99 0 2024-03-17T23:58:30.265 INFO:tasks.workunit.client.0.smithi196.stdout:3/714: dwrite d7/d19/d26/d2b/d3c/d3d/f6a [4194304,4194304] 0 2024-03-17T23:58:30.266 INFO:tasks.workunit.client.0.smithi196.stdout:1/483: symlink d1/l9a 0 2024-03-17T23:58:30.271 INFO:tasks.workunit.client.0.smithi196.stdout:1/484: mknod d1/db/dd/d34/c9b 0 2024-03-17T23:58:30.273 INFO:tasks.workunit.client.0.smithi196.stdout:1/485: truncate d1/d13/d2a/f90 313784 0 2024-03-17T23:58:30.273 INFO:tasks.workunit.client.0.smithi196.stdout:7/693: dread da/d15/f8c [0,4194304] 0 2024-03-17T23:58:30.290 INFO:tasks.workunit.client.0.smithi196.stdout:1/486: dread d1/f25 [4194304,4194304] 0 2024-03-17T23:58:30.340 INFO:tasks.workunit.client.0.smithi196.stdout:9/588: sync 2024-03-17T23:58:30.340 INFO:tasks.workunit.client.0.smithi196.stdout:2/667: sync 2024-03-17T23:58:30.340 INFO:tasks.workunit.client.0.smithi196.stdout:5/519: sync 2024-03-17T23:58:30.342 INFO:tasks.workunit.client.0.smithi196.stdout:9/589: dread - d9/d38/f76 zero size 2024-03-17T23:58:30.343 INFO:tasks.workunit.client.0.smithi196.stdout:3/715: getdents d7/d19/d26/d2b/d3c/d3d/d99 0 2024-03-17T23:58:30.344 INFO:tasks.workunit.client.0.smithi196.stdout:2/668: chown d17/d1f/cdf 4444714 1 2024-03-17T23:58:30.344 INFO:tasks.workunit.client.0.smithi196.stdout:5/520: mkdir d6/d17/d3f/d4e/d69/daf 0 2024-03-17T23:58:30.345 INFO:tasks.workunit.client.0.smithi196.stdout:7/694: mknod da/d3e/d45/d4f/d75/de7/cee 0 2024-03-17T23:58:30.346 INFO:tasks.workunit.client.0.smithi196.stdout:1/487: symlink d1/l9c 0 2024-03-17T23:58:30.348 INFO:tasks.workunit.client.0.smithi196.stdout:7/695: chown da/d3e/d45/dd8/de4/f66 32 1 2024-03-17T23:58:30.350 INFO:tasks.workunit.client.0.smithi196.stdout:2/669: symlink d17/d68/lfc 0 2024-03-17T23:58:30.350 INFO:tasks.workunit.client.0.smithi196.stdout:5/521: creat d6/d17/d23/d53/d97/fb0 x:0 0 0 2024-03-17T23:58:30.352 INFO:tasks.workunit.client.0.smithi196.stdout:9/590: link d9/d38/d60/d5e/f56 d9/d38/d60/d85/d8e/fb8 0 2024-03-17T23:58:30.354 INFO:tasks.workunit.client.0.smithi196.stdout:2/670: unlink d17/d19/d44/fcb 0 2024-03-17T23:58:30.358 INFO:tasks.workunit.client.0.smithi196.stdout:7/696: creat da/d3e/d45/d4f/fef x:0 0 0 2024-03-17T23:58:30.358 INFO:tasks.workunit.client.0.smithi196.stdout:3/716: link d7/d29/c34 d7/d19/d26/ce3 0 2024-03-17T23:58:30.358 INFO:tasks.workunit.client.0.smithi196.stdout:1/488: dwrite d1/d13/d23/f49 [0,4194304] 0 2024-03-17T23:58:30.359 INFO:tasks.workunit.client.0.smithi196.stdout:5/522: creat d6/d17/d1f/d7d/d89/fb1 x:0 0 0 2024-03-17T23:58:30.362 INFO:tasks.workunit.client.0.smithi196.stdout:9/591: link d9/df/d4a/f80 d9/d38/d60/d5e/fb9 0 2024-03-17T23:58:30.366 INFO:tasks.workunit.client.0.smithi196.stdout:1/489: mknod d1/d13/d23/d47/d48/c9d 0 2024-03-17T23:58:30.369 INFO:tasks.workunit.client.0.smithi196.stdout:9/592: write d9/df/d4a/d5b/d62/f7a [1242261,50752] 0 2024-03-17T23:58:30.372 INFO:tasks.workunit.client.0.smithi196.stdout:2/671: dwrite d17/d28/d30/d72/fb2 [0,4194304] 0 2024-03-17T23:58:30.378 INFO:tasks.workunit.client.0.smithi196.stdout:2/672: write d17/d22/d3d/f53 [1810074,74605] 0 2024-03-17T23:58:30.381 INFO:tasks.workunit.client.0.smithi196.stdout:5/523: dwrite d6/d2d/f96 [4194304,4194304] 0 2024-03-17T23:58:30.382 INFO:tasks.workunit.client.0.smithi196.stdout:7/697: dwrite da/d3e/d45/dd8/de4/f67 [0,4194304] 0 2024-03-17T23:58:30.385 INFO:tasks.workunit.client.0.smithi196.stdout:3/717: link d7/d19/d78/dca/lcb d7/d19/d78/da9/le4 0 2024-03-17T23:58:30.386 INFO:tasks.workunit.client.0.smithi196.stdout:3/718: chown d7/c8a 8977260 1 2024-03-17T23:58:30.389 INFO:tasks.workunit.client.0.smithi196.stdout:1/490: symlink d1/d13/d23/d47/d48/d74/l9e 0 2024-03-17T23:58:30.389 INFO:tasks.workunit.client.0.smithi196.stdout:2/673: creat d17/d28/d30/d71/de0/ffd x:0 0 0 2024-03-17T23:58:30.390 INFO:tasks.workunit.client.0.smithi196.stdout:7/698: unlink da/d3e/d45/d4f/d75/da8/d78/d81/f92 0 2024-03-17T23:58:30.391 INFO:tasks.workunit.client.0.smithi196.stdout:9/593: dread d9/d12/d59/f65 [0,4194304] 0 2024-03-17T23:58:30.394 INFO:tasks.workunit.client.0.smithi196.stdout:1/491: readlink d1/db/l53 0 2024-03-17T23:58:30.396 INFO:tasks.workunit.client.0.smithi196.stdout:1/492: write d1/d13/f18 [3832707,124029] 0 2024-03-17T23:58:30.397 INFO:tasks.workunit.client.0.smithi196.stdout:7/699: rmdir da/d15/d1a 39 2024-03-17T23:58:30.397 INFO:tasks.workunit.client.0.smithi196.stdout:3/719: rename f6 to d7/d19/d26/d2b/d3c/d3d/d99/fe5 0 2024-03-17T23:58:30.398 INFO:tasks.workunit.client.0.smithi196.stdout:5/524: dread d6/d2d/f55 [0,4194304] 0 2024-03-17T23:58:30.399 INFO:tasks.workunit.client.0.smithi196.stdout:5/525: write d6/f10 [3581345,31897] 0 2024-03-17T23:58:30.405 INFO:tasks.workunit.client.0.smithi196.stdout:3/720: dwrite d7/d33/f49 [0,4194304] 0 2024-03-17T23:58:30.408 INFO:tasks.workunit.client.0.smithi196.stdout:2/674: link d17/d22/d3d/d8f/f9f d17/d28/d30/d71/ffe 0 2024-03-17T23:58:30.413 INFO:tasks.workunit.client.0.smithi196.stdout:5/526: creat d6/d17/d1f/d7d/fb2 x:0 0 0 2024-03-17T23:58:30.414 INFO:tasks.workunit.client.0.smithi196.stdout:5/527: dread - d6/d17/d1f/f75 zero size 2024-03-17T23:58:30.417 INFO:tasks.workunit.client.0.smithi196.stdout:1/493: mknod d1/d13/d91/c9f 0 2024-03-17T23:58:30.418 INFO:tasks.workunit.client.0.smithi196.stdout:3/721: creat d7/d19/d78/da9/fe6 x:0 0 0 2024-03-17T23:58:30.421 INFO:tasks.workunit.client.0.smithi196.stdout:9/594: truncate d9/fd 10021046 0 2024-03-17T23:58:30.421 INFO:tasks.workunit.client.0.smithi196.stdout:7/700: write da/d15/d1d/f2d [2919623,40507] 0 2024-03-17T23:58:30.423 INFO:tasks.workunit.client.0.smithi196.stdout:5/528: unlink d6/l7 0 2024-03-17T23:58:30.424 INFO:tasks.workunit.client.0.smithi196.stdout:1/494: dread - d1/d13/f6c zero size 2024-03-17T23:58:30.424 INFO:tasks.workunit.client.0.smithi196.stdout:7/701: write da/d3e/d6d/ddf/f99 [613987,32326] 0 2024-03-17T23:58:30.426 INFO:tasks.workunit.client.0.smithi196.stdout:2/675: rename d17/c2c to d17/d28/d96/cff 0 2024-03-17T23:58:30.429 INFO:tasks.workunit.client.0.smithi196.stdout:3/722: mkdir d7/d19/d26/de7 0 2024-03-17T23:58:30.429 INFO:tasks.workunit.client.0.smithi196.stdout:7/702: fdatasync da/d15/d1a/d5e/d70/f9a 0 2024-03-17T23:58:30.430 INFO:tasks.workunit.client.0.smithi196.stdout:1/495: mkdir d1/d13/d4c/da0 0 2024-03-17T23:58:30.436 INFO:tasks.workunit.client.0.smithi196.stdout:9/595: dwrite d9/df/d14/f72 [0,4194304] 0 2024-03-17T23:58:30.436 INFO:tasks.workunit.client.0.smithi196.stdout:1/496: mkdir d1/db/dd/d43/da1 0 2024-03-17T23:58:30.438 INFO:tasks.workunit.client.0.smithi196.stdout:3/723: dread d7/d19/d26/d2b/d3c/d3d/f43 [0,4194304] 0 2024-03-17T23:58:30.442 INFO:tasks.workunit.client.0.smithi196.stdout:3/724: truncate d7/d19/d26/d48/fcc 815417 0 2024-03-17T23:58:30.442 INFO:tasks.workunit.client.0.smithi196.stdout:3/725: fsync d7/f11 0 2024-03-17T23:58:30.443 INFO:tasks.workunit.client.0.smithi196.stdout:3/726: write d7/d19/d78/da9/faa [989596,79841] 0 2024-03-17T23:58:30.445 INFO:tasks.workunit.client.0.smithi196.stdout:2/676: write d17/d22/d3d/d8f/f9f [103545,38068] 0 2024-03-17T23:58:30.446 INFO:tasks.workunit.client.0.smithi196.stdout:7/703: dwrite da/fa6 [0,4194304] 0 2024-03-17T23:58:30.453 INFO:tasks.workunit.client.0.smithi196.stdout:2/677: fsync d17/ff7 0 2024-03-17T23:58:30.454 INFO:tasks.workunit.client.0.smithi196.stdout:5/529: getdents d6/d17/d3f/d4e/d69 0 2024-03-17T23:58:30.454 INFO:tasks.workunit.client.0.smithi196.stdout:2/678: chown d17/d22/c55 29 1 2024-03-17T23:58:30.454 INFO:tasks.workunit.client.0.smithi196.stdout:2/679: chown d17/d19/l26 1887056 1 2024-03-17T23:58:30.454 INFO:tasks.workunit.client.0.smithi196.stdout:2/680: write d17/d19/f1d [4719633,56435] 0 2024-03-17T23:58:30.454 INFO:tasks.workunit.client.0.smithi196.stdout:7/704: mkdir da/d3e/d7f/dc6/df0 0 2024-03-17T23:58:30.458 INFO:tasks.workunit.client.0.smithi196.stdout:1/497: creat d1/db/fa2 x:0 0 0 2024-03-17T23:58:30.460 INFO:tasks.workunit.client.0.smithi196.stdout:9/596: write d9/d12/d59/f7d [1003496,88090] 0 2024-03-17T23:58:30.462 INFO:tasks.workunit.client.0.smithi196.stdout:1/498: truncate d1/db/dd/d34/f8a 559031 0 2024-03-17T23:58:30.464 INFO:tasks.workunit.client.0.smithi196.stdout:7/705: rename da/d3e/d7f/dc6/ce8 to da/d3e/d45/d4f/d75/da8/d78/cf1 0 2024-03-17T23:58:30.467 INFO:tasks.workunit.client.0.smithi196.stdout:5/530: dread f4 [0,4194304] 0 2024-03-17T23:58:30.468 INFO:tasks.workunit.client.0.smithi196.stdout:7/706: write da/d3e/d45/d4f/d75/da8/d78/d9f/fe9 [1024658,121373] 0 2024-03-17T23:58:30.470 INFO:tasks.workunit.client.0.smithi196.stdout:1/499: mknod d1/d13/d23/d62/ca3 0 2024-03-17T23:58:30.471 INFO:tasks.workunit.client.0.smithi196.stdout:9/597: rename d9/d38 to d9/df/d4a/d5b/d62/dba 0 2024-03-17T23:58:30.473 INFO:tasks.workunit.client.0.smithi196.stdout:9/598: truncate d9/df/d14/d3d/f8b 1353039 0 2024-03-17T23:58:30.474 INFO:tasks.workunit.client.0.smithi196.stdout:7/707: chown da/c22 523123077 1 2024-03-17T23:58:30.475 INFO:tasks.workunit.client.0.smithi196.stdout:5/531: unlink d6/d17/d3f/d4e/d69/c9a 0 2024-03-17T23:58:30.475 INFO:tasks.workunit.client.0.smithi196.stdout:7/708: dread - da/d15/d1d/d4c/fce zero size 2024-03-17T23:58:30.477 INFO:tasks.workunit.client.0.smithi196.stdout:1/500: unlink d1/d13/f18 0 2024-03-17T23:58:30.478 INFO:tasks.workunit.client.0.smithi196.stdout:5/532: write d6/d17/d1f/d7d/d81/f8c [571578,109613] 0 2024-03-17T23:58:30.481 INFO:tasks.workunit.client.0.smithi196.stdout:7/709: write da/d3e/d45/d4f/d75/fd1 [783339,13536] 0 2024-03-17T23:58:30.481 INFO:tasks.workunit.client.0.smithi196.stdout:9/599: mkdir d9/dbb 0 2024-03-17T23:58:30.483 INFO:tasks.workunit.client.0.smithi196.stdout:3/727: dread d7/f16 [0,4194304] 0 2024-03-17T23:58:30.484 INFO:tasks.workunit.client.0.smithi196.stdout:1/501: unlink d1/db/dd/d34/d6a/d75/f8b 0 2024-03-17T23:58:30.486 INFO:tasks.workunit.client.0.smithi196.stdout:1/502: truncate d1/f85 657981 0 2024-03-17T23:58:30.487 INFO:tasks.workunit.client.0.smithi196.stdout:2/681: dread d17/d19/d93/fc8 [0,4194304] 0 2024-03-17T23:58:30.488 INFO:tasks.workunit.client.0.smithi196.stdout:5/533: truncate d6/d17/d35/f4f 1967455 0 2024-03-17T23:58:30.488 INFO:tasks.workunit.client.0.smithi196.stdout:2/682: stat d17/d28/d30/d72/fb3 0 2024-03-17T23:58:30.489 INFO:tasks.workunit.client.0.smithi196.stdout:3/728: write d7/d19/d26/d2b/f42 [1283742,109727] 0 2024-03-17T23:58:30.491 INFO:tasks.workunit.client.0.smithi196.stdout:3/729: readlink d7/d19/d26/d2b/d3c/l86 0 2024-03-17T23:58:30.495 INFO:tasks.workunit.client.0.smithi196.stdout:7/710: write da/d3e/d7f/fb2 [2405746,90189] 0 2024-03-17T23:58:30.497 INFO:tasks.workunit.client.0.smithi196.stdout:9/600: unlink d9/df/d4a/d5b/d62/dba/d60/d85/d8e/d99/laf 0 2024-03-17T23:58:30.500 INFO:tasks.workunit.client.0.smithi196.stdout:2/683: dwrite d17/d22/d3d/d8f/fa5 [0,4194304] 0 2024-03-17T23:58:30.501 INFO:tasks.workunit.client.0.smithi196.stdout:3/730: creat d7/d19/d78/d8b/fe8 x:0 0 0 2024-03-17T23:58:30.502 INFO:tasks.workunit.client.0.smithi196.stdout:1/503: write d1/d13/d23/d47/f52 [4812918,114934] 0 2024-03-17T23:58:30.503 INFO:tasks.workunit.client.0.smithi196.stdout:8/431: sync 2024-03-17T23:58:30.503 INFO:tasks.workunit.client.0.smithi196.stdout:0/716: sync 2024-03-17T23:58:30.507 INFO:tasks.workunit.client.0.smithi196.stdout:9/601: creat d9/df/d4a/d5b/d6d/da8/fbc x:0 0 0 2024-03-17T23:58:30.512 INFO:tasks.workunit.client.0.smithi196.stdout:0/717: write d5/f13 [3749053,100624] 0 2024-03-17T23:58:30.512 INFO:tasks.workunit.client.0.smithi196.stdout:2/684: write d17/d28/d30/d71/f88 [1859776,24606] 0 2024-03-17T23:58:30.512 INFO:tasks.workunit.client.0.smithi196.stdout:3/731: creat d7/d19/d26/d2b/fe9 x:0 0 0 2024-03-17T23:58:30.513 INFO:tasks.workunit.client.0.smithi196.stdout:7/711: dread da/d3e/d45/d4f/d75/da8/f88 [0,4194304] 0 2024-03-17T23:58:30.513 INFO:tasks.workunit.client.0.smithi196.stdout:1/504: fdatasync d1/d13/f3c 0 2024-03-17T23:58:30.514 INFO:tasks.workunit.client.0.smithi196.stdout:5/534: getdents d6/d17/d23/d53 0 2024-03-17T23:58:30.515 INFO:tasks.workunit.client.0.smithi196.stdout:1/505: stat d1/d13/f3b 0 2024-03-17T23:58:30.517 INFO:tasks.workunit.client.0.smithi196.stdout:3/732: truncate d7/f2c 860637 0 2024-03-17T23:58:30.518 INFO:tasks.workunit.client.0.smithi196.stdout:0/718: write d5/d23/d24/d28/f37 [5412620,99184] 0 2024-03-17T23:58:30.521 INFO:tasks.workunit.client.0.smithi196.stdout:9/602: write d9/f4e [248044,113642] 0 2024-03-17T23:58:30.522 INFO:tasks.workunit.client.0.smithi196.stdout:5/535: creat d6/d2a/fb3 x:0 0 0 2024-03-17T23:58:30.525 INFO:tasks.workunit.client.0.smithi196.stdout:1/506: write d1/db/dd/f93 [1268263,111247] 0 2024-03-17T23:58:30.525 INFO:tasks.workunit.client.0.smithi196.stdout:3/733: creat d7/d29/d9b/fea x:0 0 0 2024-03-17T23:58:30.526 INFO:tasks.workunit.client.0.smithi196.stdout:8/432: link de/d2b/d3c/d5d/d65/c72 de/d2b/d3c/d5d/c84 0 2024-03-17T23:58:30.526 INFO:tasks.workunit.client.0.smithi196.stdout:0/719: chown d5/fa 172 1 2024-03-17T23:58:30.529 INFO:tasks.workunit.client.0.smithi196.stdout:9/603: symlink d9/df/d4a/d5b/d6d/da8/lbd 0 2024-03-17T23:58:30.529 INFO:tasks.workunit.client.0.smithi196.stdout:5/536: rename d6/d17/d23/c36 to d6/d17/d23/cb4 0 2024-03-17T23:58:30.529 INFO:tasks.workunit.client.0.smithi196.stdout:0/720: rmdir d5/d23/d24/d28/d47/d52/d61/d6c/d82 39 2024-03-17T23:58:30.532 INFO:tasks.workunit.client.0.smithi196.stdout:7/712: link da/l42 da/d3e/d45/d4f/d85/lf2 0 2024-03-17T23:58:30.534 INFO:tasks.workunit.client.0.smithi196.stdout:3/734: creat d7/d19/d26/d2b/dcd/feb x:0 0 0 2024-03-17T23:58:30.536 INFO:tasks.workunit.client.0.smithi196.stdout:0/721: creat d5/d23/fdd x:0 0 0 2024-03-17T23:58:30.537 INFO:tasks.workunit.client.0.smithi196.stdout:2/685: dread d17/d28/fc6 [0,4194304] 0 2024-03-17T23:58:30.542 INFO:tasks.workunit.client.0.smithi196.stdout:1/507: truncate d1/f4 362685 0 2024-03-17T23:58:30.543 INFO:tasks.workunit.client.0.smithi196.stdout:8/433: creat de/f85 x:0 0 0 2024-03-17T23:58:30.543 INFO:tasks.workunit.client.0.smithi196.stdout:3/735: dwrite d7/d19/d78/dca/fd4 [4194304,4194304] 0 2024-03-17T23:58:30.546 INFO:tasks.workunit.client.0.smithi196.stdout:3/736: dread - d7/d19/d26/d48/d4d/dd9/fc5 zero size 2024-03-17T23:58:30.548 INFO:tasks.workunit.client.0.smithi196.stdout:0/722: unlink d5/d23/f5c 0 2024-03-17T23:58:30.548 INFO:tasks.workunit.client.0.smithi196.stdout:3/737: write d7/d33/f49 [3106303,12016] 0 2024-03-17T23:58:30.554 INFO:tasks.workunit.client.0.smithi196.stdout:2/686: read d17/d28/d30/fcd [29515,28457] 0 2024-03-17T23:58:30.557 INFO:tasks.workunit.client.0.smithi196.stdout:3/738: chown d7/d19/d78/d93/lb4 129585539 1 2024-03-17T23:58:30.559 INFO:tasks.workunit.client.0.smithi196.stdout:8/434: dwrite de/d2b/d30/f73 [0,4194304] 0 2024-03-17T23:58:30.561 INFO:tasks.workunit.client.0.smithi196.stdout:5/537: link d6/d2d/c2e d6/d17/d1f/d7d/d81/cb5 0 2024-03-17T23:58:30.562 INFO:tasks.workunit.client.0.smithi196.stdout:2/687: dread d17/d19/d44/d52/f9b [0,4194304] 0 2024-03-17T23:58:30.564 INFO:tasks.workunit.client.0.smithi196.stdout:2/688: truncate d17/d22/d3d/d8f/fdc 675780 0 2024-03-17T23:58:30.570 INFO:tasks.workunit.client.0.smithi196.stdout:3/739: fdatasync d7/d19/d26/f2f 0 2024-03-17T23:58:30.570 INFO:tasks.workunit.client.0.smithi196.stdout:3/740: chown d7/d19/d78 2930 1 2024-03-17T23:58:30.571 INFO:tasks.workunit.client.0.smithi196.stdout:0/723: link d5/d23/d24/da3/dbb/fbe d5/d23/d24/d28/d47/fde 0 2024-03-17T23:58:30.572 INFO:tasks.workunit.client.0.smithi196.stdout:2/689: rmdir d17/d28 39 2024-03-17T23:58:30.575 INFO:tasks.workunit.client.0.smithi196.stdout:1/508: link d1/d13/d91/c9f d1/d13/d23/d62/d71/ca4 0 2024-03-17T23:58:30.576 INFO:tasks.workunit.client.0.smithi196.stdout:1/509: chown d1/d13/c2e 1757989082 1 2024-03-17T23:58:30.577 INFO:tasks.workunit.client.0.smithi196.stdout:8/435: link de/d10/f1a de/d10/d54/d5c/d81/f86 0 2024-03-17T23:58:30.578 INFO:tasks.workunit.client.0.smithi196.stdout:2/690: symlink d17/d22/d3d/d8f/l100 0 2024-03-17T23:58:30.578 INFO:tasks.workunit.client.0.smithi196.stdout:8/436: dread - de/f5b zero size 2024-03-17T23:58:30.581 INFO:tasks.workunit.client.0.smithi196.stdout:8/437: truncate de/d2b/d3c/f7f 171797 0 2024-03-17T23:58:30.582 INFO:tasks.workunit.client.0.smithi196.stdout:5/538: creat d6/d15/fb6 x:0 0 0 2024-03-17T23:58:30.583 INFO:tasks.workunit.client.0.smithi196.stdout:1/510: chown d1/d13/d23/d70/c83 68478855 1 2024-03-17T23:58:30.587 INFO:tasks.workunit.client.0.smithi196.stdout:1/511: write d1/d13/d23/d47/f52 [1719751,9570] 0 2024-03-17T23:58:30.590 INFO:tasks.workunit.client.0.smithi196.stdout:0/724: dwrite d5/d23/d24/d28/d47/d52/f3f [0,4194304] 0 2024-03-17T23:58:30.598 INFO:tasks.workunit.client.0.smithi196.stdout:5/539: symlink d6/d17/d3f/da5/lb7 0 2024-03-17T23:58:30.598 INFO:tasks.workunit.client.0.smithi196.stdout:2/691: rename d17/d22/da0/dc7/lf9 to d17/d22/d3d/l101 0 2024-03-17T23:58:30.598 INFO:tasks.workunit.client.0.smithi196.stdout:8/438: write de/d10/f1a [529003,8603] 0 2024-03-17T23:58:30.602 INFO:tasks.workunit.client.0.smithi196.stdout:3/741: dwrite d7/f2c [0,4194304] 0 2024-03-17T23:58:30.610 INFO:tasks.workunit.client.0.smithi196.stdout:1/512: dwrite d1/db/dd/d34/f86 [0,4194304] 0 2024-03-17T23:58:30.610 INFO:tasks.workunit.client.0.smithi196.stdout:0/725: mknod d5/d23/d24/d30/d4e/cdf 0 2024-03-17T23:58:30.610 INFO:tasks.workunit.client.0.smithi196.stdout:8/439: unlink de/d2b/d3c/d5d/l61 0 2024-03-17T23:58:30.610 INFO:tasks.workunit.client.0.smithi196.stdout:0/726: chown d5/d23/d24/d9f/cd2 322725 1 2024-03-17T23:58:30.612 INFO:tasks.workunit.client.0.smithi196.stdout:1/513: write d1/db/f15 [4389147,65884] 0 2024-03-17T23:58:30.612 INFO:tasks.workunit.client.0.smithi196.stdout:0/727: dread - d5/d23/d24/d59/d8b/fcf zero size 2024-03-17T23:58:30.612 INFO:tasks.workunit.client.0.smithi196.stdout:5/540: rmdir d6/d2d/d33/d3b/d80 39 2024-03-17T23:58:30.615 INFO:tasks.workunit.client.0.smithi196.stdout:1/514: fsync d1/db/dd/f56 0 2024-03-17T23:58:30.617 INFO:tasks.workunit.client.0.smithi196.stdout:8/440: creat de/d2b/f87 x:0 0 0 2024-03-17T23:58:30.618 INFO:tasks.workunit.client.0.smithi196.stdout:1/515: chown d1/d13/d23/d47/f52 14583307 1 2024-03-17T23:58:30.618 INFO:tasks.workunit.client.0.smithi196.stdout:0/728: rename d5/d23/d24/da8/fc5 to d5/d23/d24/d28/d47/d52/dac/fe0 0 2024-03-17T23:58:30.623 INFO:tasks.workunit.client.0.smithi196.stdout:0/729: symlink d5/d23/d24/d59/le1 0 2024-03-17T23:58:30.624 INFO:tasks.workunit.client.0.smithi196.stdout:2/692: write d17/d22/da0/f9e [789711,30607] 0 2024-03-17T23:58:30.625 INFO:tasks.workunit.client.0.smithi196.stdout:5/541: dwrite d6/d2a/fb3 [0,4194304] 0 2024-03-17T23:58:30.630 INFO:tasks.workunit.client.0.smithi196.stdout:1/516: creat d1/d13/d23/d47/d48/d74/fa5 x:0 0 0 2024-03-17T23:58:30.632 INFO:tasks.workunit.client.0.smithi196.stdout:1/517: dread - d1/d13/d23/d47/d48/d74/fa5 zero size 2024-03-17T23:58:30.633 INFO:tasks.workunit.client.0.smithi196.stdout:3/742: dread d7/fc [0,4194304] 0 2024-03-17T23:58:30.634 INFO:tasks.workunit.client.0.smithi196.stdout:1/518: write d1/db/f1f [2596447,46387] 0 2024-03-17T23:58:30.638 INFO:tasks.workunit.client.0.smithi196.stdout:2/693: symlink d17/d19/l102 0 2024-03-17T23:58:30.638 INFO:tasks.workunit.client.0.smithi196.stdout:2/694: dread - d17/fda zero size 2024-03-17T23:58:30.639 INFO:tasks.workunit.client.0.smithi196.stdout:3/743: mknod d7/d33/cec 0 2024-03-17T23:58:30.642 INFO:tasks.workunit.client.0.smithi196.stdout:8/441: getdents de/d5e 0 2024-03-17T23:58:30.643 INFO:tasks.workunit.client.0.smithi196.stdout:8/442: stat de/d2b/d30/d7c 0 2024-03-17T23:58:30.644 INFO:tasks.workunit.client.0.smithi196.stdout:6/587: sync 2024-03-17T23:58:30.647 INFO:tasks.workunit.client.0.smithi196.stdout:1/519: symlink d1/d13/d4c/da0/la6 0 2024-03-17T23:58:30.649 INFO:tasks.workunit.client.0.smithi196.stdout:2/695: write d17/d19/d44/fb1 [276833,84432] 0 2024-03-17T23:58:30.649 INFO:tasks.workunit.client.0.smithi196.stdout:5/542: dwrite d6/d17/d1f/f50 [0,4194304] 0 2024-03-17T23:58:30.652 INFO:tasks.workunit.client.0.smithi196.stdout:6/588: symlink d2/d14/d8c/ld2 0 2024-03-17T23:58:30.654 INFO:tasks.workunit.client.0.smithi196.stdout:0/730: dwrite d5/d23/d24/d28/f26 [0,4194304] 0 2024-03-17T23:58:30.658 INFO:tasks.workunit.client.0.smithi196.stdout:3/744: creat d7/d19/d26/d2b/d3c/d3d/d99/fed x:0 0 0 2024-03-17T23:58:30.659 INFO:tasks.workunit.client.0.smithi196.stdout:6/589: write d2/d14/d42/f8f [377363,109831] 0 2024-03-17T23:58:30.659 INFO:tasks.workunit.client.0.smithi196.stdout:8/443: mkdir de/d10/d35/d88 0 2024-03-17T23:58:30.660 INFO:tasks.workunit.client.0.smithi196.stdout:2/696: truncate d17/d19/d44/ff1 145610 0 2024-03-17T23:58:30.664 INFO:tasks.workunit.client.0.smithi196.stdout:0/731: read d5/d23/d24/d28/dc9/db0/fc1 [101165,15697] 0 2024-03-17T23:58:30.667 INFO:tasks.workunit.client.0.smithi196.stdout:0/732: fsync d5/d23/fb7 0 2024-03-17T23:58:30.667 INFO:tasks.workunit.client.0.smithi196.stdout:5/543: dwrite d6/d2d/f96 [4194304,4194304] 0 2024-03-17T23:58:30.669 INFO:tasks.workunit.client.0.smithi196.stdout:3/745: dread d7/fc [0,4194304] 0 2024-03-17T23:58:30.671 INFO:tasks.workunit.client.0.smithi196.stdout:3/746: stat d7/d19/d26/d2b/l46 0 2024-03-17T23:58:30.679 INFO:tasks.workunit.client.0.smithi196.stdout:1/520: truncate d1/db/dd/f72 3314068 0 2024-03-17T23:58:30.680 INFO:tasks.workunit.client.0.smithi196.stdout:0/733: dwrite d5/d23/d24/d59/d94/fb1 [0,4194304] 0 2024-03-17T23:58:30.682 INFO:tasks.workunit.client.0.smithi196.stdout:0/734: chown d5/d23/f33 436848 1 2024-03-17T23:58:30.682 INFO:tasks.workunit.client.0.smithi196.stdout:8/444: symlink de/d10/d35/d88/l89 0 2024-03-17T23:58:30.684 INFO:tasks.workunit.client.0.smithi196.stdout:3/747: mkdir d7/d19/d26/d2b/dee 0 2024-03-17T23:58:30.685 INFO:tasks.workunit.client.0.smithi196.stdout:0/735: write d5/d23/d24/d59/d94/fc8 [609070,64828] 0 2024-03-17T23:58:30.686 INFO:tasks.workunit.client.0.smithi196.stdout:2/697: dread f2 [0,4194304] 0 2024-03-17T23:58:30.687 INFO:tasks.workunit.client.0.smithi196.stdout:8/445: mknod de/d10/d43/c8a 0 2024-03-17T23:58:30.687 INFO:tasks.workunit.client.0.smithi196.stdout:0/736: dread - d5/d23/d24/fb6 zero size 2024-03-17T23:58:30.688 INFO:tasks.workunit.client.0.smithi196.stdout:5/544: mkdir d6/d2d/db8 0 2024-03-17T23:58:30.691 INFO:tasks.workunit.client.0.smithi196.stdout:1/521: creat d1/db/dd/d43/fa7 x:0 0 0 2024-03-17T23:58:30.694 INFO:tasks.workunit.client.0.smithi196.stdout:0/737: symlink d5/d23/d24/d59/d94/le2 0 2024-03-17T23:58:30.695 INFO:tasks.workunit.client.0.smithi196.stdout:6/590: dread d2/d14/f20 [0,4194304] 0 2024-03-17T23:58:30.695 INFO:tasks.workunit.client.0.smithi196.stdout:5/545: rmdir d6/d17/d1f 39 2024-03-17T23:58:30.698 INFO:tasks.workunit.client.0.smithi196.stdout:1/522: creat d1/d13/d23/d70/fa8 x:0 0 0 2024-03-17T23:58:30.701 INFO:tasks.workunit.client.0.smithi196.stdout:3/748: dread d7/d19/d26/d2b/d3c/f77 [0,4194304] 0 2024-03-17T23:58:30.702 INFO:tasks.workunit.client.0.smithi196.stdout:0/738: symlink d5/d23/d24/d59/d94/db5/le3 0 2024-03-17T23:58:30.704 INFO:tasks.workunit.client.0.smithi196.stdout:6/591: rename d2/d7/d9d to d2/d7/dcd/dd3 0 2024-03-17T23:58:30.707 INFO:tasks.workunit.client.0.smithi196.stdout:1/523: write d1/db/f14 [797393,61096] 0 2024-03-17T23:58:30.709 INFO:tasks.workunit.client.0.smithi196.stdout:2/698: rmdir d17/d22/da0/dc7/df4 0 2024-03-17T23:58:30.714 INFO:tasks.workunit.client.0.smithi196.stdout:0/739: mkdir d5/d23/d24/d59/d8b/de4 0 2024-03-17T23:58:30.716 INFO:tasks.workunit.client.0.smithi196.stdout:5/546: dread d6/d17/f48 [0,4194304] 0 2024-03-17T23:58:30.717 INFO:tasks.workunit.client.0.smithi196.stdout:1/524: creat d1/d13/d23/d47/d48/fa9 x:0 0 0 2024-03-17T23:58:30.722 INFO:tasks.workunit.client.0.smithi196.stdout:1/525: read d1/db/dd/d34/d6a/d75/f7d [5832,113967] 0 2024-03-17T23:58:30.722 INFO:tasks.workunit.client.0.smithi196.stdout:2/699: mkdir d17/d22/da0/dc7/d103 0 2024-03-17T23:58:30.724 INFO:tasks.workunit.client.0.smithi196.stdout:6/592: dread d2/d14/d42/f4b [0,4194304] 0 2024-03-17T23:58:30.727 INFO:tasks.workunit.client.0.smithi196.stdout:2/700: dread - d17/d28/d30/d3b/fe7 zero size 2024-03-17T23:58:30.728 INFO:tasks.workunit.client.0.smithi196.stdout:0/740: link d5/d23/d24/d30/d4e/f8c d5/d23/d24/d72/fe5 0 2024-03-17T23:58:30.729 INFO:tasks.workunit.client.0.smithi196.stdout:5/547: mkdir d6/d2d/d33/d3b/d80/db9 0 2024-03-17T23:58:30.729 INFO:tasks.workunit.client.0.smithi196.stdout:0/741: fdatasync d5/d23/d24/d59/d94/db5/fd0 0 2024-03-17T23:58:30.731 INFO:tasks.workunit.client.0.smithi196.stdout:3/749: getdents d7/d19/d26/d48/d4d/dd9 0 2024-03-17T23:58:30.732 INFO:tasks.workunit.client.0.smithi196.stdout:0/742: write d5/d23/d24/d28/d47/d52/d61/d6c/fb4 [2635875,87983] 0 2024-03-17T23:58:30.733 INFO:tasks.workunit.client.0.smithi196.stdout:6/593: fsync d2/d14/d42/f4f 0 2024-03-17T23:58:30.735 INFO:tasks.workunit.client.0.smithi196.stdout:2/701: symlink d17/d28/d30/d3b/l104 0 2024-03-17T23:58:30.735 INFO:tasks.workunit.client.0.smithi196.stdout:5/548: rmdir d6 39 2024-03-17T23:58:30.741 INFO:tasks.workunit.client.0.smithi196.stdout:1/526: write d1/db/fe [229241,48332] 0 2024-03-17T23:58:30.744 INFO:tasks.workunit.client.0.smithi196.stdout:0/743: mkdir d5/d23/d24/d59/de6 0 2024-03-17T23:58:30.747 INFO:tasks.workunit.client.0.smithi196.stdout:0/744: mkdir d5/d23/d85/de7 0 2024-03-17T23:58:30.749 INFO:tasks.workunit.client.0.smithi196.stdout:0/745: write d5/f18 [152705,63111] 0 2024-03-17T23:58:30.749 INFO:tasks.workunit.client.0.smithi196.stdout:3/750: write d7/d19/d26/d2b/f55 [448571,41207] 0 2024-03-17T23:58:30.752 INFO:tasks.workunit.client.0.smithi196.stdout:6/594: unlink d2/d7/d2b/c37 0 2024-03-17T23:58:30.753 INFO:tasks.workunit.client.0.smithi196.stdout:2/702: unlink d17/d22/f27 0 2024-03-17T23:58:30.754 INFO:tasks.workunit.client.0.smithi196.stdout:6/595: write d2/d14/d42/d57/dc8/fc4 [234899,48541] 0 2024-03-17T23:58:30.755 INFO:tasks.workunit.client.0.smithi196.stdout:3/751: chown d7/d19/fa2 233794 1 2024-03-17T23:58:30.757 INFO:tasks.workunit.client.0.smithi196.stdout:0/746: creat d5/d23/d24/d59/d94/db5/fe8 x:0 0 0 2024-03-17T23:58:30.758 INFO:tasks.workunit.client.0.smithi196.stdout:2/703: mknod d17/d22/d59/c105 0 2024-03-17T23:58:30.758 INFO:tasks.workunit.client.0.smithi196.stdout:5/549: getdents d6/d2d/d33/d3b/d80/db9 0 2024-03-17T23:58:30.759 INFO:tasks.workunit.client.0.smithi196.stdout:2/704: fsync d17/d22/fbb 0 2024-03-17T23:58:30.761 INFO:tasks.workunit.client.0.smithi196.stdout:6/596: dread d2/d14/f5d [0,4194304] 0 2024-03-17T23:58:30.763 INFO:tasks.workunit.client.0.smithi196.stdout:5/550: creat d6/d2d/d33/d3b/d80/da0/fba x:0 0 0 2024-03-17T23:58:30.764 INFO:tasks.workunit.client.0.smithi196.stdout:1/527: truncate d1/db/f14 2027966 0 2024-03-17T23:58:30.767 INFO:tasks.workunit.client.0.smithi196.stdout:2/705: unlink d17/d19/d44/d52/f84 0 2024-03-17T23:58:30.768 INFO:tasks.workunit.client.0.smithi196.stdout:3/752: truncate d7/d19/d26/f9d 197897 0 2024-03-17T23:58:30.770 INFO:tasks.workunit.client.0.smithi196.stdout:5/551: creat d6/d2a/fbb x:0 0 0 2024-03-17T23:58:30.770 INFO:tasks.workunit.client.0.smithi196.stdout:5/552: stat d6/d2d/f93 0 2024-03-17T23:58:30.772 INFO:tasks.workunit.client.0.smithi196.stdout:3/753: write d7/d19/d26/f64 [2662787,109010] 0 2024-03-17T23:58:30.773 INFO:tasks.workunit.client.0.smithi196.stdout:5/553: write d6/d2d/f96 [8420660,4553] 0 2024-03-17T23:58:30.774 INFO:tasks.workunit.client.0.smithi196.stdout:1/528: creat d1/db/dd/faa x:0 0 0 2024-03-17T23:58:30.785 INFO:tasks.workunit.client.0.smithi196.stdout:0/747: rename d5/d23/d24/d30/fa9 to d5/d23/d24/d30/fe9 0 2024-03-17T23:58:30.787 INFO:tasks.workunit.client.0.smithi196.stdout:6/597: dwrite d2/d14/d75/d7b/f6f [4194304,4194304] 0 2024-03-17T23:58:30.789 INFO:tasks.workunit.client.0.smithi196.stdout:6/598: dread - d2/d14/d50/f80 zero size 2024-03-17T23:58:30.794 INFO:tasks.workunit.client.0.smithi196.stdout:2/706: dread f16 [0,4194304] 0 2024-03-17T23:58:30.794 INFO:tasks.workunit.client.0.smithi196.stdout:1/529: unlink d1/d13/d4c/l89 0 2024-03-17T23:58:30.795 INFO:tasks.workunit.client.0.smithi196.stdout:2/707: chown d17/d28/f46 0 1 2024-03-17T23:58:30.803 INFO:tasks.workunit.client.0.smithi196.stdout:6/599: symlink d2/d7/ld4 0 2024-03-17T23:58:30.806 INFO:tasks.workunit.client.0.smithi196.stdout:5/554: mknod d6/d15/cbc 0 2024-03-17T23:58:30.809 INFO:tasks.workunit.client.0.smithi196.stdout:0/748: truncate d5/d23/d24/d28/d47/d52/d49/f62 898606 0 2024-03-17T23:58:30.811 INFO:tasks.workunit.client.0.smithi196.stdout:2/708: dwrite d17/d22/d3d/d8f/fdc [0,4194304] 0 2024-03-17T23:58:30.816 INFO:tasks.workunit.client.0.smithi196.stdout:6/600: unlink d2/d66/d90/fb6 0 2024-03-17T23:58:30.820 INFO:tasks.workunit.client.0.smithi196.stdout:5/555: symlink d6/d17/d1f/d7d/lbd 0 2024-03-17T23:58:30.821 INFO:tasks.workunit.client.0.smithi196.stdout:6/601: mknod d2/d7/d2b/cd5 0 2024-03-17T23:58:30.823 INFO:tasks.workunit.client.0.smithi196.stdout:1/530: truncate d1/f57 296485 0 2024-03-17T23:58:30.826 INFO:tasks.workunit.client.0.smithi196.stdout:3/754: write d7/d19/d26/f9d [229557,36836] 0 2024-03-17T23:58:30.828 INFO:tasks.workunit.client.0.smithi196.stdout:3/755: chown d7/d19/d26/d48/ce1 389156 1 2024-03-17T23:58:30.831 INFO:tasks.workunit.client.0.smithi196.stdout:6/602: symlink d2/d14/d75/d7b/ld6 0 2024-03-17T23:58:30.831 INFO:tasks.workunit.client.0.smithi196.stdout:2/709: creat d17/d19/d44/f106 x:0 0 0 2024-03-17T23:58:30.832 INFO:tasks.workunit.client.0.smithi196.stdout:0/749: link d5/d23/d24/d28/l27 d5/d23/d24/d59/de6/lea 0 2024-03-17T23:58:30.841 INFO:tasks.workunit.client.0.smithi196.stdout:6/603: dread d2/d14/d75/d7b/f6f [4194304,4194304] 0 2024-03-17T23:58:30.843 INFO:tasks.workunit.client.0.smithi196.stdout:5/556: dread d6/d15/f27 [0,4194304] 0 2024-03-17T23:58:30.844 INFO:tasks.workunit.client.0.smithi196.stdout:6/604: mkdir d2/d14/d8c/dd7 0 2024-03-17T23:58:30.846 INFO:tasks.workunit.client.0.smithi196.stdout:5/557: mkdir d6/d2d/d33/dbe 0 2024-03-17T23:58:30.846 INFO:tasks.workunit.client.0.smithi196.stdout:1/531: write d1/db/dd/d34/d6a/d75/f7d [210153,26244] 0 2024-03-17T23:58:30.847 INFO:tasks.workunit.client.0.smithi196.stdout:6/605: mkdir d2/d14/d75/d92/dd8 0 2024-03-17T23:58:30.848 INFO:tasks.workunit.client.0.smithi196.stdout:5/558: write d6/d2a/fbb [985753,111623] 0 2024-03-17T23:58:30.850 INFO:tasks.workunit.client.0.smithi196.stdout:2/710: write d17/d1f/f63 [254581,79647] 0 2024-03-17T23:58:30.852 INFO:tasks.workunit.client.0.smithi196.stdout:0/750: write d5/d23/d24/da3/dbb/fbe [644718,24083] 0 2024-03-17T23:58:30.852 INFO:tasks.workunit.client.0.smithi196.stdout:4/549: sync 2024-03-17T23:58:30.854 INFO:tasks.workunit.client.0.smithi196.stdout:1/532: dread d1/f4 [0,4194304] 0 2024-03-17T23:58:30.861 INFO:tasks.workunit.client.0.smithi196.stdout:0/751: symlink d5/d23/d24/d28/dc9/leb 0 2024-03-17T23:58:30.862 INFO:tasks.workunit.client.0.smithi196.stdout:3/756: dwrite d7/d19/d26/d48/f74 [0,4194304] 0 2024-03-17T23:58:30.862 INFO:tasks.workunit.client.0.smithi196.stdout:5/559: write f0 [1840147,21945] 0 2024-03-17T23:58:30.864 INFO:tasks.workunit.client.0.smithi196.stdout:6/606: truncate f1 6432137 0 2024-03-17T23:58:30.864 INFO:tasks.workunit.client.0.smithi196.stdout:0/752: write d5/d23/d24/d59/f9e [997451,29459] 0 2024-03-17T23:58:30.868 INFO:tasks.workunit.client.0.smithi196.stdout:6/607: write d2/d14/d75/d7b/fb1 [600354,48001] 0 2024-03-17T23:58:30.877 INFO:tasks.workunit.client.0.smithi196.stdout:0/753: write d5/d23/d24/d30/d4e/fdc [764923,123964] 0 2024-03-17T23:58:30.879 INFO:tasks.workunit.client.0.smithi196.stdout:5/560: rmdir d6/d17/d35 39 2024-03-17T23:58:30.879 INFO:tasks.workunit.client.0.smithi196.stdout:4/550: dwrite d1/d11/f95 [0,4194304] 0 2024-03-17T23:58:30.881 INFO:tasks.workunit.client.0.smithi196.stdout:2/711: dread d17/f2a [0,4194304] 0 2024-03-17T23:58:30.882 INFO:tasks.workunit.client.0.smithi196.stdout:6/608: mkdir d2/d14/d8c/dd7/dd9 0 2024-03-17T23:58:30.882 INFO:tasks.workunit.client.0.smithi196.stdout:1/533: dread d1/db/dd/d43/f4a [0,4194304] 0 2024-03-17T23:58:30.884 INFO:tasks.workunit.client.0.smithi196.stdout:5/561: unlink d6/d15/f27 0 2024-03-17T23:58:30.889 INFO:tasks.workunit.client.0.smithi196.stdout:3/757: dwrite d7/d19/d26/d48/d4d/fb0 [0,4194304] 0 2024-03-17T23:58:30.889 INFO:tasks.workunit.client.0.smithi196.stdout:2/712: fdatasync d17/d28/d30/d71/ffe 0 2024-03-17T23:58:30.890 INFO:tasks.workunit.client.0.smithi196.stdout:3/758: readlink d7/l12 0 2024-03-17T23:58:30.891 INFO:tasks.workunit.client.0.smithi196.stdout:4/551: creat d1/de/d50/fc9 x:0 0 0 2024-03-17T23:58:30.895 INFO:tasks.workunit.client.0.smithi196.stdout:2/713: creat d17/d1f/f107 x:0 0 0 2024-03-17T23:58:30.899 INFO:tasks.workunit.client.0.smithi196.stdout:1/534: mkdir d1/d13/d23/d62/dab 0 2024-03-17T23:58:30.900 INFO:tasks.workunit.client.0.smithi196.stdout:5/562: dwrite d6/fa [0,4194304] 0 2024-03-17T23:58:30.902 INFO:tasks.workunit.client.0.smithi196.stdout:3/759: dread d7/d19/d78/d93/fbc [0,4194304] 0 2024-03-17T23:58:30.904 INFO:tasks.workunit.client.0.smithi196.stdout:6/609: creat d2/d14/d42/d57/fda x:0 0 0 2024-03-17T23:58:30.905 INFO:tasks.workunit.client.0.smithi196.stdout:5/563: readlink d6/d17/d23/l2c 0 2024-03-17T23:58:30.911 INFO:tasks.workunit.client.0.smithi196.stdout:2/714: truncate d17/d28/d30/f62 1337548 0 2024-03-17T23:58:30.914 INFO:tasks.workunit.client.0.smithi196.stdout:0/754: dwrite d5/d23/d24/d72/fe5 [4194304,4194304] 0 2024-03-17T23:58:30.918 INFO:tasks.workunit.client.0.smithi196.stdout:5/564: dread d6/fe [0,4194304] 0 2024-03-17T23:58:30.920 INFO:tasks.workunit.client.0.smithi196.stdout:2/715: rmdir d17/dce 39 2024-03-17T23:58:30.921 INFO:tasks.workunit.client.0.smithi196.stdout:4/552: dwrite d1/de/d50/fc9 [0,4194304] 0 2024-03-17T23:58:30.922 INFO:tasks.workunit.client.0.smithi196.stdout:2/716: chown d17/d19/l1c 296 1 2024-03-17T23:58:30.922 INFO:tasks.workunit.client.0.smithi196.stdout:2/717: stat d17/d22/da0 0 2024-03-17T23:58:30.924 INFO:tasks.workunit.client.0.smithi196.stdout:6/610: symlink d2/d14/d35/d6a/ldb 0 2024-03-17T23:58:30.924 INFO:tasks.workunit.client.0.smithi196.stdout:2/718: truncate d17/d19/d44/ff1 682898 0 2024-03-17T23:58:30.925 INFO:tasks.workunit.client.0.smithi196.stdout:4/553: fsync d1/d11/f6a 0 2024-03-17T23:58:30.926 INFO:tasks.workunit.client.0.smithi196.stdout:5/565: stat d6/d17/d1f/d7d/d81/c5d 0 2024-03-17T23:58:30.927 INFO:tasks.workunit.client.0.smithi196.stdout:4/554: stat d1/d1b/f79 0 2024-03-17T23:58:30.928 INFO:tasks.workunit.client.0.smithi196.stdout:5/566: dread - d6/d17/d1f/d7d/d89/fb1 zero size 2024-03-17T23:58:30.929 INFO:tasks.workunit.client.0.smithi196.stdout:3/760: getdents d7/d19/d26/d2b/dcd 0 2024-03-17T23:58:30.932 INFO:tasks.workunit.client.0.smithi196.stdout:6/611: mknod d2/d14/d75/d7b/d49/cdc 0 2024-03-17T23:58:30.933 INFO:tasks.workunit.client.0.smithi196.stdout:5/567: dread d6/d17/d1f/f3c [0,4194304] 0 2024-03-17T23:58:30.933 INFO:tasks.workunit.client.0.smithi196.stdout:1/535: link d1/db/dd/d34/d6a/c76 d1/d13/d4c/da0/cac 0 2024-03-17T23:58:30.934 INFO:tasks.workunit.client.0.smithi196.stdout:1/536: chown d1/db/dd/d34/f8d 235640 1 2024-03-17T23:58:30.935 INFO:tasks.workunit.client.0.smithi196.stdout:4/555: unlink d1/d26/d8b/caa 0 2024-03-17T23:58:30.940 INFO:tasks.workunit.client.0.smithi196.stdout:2/719: write d17/d19/d44/f8c [706165,116202] 0 2024-03-17T23:58:30.940 INFO:tasks.workunit.client.0.smithi196.stdout:0/755: creat d5/d23/d24/d30/fec x:0 0 0 2024-03-17T23:58:30.941 INFO:tasks.workunit.client.0.smithi196.stdout:5/568: mknod d6/cbf 0 2024-03-17T23:58:30.942 INFO:tasks.workunit.client.0.smithi196.stdout:1/537: mknod d1/d13/d23/d62/dab/cad 0 2024-03-17T23:58:30.944 INFO:tasks.workunit.client.0.smithi196.stdout:5/569: chown d6/d17/d3f 2040 1 2024-03-17T23:58:30.945 INFO:tasks.workunit.client.0.smithi196.stdout:3/761: creat d7/d19/dc4/fef x:0 0 0 2024-03-17T23:58:30.945 INFO:tasks.workunit.client.0.smithi196.stdout:1/538: stat d1/d13/d23/d62/d71/l88 0 2024-03-17T23:58:30.946 INFO:tasks.workunit.client.0.smithi196.stdout:0/756: creat d5/d23/d24/d28/d47/d52/dac/fed x:0 0 0 2024-03-17T23:58:30.946 INFO:tasks.workunit.client.0.smithi196.stdout:6/612: dwrite d2/d14/d75/d7b/fb1 [0,4194304] 0 2024-03-17T23:58:30.947 INFO:tasks.workunit.client.0.smithi196.stdout:2/720: creat d17/d22/d3d/f108 x:0 0 0 2024-03-17T23:58:30.949 INFO:tasks.workunit.client.0.smithi196.stdout:1/539: chown d1/db/l8f 11629 1 2024-03-17T23:58:30.951 INFO:tasks.workunit.client.0.smithi196.stdout:0/757: stat d5/d23/d24/fb6 0 2024-03-17T23:58:30.952 INFO:tasks.workunit.client.0.smithi196.stdout:3/762: creat d7/d19/d78/da9/ff0 x:0 0 0 2024-03-17T23:58:30.953 INFO:tasks.workunit.client.0.smithi196.stdout:1/540: symlink d1/d13/d23/d62/d71/lae 0 2024-03-17T23:58:30.954 INFO:tasks.workunit.client.0.smithi196.stdout:1/541: truncate d1/db/dd/d43/fa7 232791 0 2024-03-17T23:58:30.955 INFO:tasks.workunit.client.0.smithi196.stdout:1/542: fdatasync d1/d13/d23/d47/f63 0 2024-03-17T23:58:30.957 INFO:tasks.workunit.client.0.smithi196.stdout:6/613: write d2/d14/d50/f80 [138361,15412] 0 2024-03-17T23:58:30.959 INFO:tasks.workunit.client.0.smithi196.stdout:5/570: mkdir d6/d15/dc0 0 2024-03-17T23:58:30.960 INFO:tasks.workunit.client.0.smithi196.stdout:3/763: symlink d7/d33/lf1 0 2024-03-17T23:58:30.961 INFO:tasks.workunit.client.0.smithi196.stdout:3/764: chown d7/d19/d26/d2b/f3b 189964 1 2024-03-17T23:58:30.962 INFO:tasks.workunit.client.0.smithi196.stdout:0/758: rename d5/d23/d24/d30/d4e/cdf to d5/d23/d24/d59/de6/cee 0 2024-03-17T23:58:30.963 INFO:tasks.workunit.client.0.smithi196.stdout:1/543: symlink d1/d13/d23/d70/laf 0 2024-03-17T23:58:30.963 INFO:tasks.workunit.client.0.smithi196.stdout:0/759: chown d5/d23/d24/d59/d8b/de4 6 1 2024-03-17T23:58:30.964 INFO:tasks.workunit.client.0.smithi196.stdout:4/556: getdents d1/d26/d33 0 2024-03-17T23:58:30.966 INFO:tasks.workunit.client.0.smithi196.stdout:5/571: creat d6/d17/d3f/fc1 x:0 0 0 2024-03-17T23:58:30.966 INFO:tasks.workunit.client.0.smithi196.stdout:3/765: mkdir d7/d19/d78/df2 0 2024-03-17T23:58:30.969 INFO:tasks.workunit.client.0.smithi196.stdout:3/766: chown d7/fc 7449895 1 2024-03-17T23:58:30.970 INFO:tasks.workunit.client.0.smithi196.stdout:5/572: truncate d6/d17/f99 145977 0 2024-03-17T23:58:30.971 INFO:tasks.workunit.client.0.smithi196.stdout:3/767: write d7/fb [694890,100543] 0 2024-03-17T23:58:30.973 INFO:tasks.workunit.client.0.smithi196.stdout:2/721: write d17/d28/d30/d3b/f4a [5176391,93640] 0 2024-03-17T23:58:30.974 INFO:tasks.workunit.client.0.smithi196.stdout:4/557: mknod d1/d26/d8b/cca 0 2024-03-17T23:58:30.976 INFO:tasks.workunit.client.0.smithi196.stdout:0/760: dread d5/f44 [0,4194304] 0 2024-03-17T23:58:30.978 INFO:tasks.workunit.client.0.smithi196.stdout:2/722: chown d17/d28/dae/cb9 9263 1 2024-03-17T23:58:30.979 INFO:tasks.workunit.client.0.smithi196.stdout:2/723: write d17/d28/d30/d72/fb3 [4509241,91408] 0 2024-03-17T23:58:30.980 INFO:tasks.workunit.client.0.smithi196.stdout:2/724: stat d17/d22/f9c 0 2024-03-17T23:58:30.983 INFO:tasks.workunit.client.0.smithi196.stdout:1/544: creat d1/d13/d23/fb0 x:0 0 0 2024-03-17T23:58:30.984 INFO:tasks.workunit.client.0.smithi196.stdout:5/573: symlink d6/d17/d23/d7e/lc2 0 2024-03-17T23:58:30.985 INFO:tasks.workunit.client.0.smithi196.stdout:0/761: mknod d5/d23/d24/d28/d47/d52/d49/cef 0 2024-03-17T23:58:30.985 INFO:tasks.workunit.client.0.smithi196.stdout:5/574: stat d6/d15/cbc 0 2024-03-17T23:58:30.986 INFO:tasks.workunit.client.0.smithi196.stdout:6/614: dread d2/f45 [4194304,4194304] 0 2024-03-17T23:58:30.987 INFO:tasks.workunit.client.0.smithi196.stdout:2/725: unlink d17/d28/d30/d72/fb3 0 2024-03-17T23:58:30.987 INFO:tasks.workunit.client.0.smithi196.stdout:3/768: dwrite d7/d19/d26/d48/d4d/dd9/dc8/fd8 [0,4194304] 0 2024-03-17T23:58:30.989 INFO:tasks.workunit.client.0.smithi196.stdout:4/558: mkdir d1/d1b/d77/dc8/dcb 0 2024-03-17T23:58:30.991 INFO:tasks.workunit.client.0.smithi196.stdout:1/545: mknod d1/d13/d4c/cb1 0 2024-03-17T23:58:30.992 INFO:tasks.workunit.client.0.smithi196.stdout:1/546: dread - d1/db/dd/d34/f55 zero size 2024-03-17T23:58:30.999 INFO:tasks.workunit.client.0.smithi196.stdout:6/615: symlink d2/d14/ldd 0 2024-03-17T23:58:31.000 INFO:tasks.workunit.client.0.smithi196.stdout:2/726: mknod d17/d19/d44/d52/df0/c109 0 2024-03-17T23:58:31.001 INFO:tasks.workunit.client.0.smithi196.stdout:2/727: chown d17/d1f/fa9 7867954 1 2024-03-17T23:58:31.002 INFO:tasks.workunit.client.0.smithi196.stdout:0/762: mkdir d5/d23/d24/d28/d47/d52/d61/d6c/df0 0 2024-03-17T23:58:31.003 INFO:tasks.workunit.client.0.smithi196.stdout:2/728: chown d17/d22/d3d/d8f/fdc 1422 1 2024-03-17T23:58:31.007 INFO:tasks.workunit.client.0.smithi196.stdout:4/559: dwrite d1/d68/f87 [0,4194304] 0 2024-03-17T23:58:31.009 INFO:tasks.workunit.client.0.smithi196.stdout:5/575: link d6/d2a/fbb d6/d17/d1f/d7d/d81/fc3 0 2024-03-17T23:58:31.010 INFO:tasks.workunit.client.0.smithi196.stdout:1/547: rename d1/db/dd/d34/d6a to d1/d13/d23/d47/d48/d74/db2 0 2024-03-17T23:58:31.011 INFO:tasks.workunit.client.0.smithi196.stdout:5/576: dread - d6/d17/d1f/d7d/d81/f9d zero size 2024-03-17T23:58:31.012 INFO:tasks.workunit.client.0.smithi196.stdout:6/616: creat d2/d14/d75/dc0/fde x:0 0 0 2024-03-17T23:58:31.012 INFO:tasks.workunit.client.0.smithi196.stdout:0/763: symlink d5/d23/d24/d28/lf1 0 2024-03-17T23:58:31.013 INFO:tasks.workunit.client.0.smithi196.stdout:6/617: chown d2/d66/l74 4 1 2024-03-17T23:58:31.017 INFO:tasks.workunit.client.0.smithi196.stdout:4/560: write d1/f58 [1124749,107006] 0 2024-03-17T23:58:31.017 INFO:tasks.workunit.client.0.smithi196.stdout:1/548: symlink d1/d13/d2a/lb3 0 2024-03-17T23:58:31.019 INFO:tasks.workunit.client.0.smithi196.stdout:0/764: read d5/d23/d24/d28/d47/fde [182863,21516] 0 2024-03-17T23:58:31.020 INFO:tasks.workunit.client.0.smithi196.stdout:4/561: dread d1/fa7 [0,4194304] 0 2024-03-17T23:58:31.020 INFO:tasks.workunit.client.0.smithi196.stdout:3/769: dread d7/d19/d26/d48/d4d/f85 [0,4194304] 0 2024-03-17T23:58:31.021 INFO:tasks.workunit.client.0.smithi196.stdout:5/577: truncate d6/d17/d1f/f4c 104355 0 2024-03-17T23:58:31.021 INFO:tasks.workunit.client.0.smithi196.stdout:1/549: rmdir d1/d13 39 2024-03-17T23:58:31.023 INFO:tasks.workunit.client.0.smithi196.stdout:0/765: write d5/d23/d24/d59/f9a [231756,124617] 0 2024-03-17T23:58:31.025 INFO:tasks.workunit.client.0.smithi196.stdout:6/618: fdatasync d2/d14/d42/d57/dc8/f87 0 2024-03-17T23:58:31.025 INFO:tasks.workunit.client.0.smithi196.stdout:6/619: fdatasync d2/f41 0 2024-03-17T23:58:31.027 INFO:tasks.workunit.client.0.smithi196.stdout:3/770: mknod d7/d33/cf3 0 2024-03-17T23:58:31.031 INFO:tasks.workunit.client.0.smithi196.stdout:2/729: truncate d17/fdb 1859044 0 2024-03-17T23:58:31.034 INFO:tasks.workunit.client.0.smithi196.stdout:6/620: rename d2/d14/d75/d7b/d49 to d2/d14/d75/dc0/ddf 0 2024-03-17T23:58:31.035 INFO:tasks.workunit.client.0.smithi196.stdout:1/550: creat d1/d13/d23/d70/fb4 x:0 0 0 2024-03-17T23:58:31.036 INFO:tasks.workunit.client.0.smithi196.stdout:1/551: stat d1/d13/d23/l2d 0 2024-03-17T23:58:31.037 INFO:tasks.workunit.client.0.smithi196.stdout:5/578: unlink d6/d2a/fbb 0 2024-03-17T23:58:31.042 INFO:tasks.workunit.client.0.smithi196.stdout:2/730: chown d17/d22/l8b 6699 1 2024-03-17T23:58:31.044 INFO:tasks.workunit.client.0.smithi196.stdout:4/562: creat d1/d26/fcc x:0 0 0 2024-03-17T23:58:31.048 INFO:tasks.workunit.client.0.smithi196.stdout:0/766: truncate d5/d23/f33 8053283 0 2024-03-17T23:58:31.050 INFO:tasks.workunit.client.0.smithi196.stdout:1/552: symlink d1/d13/d23/d62/lb5 0 2024-03-17T23:58:31.051 INFO:tasks.workunit.client.0.smithi196.stdout:6/621: write d2/f3e [1237616,29879] 0 2024-03-17T23:58:31.052 INFO:tasks.workunit.client.0.smithi196.stdout:5/579: creat d6/d17/d3f/d4e/d69/fc4 x:0 0 0 2024-03-17T23:58:31.055 INFO:tasks.workunit.client.0.smithi196.stdout:1/553: readlink d1/d13/d23/d62/d71/l88 0 2024-03-17T23:58:31.059 INFO:tasks.workunit.client.0.smithi196.stdout:0/767: creat d5/d23/d85/de7/ff2 x:0 0 0 2024-03-17T23:58:31.066 INFO:tasks.workunit.client.0.smithi196.stdout:3/771: rename d7/d19/d26/d2b/d3c/d3d/c45 to d7/d19/d26/cf4 0 2024-03-17T23:58:31.067 INFO:tasks.workunit.client.0.smithi196.stdout:6/622: dwrite d2/d14/d8c/f98 [0,4194304] 0 2024-03-17T23:58:31.068 INFO:tasks.workunit.client.0.smithi196.stdout:5/580: dwrite d6/d17/f26 [0,4194304] 0 2024-03-17T23:58:31.070 INFO:tasks.workunit.client.0.smithi196.stdout:1/554: creat d1/d13/d23/d47/d48/d74/db2/d75/fb6 x:0 0 0 2024-03-17T23:58:31.070 INFO:tasks.workunit.client.0.smithi196.stdout:0/768: read d5/d23/d24/d28/d47/fde [415370,11314] 0 2024-03-17T23:58:31.075 INFO:tasks.workunit.client.0.smithi196.stdout:1/555: unlink d1/f85 0 2024-03-17T23:58:31.077 INFO:tasks.workunit.client.0.smithi196.stdout:3/772: stat d7/d19/f73 0 2024-03-17T23:58:31.078 INFO:tasks.workunit.client.0.smithi196.stdout:0/769: dread d5/d23/d24/d59/d94/fb1 [0,4194304] 0 2024-03-17T23:58:31.084 INFO:tasks.workunit.client.0.smithi196.stdout:4/563: rename d1/d26/d33/l4d to d1/de/d50/lcd 0 2024-03-17T23:58:31.087 INFO:tasks.workunit.client.0.smithi196.stdout:4/564: truncate d1/de/d50/d55/fb3 298482 0 2024-03-17T23:58:31.089 INFO:tasks.workunit.client.0.smithi196.stdout:2/731: dwrite d17/d28/d30/f94 [0,4194304] 0 2024-03-17T23:58:31.093 INFO:tasks.workunit.client.0.smithi196.stdout:0/770: dwrite d5/d23/d24/d30/d4e/f8c [4194304,4194304] 0 2024-03-17T23:58:31.102 INFO:tasks.workunit.client.0.smithi196.stdout:0/771: write d5/d23/d24/d28/f37 [4369556,110504] 0 2024-03-17T23:58:31.102 INFO:tasks.workunit.client.0.smithi196.stdout:9/604: sync 2024-03-17T23:58:31.102 INFO:tasks.workunit.client.0.smithi196.stdout:4/565: dread d1/d1b/d77/f90 [0,4194304] 0 2024-03-17T23:58:31.103 INFO:tasks.workunit.client.0.smithi196.stdout:5/581: mkdir d6/d2d/d33/dc5 0 2024-03-17T23:58:31.103 INFO:tasks.workunit.client.0.smithi196.stdout:6/623: creat d2/d14/dcc/fe0 x:0 0 0 2024-03-17T23:58:31.107 INFO:tasks.workunit.client.0.smithi196.stdout:3/773: mkdir d7/d19/d26/df5 0 2024-03-17T23:58:31.110 INFO:tasks.workunit.client.0.smithi196.stdout:2/732: creat d17/d68/f10a x:0 0 0 2024-03-17T23:58:31.116 INFO:tasks.workunit.client.0.smithi196.stdout:0/772: rename d5/l1e to d5/d23/d24/d28/d47/d52/d61/d6c/df0/lf3 0 2024-03-17T23:58:31.117 INFO:tasks.workunit.client.0.smithi196.stdout:1/556: link d1/d13/d23/c32 d1/d13/d2a/d94/cb7 0 2024-03-17T23:58:31.119 INFO:tasks.workunit.client.0.smithi196.stdout:9/605: symlink d9/df/lbe 0 2024-03-17T23:58:31.120 INFO:tasks.workunit.client.0.smithi196.stdout:4/566: write d1/d11/f12 [1129533,41223] 0 2024-03-17T23:58:31.130 INFO:tasks.workunit.client.0.smithi196.stdout:1/557: dread d1/db/fe [4194304,4194304] 0 2024-03-17T23:58:31.131 INFO:tasks.workunit.client.0.smithi196.stdout:3/774: mknod d7/d19/d26/de7/cf6 0 2024-03-17T23:58:31.133 INFO:tasks.workunit.client.0.smithi196.stdout:9/606: fsync d9/f44 0 2024-03-17T23:58:31.135 INFO:tasks.workunit.client.0.smithi196.stdout:6/624: dread d2/faf [0,4194304] 0 2024-03-17T23:58:31.136 INFO:tasks.workunit.client.0.smithi196.stdout:4/567: creat d1/d68/fce x:0 0 0 2024-03-17T23:58:31.138 INFO:tasks.workunit.client.0.smithi196.stdout:2/733: dread d17/d22/f9c [0,4194304] 0 2024-03-17T23:58:31.138 INFO:tasks.workunit.client.0.smithi196.stdout:5/582: dread d6/d17/d1f/d7d/d81/fc3 [0,4194304] 0 2024-03-17T23:58:31.142 INFO:tasks.workunit.client.0.smithi196.stdout:1/558: dwrite d1/db/f1f [4194304,4194304] 0 2024-03-17T23:58:31.143 INFO:tasks.workunit.client.0.smithi196.stdout:1/559: readlink d1/d13/d4c/l5f 0 2024-03-17T23:58:31.144 INFO:tasks.workunit.client.0.smithi196.stdout:1/560: read d1/db/dd/d34/f42 [461457,10448] 0 2024-03-17T23:58:31.145 INFO:tasks.workunit.client.0.smithi196.stdout:1/561: fsync d1/d13/d23/d47/d48/f54 0 2024-03-17T23:58:31.150 INFO:tasks.workunit.client.0.smithi196.stdout:3/775: unlink d7/d19/d26/d2b/c6d 0 2024-03-17T23:58:31.156 INFO:tasks.workunit.client.0.smithi196.stdout:6/625: mknod d2/d14/d8c/ce1 0 2024-03-17T23:58:31.156 INFO:tasks.workunit.client.0.smithi196.stdout:9/607: creat d9/df/d4a/d89/fbf x:0 0 0 2024-03-17T23:58:31.159 INFO:tasks.workunit.client.0.smithi196.stdout:3/776: dwrite d7/d19/d26/d2b/d3c/d3d/d7d/fc7 [0,4194304] 0 2024-03-17T23:58:31.160 INFO:tasks.workunit.client.0.smithi196.stdout:3/777: write d7/d19/d26/f37 [3153374,7362] 0 2024-03-17T23:58:31.166 INFO:tasks.workunit.client.0.smithi196.stdout:9/608: stat d9/df 0 2024-03-17T23:58:31.167 INFO:tasks.workunit.client.0.smithi196.stdout:4/568: truncate d1/f2c 352815 0 2024-03-17T23:58:31.169 INFO:tasks.workunit.client.0.smithi196.stdout:1/562: mknod d1/d13/d2a/cb8 0 2024-03-17T23:58:31.170 INFO:tasks.workunit.client.0.smithi196.stdout:0/773: getdents d5/d23/d85 0 2024-03-17T23:58:31.172 INFO:tasks.workunit.client.0.smithi196.stdout:5/583: stat d6/d2d/d33/d3b/c68 0 2024-03-17T23:58:31.172 INFO:tasks.workunit.client.0.smithi196.stdout:4/569: mknod d1/d68/ccf 0 2024-03-17T23:58:31.173 INFO:tasks.workunit.client.0.smithi196.stdout:3/778: dwrite d7/d33/f56 [0,4194304] 0 2024-03-17T23:58:31.175 INFO:tasks.workunit.client.0.smithi196.stdout:6/626: mkdir d2/d14/de2 0 2024-03-17T23:58:31.176 INFO:tasks.workunit.client.0.smithi196.stdout:5/584: write d6/f8a [2927006,91310] 0 2024-03-17T23:58:31.177 INFO:tasks.workunit.client.0.smithi196.stdout:9/609: mkdir d9/dbb/dc0 0 2024-03-17T23:58:31.177 INFO:tasks.workunit.client.0.smithi196.stdout:6/627: chown d2/f3e 184592116 1 2024-03-17T23:58:31.182 INFO:tasks.workunit.client.0.smithi196.stdout:3/779: chown d7/d19/d26/cf4 97 1 2024-03-17T23:58:31.183 INFO:tasks.workunit.client.0.smithi196.stdout:1/563: dread d1/d13/d23/d47/f63 [0,4194304] 0 2024-03-17T23:58:31.184 INFO:tasks.workunit.client.0.smithi196.stdout:1/564: dread - d1/db/dd/d34/f8d zero size 2024-03-17T23:58:31.185 INFO:tasks.workunit.client.0.smithi196.stdout:0/774: creat d5/d23/d24/d28/d47/d52/d49/ff4 x:0 0 0 2024-03-17T23:58:31.186 INFO:tasks.workunit.client.0.smithi196.stdout:4/570: rename d1/d26/l29 to d1/d68/d74/ld0 0 2024-03-17T23:58:31.187 INFO:tasks.workunit.client.0.smithi196.stdout:2/734: link d17/d1f/ld6 d17/d68/l10b 0 2024-03-17T23:58:31.188 INFO:tasks.workunit.client.0.smithi196.stdout:5/585: creat d6/d17/d23/fc6 x:0 0 0 2024-03-17T23:58:31.192 INFO:tasks.workunit.client.0.smithi196.stdout:9/610: fdatasync d9/df/d14/f5c 0 2024-03-17T23:58:31.195 INFO:tasks.workunit.client.0.smithi196.stdout:1/565: mknod d1/d13/d4c/cb9 0 2024-03-17T23:58:31.196 INFO:tasks.workunit.client.0.smithi196.stdout:0/775: dwrite d5/d23/d24/d28/d47/d52/d61/d6c/fb4 [0,4194304] 0 2024-03-17T23:58:31.196 INFO:tasks.workunit.client.0.smithi196.stdout:4/571: rename d1/l41 to d1/d26/d57/dac/ld1 0 2024-03-17T23:58:31.199 INFO:tasks.workunit.client.0.smithi196.stdout:0/776: write d5/f10 [229040,88745] 0 2024-03-17T23:58:31.203 INFO:tasks.workunit.client.0.smithi196.stdout:6/628: mkdir d2/d66/de3 0 2024-03-17T23:58:31.203 INFO:tasks.workunit.client.0.smithi196.stdout:4/572: chown d1/d26/d57/d8c/d97/fa8 73384 1 2024-03-17T23:58:31.203 INFO:tasks.workunit.client.0.smithi196.stdout:6/629: chown d2/d14/d42/l53 66905303 1 2024-03-17T23:58:31.204 INFO:tasks.workunit.client.0.smithi196.stdout:4/573: stat d1/d26/d33/d85 0 2024-03-17T23:58:31.204 INFO:tasks.workunit.client.0.smithi196.stdout:9/611: rmdir d9/df/d4a/d5b/d62/dba/d60 39 2024-03-17T23:58:31.205 INFO:tasks.workunit.client.0.smithi196.stdout:3/780: dread d7/d19/d26/d2b/d3c/d3d/f5a [0,4194304] 0 2024-03-17T23:58:31.206 INFO:tasks.workunit.client.0.smithi196.stdout:4/574: chown d1/d61/l69 1010999 1 2024-03-17T23:58:31.208 INFO:tasks.workunit.client.0.smithi196.stdout:2/735: dread d17/d28/d30/d3b/f4a [0,4194304] 0 2024-03-17T23:58:31.208 INFO:tasks.workunit.client.0.smithi196.stdout:4/575: dread - d1/d11/fa6 zero size 2024-03-17T23:58:31.216 INFO:tasks.workunit.client.0.smithi196.stdout:4/576: dwrite d1/de/d50/fc9 [4194304,4194304] 0 2024-03-17T23:58:31.216 INFO:tasks.workunit.client.0.smithi196.stdout:0/777: creat d5/d23/d24/d28/d47/d52/dac/ff5 x:0 0 0 2024-03-17T23:58:31.219 INFO:tasks.workunit.client.0.smithi196.stdout:3/781: chown d7/d19/d26/c36 30408 1 2024-03-17T23:58:31.222 INFO:tasks.workunit.client.0.smithi196.stdout:0/778: mknod d5/d23/d24/d28/dc9/cf6 0 2024-03-17T23:58:31.223 INFO:tasks.workunit.client.0.smithi196.stdout:0/779: chown d5/fa 14496855 1 2024-03-17T23:58:31.224 INFO:tasks.workunit.client.0.smithi196.stdout:6/630: creat d2/d14/d75/d7b/d9e/fe4 x:0 0 0 2024-03-17T23:58:31.226 INFO:tasks.workunit.client.0.smithi196.stdout:1/566: rename d1/db/fa2 to d1/d13/d23/fba 0 2024-03-17T23:58:31.230 INFO:tasks.workunit.client.0.smithi196.stdout:3/782: symlink d7/d19/d26/d2b/dee/lf7 0 2024-03-17T23:58:31.231 INFO:tasks.workunit.client.0.smithi196.stdout:1/567: truncate d1/d13/d23/d47/d48/f80 3248510 0 2024-03-17T23:58:31.231 INFO:tasks.workunit.client.0.smithi196.stdout:3/783: chown d7/d29/d9b/fea 54996 1 2024-03-17T23:58:31.233 INFO:tasks.workunit.client.0.smithi196.stdout:2/736: getdents d17/d19/d93 0 2024-03-17T23:58:31.233 INFO:tasks.workunit.client.0.smithi196.stdout:0/780: unlink d5/d23/d24/d28/d47/d52/d49/f62 0 2024-03-17T23:58:31.235 INFO:tasks.workunit.client.0.smithi196.stdout:2/737: fsync d17/f38 0 2024-03-17T23:58:31.235 INFO:tasks.workunit.client.0.smithi196.stdout:0/781: rmdir d5/d23/d24/d30/d4e 39 2024-03-17T23:58:31.236 INFO:tasks.workunit.client.0.smithi196.stdout:0/782: truncate d5/d23/d24/fb6 22073 0 2024-03-17T23:58:31.237 INFO:tasks.workunit.client.0.smithi196.stdout:4/577: rename d1/d1b/d77/dc8 to d1/dd2 0 2024-03-17T23:58:31.239 INFO:tasks.workunit.client.0.smithi196.stdout:1/568: creat d1/d13/d2a/d94/fbb x:0 0 0 2024-03-17T23:58:31.240 INFO:tasks.workunit.client.0.smithi196.stdout:1/569: chown d1/d13/d23/l2d 858885 1 2024-03-17T23:58:31.240 INFO:tasks.workunit.client.0.smithi196.stdout:9/612: rename d9/d33/c88 to d9/df/d4a/d5b/d62/dba/d60/d85/d8e/cc1 0 2024-03-17T23:58:31.244 INFO:tasks.workunit.client.0.smithi196.stdout:3/784: rename d7/d19/d26/d2b/d3c/d9e to d7/d29/d9b/df8 0 2024-03-17T23:58:31.245 INFO:tasks.workunit.client.0.smithi196.stdout:9/613: write d9/d12/d59/f65 [807844,1988] 0 2024-03-17T23:58:31.247 INFO:tasks.workunit.client.0.smithi196.stdout:3/785: chown d7/d19/d26/f4b 182 1 2024-03-17T23:58:31.248 INFO:tasks.workunit.client.0.smithi196.stdout:4/578: dwrite d1/d26/d33/d40/f5e [0,4194304] 0 2024-03-17T23:58:31.249 INFO:tasks.workunit.client.0.smithi196.stdout:6/631: truncate d2/d14/d8c/f98 798416 0 2024-03-17T23:58:31.251 INFO:tasks.workunit.client.0.smithi196.stdout:3/786: unlink d7/d29/fa4 0 2024-03-17T23:58:31.251 INFO:tasks.workunit.client.0.smithi196.stdout:6/632: readlink d2/d7/dcd/dd3/l7a 0 2024-03-17T23:58:31.252 INFO:tasks.workunit.client.0.smithi196.stdout:3/787: read - d7/fde zero size 2024-03-17T23:58:31.253 INFO:tasks.workunit.client.0.smithi196.stdout:3/788: chown d7/d19/d78/d8b/cb9 15 1 2024-03-17T23:58:31.257 INFO:tasks.workunit.client.0.smithi196.stdout:0/783: rename d5/d23/d24/d9f to d5/d23/d24/d28/d47/d52/d61/d6c/df7 0 2024-03-17T23:58:31.258 INFO:tasks.workunit.client.0.smithi196.stdout:4/579: dwrite d1/d26/d33/d3f/f7a [0,4194304] 0 2024-03-17T23:58:31.259 INFO:tasks.workunit.client.0.smithi196.stdout:0/784: stat d5/d23/d24/d28/d47/d52/dac/ld8 0 2024-03-17T23:58:31.261 INFO:tasks.workunit.client.0.smithi196.stdout:3/789: mkdir d7/d19/d26/d2b/d3c/d3d/df9 0 2024-03-17T23:58:31.266 INFO:tasks.workunit.client.0.smithi196.stdout:6/633: mkdir d2/d14/d8c/dd7/dd9/de5 0 2024-03-17T23:58:31.268 INFO:tasks.workunit.client.0.smithi196.stdout:8/446: sync 2024-03-17T23:58:31.268 INFO:tasks.workunit.client.0.smithi196.stdout:7/713: sync 2024-03-17T23:58:31.268 INFO:tasks.workunit.client.0.smithi196.stdout:3/790: mknod d7/d33/cfa 0 2024-03-17T23:58:31.271 INFO:tasks.workunit.client.0.smithi196.stdout:7/714: stat da/d3e/d45/d4f/d75/da8/f98 0 2024-03-17T23:58:31.274 INFO:tasks.workunit.client.0.smithi196.stdout:3/791: mkdir d7/d29/d9b/df8/dfb 0 2024-03-17T23:58:31.276 INFO:tasks.workunit.client.0.smithi196.stdout:0/785: dwrite d5/d23/d24/d30/fec [0,4194304] 0 2024-03-17T23:58:31.278 INFO:tasks.workunit.client.0.smithi196.stdout:0/786: chown d5/d23/d24/d30/f6b 115 1 2024-03-17T23:58:31.279 INFO:tasks.workunit.client.0.smithi196.stdout:8/447: dread f3 [0,4194304] 0 2024-03-17T23:58:31.279 INFO:tasks.workunit.client.0.smithi196.stdout:0/787: readlink d5/d23/d24/d59/d94/ldb 0 2024-03-17T23:58:31.280 INFO:tasks.workunit.client.0.smithi196.stdout:7/715: rename da/d3e/d45/d4f/d85 to da/d15/d1a/d5e/df3 0 2024-03-17T23:58:31.280 INFO:tasks.workunit.client.0.smithi196.stdout:3/792: creat d7/d19/d78/dca/ffc x:0 0 0 2024-03-17T23:58:31.281 INFO:tasks.workunit.client.0.smithi196.stdout:0/788: fdatasync d5/d23/f74 0 2024-03-17T23:58:31.282 INFO:tasks.workunit.client.0.smithi196.stdout:7/716: rmdir da/d15/da7 39 2024-03-17T23:58:31.282 INFO:tasks.workunit.client.0.smithi196.stdout:0/789: dread - d5/fb8 zero size 2024-03-17T23:58:31.283 INFO:tasks.workunit.client.0.smithi196.stdout:3/793: readlink d7/d19/d26/d2b/d3c/d3d/la8 0 2024-03-17T23:58:31.283 INFO:tasks.workunit.client.0.smithi196.stdout:7/717: chown da/d3e/d45/la3 31887 1 2024-03-17T23:58:31.285 INFO:tasks.workunit.client.0.smithi196.stdout:7/718: write da/d15/d1a/faa [883134,44219] 0 2024-03-17T23:58:31.288 INFO:tasks.workunit.client.0.smithi196.stdout:7/719: chown da/d3e/ddc 1662943 1 2024-03-17T23:58:31.289 INFO:tasks.workunit.client.0.smithi196.stdout:8/448: dread de/d2b/f38 [4194304,4194304] 0 2024-03-17T23:58:31.291 INFO:tasks.workunit.client.0.smithi196.stdout:0/790: truncate d5/d23/f74 442335 0 2024-03-17T23:58:31.292 INFO:tasks.workunit.client.0.smithi196.stdout:6/634: truncate d2/d14/d42/d57/d5f/f8d 4042746 0 2024-03-17T23:58:31.294 INFO:tasks.workunit.client.0.smithi196.stdout:6/635: fdatasync d2/d14/d42/f8f 0 2024-03-17T23:58:31.294 INFO:tasks.workunit.client.0.smithi196.stdout:8/449: dread de/d2b/d3c/f55 [0,4194304] 0 2024-03-17T23:58:31.295 INFO:tasks.workunit.client.0.smithi196.stdout:7/720: creat da/d15/d1d/d2e/ff4 x:0 0 0 2024-03-17T23:58:31.297 INFO:tasks.workunit.client.0.smithi196.stdout:0/791: mkdir d5/d23/d24/d28/d47/d52/d49/df8 0 2024-03-17T23:58:31.299 INFO:tasks.workunit.client.0.smithi196.stdout:3/794: link d7/d19/d26/d2b/d3c/d3d/f5a d7/d19/d78/d8b/ffd 0 2024-03-17T23:58:31.301 INFO:tasks.workunit.client.0.smithi196.stdout:8/450: mknod de/d10/d43/d71/c8b 0 2024-03-17T23:58:31.310 INFO:tasks.workunit.client.0.smithi196.stdout:0/792: creat d5/d23/d85/dce/ff9 x:0 0 0 2024-03-17T23:58:31.311 INFO:tasks.workunit.client.0.smithi196.stdout:8/451: creat de/d2b/d30/d33/f8c x:0 0 0 2024-03-17T23:58:31.314 INFO:tasks.workunit.client.0.smithi196.stdout:7/721: link da/d15/d1d/l34 da/d15/d1d/d29/dc4/lf5 0 2024-03-17T23:58:31.314 INFO:tasks.workunit.client.0.smithi196.stdout:0/793: write d5/d23/d24/d28/d47/d52/d49/ff4 [611769,17254] 0 2024-03-17T23:58:31.314 INFO:tasks.workunit.client.0.smithi196.stdout:3/795: dread d7/fb [0,4194304] 0 2024-03-17T23:58:31.317 INFO:tasks.workunit.client.0.smithi196.stdout:8/452: truncate de/d10/d35/d3e/f5f 775486 0 2024-03-17T23:58:31.321 INFO:tasks.workunit.client.0.smithi196.stdout:8/453: readlink lc 0 2024-03-17T23:58:31.322 INFO:tasks.workunit.client.0.smithi196.stdout:6/636: dwrite d2/d14/d42/f59 [0,4194304] 0 2024-03-17T23:58:31.323 INFO:tasks.workunit.client.0.smithi196.stdout:0/794: creat d5/d23/d24/d30/ffa x:0 0 0 2024-03-17T23:58:31.325 INFO:tasks.workunit.client.0.smithi196.stdout:6/637: fsync d2/d14/d75/dc0/ddf/da1/fa5 0 2024-03-17T23:58:31.330 INFO:tasks.workunit.client.0.smithi196.stdout:3/796: dwrite d7/d19/d26/d2b/fe9 [0,4194304] 0 2024-03-17T23:58:31.331 INFO:tasks.workunit.client.0.smithi196.stdout:3/797: read d7/d19/d26/d48/d4d/f85 [2606372,34151] 0 2024-03-17T23:58:31.332 INFO:tasks.workunit.client.0.smithi196.stdout:8/454: write de/f31 [608005,120761] 0 2024-03-17T23:58:31.339 INFO:tasks.workunit.client.0.smithi196.stdout:6/638: fsync d2/d14/d42/f64 0 2024-03-17T23:58:31.341 INFO:tasks.workunit.client.0.smithi196.stdout:3/798: rename d7/d19/d26/d2b/d3c/d3d/d7d/fc7 to d7/d19/d26/d2b/dcd/ffe 0 2024-03-17T23:58:31.342 INFO:tasks.workunit.client.0.smithi196.stdout:8/455: rmdir de/d10/d35 39 2024-03-17T23:58:31.345 INFO:tasks.workunit.client.0.smithi196.stdout:7/722: truncate da/d3e/d7f/f84 3073271 0 2024-03-17T23:58:31.346 INFO:tasks.workunit.client.0.smithi196.stdout:6/639: rmdir d2/d7 39 2024-03-17T23:58:31.347 INFO:tasks.workunit.client.0.smithi196.stdout:3/799: dread d7/fb [0,4194304] 0 2024-03-17T23:58:31.353 INFO:tasks.workunit.client.0.smithi196.stdout:8/456: creat de/d10/d35/d3e/f8d x:0 0 0 2024-03-17T23:58:31.357 INFO:tasks.workunit.client.0.smithi196.stdout:8/457: rmdir de/d2b/d30/d33 39 2024-03-17T23:58:31.363 INFO:tasks.workunit.client.0.smithi196.stdout:7/723: rename da/d15/d1d/d2e/l94 to da/d15/da7/lf6 0 2024-03-17T23:58:31.364 INFO:tasks.workunit.client.0.smithi196.stdout:7/724: readlink da/d3e/d45/dd8/de4/l4b 0 2024-03-17T23:58:31.365 INFO:tasks.workunit.client.0.smithi196.stdout:6/640: dwrite d2/d14/d35/f52 [0,4194304] 0 2024-03-17T23:58:31.370 INFO:tasks.workunit.client.0.smithi196.stdout:6/641: rename d2/d14/d8c/dd7 to d2/d14/d75/dc0/ddf/de6 0 2024-03-17T23:58:31.373 INFO:tasks.workunit.client.0.smithi196.stdout:3/800: dread d7/d33/f49 [0,4194304] 0 2024-03-17T23:58:31.374 INFO:tasks.workunit.client.0.smithi196.stdout:7/725: getdents da/d3e/d45/dd8/de4/d9e/da2 0 2024-03-17T23:58:31.375 INFO:tasks.workunit.client.0.smithi196.stdout:8/458: dwrite de/d10/d35/f4f [0,4194304] 0 2024-03-17T23:58:31.376 INFO:tasks.workunit.client.0.smithi196.stdout:6/642: creat d2/d7/d2b/fe7 x:0 0 0 2024-03-17T23:58:31.377 INFO:tasks.workunit.client.0.smithi196.stdout:8/459: truncate de/d5e/f60 738194 0 2024-03-17T23:58:31.382 INFO:tasks.workunit.client.0.smithi196.stdout:8/460: fdatasync de/f31 0 2024-03-17T23:58:31.386 INFO:tasks.workunit.client.0.smithi196.stdout:6/643: unlink d2/d14/d35/d63/lb8 0 2024-03-17T23:58:31.392 INFO:tasks.workunit.client.0.smithi196.stdout:6/644: link d2/d14/d8c/f91 d2/d14/d42/d57/d5f/fe8 0 2024-03-17T23:58:31.393 INFO:tasks.workunit.client.0.smithi196.stdout:8/461: getdents de/d10/d54 0 2024-03-17T23:58:31.395 INFO:tasks.workunit.client.0.smithi196.stdout:6/645: rmdir d2/d66/d90 39 2024-03-17T23:58:31.395 INFO:tasks.workunit.client.0.smithi196.stdout:3/801: dwrite d7/d19/f1c [0,4194304] 0 2024-03-17T23:58:31.395 INFO:tasks.workunit.client.0.smithi196.stdout:8/462: read de/d10/f1a [1288710,93087] 0 2024-03-17T23:58:31.399 INFO:tasks.workunit.client.0.smithi196.stdout:6/646: mkdir d2/d14/d75/dc0/ddf/de9 0 2024-03-17T23:58:31.401 INFO:tasks.workunit.client.0.smithi196.stdout:6/647: write d2/d14/d35/fc6 [426911,121107] 0 2024-03-17T23:58:31.401 INFO:tasks.workunit.client.0.smithi196.stdout:8/463: symlink de/d10/d54/l8e 0 2024-03-17T23:58:31.401 INFO:tasks.workunit.client.0.smithi196.stdout:7/726: dwrite da/d3e/d7f/f84 [0,4194304] 0 2024-03-17T23:58:31.411 INFO:tasks.workunit.client.0.smithi196.stdout:3/802: write d7/d19/d78/d93/fa0 [382728,5100] 0 2024-03-17T23:58:31.411 INFO:tasks.workunit.client.0.smithi196.stdout:7/727: symlink da/d3e/d7f/dc6/df0/lf7 0 2024-03-17T23:58:31.413 INFO:tasks.workunit.client.0.smithi196.stdout:3/803: chown d7/d19/d26/d48/d4d/faf 56 1 2024-03-17T23:58:31.414 INFO:tasks.workunit.client.0.smithi196.stdout:3/804: write d7/d29/f87 [5158583,36964] 0 2024-03-17T23:58:31.415 INFO:tasks.workunit.client.0.smithi196.stdout:6/648: rmdir d2/d14/d42/d57/d5f/dc5 0 2024-03-17T23:58:31.415 INFO:tasks.workunit.client.0.smithi196.stdout:8/464: dread de/d2b/f47 [0,4194304] 0 2024-03-17T23:58:31.416 INFO:tasks.workunit.client.0.smithi196.stdout:7/728: creat da/d3e/d45/d4f/d75/da8/ff8 x:0 0 0 2024-03-17T23:58:31.416 INFO:tasks.workunit.client.0.smithi196.stdout:8/465: readlink de/d10/d43/l4d 0 2024-03-17T23:58:31.416 INFO:tasks.workunit.client.0.smithi196.stdout:3/805: creat d7/d29/fff x:0 0 0 2024-03-17T23:58:31.418 INFO:tasks.workunit.client.0.smithi196.stdout:8/466: fdatasync de/d5e/f60 0 2024-03-17T23:58:31.421 INFO:tasks.workunit.client.0.smithi196.stdout:8/467: rmdir de/d2b/d3c/d5d/d65 39 2024-03-17T23:58:31.429 INFO:tasks.workunit.client.0.smithi196.stdout:7/729: rename da/d3e/d45/d4f/d75/da8/d78/d9f/fcd to da/d15/d1d/d29/ff9 0 2024-03-17T23:58:31.430 INFO:tasks.workunit.client.0.smithi196.stdout:6/649: dwrite d2/d14/d42/f4b [0,4194304] 0 2024-03-17T23:58:31.430 INFO:tasks.workunit.client.0.smithi196.stdout:7/730: write da/d15/fc0 [254761,48247] 0 2024-03-17T23:58:31.431 INFO:tasks.workunit.client.0.smithi196.stdout:8/468: rmdir de/d2b/d3c/d5d/d65 39 2024-03-17T23:58:31.432 INFO:tasks.workunit.client.0.smithi196.stdout:6/650: chown d2/d14/d42/l95 52 1 2024-03-17T23:58:31.433 INFO:tasks.workunit.client.0.smithi196.stdout:3/806: dread d7/d19/f73 [0,4194304] 0 2024-03-17T23:58:31.434 INFO:tasks.workunit.client.0.smithi196.stdout:8/469: creat de/d5e/f8f x:0 0 0 2024-03-17T23:58:31.434 INFO:tasks.workunit.client.0.smithi196.stdout:7/731: mknod da/d3e/d6d/cfa 0 2024-03-17T23:58:31.434 INFO:tasks.workunit.client.0.smithi196.stdout:3/807: chown d7/d19/d78/dca/ffc 148728572 1 2024-03-17T23:58:31.435 INFO:tasks.workunit.client.0.smithi196.stdout:3/808: stat d7/d19/d26/df5 0 2024-03-17T23:58:31.436 INFO:tasks.workunit.client.0.smithi196.stdout:7/732: chown da/d15/d1d/d4c/f51 3677905 1 2024-03-17T23:58:31.437 INFO:tasks.workunit.client.0.smithi196.stdout:8/470: unlink de/d10/c6f 0 2024-03-17T23:58:31.438 INFO:tasks.workunit.client.0.smithi196.stdout:8/471: dread - de/d10/d35/d3e/f8d zero size 2024-03-17T23:58:31.581 INFO:tasks.workunit.client.0.smithi196.stdout:7/733: mkdir da/d15/d1a/d5e/d70/dfb 0 2024-03-17T23:58:31.581 INFO:tasks.workunit.client.0.smithi196.stdout:3/809: rmdir d7/d19/dc4 39 2024-03-17T23:58:31.583 INFO:tasks.workunit.client.0.smithi196.stdout:7/734: write da/d3e/d6d/ddf/f8d [3869621,18454] 0 2024-03-17T23:58:31.583 INFO:tasks.workunit.client.0.smithi196.stdout:3/810: stat d7/d19/d26/d48/d4d/f85 0 2024-03-17T23:58:31.587 INFO:tasks.workunit.client.0.smithi196.stdout:3/811: symlink d7/d19/d26/d2b/dcd/l100 0 2024-03-17T23:58:31.588 INFO:tasks.workunit.client.0.smithi196.stdout:8/472: write de/f23 [989811,79956] 0 2024-03-17T23:58:31.590 INFO:tasks.workunit.client.0.smithi196.stdout:8/473: dread - de/d10/d35/d3e/f8d zero size 2024-03-17T23:58:31.590 INFO:tasks.workunit.client.0.smithi196.stdout:6/651: dwrite d2/d14/f20 [0,4194304] 0 2024-03-17T23:58:31.593 INFO:tasks.workunit.client.0.smithi196.stdout:8/474: creat de/d2b/d30/f90 x:0 0 0 2024-03-17T23:58:31.598 INFO:tasks.workunit.client.0.smithi196.stdout:6/652: rmdir d2/d14/d75/dc0/ddf/de9 0 2024-03-17T23:58:31.604 INFO:tasks.workunit.client.0.smithi196.stdout:6/653: dread d2/d14/f47 [0,4194304] 0 2024-03-17T23:58:31.604 INFO:tasks.workunit.client.0.smithi196.stdout:8/475: dwrite de/d2b/d30/d33/f8c [0,4194304] 0 2024-03-17T23:58:31.606 INFO:tasks.workunit.client.0.smithi196.stdout:6/654: fdatasync d2/d14/d75/dc0/ddf/da1/fa5 0 2024-03-17T23:58:31.609 INFO:tasks.workunit.client.0.smithi196.stdout:8/476: truncate de/f13 1087889 0 2024-03-17T23:58:31.609 INFO:tasks.workunit.client.0.smithi196.stdout:6/655: fdatasync d2/d14/d75/d7b/f7c 0 2024-03-17T23:58:31.609 INFO:tasks.workunit.client.0.smithi196.stdout:8/477: chown de/d5e/f70 666027 1 2024-03-17T23:58:31.610 INFO:tasks.workunit.client.0.smithi196.stdout:8/478: write de/f5b [164757,49160] 0 2024-03-17T23:58:31.611 INFO:tasks.workunit.client.0.smithi196.stdout:6/656: creat d2/d14/d35/d6a/fea x:0 0 0 2024-03-17T23:58:31.612 INFO:tasks.workunit.client.0.smithi196.stdout:8/479: fsync de/d2b/d3c/f6a 0 2024-03-17T23:58:31.613 INFO:tasks.workunit.client.0.smithi196.stdout:5/586: sync 2024-03-17T23:58:31.618 INFO:tasks.workunit.client.0.smithi196.stdout:5/587: write d6/d17/d1f/d7d/d81/f9d [298663,84116] 0 2024-03-17T23:58:31.618 INFO:tasks.workunit.client.0.smithi196.stdout:8/480: creat de/d2b/d3c/d5d/d65/f91 x:0 0 0 2024-03-17T23:58:31.623 INFO:tasks.workunit.client.0.smithi196.stdout:6/657: dwrite d2/d14/d42/d57/dc8/f87 [0,4194304] 0 2024-03-17T23:58:31.628 INFO:tasks.workunit.client.0.smithi196.stdout:8/481: getdents de/d10/d54/d5c/d81 0 2024-03-17T23:58:31.630 INFO:tasks.workunit.client.0.smithi196.stdout:6/658: creat d2/d14/d42/d57/d5f/dbd/feb x:0 0 0 2024-03-17T23:58:31.630 INFO:tasks.workunit.client.0.smithi196.stdout:5/588: write d6/d17/d1f/f4c [250233,115362] 0 2024-03-17T23:58:31.634 INFO:tasks.workunit.client.0.smithi196.stdout:8/482: link de/d10/d43/d71/f82 de/d10/d54/f92 0 2024-03-17T23:58:31.635 INFO:tasks.workunit.client.0.smithi196.stdout:5/589: mkdir d6/d2d/d9c/dc7 0 2024-03-17T23:58:31.636 INFO:tasks.workunit.client.0.smithi196.stdout:8/483: fsync de/d2b/d3c/d5d/f79 0 2024-03-17T23:58:31.639 INFO:tasks.workunit.client.0.smithi196.stdout:5/590: rename d6/d17/f6c to d6/d17/d23/d7e/fc8 0 2024-03-17T23:58:31.640 INFO:tasks.workunit.client.0.smithi196.stdout:6/659: dwrite d2/d14/f1d [4194304,4194304] 0 2024-03-17T23:58:31.642 INFO:tasks.workunit.client.0.smithi196.stdout:8/484: write de/f15 [2874370,38269] 0 2024-03-17T23:58:31.646 INFO:tasks.workunit.client.0.smithi196.stdout:8/485: mkdir de/d10/d35/d88/d93 0 2024-03-17T23:58:31.647 INFO:tasks.workunit.client.0.smithi196.stdout:6/660: creat d2/d14/de2/fec x:0 0 0 2024-03-17T23:58:31.648 INFO:tasks.workunit.client.0.smithi196.stdout:5/591: rename d6/d17/d3f/d4e/d69/c44 to d6/d2d/cc9 0 2024-03-17T23:58:31.649 INFO:tasks.workunit.client.0.smithi196.stdout:8/486: creat de/d10/d54/d5c/d81/f94 x:0 0 0 2024-03-17T23:58:31.651 INFO:tasks.workunit.client.0.smithi196.stdout:6/661: symlink d2/d14/d42/d57/led 0 2024-03-17T23:58:31.652 INFO:tasks.workunit.client.0.smithi196.stdout:6/662: dread - d2/d14/d35/f81 zero size 2024-03-17T23:58:31.653 INFO:tasks.workunit.client.0.smithi196.stdout:5/592: read d6/d17/d35/f4f [1481824,35829] 0 2024-03-17T23:58:31.653 INFO:tasks.workunit.client.0.smithi196.stdout:6/663: stat d2/d14/d8c/fc1 0 2024-03-17T23:58:31.653 INFO:tasks.workunit.client.0.smithi196.stdout:8/487: mknod de/d2b/d30/d7c/c95 0 2024-03-17T23:58:31.656 INFO:tasks.workunit.client.0.smithi196.stdout:6/664: creat d2/d14/d50/d68/fee x:0 0 0 2024-03-17T23:58:31.658 INFO:tasks.workunit.client.0.smithi196.stdout:6/665: mkdir d2/def 0 2024-03-17T23:58:31.661 INFO:tasks.workunit.client.0.smithi196.stdout:6/666: mknod d2/d14/d35/d6a/cf0 0 2024-03-17T23:58:31.662 INFO:tasks.workunit.client.0.smithi196.stdout:8/488: dwrite de/d5e/f8f [0,4194304] 0 2024-03-17T23:58:31.663 INFO:tasks.workunit.client.0.smithi196.stdout:8/489: write de/d10/d54/f67 [1045253,65392] 0 2024-03-17T23:58:31.667 INFO:tasks.workunit.client.0.smithi196.stdout:8/490: dread de/d10/d35/d3e/f5f [0,4194304] 0 2024-03-17T23:58:31.670 INFO:tasks.workunit.client.0.smithi196.stdout:8/491: mkdir de/d2b/d30/d33/d96 0 2024-03-17T23:58:31.678 INFO:tasks.workunit.client.0.smithi196.stdout:5/593: dread d6/d17/d1f/d7d/d81/f4a [0,4194304] 0 2024-03-17T23:58:31.684 INFO:tasks.workunit.client.0.smithi196.stdout:5/594: getdents d6/d17/d23/d7e 0 2024-03-17T23:58:31.684 INFO:tasks.workunit.client.0.smithi196.stdout:8/492: dread de/f31 [0,4194304] 0 2024-03-17T23:58:31.686 INFO:tasks.workunit.client.0.smithi196.stdout:5/595: fsync d6/d17/d1f/d7d/d81/f4a 0 2024-03-17T23:58:31.688 INFO:tasks.workunit.client.0.smithi196.stdout:8/493: creat de/d10/d35/d3e/f97 x:0 0 0 2024-03-17T23:58:31.688 INFO:tasks.workunit.client.0.smithi196.stdout:8/494: chown de/d2b/f87 567756 1 2024-03-17T23:58:31.689 INFO:tasks.workunit.client.0.smithi196.stdout:8/495: read de/d2b/d30/f68 [2711803,14001] 0 2024-03-17T23:58:31.693 INFO:tasks.workunit.client.0.smithi196.stdout:8/496: creat de/f98 x:0 0 0 2024-03-17T23:58:31.694 INFO:tasks.workunit.client.0.smithi196.stdout:5/596: dwrite d6/fa [0,4194304] 0 2024-03-17T23:58:31.696 INFO:tasks.workunit.client.0.smithi196.stdout:8/497: mknod de/d10/d43/d71/c99 0 2024-03-17T23:58:31.698 INFO:tasks.workunit.client.0.smithi196.stdout:5/597: chown d6/d17/d1f/d7d/d81/fad 5849 1 2024-03-17T23:58:31.705 INFO:tasks.workunit.client.0.smithi196.stdout:5/598: dwrite d6/fb [0,4194304] 0 2024-03-17T23:58:31.708 INFO:tasks.workunit.client.0.smithi196.stdout:8/498: write de/d10/d54/f92 [1042516,81625] 0 2024-03-17T23:58:31.710 INFO:tasks.workunit.client.0.smithi196.stdout:5/599: mknod d6/d17/d23/d53/d97/cca 0 2024-03-17T23:58:31.711 INFO:tasks.workunit.client.0.smithi196.stdout:8/499: stat de/d10/d35/d3e/f4c 0 2024-03-17T23:58:31.711 INFO:tasks.workunit.client.0.smithi196.stdout:5/600: chown d6/d2d/d33/d3b/c91 76895333 1 2024-03-17T23:58:31.712 INFO:tasks.workunit.client.0.smithi196.stdout:8/500: read - de/d2b/d30/d33/f77 zero size 2024-03-17T23:58:31.714 INFO:tasks.workunit.client.0.smithi196.stdout:5/601: creat d6/d2d/db8/fcb x:0 0 0 2024-03-17T23:58:31.715 INFO:tasks.workunit.client.0.smithi196.stdout:8/501: dread - de/d5e/f70 zero size 2024-03-17T23:58:31.717 INFO:tasks.workunit.client.0.smithi196.stdout:5/602: symlink d6/d17/d1f/lcc 0 2024-03-17T23:58:31.717 INFO:tasks.workunit.client.0.smithi196.stdout:8/502: symlink de/d2b/d3c/l9a 0 2024-03-17T23:58:31.718 INFO:tasks.workunit.client.0.smithi196.stdout:8/503: fsync de/f2d 0 2024-03-17T23:58:31.725 INFO:tasks.workunit.client.0.smithi196.stdout:5/603: dwrite d6/d17/d1f/d7d/d81/f8c [4194304,4194304] 0 2024-03-17T23:58:31.732 INFO:tasks.workunit.client.0.smithi196.stdout:5/604: symlink d6/lcd 0 2024-03-17T23:58:31.735 INFO:tasks.workunit.client.0.smithi196.stdout:5/605: mkdir d6/d2d/d33/dc5/dce 0 2024-03-17T23:58:31.737 INFO:tasks.workunit.client.0.smithi196.stdout:5/606: creat d6/d2d/d33/d3b/d80/da0/fcf x:0 0 0 2024-03-17T23:58:31.739 INFO:tasks.workunit.client.0.smithi196.stdout:8/504: dread de/d2b/d30/d33/f48 [0,4194304] 0 2024-03-17T23:58:31.741 INFO:tasks.workunit.client.0.smithi196.stdout:5/607: rmdir d6/d2d/d33/dbe 0 2024-03-17T23:58:31.745 INFO:tasks.workunit.client.0.smithi196.stdout:2/738: sync 2024-03-17T23:58:31.745 INFO:tasks.workunit.client.0.smithi196.stdout:5/608: link d6/d17/d1f/f4c d6/d17/d1f/d5c/fd0 0 2024-03-17T23:58:31.747 INFO:tasks.workunit.client.0.smithi196.stdout:8/505: dwrite de/d10/d35/d3e/f4c [0,4194304] 0 2024-03-17T23:58:31.748 INFO:tasks.workunit.client.0.smithi196.stdout:2/739: unlink d17/d28/d30/lc1 0 2024-03-17T23:58:31.752 INFO:tasks.workunit.client.0.smithi196.stdout:8/506: fsync de/d10/d43/f75 0 2024-03-17T23:58:31.770 INFO:tasks.workunit.client.0.smithi196.stdout:8/507: creat de/d10/d35/d88/f9b x:0 0 0 2024-03-17T23:58:31.771 INFO:tasks.workunit.client.0.smithi196.stdout:2/740: creat d17/d19/f10c x:0 0 0 2024-03-17T23:58:31.775 INFO:tasks.workunit.client.0.smithi196.stdout:2/741: mkdir d17/d22/d59/d10d 0 2024-03-17T23:58:31.778 INFO:tasks.workunit.client.0.smithi196.stdout:2/742: creat d17/d22/d3d/d8f/f10e x:0 0 0 2024-03-17T23:58:31.779 INFO:tasks.workunit.client.0.smithi196.stdout:2/743: dread - d17/d28/d30/d3b/fe5 zero size 2024-03-17T23:58:31.783 INFO:tasks.workunit.client.0.smithi196.stdout:2/744: write d17/d28/dae/fca [74545,2467] 0 2024-03-17T23:58:31.786 INFO:tasks.workunit.client.0.smithi196.stdout:5/609: dwrite d6/d2d/d33/d3b/f5e [0,4194304] 0 2024-03-17T23:58:31.790 INFO:tasks.workunit.client.0.smithi196.stdout:2/745: rename d17/d22/lb0 to d17/d28/d30/l10f 0 2024-03-17T23:58:31.795 INFO:tasks.workunit.client.0.smithi196.stdout:5/610: chown d6/d2d/d33/d3b/f6d 81832683 1 2024-03-17T23:58:31.797 INFO:tasks.workunit.client.0.smithi196.stdout:2/746: rename d17/d1f/cdf to d17/d22/da0/dc7/d103/c110 0 2024-03-17T23:58:31.804 INFO:tasks.workunit.client.0.smithi196.stdout:2/747: write d17/d28/d30/d3b/fac [564058,121281] 0 2024-03-17T23:58:31.804 INFO:tasks.workunit.client.0.smithi196.stdout:5/611: dwrite d6/d17/d1f/d7d/fb2 [0,4194304] 0 2024-03-17T23:58:31.807 INFO:tasks.workunit.client.0.smithi196.stdout:2/748: readlink d17/d22/d3d/l6a 0 2024-03-17T23:58:31.808 INFO:tasks.workunit.client.0.smithi196.stdout:2/749: creat d17/d68/f111 x:0 0 0 2024-03-17T23:58:31.810 INFO:tasks.workunit.client.0.smithi196.stdout:5/612: rename d6/d17/d1f/fac to d6/fd1 0 2024-03-17T23:58:31.814 INFO:tasks.workunit.client.0.smithi196.stdout:5/613: creat d6/d2d/d33/d84/fd2 x:0 0 0 2024-03-17T23:58:31.818 INFO:tasks.workunit.client.0.smithi196.stdout:2/750: dwrite d17/d19/d93/fc8 [0,4194304] 0 2024-03-17T23:58:31.821 INFO:tasks.workunit.client.0.smithi196.stdout:2/751: dread - d17/d28/d30/d71/faa zero size 2024-03-17T23:58:31.824 INFO:tasks.workunit.client.0.smithi196.stdout:2/752: rmdir d17/d68 39 2024-03-17T23:58:31.824 INFO:tasks.workunit.client.0.smithi196.stdout:2/753: fsync d17/d1f/f5d 0 2024-03-17T23:58:31.829 INFO:tasks.workunit.client.0.smithi196.stdout:5/614: link d6/d2d/d33/l87 d6/d2d/d9c/dc7/ld3 0 2024-03-17T23:58:31.830 INFO:tasks.workunit.client.0.smithi196.stdout:5/615: rmdir d6/d17/d3f/d4e/d69 39 2024-03-17T23:58:31.832 INFO:tasks.workunit.client.0.smithi196.stdout:5/616: creat d6/d17/d23/d7e/fd4 x:0 0 0 2024-03-17T23:58:31.834 INFO:tasks.workunit.client.0.smithi196.stdout:5/617: symlink d6/d17/d23/ld5 0 2024-03-17T23:58:31.836 INFO:tasks.workunit.client.0.smithi196.stdout:5/618: mknod d6/d2d/d9c/cd6 0 2024-03-17T23:58:31.838 INFO:tasks.workunit.client.0.smithi196.stdout:5/619: mkdir d6/d17/d1f/d7d/dd7 0 2024-03-17T23:58:31.839 INFO:tasks.workunit.client.0.smithi196.stdout:5/620: chown d6/d17/d23/fc6 96518 1 2024-03-17T23:58:31.845 INFO:tasks.workunit.client.0.smithi196.stdout:2/754: dwrite f13 [0,4194304] 0 2024-03-17T23:58:31.848 INFO:tasks.workunit.client.0.smithi196.stdout:2/755: creat d17/d19/d44/d52/df0/f112 x:0 0 0 2024-03-17T23:58:31.851 INFO:tasks.workunit.client.0.smithi196.stdout:2/756: creat d17/d22/d59/d10d/f113 x:0 0 0 2024-03-17T23:58:31.856 INFO:tasks.workunit.client.0.smithi196.stdout:5/621: dwrite d6/fd1 [0,4194304] 0 2024-03-17T23:58:31.858 INFO:tasks.workunit.client.0.smithi196.stdout:5/622: write d6/fa [5136486,109804] 0 2024-03-17T23:58:31.859 INFO:tasks.workunit.client.0.smithi196.stdout:5/623: stat d6/d17/d1f/d5c 0 2024-03-17T23:58:31.860 INFO:tasks.workunit.client.0.smithi196.stdout:2/757: mkdir d17/d22/d3d/d8f/d114 0 2024-03-17T23:58:31.862 INFO:tasks.workunit.client.0.smithi196.stdout:5/624: symlink d6/d17/d1f/ld8 0 2024-03-17T23:58:31.863 INFO:tasks.workunit.client.0.smithi196.stdout:2/758: rmdir d17/d19/d44/d52/df0 39 2024-03-17T23:58:31.864 INFO:tasks.workunit.client.0.smithi196.stdout:5/625: symlink d6/d17/d35/ld9 0 2024-03-17T23:58:31.864 INFO:tasks.workunit.client.0.smithi196.stdout:5/626: read f3 [2415700,85901] 0 2024-03-17T23:58:31.867 INFO:tasks.workunit.client.0.smithi196.stdout:5/627: mknod d6/d17/d23/d53/cda 0 2024-03-17T23:58:31.876 INFO:tasks.workunit.client.0.smithi196.stdout:2/759: dwrite d17/d28/f29 [0,4194304] 0 2024-03-17T23:58:31.876 INFO:tasks.workunit.client.0.smithi196.stdout:5/628: dwrite d6/d2d/d33/d84/fd2 [0,4194304] 0 2024-03-17T23:58:31.880 INFO:tasks.workunit.client.0.smithi196.stdout:5/629: readlink d6/d17/d3f/d4e/l52 0 2024-03-17T23:58:31.883 INFO:tasks.workunit.client.0.smithi196.stdout:2/760: unlink d17/d28/d30/d71/de0/fe3 0 2024-03-17T23:58:31.889 INFO:tasks.workunit.client.0.smithi196.stdout:5/630: dwrite d6/d17/d23/d53/f54 [0,4194304] 0 2024-03-17T23:58:31.892 INFO:tasks.workunit.client.0.smithi196.stdout:5/631: symlink d6/d17/d1f/ldb 0 2024-03-17T23:58:31.893 INFO:tasks.workunit.client.0.smithi196.stdout:5/632: dread - d6/d2d/db8/fcb zero size 2024-03-17T23:58:31.895 INFO:tasks.workunit.client.0.smithi196.stdout:2/761: write d17/d22/f6c [935825,97740] 0 2024-03-17T23:58:31.896 INFO:tasks.workunit.client.0.smithi196.stdout:5/633: creat d6/d17/d23/d7e/fdc x:0 0 0 2024-03-17T23:58:31.897 INFO:tasks.workunit.client.0.smithi196.stdout:2/762: chown d17/d19/c3e 367 1 2024-03-17T23:58:31.899 INFO:tasks.workunit.client.0.smithi196.stdout:2/763: read d17/d1f/fa9 [342552,114471] 0 2024-03-17T23:58:31.901 INFO:tasks.workunit.client.0.smithi196.stdout:2/764: write d17/d1f/f20 [1564939,116508] 0 2024-03-17T23:58:31.901 INFO:tasks.workunit.client.0.smithi196.stdout:5/634: symlink d6/d2d/d33/d3b/d80/db9/ldd 0 2024-03-17T23:58:31.901 INFO:tasks.workunit.client.0.smithi196.stdout:5/635: chown d6/d2a 2444 1 2024-03-17T23:58:31.903 INFO:tasks.workunit.client.0.smithi196.stdout:5/636: fdatasync d6/d17/d3f/d4e/f73 0 2024-03-17T23:58:31.903 INFO:tasks.workunit.client.0.smithi196.stdout:2/765: write d17/d28/d30/d72/d81/fa4 [4168565,72438] 0 2024-03-17T23:58:31.906 INFO:tasks.workunit.client.0.smithi196.stdout:5/637: creat d6/d2d/d33/d3b/d80/db9/fde x:0 0 0 2024-03-17T23:58:31.906 INFO:tasks.workunit.client.0.smithi196.stdout:2/766: symlink d17/d22/da0/l115 0 2024-03-17T23:58:31.907 INFO:tasks.workunit.client.0.smithi196.stdout:2/767: fdatasync d17/d1f/f5d 0 2024-03-17T23:58:31.916 INFO:tasks.workunit.client.0.smithi196.stdout:5/638: dwrite d6/d2d/d33/f9b [0,4194304] 0 2024-03-17T23:58:31.917 INFO:tasks.workunit.client.0.smithi196.stdout:2/768: dwrite d17/d28/d30/d71/de0/fe4 [0,4194304] 0 2024-03-17T23:58:31.918 INFO:tasks.workunit.client.0.smithi196.stdout:5/639: write d6/d17/d1f/d5c/fa9 [794236,84598] 0 2024-03-17T23:58:31.926 INFO:tasks.workunit.client.0.smithi196.stdout:5/640: creat d6/d15/dc0/fdf x:0 0 0 2024-03-17T23:58:31.929 INFO:tasks.workunit.client.0.smithi196.stdout:1/570: sync 2024-03-17T23:58:31.931 INFO:tasks.workunit.client.0.smithi196.stdout:5/641: symlink d6/d17/d1f/le0 0 2024-03-17T23:58:31.932 INFO:tasks.workunit.client.0.smithi196.stdout:1/571: rmdir d1/d13/d23/d62/d71 39 2024-03-17T23:58:31.933 INFO:tasks.workunit.client.0.smithi196.stdout:2/769: dwrite d17/d19/d44/d52/df0/f112 [0,4194304] 0 2024-03-17T23:58:31.937 INFO:tasks.workunit.client.0.smithi196.stdout:2/770: chown d17/d1f/f23 285 1 2024-03-17T23:58:31.967 INFO:tasks.workunit.client.0.smithi196.stdout:1/572: write d1/fa [686210,54139] 0 2024-03-17T23:58:31.967 INFO:tasks.workunit.client.0.smithi196.stdout:5/642: link d6/c14 d6/d17/d1f/ce1 0 2024-03-17T23:58:31.969 INFO:tasks.workunit.client.0.smithi196.stdout:2/771: creat d17/f116 x:0 0 0 2024-03-17T23:58:31.970 INFO:tasks.workunit.client.0.smithi196.stdout:5/643: readlink d6/d2d/d33/l4b 0 2024-03-17T23:58:31.971 INFO:tasks.workunit.client.0.smithi196.stdout:5/644: dread - d6/d2d/db8/fcb zero size 2024-03-17T23:58:31.971 INFO:tasks.workunit.client.0.smithi196.stdout:1/573: creat d1/d13/d23/d47/d48/fbc x:0 0 0 2024-03-17T23:58:31.971 INFO:tasks.workunit.client.0.smithi196.stdout:2/772: symlink d17/d28/d30/d72/d81/l117 0 2024-03-17T23:58:31.975 INFO:tasks.workunit.client.0.smithi196.stdout:2/773: creat d17/d19/f118 x:0 0 0 2024-03-17T23:58:31.976 INFO:tasks.workunit.client.0.smithi196.stdout:2/774: write d17/d19/d93/fd1 [945073,103434] 0 2024-03-17T23:58:31.978 INFO:tasks.workunit.client.0.smithi196.stdout:2/775: stat d17/d22/f9c 0 2024-03-17T23:58:31.978 INFO:tasks.workunit.client.0.smithi196.stdout:5/645: write d6/d17/d23/d7e/fc8 [597851,3725] 0 2024-03-17T23:58:31.982 INFO:tasks.workunit.client.0.smithi196.stdout:2/776: getdents d17/d1f 0 2024-03-17T23:58:31.983 INFO:tasks.workunit.client.0.smithi196.stdout:5/646: getdents d6/d2d/d33/d3b 0 2024-03-17T23:58:31.984 INFO:tasks.workunit.client.0.smithi196.stdout:5/647: truncate d6/d17/d23/d7e/fc8 1046011 0 2024-03-17T23:58:31.985 INFO:tasks.workunit.client.0.smithi196.stdout:2/777: creat d17/d22/d59/f119 x:0 0 0 2024-03-17T23:58:31.985 INFO:tasks.workunit.client.0.smithi196.stdout:5/648: chown d6/d17/f34 84872036 1 2024-03-17T23:58:31.987 INFO:tasks.workunit.client.0.smithi196.stdout:2/778: chown d17/d22/d59/cf3 27346 1 2024-03-17T23:58:31.987 INFO:tasks.workunit.client.0.smithi196.stdout:5/649: symlink d6/d2d/d33/d3b/d80/da0/le2 0 2024-03-17T23:58:31.989 INFO:tasks.workunit.client.0.smithi196.stdout:2/779: mknod d17/d22/d3d/d8f/c11a 0 2024-03-17T23:58:31.991 INFO:tasks.workunit.client.0.smithi196.stdout:5/650: unlink d6/d17/d23/d53/c94 0 2024-03-17T23:58:31.992 INFO:tasks.workunit.client.0.smithi196.stdout:5/651: write d6/d2d/d33/d3b/d80/da0/fba [866183,107913] 0 2024-03-17T23:58:31.994 INFO:tasks.workunit.client.0.smithi196.stdout:2/780: rename d17/d28/d30/d71/faa to d17/d22/f11b 0 2024-03-17T23:58:32.000 INFO:tasks.workunit.client.0.smithi196.stdout:5/652: dwrite d6/d17/f26 [0,4194304] 0 2024-03-17T23:58:32.006 INFO:tasks.workunit.client.0.smithi196.stdout:2/781: dwrite d17/d28/d30/d71/de0/fe4 [0,4194304] 0 2024-03-17T23:58:32.008 INFO:tasks.workunit.client.0.smithi196.stdout:2/782: write d17/d28/d30/d71/f88 [2339523,85914] 0 2024-03-17T23:58:32.009 INFO:tasks.workunit.client.0.smithi196.stdout:5/653: unlink d6/d17/d1f/d7d/d81/fc3 0 2024-03-17T23:58:32.012 INFO:tasks.workunit.client.0.smithi196.stdout:5/654: truncate d6/d2d/d33/d3b/d80/db9/fde 763090 0 2024-03-17T23:58:32.015 INFO:tasks.workunit.client.0.smithi196.stdout:5/655: creat d6/d2d/fe3 x:0 0 0 2024-03-17T23:58:32.021 INFO:tasks.workunit.client.0.smithi196.stdout:5/656: fsync d6/d17/d3f/d4e/d69/fc4 0 2024-03-17T23:58:32.022 INFO:tasks.workunit.client.0.smithi196.stdout:2/783: dread d17/d28/d30/f62 [0,4194304] 0 2024-03-17T23:58:32.023 INFO:tasks.workunit.client.0.smithi196.stdout:5/657: truncate f3 272261 0 2024-03-17T23:58:32.024 INFO:tasks.workunit.client.0.smithi196.stdout:5/658: fsync d6/d17/d1f/d5c/fa9 0 2024-03-17T23:58:32.025 INFO:tasks.workunit.client.0.smithi196.stdout:2/784: symlink d17/d28/l11c 0 2024-03-17T23:58:32.026 INFO:tasks.workunit.client.0.smithi196.stdout:5/659: creat d6/d17/d23/d53/d97/fe4 x:0 0 0 2024-03-17T23:58:32.029 INFO:tasks.workunit.client.0.smithi196.stdout:5/660: mkdir d6/d15/dc0/de5 0 2024-03-17T23:58:32.039 INFO:tasks.workunit.client.0.smithi196.stdout:5/661: truncate d6/fd1 3780516 0 2024-03-17T23:58:32.047 INFO:tasks.workunit.client.0.smithi196.stdout:2/785: dread d17/d22/f6c [0,4194304] 0 2024-03-17T23:58:32.048 INFO:tasks.workunit.client.0.smithi196.stdout:5/662: dwrite d6/fa [0,4194304] 0 2024-03-17T23:58:32.049 INFO:tasks.workunit.client.0.smithi196.stdout:2/786: rmdir d17/d22/d3d/d8f/dbe 39 2024-03-17T23:58:32.050 INFO:tasks.workunit.client.0.smithi196.stdout:2/787: fsync d17/d22/d3d/d8f/fdc 0 2024-03-17T23:58:32.062 INFO:tasks.workunit.client.0.smithi196.stdout:2/788: rename d17/d28/d30/f6b to d17/f11d 0 2024-03-17T23:58:32.063 INFO:tasks.workunit.client.0.smithi196.stdout:2/789: read - d17/d28/d96/fdd zero size 2024-03-17T23:58:32.063 INFO:tasks.workunit.client.0.smithi196.stdout:5/663: truncate d6/fb 1715271 0 2024-03-17T23:58:32.065 INFO:tasks.workunit.client.0.smithi196.stdout:5/664: creat d6/d17/d1f/fe6 x:0 0 0 2024-03-17T23:58:32.066 INFO:tasks.workunit.client.0.smithi196.stdout:5/665: chown d6/d2d/d33/d84 3086 1 2024-03-17T23:58:32.067 INFO:tasks.workunit.client.0.smithi196.stdout:2/790: getdents d17/d19/d44/d52 0 2024-03-17T23:58:32.068 INFO:tasks.workunit.client.0.smithi196.stdout:5/666: truncate d6/d17/d23/d53/f54 5189474 0 2024-03-17T23:58:32.076 INFO:tasks.workunit.client.0.smithi196.stdout:5/667: dwrite d6/d17/d23/d7e/fdc [0,4194304] 0 2024-03-17T23:58:32.077 INFO:tasks.workunit.client.0.smithi196.stdout:2/791: dwrite f2 [0,4194304] 0 2024-03-17T23:58:32.081 INFO:tasks.workunit.client.0.smithi196.stdout:2/792: read d17/d22/da0/f9e [667694,82387] 0 2024-03-17T23:58:32.085 INFO:tasks.workunit.client.0.smithi196.stdout:2/793: dread - d17/d28/d96/fc3 zero size 2024-03-17T23:58:32.087 INFO:tasks.workunit.client.0.smithi196.stdout:2/794: write d17/d22/d3d/f53 [1398883,74324] 0 2024-03-17T23:58:32.091 INFO:tasks.workunit.client.0.smithi196.stdout:5/668: dwrite d6/d17/d23/f9f [0,4194304] 0 2024-03-17T23:58:32.092 INFO:tasks.workunit.client.0.smithi196.stdout:2/795: mkdir d17/d22/d3d/d8f/df2/d11e 0 2024-03-17T23:58:32.092 INFO:tasks.workunit.client.0.smithi196.stdout:5/669: chown d6/d2a/c62 16135108 1 2024-03-17T23:58:32.098 INFO:tasks.workunit.client.0.smithi196.stdout:2/796: creat d17/d28/d30/d3b/f11f x:0 0 0 2024-03-17T23:58:32.099 INFO:tasks.workunit.client.0.smithi196.stdout:5/670: dread d6/d17/f26 [0,4194304] 0 2024-03-17T23:58:32.099 INFO:tasks.workunit.client.0.smithi196.stdout:2/797: write d17/d19/d44/fb1 [242160,64511] 0 2024-03-17T23:58:32.100 INFO:tasks.workunit.client.0.smithi196.stdout:5/671: fdatasync d6/d17/d3f/d4e/f73 0 2024-03-17T23:58:32.103 INFO:tasks.workunit.client.0.smithi196.stdout:5/672: mkdir d6/d17/d3f/d4e/d69/de7 0 2024-03-17T23:58:32.105 INFO:tasks.workunit.client.0.smithi196.stdout:2/798: rename d17/d28/dae/cb9 to d17/c120 0 2024-03-17T23:58:32.106 INFO:tasks.workunit.client.0.smithi196.stdout:5/673: creat d6/d17/d1f/d7d/dd7/fe8 x:0 0 0 2024-03-17T23:58:32.109 INFO:tasks.workunit.client.0.smithi196.stdout:5/674: symlink d6/d2d/d33/dc5/dce/le9 0 2024-03-17T23:58:32.113 INFO:tasks.workunit.client.0.smithi196.stdout:5/675: getdents d6/d2d 0 2024-03-17T23:58:32.117 INFO:tasks.workunit.client.0.smithi196.stdout:2/799: truncate d17/f18 3744437 0 2024-03-17T23:58:32.118 INFO:tasks.workunit.client.0.smithi196.stdout:5/676: symlink d6/d2d/d33/dc5/dce/lea 0 2024-03-17T23:58:32.121 INFO:tasks.workunit.client.0.smithi196.stdout:2/800: symlink d17/dce/l121 0 2024-03-17T23:58:32.121 INFO:tasks.workunit.client.0.smithi196.stdout:5/677: truncate d6/d2d/d33/d3b/d80/db9/fde 1149130 0 2024-03-17T23:58:32.123 INFO:tasks.workunit.client.0.smithi196.stdout:2/801: creat d17/d22/da0/dc7/d103/f122 x:0 0 0 2024-03-17T23:58:32.123 INFO:tasks.workunit.client.0.smithi196.stdout:5/678: mknod d6/d17/d1f/d7d/dd7/ceb 0 2024-03-17T23:58:32.125 INFO:tasks.workunit.client.0.smithi196.stdout:2/802: read - d17/d68/f111 zero size 2024-03-17T23:58:32.126 INFO:tasks.workunit.client.0.smithi196.stdout:5/679: write d6/d2d/d33/faa [173261,77103] 0 2024-03-17T23:58:32.126 INFO:tasks.workunit.client.0.smithi196.stdout:2/803: fdatasync d17/d28/f46 0 2024-03-17T23:58:32.129 INFO:tasks.workunit.client.0.smithi196.stdout:5/680: read d6/d17/d1f/f50 [3010320,103407] 0 2024-03-17T23:58:32.136 INFO:tasks.workunit.client.0.smithi196.stdout:5/681: write d6/d17/d35/f66 [1188641,57832] 0 2024-03-17T23:58:32.137 INFO:tasks.workunit.client.0.smithi196.stdout:5/682: dread - d6/d17/d3f/fc1 zero size 2024-03-17T23:58:32.165 INFO:tasks.workunit.client.0.smithi196.stdout:4/580: sync 2024-03-17T23:58:32.165 INFO:tasks.workunit.client.0.smithi196.stdout:0/795: sync 2024-03-17T23:58:32.165 INFO:tasks.workunit.client.0.smithi196.stdout:9/614: sync 2024-03-17T23:58:32.166 INFO:tasks.workunit.client.0.smithi196.stdout:9/615: write d9/d33/f42 [123023,34818] 0 2024-03-17T23:58:32.167 INFO:tasks.workunit.client.0.smithi196.stdout:9/616: chown d9/df/d4a/d89 762457692 1 2024-03-17T23:58:32.168 INFO:tasks.workunit.client.0.smithi196.stdout:2/804: write d17/d28/d30/f62 [743116,74943] 0 2024-03-17T23:58:32.175 INFO:tasks.workunit.client.0.smithi196.stdout:4/581: dwrite d1/d26/d57/dac/fb5 [0,4194304] 0 2024-03-17T23:58:32.189 INFO:tasks.workunit.client.0.smithi196.stdout:4/582: symlink d1/d68/d74/ld3 0 2024-03-17T23:58:32.193 INFO:tasks.workunit.client.0.smithi196.stdout:2/805: dwrite d17/d28/d30/d72/d81/fa1 [4194304,4194304] 0 2024-03-17T23:58:32.199 INFO:tasks.workunit.client.0.smithi196.stdout:4/583: unlink d1/d26/d57/cb1 0 2024-03-17T23:58:32.202 INFO:tasks.workunit.client.0.smithi196.stdout:9/617: rmdir d9/dbb/dc0 0 2024-03-17T23:58:32.202 INFO:tasks.workunit.client.0.smithi196.stdout:5/683: dwrite d6/d17/d35/f4f [0,4194304] 0 2024-03-17T23:58:32.205 INFO:tasks.workunit.client.0.smithi196.stdout:0/796: getdents d5/d23/d24/da3/dbb 0 2024-03-17T23:58:32.208 INFO:tasks.workunit.client.0.smithi196.stdout:4/584: dread d1/d26/d33/f72 [0,4194304] 0 2024-03-17T23:58:32.210 INFO:tasks.workunit.client.0.smithi196.stdout:5/684: mknod d6/d2d/cec 0 2024-03-17T23:58:32.212 INFO:tasks.workunit.client.0.smithi196.stdout:0/797: symlink d5/d23/d24/da3/lfb 0 2024-03-17T23:58:32.212 INFO:tasks.workunit.client.0.smithi196.stdout:2/806: write d17/d28/d30/fcf [272997,106894] 0 2024-03-17T23:58:32.215 INFO:tasks.workunit.client.0.smithi196.stdout:4/585: rename d1/d26/f80 to d1/d26/d57/d8c/fd4 0 2024-03-17T23:58:32.217 INFO:tasks.workunit.client.0.smithi196.stdout:0/798: fsync d5/d23/d24/d30/d4e/f8c 0 2024-03-17T23:58:32.218 INFO:tasks.workunit.client.0.smithi196.stdout:2/807: symlink d17/d22/da0/l123 0 2024-03-17T23:58:32.220 INFO:tasks.workunit.client.0.smithi196.stdout:2/808: read - d17/d22/da0/dc7/d103/f122 zero size 2024-03-17T23:58:32.220 INFO:tasks.workunit.client.0.smithi196.stdout:5/685: dwrite d6/d17/f99 [0,4194304] 0 2024-03-17T23:58:32.223 INFO:tasks.workunit.client.0.smithi196.stdout:9/618: write d9/df/d4a/f80 [193316,83800] 0 2024-03-17T23:58:32.223 INFO:tasks.workunit.client.0.smithi196.stdout:0/799: fdatasync d5/f13 0 2024-03-17T23:58:32.224 INFO:tasks.workunit.client.0.smithi196.stdout:2/809: rmdir d17/d22/da0 39 2024-03-17T23:58:32.224 INFO:tasks.workunit.client.0.smithi196.stdout:5/686: write d6/d2a/f47 [385642,17810] 0 2024-03-17T23:58:32.229 INFO:tasks.workunit.client.0.smithi196.stdout:0/800: readlink d5/d23/d24/d28/d47/d52/d61/l89 0 2024-03-17T23:58:32.229 INFO:tasks.workunit.client.0.smithi196.stdout:9/619: truncate d9/df/d4a/d5b/d62/dba/d60/d5e/fb9 693223 0 2024-03-17T23:58:32.232 INFO:tasks.workunit.client.0.smithi196.stdout:4/586: dwrite d1/d68/f87 [0,4194304] 0 2024-03-17T23:58:32.235 INFO:tasks.workunit.client.0.smithi196.stdout:5/687: mkdir d6/d17/d3f/d4e/d69/ded 0 2024-03-17T23:58:32.235 INFO:tasks.workunit.client.0.smithi196.stdout:4/587: stat d1/de/d50 0 2024-03-17T23:58:32.235 INFO:tasks.workunit.client.0.smithi196.stdout:5/688: stat d6/d17/d35/la2 0 2024-03-17T23:58:32.235 INFO:tasks.workunit.client.0.smithi196.stdout:4/588: chown d1/de/d50/cab 1 1 2024-03-17T23:58:32.241 INFO:tasks.workunit.client.0.smithi196.stdout:9/620: dwrite d9/df/d14/d27/fa6 [0,4194304] 0 2024-03-17T23:58:32.241 INFO:tasks.workunit.client.0.smithi196.stdout:4/589: creat d1/dd2/dcb/fd5 x:0 0 0 2024-03-17T23:58:32.246 INFO:tasks.workunit.client.0.smithi196.stdout:5/689: dread d6/d2d/d33/d3b/f5e [0,4194304] 0 2024-03-17T23:58:32.249 INFO:tasks.workunit.client.0.smithi196.stdout:4/590: creat d1/d26/d57/d8c/d97/fd6 x:0 0 0 2024-03-17T23:58:32.252 INFO:tasks.workunit.client.0.smithi196.stdout:5/690: mknod d6/d2d/d33/cee 0 2024-03-17T23:58:32.252 INFO:tasks.workunit.client.0.smithi196.stdout:4/591: rmdir d1/d26/d57/d8c/d97 39 2024-03-17T23:58:32.256 INFO:tasks.workunit.client.0.smithi196.stdout:0/801: dread d5/d23/d24/d28/d47/d52/f42 [0,4194304] 0 2024-03-17T23:58:32.258 INFO:tasks.workunit.client.0.smithi196.stdout:4/592: unlink d1/d26/d57/dac/lae 0 2024-03-17T23:58:32.258 INFO:tasks.workunit.client.0.smithi196.stdout:0/802: symlink d5/d23/d24/d59/de6/lfc 0 2024-03-17T23:58:32.260 INFO:tasks.workunit.client.0.smithi196.stdout:4/593: write d1/d26/fcc [416640,120848] 0 2024-03-17T23:58:32.262 INFO:tasks.workunit.client.0.smithi196.stdout:4/594: rename d1 to d1/d11/dd7 22 2024-03-17T23:58:32.265 INFO:tasks.workunit.client.0.smithi196.stdout:0/803: mknod d5/d23/d24/d28/d47/d52/d61/d6c/d82/cfd 0 2024-03-17T23:58:32.266 INFO:tasks.workunit.client.0.smithi196.stdout:4/595: creat d1/d26/d33/fd8 x:0 0 0 2024-03-17T23:58:32.269 INFO:tasks.workunit.client.0.smithi196.stdout:4/596: mknod d1/de/cd9 0 2024-03-17T23:58:32.270 INFO:tasks.workunit.client.0.smithi196.stdout:5/691: dread d6/ff [0,4194304] 0 2024-03-17T23:58:32.273 INFO:tasks.workunit.client.0.smithi196.stdout:5/692: creat d6/d17/d1f/d5c/fef x:0 0 0 2024-03-17T23:58:32.276 INFO:tasks.workunit.client.0.smithi196.stdout:4/597: write d1/d11/f1c [738641,115446] 0 2024-03-17T23:58:32.277 INFO:tasks.workunit.client.0.smithi196.stdout:5/693: symlink d6/d17/d1f/d7d/lf0 0 2024-03-17T23:58:32.278 INFO:tasks.workunit.client.0.smithi196.stdout:4/598: chown d1/d11/l47 60 1 2024-03-17T23:58:32.279 INFO:tasks.workunit.client.0.smithi196.stdout:4/599: dread - d1/d68/d74/fbf zero size 2024-03-17T23:58:32.281 INFO:tasks.workunit.client.0.smithi196.stdout:5/694: creat d6/d2d/ff1 x:0 0 0 2024-03-17T23:58:32.282 INFO:tasks.workunit.client.0.smithi196.stdout:4/600: mknod d1/d26/d33/d3f/cda 0 2024-03-17T23:58:32.283 INFO:tasks.workunit.client.0.smithi196.stdout:4/601: chown d1/d1b/l24 10260080 1 2024-03-17T23:58:32.283 INFO:tasks.workunit.client.0.smithi196.stdout:0/804: dread d5/f1c [0,4194304] 0 2024-03-17T23:58:32.287 INFO:tasks.workunit.client.0.smithi196.stdout:5/695: mknod d6/d17/d3f/da5/cf2 0 2024-03-17T23:58:32.291 INFO:tasks.workunit.client.0.smithi196.stdout:5/696: symlink d6/d2d/d33/d3b/d80/db9/lf3 0 2024-03-17T23:58:32.292 INFO:tasks.workunit.client.0.smithi196.stdout:4/602: dwrite d1/d26/d33/d85/f92 [0,4194304] 0 2024-03-17T23:58:32.293 INFO:tasks.workunit.client.0.smithi196.stdout:5/697: fsync d6/d17/d3f/d4e/f73 0 2024-03-17T23:58:32.296 INFO:tasks.workunit.client.0.smithi196.stdout:5/698: symlink d6/d2d/d33/dc5/dce/lf4 0 2024-03-17T23:58:32.299 INFO:tasks.workunit.client.0.smithi196.stdout:5/699: mkdir d6/d17/df5 0 2024-03-17T23:58:32.304 INFO:tasks.workunit.client.0.smithi196.stdout:4/603: truncate d1/d26/d33/d3f/f6e 2491006 0 2024-03-17T23:58:32.304 INFO:tasks.workunit.client.0.smithi196.stdout:5/700: creat d6/d17/d3f/ff6 x:0 0 0 2024-03-17T23:58:32.304 INFO:tasks.workunit.client.0.smithi196.stdout:4/604: fdatasync d1/d26/d33/d3f/f7a 0 2024-03-17T23:58:32.307 INFO:tasks.workunit.client.0.smithi196.stdout:4/605: mknod d1/d26/d57/dac/db2/cdb 0 2024-03-17T23:58:32.308 INFO:tasks.workunit.client.0.smithi196.stdout:0/805: dread d5/d23/f33 [4194304,4194304] 0 2024-03-17T23:58:32.308 INFO:tasks.workunit.client.0.smithi196.stdout:5/701: mknod d6/d2d/db8/cf7 0 2024-03-17T23:58:32.308 INFO:tasks.workunit.client.0.smithi196.stdout:0/806: stat d5/d23/d24/d30/l86 0 2024-03-17T23:58:32.309 INFO:tasks.workunit.client.0.smithi196.stdout:4/606: symlink d1/d26/d33/d85/ldc 0 2024-03-17T23:58:32.310 INFO:tasks.workunit.client.0.smithi196.stdout:5/702: symlink d6/d17/d1f/d5c/lf8 0 2024-03-17T23:58:32.311 INFO:tasks.workunit.client.0.smithi196.stdout:4/607: creat d1/d1b/d77/fdd x:0 0 0 2024-03-17T23:58:32.312 INFO:tasks.workunit.client.0.smithi196.stdout:5/703: symlink d6/d15/dc0/de5/lf9 0 2024-03-17T23:58:32.315 INFO:tasks.workunit.client.0.smithi196.stdout:5/704: creat d6/d2d/d33/ffa x:0 0 0 2024-03-17T23:58:32.318 INFO:tasks.workunit.client.0.smithi196.stdout:5/705: creat d6/d17/d3f/d4e/d69/ded/ffb x:0 0 0 2024-03-17T23:58:32.320 INFO:tasks.workunit.client.0.smithi196.stdout:5/706: mknod d6/d2d/d33/d3b/d65/cfc 0 2024-03-17T23:58:32.321 INFO:tasks.workunit.client.0.smithi196.stdout:5/707: truncate d6/d17/d23/d53/f8f 4676030 0 2024-03-17T23:58:32.324 INFO:tasks.workunit.client.0.smithi196.stdout:5/708: mkdir d6/d17/d1f/d7d/d81/dfd 0 2024-03-17T23:58:32.326 INFO:tasks.workunit.client.0.smithi196.stdout:4/608: dread d1/d26/f3b [0,4194304] 0 2024-03-17T23:58:32.326 INFO:tasks.workunit.client.0.smithi196.stdout:5/709: mknod d6/d17/d23/cfe 0 2024-03-17T23:58:32.327 INFO:tasks.workunit.client.0.smithi196.stdout:4/609: chown d1/d1b/c81 121 1 2024-03-17T23:58:32.328 INFO:tasks.workunit.client.0.smithi196.stdout:5/710: mknod d6/d2d/d33/d3b/d80/cff 0 2024-03-17T23:58:32.329 INFO:tasks.workunit.client.0.smithi196.stdout:5/711: write d6/d2d/d33/d3b/f5e [3445374,42698] 0 2024-03-17T23:58:32.330 INFO:tasks.workunit.client.0.smithi196.stdout:5/712: fsync d6/d17/d1f/d7d/d81/f8c 0 2024-03-17T23:58:32.379 INFO:tasks.workunit.client.0.smithi196.stdout:7/735: sync 2024-03-17T23:58:32.381 INFO:tasks.workunit.client.0.smithi196.stdout:5/713: rename d6/d17/d3f/d4e/l88 to d6/d2d/db8/l100 0 2024-03-17T23:58:32.382 INFO:tasks.workunit.client.0.smithi196.stdout:4/610: dwrite d1/d26/f3b [0,4194304] 0 2024-03-17T23:58:32.385 INFO:tasks.workunit.client.0.smithi196.stdout:7/736: creat da/d15/d1d/d29/dc4/ffc x:0 0 0 2024-03-17T23:58:32.385 INFO:tasks.workunit.client.0.smithi196.stdout:5/714: mknod d6/d2a/c101 0 2024-03-17T23:58:32.387 INFO:tasks.workunit.client.0.smithi196.stdout:4/611: write d1/d1b/d77/f83 [758630,84516] 0 2024-03-17T23:58:32.388 INFO:tasks.workunit.client.0.smithi196.stdout:7/737: write da/d3e/d7f/fb2 [200852,52615] 0 2024-03-17T23:58:32.398 INFO:tasks.workunit.client.0.smithi196.stdout:5/715: link d6/d17/d1f/f3c d6/d2d/f102 0 2024-03-17T23:58:32.400 INFO:tasks.workunit.client.0.smithi196.stdout:7/738: getdents da/d15/d1d/d29 0 2024-03-17T23:58:32.401 INFO:tasks.workunit.client.0.smithi196.stdout:7/739: write da/d15/d1a/d5e/df3/fb8 [362968,97421] 0 2024-03-17T23:58:32.401 INFO:tasks.workunit.client.0.smithi196.stdout:4/612: write d1/d68/f6b [1020270,1868] 0 2024-03-17T23:58:32.404 INFO:tasks.workunit.client.0.smithi196.stdout:5/716: mknod d6/d2d/c103 0 2024-03-17T23:58:32.406 INFO:tasks.workunit.client.0.smithi196.stdout:7/740: rename da/d3e/d45/c6b to da/d15/d1d/d29/dc4/cfd 0 2024-03-17T23:58:32.412 INFO:tasks.workunit.client.0.smithi196.stdout:4/613: dwrite d1/d1b/d77/fb4 [0,4194304] 0 2024-03-17T23:58:32.415 INFO:tasks.workunit.client.0.smithi196.stdout:4/614: fsync d1/d26/f3b 0 2024-03-17T23:58:32.416 INFO:tasks.workunit.client.0.smithi196.stdout:5/717: dwrite d6/d17/d3f/ff6 [0,4194304] 0 2024-03-17T23:58:32.421 INFO:tasks.workunit.client.0.smithi196.stdout:7/741: dwrite da/d3e/d45/dd8/de4/f67 [0,4194304] 0 2024-03-17T23:58:32.424 INFO:tasks.workunit.client.0.smithi196.stdout:5/718: creat d6/d17/d1f/d7d/f104 x:0 0 0 2024-03-17T23:58:32.424 INFO:tasks.workunit.client.0.smithi196.stdout:7/742: read - da/d15/d1d/d29/fde zero size 2024-03-17T23:58:32.425 INFO:tasks.workunit.client.0.smithi196.stdout:5/719: fsync d6/d17/d3f/d4e/f73 0 2024-03-17T23:58:32.427 INFO:tasks.workunit.client.0.smithi196.stdout:5/720: readlink d6/d17/d35/ld9 0 2024-03-17T23:58:32.427 INFO:tasks.workunit.client.0.smithi196.stdout:4/615: write d1/d26/d57/d8c/d97/fbd [611319,128515] 0 2024-03-17T23:58:32.429 INFO:tasks.workunit.client.0.smithi196.stdout:7/743: mkdir da/d3e/d45/dfe 0 2024-03-17T23:58:32.431 INFO:tasks.workunit.client.0.smithi196.stdout:4/616: symlink d1/d26/d57/lde 0 2024-03-17T23:58:32.433 INFO:tasks.workunit.client.0.smithi196.stdout:7/744: write da/d15/f27 [1102960,73407] 0 2024-03-17T23:58:32.434 INFO:tasks.workunit.client.0.smithi196.stdout:5/721: dread d6/d17/d3f/ff6 [0,4194304] 0 2024-03-17T23:58:32.436 INFO:tasks.workunit.client.0.smithi196.stdout:7/745: write da/d3e/d7f/fbc [847089,14361] 0 2024-03-17T23:58:32.437 INFO:tasks.workunit.client.0.smithi196.stdout:4/617: rename d1/d26/d57/dac/db2/cdb to d1/d11/cdf 0 2024-03-17T23:58:32.441 INFO:tasks.workunit.client.0.smithi196.stdout:4/618: truncate d1/d1b/f59 539990 0 2024-03-17T23:58:32.441 INFO:tasks.workunit.client.0.smithi196.stdout:4/619: stat d1/de/d50/d55 0 2024-03-17T23:58:32.442 INFO:tasks.workunit.client.0.smithi196.stdout:4/620: fdatasync d1/d68/f87 0 2024-03-17T23:58:32.444 INFO:tasks.workunit.client.0.smithi196.stdout:7/746: fdatasync da/d15/f27 0 2024-03-17T23:58:32.444 INFO:tasks.workunit.client.0.smithi196.stdout:4/621: mknod d1/d26/d33/d40/ce0 0 2024-03-17T23:58:32.446 INFO:tasks.workunit.client.0.smithi196.stdout:4/622: symlink d1/dd2/le1 0 2024-03-17T23:58:32.447 INFO:tasks.workunit.client.0.smithi196.stdout:5/722: dwrite d6/f13 [0,4194304] 0 2024-03-17T23:58:32.448 INFO:tasks.workunit.client.0.smithi196.stdout:4/623: chown d1/d26/d33/f4f 5614461 1 2024-03-17T23:58:32.449 INFO:tasks.workunit.client.0.smithi196.stdout:7/747: rename da/d3e/d6d to da/d3e/ddc/dff 0 2024-03-17T23:58:32.454 INFO:tasks.workunit.client.0.smithi196.stdout:5/723: unlink d6/d17/d1f/d7d/dd7/ceb 0 2024-03-17T23:58:32.456 INFO:tasks.workunit.client.0.smithi196.stdout:5/724: read - d6/d2d/d33/d3b/d80/da0/fcf zero size 2024-03-17T23:58:32.457 INFO:tasks.workunit.client.0.smithi196.stdout:7/748: creat da/d3e/d45/f100 x:0 0 0 2024-03-17T23:58:32.458 INFO:tasks.workunit.client.0.smithi196.stdout:5/725: mkdir d6/d15/dc0/d105 0 2024-03-17T23:58:32.459 INFO:tasks.workunit.client.0.smithi196.stdout:7/749: creat da/d15/d1d/d29/f101 x:0 0 0 2024-03-17T23:58:32.461 INFO:tasks.workunit.client.0.smithi196.stdout:7/750: symlink da/d3e/d45/d4f/dda/l102 0 2024-03-17T23:58:32.462 INFO:tasks.workunit.client.0.smithi196.stdout:7/751: creat da/f103 x:0 0 0 2024-03-17T23:58:32.464 INFO:tasks.workunit.client.0.smithi196.stdout:7/752: symlink da/d15/da7/l104 0 2024-03-17T23:58:32.466 INFO:tasks.workunit.client.0.smithi196.stdout:7/753: creat da/d15/d1d/d2e/f105 x:0 0 0 2024-03-17T23:58:32.467 INFO:tasks.workunit.client.0.smithi196.stdout:7/754: write da/d3e/ddc/dff/ddf/fe1 [764607,120502] 0 2024-03-17T23:58:32.478 INFO:tasks.workunit.client.0.smithi196.stdout:7/755: write da/d15/d1d/f32 [3216966,24051] 0 2024-03-17T23:58:32.480 INFO:tasks.workunit.client.0.smithi196.stdout:7/756: fdatasync da/d3e/d45/d4f/d75/da8/f96 0 2024-03-17T23:58:32.484 INFO:tasks.workunit.client.0.smithi196.stdout:7/757: link da/d3e/d45/d4f/d75/da8/d78/fcc da/d3e/d45/dd8/de4/d8f/f106 0 2024-03-17T23:58:32.491 INFO:tasks.workunit.client.0.smithi196.stdout:7/758: dread da/d3e/d45/d4f/d75/da8/f98 [0,4194304] 0 2024-03-17T23:58:32.495 INFO:tasks.workunit.client.0.smithi196.stdout:7/759: getdents da/d15/d1d/d4c 0 2024-03-17T23:58:32.496 INFO:tasks.workunit.client.0.smithi196.stdout:7/760: chown da/d15/d1d/d4c/l8e 308749030 1 2024-03-17T23:58:32.504 INFO:tasks.workunit.client.0.smithi196.stdout:7/761: dwrite da/d15/d1d/d29/dc4/ffc [0,4194304] 0 2024-03-17T23:58:32.505 INFO:tasks.workunit.client.0.smithi196.stdout:3/812: sync 2024-03-17T23:58:32.509 INFO:tasks.workunit.client.0.smithi196.stdout:3/813: fsync d7/d19/d26/d48/f6c 0 2024-03-17T23:58:32.512 INFO:tasks.workunit.client.0.smithi196.stdout:7/762: dwrite da/d3e/ddc/fec [0,4194304] 0 2024-03-17T23:58:32.548 INFO:tasks.workunit.client.0.smithi196.stdout:7/763: unlink da/d3e/d45/d4f/d75/da8/d78/fd6 0 2024-03-17T23:58:32.550 INFO:tasks.workunit.client.0.smithi196.stdout:3/814: dwrite d7/d19/d78/da9/faa [0,4194304] 0 2024-03-17T23:58:32.556 INFO:tasks.workunit.client.0.smithi196.stdout:3/815: write d7/d19/d26/f4b [3126737,8561] 0 2024-03-17T23:58:32.564 INFO:tasks.workunit.client.0.smithi196.stdout:3/816: truncate d7/d19/d26/f64 1242167 0 2024-03-17T23:58:32.565 INFO:tasks.workunit.client.0.smithi196.stdout:3/817: chown d7/d19/fa5 627 1 2024-03-17T23:58:32.568 INFO:tasks.workunit.client.0.smithi196.stdout:3/818: symlink d7/d29/d9b/df8/l101 0 2024-03-17T23:58:32.570 INFO:tasks.workunit.client.0.smithi196.stdout:3/819: mkdir d7/d29/d9b/df8/dfb/d102 0 2024-03-17T23:58:32.574 INFO:tasks.workunit.client.0.smithi196.stdout:3/820: rename d7/d19/d26/d2b/d3c/d3d/d99 to d7/d19/d26/d2b/d103 0 2024-03-17T23:58:32.582 INFO:tasks.workunit.client.0.smithi196.stdout:3/821: dwrite d7/d19/d78/da9/faa [0,4194304] 0 2024-03-17T23:58:32.584 INFO:tasks.workunit.client.0.smithi196.stdout:3/822: write d7/d19/d78/dca/ffc [741628,26633] 0 2024-03-17T23:58:32.589 INFO:tasks.workunit.client.0.smithi196.stdout:3/823: dread d7/d19/d26/f9d [0,4194304] 0 2024-03-17T23:58:32.590 INFO:tasks.workunit.client.0.smithi196.stdout:3/824: chown d7/d19/d26/d2b/d3c/d3d/f6a 37262994 1 2024-03-17T23:58:32.592 INFO:tasks.workunit.client.0.smithi196.stdout:3/825: symlink d7/d19/d78/d93/l104 0 2024-03-17T23:58:32.592 INFO:tasks.workunit.client.0.smithi196.stdout:3/826: chown d7/d19/d26/d2b/d3c/d3d/c71 8042 1 2024-03-17T23:58:32.593 INFO:tasks.workunit.client.0.smithi196.stdout:3/827: fdatasync d7/d19/d26/d48/d4d/fb0 0 2024-03-17T23:58:32.594 INFO:tasks.workunit.client.0.smithi196.stdout:3/828: chown d7/d19/d26/d2b/d3c/d3d/la8 865269 1 2024-03-17T23:58:32.596 INFO:tasks.workunit.client.0.smithi196.stdout:3/829: creat d7/d19/d26/d2b/f105 x:0 0 0 2024-03-17T23:58:32.598 INFO:tasks.workunit.client.0.smithi196.stdout:3/830: unlink d7/d19/d26/d48/d98/fa6 0 2024-03-17T23:58:32.600 INFO:tasks.workunit.client.0.smithi196.stdout:3/831: creat d7/d19/d78/dca/f106 x:0 0 0 2024-03-17T23:58:32.601 INFO:tasks.workunit.client.0.smithi196.stdout:3/832: chown d7/d19/d26/d48/d4d/dd9/fc5 46130 1 2024-03-17T23:58:32.609 INFO:tasks.workunit.client.0.smithi196.stdout:3/833: truncate d7/d19/d26/d2b/dcd/ffe 3696361 0 2024-03-17T23:58:32.610 INFO:tasks.workunit.client.0.smithi196.stdout:3/834: mknod d7/d19/d78/dca/c107 0 2024-03-17T23:58:32.611 INFO:tasks.workunit.client.0.smithi196.stdout:3/835: stat d7/d19/d26/d2b/dee 0 2024-03-17T23:58:32.613 INFO:tasks.workunit.client.0.smithi196.stdout:3/836: dread d7/d19/d26/d48/fcc [0,4194304] 0 2024-03-17T23:58:32.614 INFO:tasks.workunit.client.0.smithi196.stdout:3/837: write d7/d19/d78/dca/fd4 [8636500,130787] 0 2024-03-17T23:58:32.618 INFO:tasks.workunit.client.0.smithi196.stdout:3/838: getdents d7 0 2024-03-17T23:58:32.619 INFO:tasks.workunit.client.0.smithi196.stdout:3/839: dread - d7/d19/f97 zero size 2024-03-17T23:58:32.626 INFO:tasks.workunit.client.0.smithi196.stdout:3/840: write d7/d19/d26/d2b/d103/fe5 [2293425,41629] 0 2024-03-17T23:58:32.629 INFO:tasks.workunit.client.0.smithi196.stdout:3/841: symlink d7/d19/d26/d48/d4d/dd9/l108 0 2024-03-17T23:58:32.631 INFO:tasks.workunit.client.0.smithi196.stdout:3/842: rmdir d7/d19/d26 39 2024-03-17T23:58:32.634 INFO:tasks.workunit.client.0.smithi196.stdout:3/843: rename d7/d19/d26/d2b/d3c/c89 to d7/d19/d26/d2b/dee/c109 0 2024-03-17T23:58:32.636 INFO:tasks.workunit.client.0.smithi196.stdout:3/844: dread d7/d19/fa5 [0,4194304] 0 2024-03-17T23:58:32.638 INFO:tasks.workunit.client.0.smithi196.stdout:3/845: write d7/d19/d78/d93/fa0 [730423,64572] 0 2024-03-17T23:58:32.640 INFO:tasks.workunit.client.0.smithi196.stdout:3/846: rename d7/d33/f91 to d7/d33/ddc/f10a 0 2024-03-17T23:58:32.642 INFO:tasks.workunit.client.0.smithi196.stdout:3/847: symlink d7/d19/l10b 0 2024-03-17T23:58:32.644 INFO:tasks.workunit.client.0.smithi196.stdout:3/848: rename d7/d19/d78/d93/lb4 to d7/d33/ddc/l10c 0 2024-03-17T23:58:32.655 INFO:tasks.workunit.client.0.smithi196.stdout:3/849: link d7/d19/d26/d2b/dee/c109 d7/d19/d26/de7/c10d 0 2024-03-17T23:58:32.656 INFO:tasks.workunit.client.0.smithi196.stdout:3/850: fdatasync d7/fc 0 2024-03-17T23:58:32.657 INFO:tasks.workunit.client.0.smithi196.stdout:3/851: stat d7/d19/d26/d2b/f42 0 2024-03-17T23:58:32.658 INFO:tasks.workunit.client.0.smithi196.stdout:3/852: truncate d7/d19/d78/da9/fd1 121618 0 2024-03-17T23:58:32.660 INFO:tasks.workunit.client.0.smithi196.stdout:3/853: dread d7/f80 [0,4194304] 0 2024-03-17T23:58:32.663 INFO:tasks.workunit.client.0.smithi196.stdout:3/854: getdents d7/d19/d26/d2b/d3c 0 2024-03-17T23:58:32.666 INFO:tasks.workunit.client.0.smithi196.stdout:3/855: creat d7/d29/d9b/df8/dfb/d102/f10e x:0 0 0 2024-03-17T23:58:32.666 INFO:tasks.workunit.client.0.smithi196.stdout:3/856: chown d7/d19/d26/d2b/d3c/f7b 22896 1 2024-03-17T23:58:32.666 INFO:tasks.workunit.client.0.smithi196.stdout:3/857: chown d7/d19/d26/d2b/d3c 164505 1 2024-03-17T23:58:32.667 INFO:tasks.workunit.client.0.smithi196.stdout:3/858: dread - d7/d19/d78/da9/fe6 zero size 2024-03-17T23:58:32.670 INFO:tasks.workunit.client.0.smithi196.stdout:3/859: creat d7/d19/d26/d48/d4d/dd9/f10f x:0 0 0 2024-03-17T23:58:32.673 INFO:tasks.workunit.client.0.smithi196.stdout:3/860: rename d7/d19/d26/d2b/ldb to d7/d19/d26/d48/d4d/dd9/dc8/l110 0 2024-03-17T23:58:32.676 INFO:tasks.workunit.client.0.smithi196.stdout:6/667: sync 2024-03-17T23:58:32.678 INFO:tasks.workunit.client.0.smithi196.stdout:6/668: read d2/d14/d35/d63/f38 [1213825,53968] 0 2024-03-17T23:58:32.680 INFO:tasks.workunit.client.0.smithi196.stdout:6/669: mknod d2/d14/d35/d63/cf1 0 2024-03-17T23:58:32.682 INFO:tasks.workunit.client.0.smithi196.stdout:6/670: mkdir d2/d14/d42/d57/d5f/dbd/df2 0 2024-03-17T23:58:32.685 INFO:tasks.workunit.client.0.smithi196.stdout:6/671: creat d2/d14/d75/ff3 x:0 0 0 2024-03-17T23:58:32.692 INFO:tasks.workunit.client.0.smithi196.stdout:6/672: getdents d2/d14/d75 0 2024-03-17T23:58:32.693 INFO:tasks.workunit.client.0.smithi196.stdout:6/673: chown d2/d14/d35/fbf 3 1 2024-03-17T23:58:32.695 INFO:tasks.workunit.client.0.smithi196.stdout:6/674: creat d2/d14/d75/d92/dd8/ff4 x:0 0 0 2024-03-17T23:58:32.695 INFO:tasks.workunit.client.0.smithi196.stdout:6/675: stat d2/d7/d2b/f67 0 2024-03-17T23:58:32.702 INFO:tasks.workunit.client.0.smithi196.stdout:6/676: dwrite d2/d14/d75/dc0/ddf/da1/fa9 [0,4194304] 0 2024-03-17T23:58:32.704 INFO:tasks.workunit.client.0.smithi196.stdout:6/677: readlink d2/d14/d75/d7b/ld6 0 2024-03-17T23:58:32.707 INFO:tasks.workunit.client.0.smithi196.stdout:6/678: unlink d2/d7/d2b/cd5 0 2024-03-17T23:58:32.708 INFO:tasks.workunit.client.0.smithi196.stdout:6/679: write d2/d14/d75/dc0/ddf/da1/fa5 [1020406,13239] 0 2024-03-17T23:58:32.710 INFO:tasks.workunit.client.0.smithi196.stdout:6/680: write d2/d14/d75/d7b/f3f [1496846,102806] 0 2024-03-17T23:58:32.718 INFO:tasks.workunit.client.0.smithi196.stdout:6/681: dwrite d2/d14/d75/dc0/ddf/da1/fa9 [0,4194304] 0 2024-03-17T23:58:32.722 INFO:tasks.workunit.client.0.smithi196.stdout:6/682: creat d2/d14/d35/d6a/ff5 x:0 0 0 2024-03-17T23:58:32.735 INFO:tasks.workunit.client.0.smithi196.stdout:6/683: dread d2/f3e [0,4194304] 0 2024-03-17T23:58:32.738 INFO:tasks.workunit.client.0.smithi196.stdout:6/684: rename d2/d14/d75/d92/fd1 to d2/d14/d75/dc0/ddf/de6/dd9/de5/ff6 0 2024-03-17T23:58:32.741 INFO:tasks.workunit.client.0.smithi196.stdout:6/685: creat d2/d14/d42/d57/d5f/dbd/ff7 x:0 0 0 2024-03-17T23:58:32.749 INFO:tasks.workunit.client.0.smithi196.stdout:6/686: dwrite d2/d14/d75/d92/dd8/ff4 [0,4194304] 0 2024-03-17T23:58:32.750 INFO:tasks.workunit.client.0.smithi196.stdout:6/687: dread - d2/d7/d2b/fe7 zero size 2024-03-17T23:58:32.760 INFO:tasks.workunit.client.0.smithi196.stdout:6/688: link d2/d14/d75/d92/l93 d2/d14/d75/dc0/lf8 0 2024-03-17T23:58:32.767 INFO:tasks.workunit.client.0.smithi196.stdout:6/689: dwrite d2/d14/d42/d57/dc8/fb9 [4194304,4194304] 0 2024-03-17T23:58:32.769 INFO:tasks.workunit.client.0.smithi196.stdout:6/690: dread - d2/d14/d42/d57/dc8/db3/fcb zero size 2024-03-17T23:58:32.787 INFO:tasks.workunit.client.0.smithi196.stdout:6/691: dread d2/d14/d42/d57/f82 [0,4194304] 0 2024-03-17T23:58:32.791 INFO:tasks.workunit.client.0.smithi196.stdout:6/692: mkdir d2/d14/d42/df9 0 2024-03-17T23:58:32.792 INFO:tasks.workunit.client.0.smithi196.stdout:6/693: stat d2/d14/d75/d92/l93 0 2024-03-17T23:58:32.796 INFO:tasks.workunit.client.0.smithi196.stdout:6/694: rename d2/d14/d75/dc0/ddf/cdc to d2/d7/cfa 0 2024-03-17T23:58:32.797 INFO:tasks.workunit.client.0.smithi196.stdout:6/695: mkdir d2/d7/dcd/dfb 0 2024-03-17T23:58:32.809 INFO:tasks.workunit.client.0.smithi196.stdout:6/696: dwrite d2/d14/f47 [0,4194304] 0 2024-03-17T23:58:32.815 INFO:tasks.workunit.client.0.smithi196.stdout:6/697: mknod d2/d14/d42/cfc 0 2024-03-17T23:58:32.828 INFO:tasks.workunit.client.0.smithi196.stdout:6/698: dread d2/d7/d2b/f4a [0,4194304] 0 2024-03-17T23:58:32.831 INFO:tasks.workunit.client.0.smithi196.stdout:6/699: getdents d2/d14/d8c 0 2024-03-17T23:58:32.833 INFO:tasks.workunit.client.0.smithi196.stdout:6/700: dread d2/d14/f5d [0,4194304] 0 2024-03-17T23:58:32.835 INFO:tasks.workunit.client.0.smithi196.stdout:6/701: unlink d2/d14/d8c/f91 0 2024-03-17T23:58:32.837 INFO:tasks.workunit.client.0.smithi196.stdout:6/702: symlink d2/d14/d42/d57/dc8/lfd 0 2024-03-17T23:58:32.841 INFO:tasks.workunit.client.0.smithi196.stdout:6/703: link d2/d14/d35/d6a/fea d2/d14/d75/dc0/ddf/de6/ffe 0 2024-03-17T23:58:32.855 INFO:tasks.workunit.client.0.smithi196.stdout:1/574: sync 2024-03-17T23:58:32.856 INFO:tasks.workunit.client.0.smithi196.stdout:8/508: sync 2024-03-17T23:58:32.859 INFO:tasks.workunit.client.0.smithi196.stdout:8/509: rename de/d2b/d30/d33/f8c to de/d10/d35/d3e/f9c 0 2024-03-17T23:58:32.862 INFO:tasks.workunit.client.0.smithi196.stdout:6/704: dread d2/f45 [0,4194304] 0 2024-03-17T23:58:32.863 INFO:tasks.workunit.client.0.smithi196.stdout:8/510: read de/d2b/d30/d33/f3d [3642097,84505] 0 2024-03-17T23:58:32.875 INFO:tasks.workunit.client.0.smithi196.stdout:6/705: dwrite d2/d14/f1d [8388608,4194304] 0 2024-03-17T23:58:32.876 INFO:tasks.workunit.client.0.smithi196.stdout:6/706: readlink d2/d14/l55 0 2024-03-17T23:58:32.877 INFO:tasks.workunit.client.0.smithi196.stdout:8/511: mknod de/d10/d35/d3e/c9d 0 2024-03-17T23:58:32.879 INFO:tasks.workunit.client.0.smithi196.stdout:1/575: truncate d1/db/dd/d34/f86 493228 0 2024-03-17T23:58:32.882 INFO:tasks.workunit.client.0.smithi196.stdout:8/512: unlink de/d2b/f4e 0 2024-03-17T23:58:32.886 INFO:tasks.workunit.client.0.smithi196.stdout:6/707: mknod d2/d7/dcd/dfb/cff 0 2024-03-17T23:58:32.894 INFO:tasks.workunit.client.0.smithi196.stdout:8/513: dwrite de/f85 [0,4194304] 0 2024-03-17T23:58:32.898 INFO:tasks.workunit.client.0.smithi196.stdout:8/514: symlink de/d2b/d30/d33/l9e 0 2024-03-17T23:58:32.899 INFO:tasks.workunit.client.0.smithi196.stdout:1/576: dwrite d1/db/fe [0,4194304] 0 2024-03-17T23:58:32.903 INFO:tasks.workunit.client.0.smithi196.stdout:1/577: creat d1/d13/d23/d62/dab/fbd x:0 0 0 2024-03-17T23:58:32.904 INFO:tasks.workunit.client.0.smithi196.stdout:6/708: dwrite d2/d14/d75/dc0/ddf/f7f [0,4194304] 0 2024-03-17T23:58:32.906 INFO:tasks.workunit.client.0.smithi196.stdout:6/709: write d2/d14/dcc/fe0 [741797,112960] 0 2024-03-17T23:58:32.908 INFO:tasks.workunit.client.0.smithi196.stdout:6/710: mkdir d2/d7/d100 0 2024-03-17T23:58:32.909 INFO:tasks.workunit.client.0.smithi196.stdout:1/578: write d1/f7c [875365,38813] 0 2024-03-17T23:58:32.911 INFO:tasks.workunit.client.0.smithi196.stdout:1/579: rmdir d1/d13/d23/d47/d48/d74/db2 39 2024-03-17T23:58:32.913 INFO:tasks.workunit.client.0.smithi196.stdout:6/711: rename d2/d14/d75/dc0/ddf/de6/ffe to d2/d14/d75/dc0/ddf/da1/f101 0 2024-03-17T23:58:32.918 INFO:tasks.workunit.client.0.smithi196.stdout:1/580: dwrite d1/d13/d2a/f90 [0,4194304] 0 2024-03-17T23:58:32.925 INFO:tasks.workunit.client.0.smithi196.stdout:1/581: dread d1/fa [0,4194304] 0 2024-03-17T23:58:32.927 INFO:tasks.workunit.client.0.smithi196.stdout:1/582: symlink d1/d13/d23/d62/dab/lbe 0 2024-03-17T23:58:32.928 INFO:tasks.workunit.client.0.smithi196.stdout:1/583: read - d1/db/dd/d34/f55 zero size 2024-03-17T23:58:32.931 INFO:tasks.workunit.client.0.smithi196.stdout:1/584: mknod d1/d13/d23/d47/d48/d7e/cbf 0 2024-03-17T23:58:32.933 INFO:tasks.workunit.client.0.smithi196.stdout:1/585: mknod d1/d13/d23/d62/dab/cc0 0 2024-03-17T23:58:32.935 INFO:tasks.workunit.client.0.smithi196.stdout:1/586: creat d1/d13/d2a/d94/fc1 x:0 0 0 2024-03-17T23:58:32.938 INFO:tasks.workunit.client.0.smithi196.stdout:1/587: getdents d1/d13/d4c 0 2024-03-17T23:58:32.942 INFO:tasks.workunit.client.0.smithi196.stdout:1/588: getdents d1/d13/d23/d47/d48 0 2024-03-17T23:58:32.946 INFO:tasks.workunit.client.0.smithi196.stdout:1/589: link d1/db/dd/d34/f8d d1/d13/d4c/fc2 0 2024-03-17T23:58:32.952 INFO:tasks.workunit.client.0.smithi196.stdout:1/590: write d1/d13/d23/d47/f5c [1005818,80079] 0 2024-03-17T23:58:32.955 INFO:tasks.workunit.client.0.smithi196.stdout:1/591: write d1/d13/d23/f49 [576528,23208] 0 2024-03-17T23:58:32.957 INFO:tasks.workunit.client.0.smithi196.stdout:1/592: symlink d1/d13/d91/lc3 0 2024-03-17T23:58:32.958 INFO:tasks.workunit.client.0.smithi196.stdout:1/593: mkdir d1/d13/d23/d47/d48/dc4 0 2024-03-17T23:58:32.960 INFO:tasks.workunit.client.0.smithi196.stdout:1/594: truncate d1/d13/f6c 733113 0 2024-03-17T23:58:32.961 INFO:tasks.workunit.client.0.smithi196.stdout:1/595: mknod d1/d13/d23/d47/d48/d74/cc5 0 2024-03-17T23:58:32.962 INFO:tasks.workunit.client.0.smithi196.stdout:1/596: write d1/d13/f3b [3216423,3940] 0 2024-03-17T23:58:32.963 INFO:tasks.workunit.client.0.smithi196.stdout:1/597: dread - d1/d13/d23/d47/d48/d74/f84 zero size 2024-03-17T23:58:32.965 INFO:tasks.workunit.client.0.smithi196.stdout:1/598: symlink d1/d13/d23/d47/d48/d74/lc6 0 2024-03-17T23:58:32.967 INFO:tasks.workunit.client.0.smithi196.stdout:1/599: symlink d1/d13/d23/d47/d48/lc7 0 2024-03-17T23:58:32.970 INFO:tasks.workunit.client.0.smithi196.stdout:1/600: getdents d1/d13/d23/d62/d71 0 2024-03-17T23:58:32.971 INFO:tasks.workunit.client.0.smithi196.stdout:1/601: read - d1/d13/d23/fb0 zero size 2024-03-17T23:58:32.973 INFO:tasks.workunit.client.0.smithi196.stdout:1/602: link d1/db/dd/d43/f4a d1/db/dd/d34/fc8 0 2024-03-17T23:58:32.974 INFO:tasks.workunit.client.0.smithi196.stdout:1/603: write d1/d13/d23/d47/d48/fa9 [958217,67506] 0 2024-03-17T23:58:32.978 INFO:tasks.workunit.client.0.smithi196.stdout:1/604: rename d1/db/dd/d43/f50 to d1/db/dd/fc9 0 2024-03-17T23:58:32.979 INFO:tasks.workunit.client.0.smithi196.stdout:1/605: mkdir d1/d13/d23/d62/dab/dca 0 2024-03-17T23:58:32.982 INFO:tasks.workunit.client.0.smithi196.stdout:1/606: link d1/db/l8f d1/d13/d2a/d94/lcb 0 2024-03-17T23:58:32.986 INFO:tasks.workunit.client.0.smithi196.stdout:1/607: dread d1/d13/d23/d47/f52 [4194304,4194304] 0 2024-03-17T23:58:32.987 INFO:tasks.workunit.client.0.smithi196.stdout:1/608: truncate d1/db/dd/faa 563102 0 2024-03-17T23:58:33.021 INFO:tasks.workunit.client.0.smithi196.stdout:9/621: sync 2024-03-17T23:58:33.021 INFO:tasks.workunit.client.0.smithi196.stdout:2/810: sync 2024-03-17T23:58:33.024 INFO:tasks.workunit.client.0.smithi196.stdout:9/622: creat d9/df/d4a/d8c/fc2 x:0 0 0 2024-03-17T23:58:33.025 INFO:tasks.workunit.client.0.smithi196.stdout:9/623: fsync d9/df/d14/d3d/f8b 0 2024-03-17T23:58:33.027 INFO:tasks.workunit.client.0.smithi196.stdout:9/624: write d9/df/f34 [4241014,9214] 0 2024-03-17T23:58:33.030 INFO:tasks.workunit.client.0.smithi196.stdout:2/811: dwrite d17/d22/d59/f119 [0,4194304] 0 2024-03-17T23:58:33.037 INFO:tasks.workunit.client.0.smithi196.stdout:9/625: symlink d9/df/d4a/d5b/d62/dba/d60/d5e/lc3 0 2024-03-17T23:58:33.038 INFO:tasks.workunit.client.0.smithi196.stdout:2/812: mknod d17/d28/c124 0 2024-03-17T23:58:33.041 INFO:tasks.workunit.client.0.smithi196.stdout:2/813: mknod d17/c125 0 2024-03-17T23:58:33.042 INFO:tasks.workunit.client.0.smithi196.stdout:2/814: write d17/d28/d30/d71/f88 [2912230,3726] 0 2024-03-17T23:58:33.044 INFO:tasks.workunit.client.0.smithi196.stdout:2/815: write d17/d28/dae/fca [965609,78542] 0 2024-03-17T23:58:33.046 INFO:tasks.workunit.client.0.smithi196.stdout:2/816: creat d17/d28/d96/f126 x:0 0 0 2024-03-17T23:58:33.048 INFO:tasks.workunit.client.0.smithi196.stdout:2/817: mkdir d17/d19/d44/d52/df0/d127 0 2024-03-17T23:58:33.051 INFO:tasks.workunit.client.0.smithi196.stdout:2/818: creat d17/d22/d3d/d8f/d114/f128 x:0 0 0 2024-03-17T23:58:33.055 INFO:tasks.workunit.client.0.smithi196.stdout:9/626: dwrite d9/df/d4a/d5b/d62/dba/d60/d5e/f56 [0,4194304] 0 2024-03-17T23:58:33.063 INFO:tasks.workunit.client.0.smithi196.stdout:2/819: getdents d17/dce 0 2024-03-17T23:58:33.063 INFO:tasks.workunit.client.0.smithi196.stdout:9/627: chown d9/df/d4a/d5b/d62/dba/d60/d5e/f57 325132 1 2024-03-17T23:58:33.063 INFO:tasks.workunit.client.0.smithi196.stdout:2/820: fdatasync d17/d28/d30/d71/ffe 0 2024-03-17T23:58:33.063 INFO:tasks.workunit.client.0.smithi196.stdout:2/821: write d17/d22/f6c [91301,129938] 0 2024-03-17T23:58:33.064 INFO:tasks.workunit.client.0.smithi196.stdout:2/822: dread - d17/d19/f7c zero size 2024-03-17T23:58:33.066 INFO:tasks.workunit.client.0.smithi196.stdout:9/628: getdents d9/df/d14 0 2024-03-17T23:58:33.069 INFO:tasks.workunit.client.0.smithi196.stdout:9/629: unlink d9/df/d14/d27/d9e/lae 0 2024-03-17T23:58:33.071 INFO:tasks.workunit.client.0.smithi196.stdout:2/823: dwrite d17/d19/f60 [4194304,4194304] 0 2024-03-17T23:58:33.073 INFO:tasks.workunit.client.0.smithi196.stdout:9/630: creat d9/df/fc4 x:0 0 0 2024-03-17T23:58:33.073 INFO:tasks.workunit.client.0.smithi196.stdout:2/824: rmdir d17/d19/d93 39 2024-03-17T23:58:33.077 INFO:tasks.workunit.client.0.smithi196.stdout:9/631: mkdir d9/df/d14/d27/d9e/dc5 0 2024-03-17T23:58:33.077 INFO:tasks.workunit.client.0.smithi196.stdout:9/632: fdatasync d9/df/d14/d3d/f3e 0 2024-03-17T23:58:33.079 INFO:tasks.workunit.client.0.smithi196.stdout:9/633: dread d9/df/d14/d27/d9e/fb4 [0,4194304] 0 2024-03-17T23:58:33.082 INFO:tasks.workunit.client.0.smithi196.stdout:2/825: dwrite d17/d28/d30/d3b/fac [0,4194304] 0 2024-03-17T23:58:33.085 INFO:tasks.workunit.client.0.smithi196.stdout:9/634: rename d9/df/d4a/d5b/d6d/fa7 to d9/df/d14/db0/fc6 0 2024-03-17T23:58:33.086 INFO:tasks.workunit.client.0.smithi196.stdout:2/826: stat d17/d28/d96/fc3 0 2024-03-17T23:58:33.087 INFO:tasks.workunit.client.0.smithi196.stdout:2/827: readlink d17/d19/l77 0 2024-03-17T23:58:33.087 INFO:tasks.workunit.client.0.smithi196.stdout:2/828: stat d17/d19/l1c 0 2024-03-17T23:58:33.093 INFO:tasks.workunit.client.0.smithi196.stdout:2/829: dread d17/d28/dae/fca [0,4194304] 0 2024-03-17T23:58:33.095 INFO:tasks.workunit.client.0.smithi196.stdout:2/830: truncate d17/d28/d30/d3b/f4a 5789899 0 2024-03-17T23:58:33.104 INFO:tasks.workunit.client.0.smithi196.stdout:9/635: truncate d9/df/d14/d27/fa6 2776134 0 2024-03-17T23:58:33.106 INFO:tasks.workunit.client.0.smithi196.stdout:9/636: mkdir d9/df/d4a/d5b/d6d/da8/dc7 0 2024-03-17T23:58:33.112 INFO:tasks.workunit.client.0.smithi196.stdout:2/831: dwrite d17/d19/d44/d52/f9b [0,4194304] 0 2024-03-17T23:58:33.116 INFO:tasks.workunit.client.0.smithi196.stdout:2/832: unlink d17/d19/l26 0 2024-03-17T23:58:33.117 INFO:tasks.workunit.client.0.smithi196.stdout:9/637: dwrite d9/f8a [0,4194304] 0 2024-03-17T23:58:33.127 INFO:tasks.workunit.client.0.smithi196.stdout:2/833: creat d17/d22/da0/dc7/f129 x:0 0 0 2024-03-17T23:58:33.127 INFO:tasks.workunit.client.0.smithi196.stdout:2/834: chown d17/d22/d3d/d8f/ld7 2256940 1 2024-03-17T23:58:33.127 INFO:tasks.workunit.client.0.smithi196.stdout:2/835: dread - d17/d22/f11b zero size 2024-03-17T23:58:33.129 INFO:tasks.workunit.client.0.smithi196.stdout:9/638: dwrite d9/f4e [0,4194304] 0 2024-03-17T23:58:33.129 INFO:tasks.workunit.client.0.smithi196.stdout:9/639: write f5 [7638121,49350] 0 2024-03-17T23:58:33.131 INFO:tasks.workunit.client.0.smithi196.stdout:2/836: mkdir d17/d22/d12a 0 2024-03-17T23:58:33.134 INFO:tasks.workunit.client.0.smithi196.stdout:9/640: unlink d9/df/d4a/f8f 0 2024-03-17T23:58:33.141 INFO:tasks.workunit.client.0.smithi196.stdout:9/641: write d9/d12/d59/f65 [778247,110230] 0 2024-03-17T23:58:33.145 INFO:tasks.workunit.client.0.smithi196.stdout:2/837: dwrite d17/d28/d30/f62 [0,4194304] 0 2024-03-17T23:58:33.160 INFO:tasks.workunit.client.0.smithi196.stdout:9/642: unlink d9/df/d4a/d5b/d62/dba/d60/ca1 0 2024-03-17T23:58:33.161 INFO:tasks.workunit.client.0.smithi196.stdout:2/838: dread d17/d28/d30/d72/fb2 [0,4194304] 0 2024-03-17T23:58:33.163 INFO:tasks.workunit.client.0.smithi196.stdout:9/643: symlink d9/df/d4a/d5b/d62/dba/d60/d5e/lc8 0 2024-03-17T23:58:33.177 INFO:tasks.workunit.client.0.smithi196.stdout:2/839: dread d17/d19/d44/d52/df0/f112 [0,4194304] 0 2024-03-17T23:58:33.178 INFO:tasks.workunit.client.0.smithi196.stdout:2/840: fsync d17/d22/f64 0 2024-03-17T23:58:33.179 INFO:tasks.workunit.client.0.smithi196.stdout:2/841: chown d17/d28/d30/lad 211360387 1 2024-03-17T23:58:33.179 INFO:tasks.workunit.client.0.smithi196.stdout:2/842: chown d17/d28/l8e 860893385 1 2024-03-17T23:58:33.181 INFO:tasks.workunit.client.0.smithi196.stdout:2/843: dread d17/d28/dae/fca [0,4194304] 0 2024-03-17T23:58:33.189 INFO:tasks.workunit.client.0.smithi196.stdout:2/844: rename d17/d19/d44/d52 to d17/d28/d30/d12b 0 2024-03-17T23:58:33.189 INFO:tasks.workunit.client.0.smithi196.stdout:2/845: fdatasync d17/d28/d30/d71/de0/ffd 0 2024-03-17T23:58:33.192 INFO:tasks.workunit.client.0.smithi196.stdout:2/846: creat d17/d28/d30/f12c x:0 0 0 2024-03-17T23:58:33.192 INFO:tasks.workunit.client.0.smithi196.stdout:9/644: dwrite d9/df/d4a/d5b/d62/dba/fb2 [0,4194304] 0 2024-03-17T23:58:33.194 INFO:tasks.workunit.client.0.smithi196.stdout:9/645: chown d9 18039 1 2024-03-17T23:58:33.197 INFO:tasks.workunit.client.0.smithi196.stdout:2/847: creat d17/d28/d30/d12b/df0/f12d x:0 0 0 2024-03-17T23:58:33.197 INFO:tasks.workunit.client.0.smithi196.stdout:9/646: symlink d9/df/d4a/d5b/da5/lc9 0 2024-03-17T23:58:33.201 INFO:tasks.workunit.client.0.smithi196.stdout:2/848: rename d17/d28/f46 to d17/d22/d59/d10d/f12e 0 2024-03-17T23:58:33.204 INFO:tasks.workunit.client.0.smithi196.stdout:9/647: rename d9/df/d4a/d5b/d62/dba/d60/f48 to d9/df/d4a/d5b/d6d/da8/fca 0 2024-03-17T23:58:33.207 INFO:tasks.workunit.client.0.smithi196.stdout:2/849: creat d17/d19/f12f x:0 0 0 2024-03-17T23:58:33.208 INFO:tasks.workunit.client.0.smithi196.stdout:2/850: write d17/f83 [108326,58041] 0 2024-03-17T23:58:33.209 INFO:tasks.workunit.client.0.smithi196.stdout:9/648: creat d9/df/d14/d27/d9e/dc5/fcb x:0 0 0 2024-03-17T23:58:33.218 INFO:tasks.workunit.client.0.smithi196.stdout:9/649: link d9/df/d14/d27/f4c d9/df/d4a/d89/db1/fcc 0 2024-03-17T23:58:33.219 INFO:tasks.workunit.client.0.smithi196.stdout:2/851: getdents d17/d19/d44 0 2024-03-17T23:58:33.221 INFO:tasks.workunit.client.0.smithi196.stdout:2/852: write d17/d28/d30/d72/fb2 [1212318,41455] 0 2024-03-17T23:58:33.223 INFO:tasks.workunit.client.0.smithi196.stdout:9/650: link d9/df/d4a/d5b/d62/dba/d60/l7f d9/df/d4a/d5b/d62/lcd 0 2024-03-17T23:58:33.224 INFO:tasks.workunit.client.0.smithi196.stdout:2/853: write d17/d28/d30/d72/d81/fa1 [762759,12332] 0 2024-03-17T23:58:33.226 INFO:tasks.workunit.client.0.smithi196.stdout:9/651: rmdir d9/df/d4a/d5b/d62/dba/d60/d85/d8e 39 2024-03-17T23:58:33.227 INFO:tasks.workunit.client.0.smithi196.stdout:2/854: symlink d17/d28/d30/d71/de0/l130 0 2024-03-17T23:58:33.230 INFO:tasks.workunit.client.0.smithi196.stdout:2/855: truncate d17/d22/f6e 4965632 0 2024-03-17T23:58:33.233 INFO:tasks.workunit.client.0.smithi196.stdout:2/856: creat d17/d22/d3d/d8f/df2/f131 x:0 0 0 2024-03-17T23:58:33.234 INFO:tasks.workunit.client.0.smithi196.stdout:2/857: truncate d17/f11d 4261587 0 2024-03-17T23:58:33.236 INFO:tasks.workunit.client.0.smithi196.stdout:2/858: creat d17/d22/da0/dc7/f132 x:0 0 0 2024-03-17T23:58:33.239 INFO:tasks.workunit.client.0.smithi196.stdout:2/859: mkdir d17/d28/d30/d3b/d133 0 2024-03-17T23:58:33.239 INFO:tasks.workunit.client.0.smithi196.stdout:9/652: dwrite d9/d12/f17 [0,4194304] 0 2024-03-17T23:58:33.240 INFO:tasks.workunit.client.0.smithi196.stdout:2/860: read d17/d28/d30/d72/d81/fa1 [4294980,112654] 0 2024-03-17T23:58:33.241 INFO:tasks.workunit.client.0.smithi196.stdout:2/861: stat d17/d28/dae 0 2024-03-17T23:58:33.241 INFO:tasks.workunit.client.0.smithi196.stdout:9/653: readlink d9/df/d4a/d5b/d62/dba/d60/l4f 0 2024-03-17T23:58:33.244 INFO:tasks.workunit.client.0.smithi196.stdout:2/862: mkdir d17/d22/da0/d134 0 2024-03-17T23:58:33.250 INFO:tasks.workunit.client.0.smithi196.stdout:9/654: mkdir d9/df/d14/db0/dce 0 2024-03-17T23:58:33.250 INFO:tasks.workunit.client.0.smithi196.stdout:0/807: sync 2024-03-17T23:58:33.250 INFO:tasks.workunit.client.0.smithi196.stdout:4/624: sync 2024-03-17T23:58:33.251 INFO:tasks.workunit.client.0.smithi196.stdout:2/863: creat d17/d28/f135 x:0 0 0 2024-03-17T23:58:33.253 INFO:tasks.workunit.client.0.smithi196.stdout:2/864: truncate d17/d28/d30/f12c 83530 0 2024-03-17T23:58:33.254 INFO:tasks.workunit.client.0.smithi196.stdout:4/625: stat d1/d26/d33/d85/l9a 0 2024-03-17T23:58:33.255 INFO:tasks.workunit.client.0.smithi196.stdout:9/655: getdents d9/df/d4a/d5b/d6d/da8/dc7 0 2024-03-17T23:58:33.257 INFO:tasks.workunit.client.0.smithi196.stdout:2/865: rename d17/d68/c75 to d17/d22/d59/d10d/c136 0 2024-03-17T23:58:33.261 INFO:tasks.workunit.client.0.smithi196.stdout:9/656: unlink d9/df/d4a/d5b/d62/dba/d60/d5e/lc8 0 2024-03-17T23:58:33.262 INFO:tasks.workunit.client.0.smithi196.stdout:0/808: dwrite d5/d23/fb7 [0,4194304] 0 2024-03-17T23:58:33.262 INFO:tasks.workunit.client.0.smithi196.stdout:4/626: creat d1/d26/fe2 x:0 0 0 2024-03-17T23:58:33.265 INFO:tasks.workunit.client.0.smithi196.stdout:4/627: stat d1/d26/d57/d8c/d97/fbd 0 2024-03-17T23:58:33.270 INFO:tasks.workunit.client.0.smithi196.stdout:9/657: mkdir d9/df/d55/dcf 0 2024-03-17T23:58:33.270 INFO:tasks.workunit.client.0.smithi196.stdout:0/809: dread d5/d23/d24/d59/f9a [0,4194304] 0 2024-03-17T23:58:33.273 INFO:tasks.workunit.client.0.smithi196.stdout:0/810: chown d5/d23/d24/cd7 10 1 2024-03-17T23:58:33.274 INFO:tasks.workunit.client.0.smithi196.stdout:2/866: dwrite d17/d28/d30/f94 [0,4194304] 0 2024-03-17T23:58:33.275 INFO:tasks.workunit.client.0.smithi196.stdout:0/811: readlink d5/d23/d24/d59/de6/lfc 0 2024-03-17T23:58:33.277 INFO:tasks.workunit.client.0.smithi196.stdout:2/867: truncate d17/d28/d30/d12b/df0/f12d 704684 0 2024-03-17T23:58:33.277 INFO:tasks.workunit.client.0.smithi196.stdout:9/658: read d9/d33/f5f [299239,67473] 0 2024-03-17T23:58:33.277 INFO:tasks.workunit.client.0.smithi196.stdout:4/628: mknod d1/d11/ce3 0 2024-03-17T23:58:33.281 INFO:tasks.workunit.client.0.smithi196.stdout:2/868: rmdir d17/d28/d30 39 2024-03-17T23:58:33.283 INFO:tasks.workunit.client.0.smithi196.stdout:4/629: mkdir d1/de/d50/d55/de4 0 2024-03-17T23:58:33.284 INFO:tasks.workunit.client.0.smithi196.stdout:1/609: sync 2024-03-17T23:58:33.284 INFO:tasks.workunit.client.0.smithi196.stdout:7/764: sync 2024-03-17T23:58:33.284 INFO:tasks.workunit.client.0.smithi196.stdout:8/515: sync 2024-03-17T23:58:33.284 INFO:tasks.workunit.client.0.smithi196.stdout:6/712: sync 2024-03-17T23:58:33.285 INFO:tasks.workunit.client.0.smithi196.stdout:5/726: sync 2024-03-17T23:58:33.285 INFO:tasks.workunit.client.0.smithi196.stdout:3/861: sync 2024-03-17T23:58:33.285 INFO:tasks.workunit.client.0.smithi196.stdout:9/659: read d9/df/f1d [2590706,67824] 0 2024-03-17T23:58:33.290 INFO:tasks.workunit.client.0.smithi196.stdout:1/610: stat d1/db/dd/f72 0 2024-03-17T23:58:33.290 INFO:tasks.workunit.client.0.smithi196.stdout:4/630: symlink d1/d1b/le5 0 2024-03-17T23:58:33.292 INFO:tasks.workunit.client.0.smithi196.stdout:0/812: dwrite d5/d23/d24/d28/dc9/faf [0,4194304] 0 2024-03-17T23:58:33.292 INFO:tasks.workunit.client.0.smithi196.stdout:7/765: read da/d15/d1d/d4c/f51 [3472075,122011] 0 2024-03-17T23:58:33.292 INFO:tasks.workunit.client.0.smithi196.stdout:6/713: read - d2/d14/d75/dc0/ddf/de6/dd9/de5/ff6 zero size 2024-03-17T23:58:33.293 INFO:tasks.workunit.client.0.smithi196.stdout:4/631: chown d1/d11/c38 40 1 2024-03-17T23:58:33.295 INFO:tasks.workunit.client.0.smithi196.stdout:2/869: rename d17/d28/d30 to d17/d19/d137 0 2024-03-17T23:58:33.295 INFO:tasks.workunit.client.0.smithi196.stdout:9/660: chown d9/df/d4a/d5b/d6d/da8 935 1 2024-03-17T23:58:33.298 INFO:tasks.workunit.client.0.smithi196.stdout:1/611: chown d1/d13/d23/d70/fa8 4 1 2024-03-17T23:58:33.298 INFO:tasks.workunit.client.0.smithi196.stdout:3/862: truncate d7/d29/fff 915882 0 2024-03-17T23:58:33.298 INFO:tasks.workunit.client.0.smithi196.stdout:6/714: fdatasync d2/d14/f1d 0 2024-03-17T23:58:33.299 INFO:tasks.workunit.client.0.smithi196.stdout:4/632: unlink d1/d26/l30 0 2024-03-17T23:58:33.302 INFO:tasks.workunit.client.0.smithi196.stdout:5/727: creat d6/d17/f106 x:0 0 0 2024-03-17T23:58:33.306 INFO:tasks.workunit.client.0.smithi196.stdout:7/766: dread - da/d3e/d45/d4f/d75/da8/ff8 zero size 2024-03-17T23:58:33.306 INFO:tasks.workunit.client.0.smithi196.stdout:3/863: unlink d7/d29/f87 0 2024-03-17T23:58:33.307 INFO:tasks.workunit.client.0.smithi196.stdout:7/767: chown da/d15/c74 322367187 1 2024-03-17T23:58:33.308 INFO:tasks.workunit.client.0.smithi196.stdout:9/661: dread d9/f8a [0,4194304] 0 2024-03-17T23:58:33.310 INFO:tasks.workunit.client.0.smithi196.stdout:0/813: read d5/d23/d24/d28/d47/f70 [237035,65575] 0 2024-03-17T23:58:33.310 INFO:tasks.workunit.client.0.smithi196.stdout:8/516: dread de/f31 [0,4194304] 0 2024-03-17T23:58:33.310 INFO:tasks.workunit.client.0.smithi196.stdout:8/517: stat f6 0 2024-03-17T23:58:33.311 INFO:tasks.workunit.client.0.smithi196.stdout:1/612: mknod d1/db/dd/d43/ccc 0 2024-03-17T23:58:33.313 INFO:tasks.workunit.client.0.smithi196.stdout:0/814: truncate d5/d23/d24/d28/f41 305740 0 2024-03-17T23:58:33.316 INFO:tasks.workunit.client.0.smithi196.stdout:5/728: rename d6/d2a/c101 to d6/d2d/d33/dc5/c107 0 2024-03-17T23:58:33.318 INFO:tasks.workunit.client.0.smithi196.stdout:2/870: mkdir d17/d22/d3d/d8f/d138 0 2024-03-17T23:58:33.318 INFO:tasks.workunit.client.0.smithi196.stdout:2/871: stat f4 0 2024-03-17T23:58:33.322 INFO:tasks.workunit.client.0.smithi196.stdout:6/715: dread d2/d14/d75/d7b/fb1 [0,4194304] 0 2024-03-17T23:58:33.323 INFO:tasks.workunit.client.0.smithi196.stdout:9/662: creat d9/df/d4a/d5b/d6d/fd0 x:0 0 0 2024-03-17T23:58:33.327 INFO:tasks.workunit.client.0.smithi196.stdout:1/613: mkdir d1/d13/d4c/dcd 0 2024-03-17T23:58:33.330 INFO:tasks.workunit.client.0.smithi196.stdout:4/633: mkdir d1/d26/d57/de6 0 2024-03-17T23:58:33.332 INFO:tasks.workunit.client.0.smithi196.stdout:0/815: creat d5/d23/d24/d28/dc9/ffe x:0 0 0 2024-03-17T23:58:33.335 INFO:tasks.workunit.client.0.smithi196.stdout:8/518: mkdir de/d2b/d9f 0 2024-03-17T23:58:33.335 INFO:tasks.workunit.client.0.smithi196.stdout:9/663: mkdir d9/df/d4a/d5b/d62/dd1 0 2024-03-17T23:58:33.336 INFO:tasks.workunit.client.0.smithi196.stdout:1/614: unlink d1/d13/d23/d62/dab/lbe 0 2024-03-17T23:58:33.339 INFO:tasks.workunit.client.0.smithi196.stdout:5/729: dread d6/d17/d35/f4f [0,4194304] 0 2024-03-17T23:58:33.341 INFO:tasks.workunit.client.0.smithi196.stdout:3/864: creat d7/d19/f111 x:0 0 0 2024-03-17T23:58:33.341 INFO:tasks.workunit.client.0.smithi196.stdout:9/664: fsync d9/df/d14/f72 0 2024-03-17T23:58:33.342 INFO:tasks.workunit.client.0.smithi196.stdout:5/730: stat d6/d17/d1f/d5c/fa3 0 2024-03-17T23:58:33.342 INFO:tasks.workunit.client.0.smithi196.stdout:2/872: mknod d17/d19/d93/c139 0 2024-03-17T23:58:33.343 INFO:tasks.workunit.client.0.smithi196.stdout:7/768: dwrite da/d15/d1d/d29/f79 [0,4194304] 0 2024-03-17T23:58:33.344 INFO:tasks.workunit.client.0.smithi196.stdout:6/716: dwrite d2/d14/d42/d57/fda [0,4194304] 0 2024-03-17T23:58:33.346 INFO:tasks.workunit.client.0.smithi196.stdout:2/873: dread - d17/d28/d96/fc3 zero size 2024-03-17T23:58:33.347 INFO:tasks.workunit.client.0.smithi196.stdout:9/665: fdatasync d9/df/d4a/d5b/d6d/da8/fbc 0 2024-03-17T23:58:33.351 INFO:tasks.workunit.client.0.smithi196.stdout:4/634: dwrite d1/d26/d57/dac/fb5 [0,4194304] 0 2024-03-17T23:58:33.365 INFO:tasks.workunit.client.0.smithi196.stdout:6/717: mknod d2/d14/de2/c102 0 2024-03-17T23:58:33.365 INFO:tasks.workunit.client.0.smithi196.stdout:6/718: fdatasync d2/d14/d75/ff3 0 2024-03-17T23:58:33.365 INFO:tasks.workunit.client.0.smithi196.stdout:6/719: chown d2/d7/lb5 1782 1 2024-03-17T23:58:33.367 INFO:tasks.workunit.client.0.smithi196.stdout:2/874: unlink d17/d19/d137/d71/de0/ffd 0 2024-03-17T23:58:33.369 INFO:tasks.workunit.client.0.smithi196.stdout:8/519: fsync de/f13 0 2024-03-17T23:58:33.370 INFO:tasks.workunit.client.0.smithi196.stdout:9/666: write d9/df/f7b [387781,63016] 0 2024-03-17T23:58:33.371 INFO:tasks.workunit.client.0.smithi196.stdout:2/875: read - d17/d19/f10c zero size 2024-03-17T23:58:33.371 INFO:tasks.workunit.client.0.smithi196.stdout:4/635: unlink d1/d1b/d77/f83 0 2024-03-17T23:58:33.371 INFO:tasks.workunit.client.0.smithi196.stdout:1/615: symlink d1/d13/d4c/dcd/lce 0 2024-03-17T23:58:33.372 INFO:tasks.workunit.client.0.smithi196.stdout:5/731: creat d6/d17/d1f/d7d/d81/dfd/f108 x:0 0 0 2024-03-17T23:58:33.373 INFO:tasks.workunit.client.0.smithi196.stdout:6/720: rmdir d2/d14/d75/d92/dd8 39 2024-03-17T23:58:33.377 INFO:tasks.workunit.client.0.smithi196.stdout:9/667: read - d9/df/d4a/d89/db1/fb3 zero size 2024-03-17T23:58:33.378 INFO:tasks.workunit.client.0.smithi196.stdout:5/732: write d6/d2a/fb3 [2617253,38879] 0 2024-03-17T23:58:33.380 INFO:tasks.workunit.client.0.smithi196.stdout:0/816: dwrite d5/d23/d24/d30/f6b [0,4194304] 0 2024-03-17T23:58:33.383 INFO:tasks.workunit.client.0.smithi196.stdout:2/876: mknod d17/d22/d3d/c13a 0 2024-03-17T23:58:33.384 INFO:tasks.workunit.client.0.smithi196.stdout:1/616: write d1/f4 [300012,124383] 0 2024-03-17T23:58:33.388 INFO:tasks.workunit.client.0.smithi196.stdout:0/817: fsync d5/d23/d24/d59/f9e 0 2024-03-17T23:58:33.390 INFO:tasks.workunit.client.0.smithi196.stdout:7/769: dwrite da/d15/f8c [4194304,4194304] 0 2024-03-17T23:58:33.395 INFO:tasks.workunit.client.0.smithi196.stdout:6/721: write d2/d14/d8c/fc1 [35435,96862] 0 2024-03-17T23:58:33.395 INFO:tasks.workunit.client.0.smithi196.stdout:3/865: dwrite d7/d19/d78/fb7 [0,4194304] 0 2024-03-17T23:58:33.396 INFO:tasks.workunit.client.0.smithi196.stdout:5/733: dread d6/d17/d1f/f4c [0,4194304] 0 2024-03-17T23:58:33.396 INFO:tasks.workunit.client.0.smithi196.stdout:7/770: chown da/d15/da7 0 1 2024-03-17T23:58:33.398 INFO:tasks.workunit.client.0.smithi196.stdout:5/734: read - d6/d17/d3f/fae zero size 2024-03-17T23:58:33.402 INFO:tasks.workunit.client.0.smithi196.stdout:2/877: truncate d17/d22/d3d/d8f/d114/f128 517715 0 2024-03-17T23:58:33.403 INFO:tasks.workunit.client.0.smithi196.stdout:1/617: creat d1/d13/d23/d47/d48/fcf x:0 0 0 2024-03-17T23:58:33.407 INFO:tasks.workunit.client.0.smithi196.stdout:0/818: mknod d5/d23/d24/d28/d47/d52/d61/d6c/d82/cff 0 2024-03-17T23:58:33.410 INFO:tasks.workunit.client.0.smithi196.stdout:7/771: creat da/d3e/ddc/f107 x:0 0 0 2024-03-17T23:58:33.412 INFO:tasks.workunit.client.0.smithi196.stdout:6/722: mkdir d2/d14/dcc/d103 0 2024-03-17T23:58:33.413 INFO:tasks.workunit.client.0.smithi196.stdout:2/878: read d17/d19/f69 [119341,70026] 0 2024-03-17T23:58:33.416 INFO:tasks.workunit.client.0.smithi196.stdout:3/866: unlink d7/d19/d26/f9c 0 2024-03-17T23:58:33.417 INFO:tasks.workunit.client.0.smithi196.stdout:1/618: mkdir d1/d13/d23/d62/dd0 0 2024-03-17T23:58:33.418 INFO:tasks.workunit.client.0.smithi196.stdout:2/879: stat d17/d19/d137/d3b/fe5 0 2024-03-17T23:58:33.421 INFO:tasks.workunit.client.0.smithi196.stdout:4/636: dread d1/d26/d33/f88 [0,4194304] 0 2024-03-17T23:58:33.422 INFO:tasks.workunit.client.0.smithi196.stdout:5/735: dwrite d6/d2d/db8/fcb [0,4194304] 0 2024-03-17T23:58:33.423 INFO:tasks.workunit.client.0.smithi196.stdout:9/668: dread f5 [4194304,4194304] 0 2024-03-17T23:58:33.424 INFO:tasks.workunit.client.0.smithi196.stdout:8/520: dread de/f1f [0,4194304] 0 2024-03-17T23:58:33.427 INFO:tasks.workunit.client.0.smithi196.stdout:2/880: truncate d17/d22/d59/f80 1209388 0 2024-03-17T23:58:33.428 INFO:tasks.workunit.client.0.smithi196.stdout:9/669: readlink d9/df/d4a/d5b/da5/lc9 0 2024-03-17T23:58:33.434 INFO:tasks.workunit.client.0.smithi196.stdout:3/867: mknod d7/d29/d9b/df8/c112 0 2024-03-17T23:58:33.437 INFO:tasks.workunit.client.0.smithi196.stdout:1/619: dwrite d1/d13/d2a/f90 [0,4194304] 0 2024-03-17T23:58:33.437 INFO:tasks.workunit.client.0.smithi196.stdout:5/736: write d6/d15/fb6 [81322,7192] 0 2024-03-17T23:58:33.437 INFO:tasks.workunit.client.0.smithi196.stdout:4/637: creat d1/d11/fe7 x:0 0 0 2024-03-17T23:58:33.441 INFO:tasks.workunit.client.0.smithi196.stdout:0/819: dread d5/d23/d24/d28/d47/d52/f42 [0,4194304] 0 2024-03-17T23:58:33.442 INFO:tasks.workunit.client.0.smithi196.stdout:8/521: rmdir de/d5e 39 2024-03-17T23:58:33.447 INFO:tasks.workunit.client.0.smithi196.stdout:9/670: mkdir d9/df/d14/db0/dd2 0 2024-03-17T23:58:33.451 INFO:tasks.workunit.client.0.smithi196.stdout:6/723: link d2/d14/d35/fbf d2/d14/d75/dc0/ddf/f104 0 2024-03-17T23:58:33.451 INFO:tasks.workunit.client.0.smithi196.stdout:5/737: dwrite d6/d17/d1f/f75 [0,4194304] 0 2024-03-17T23:58:33.454 INFO:tasks.workunit.client.0.smithi196.stdout:4/638: mknod d1/de/ce8 0 2024-03-17T23:58:33.456 INFO:tasks.workunit.client.0.smithi196.stdout:8/522: creat de/d10/d54/d5c/fa0 x:0 0 0 2024-03-17T23:58:33.456 INFO:tasks.workunit.client.0.smithi196.stdout:8/523: chown de/d2b/d3c 13 1 2024-03-17T23:58:33.458 INFO:tasks.workunit.client.0.smithi196.stdout:7/772: dread da/f13 [0,4194304] 0 2024-03-17T23:58:33.459 INFO:tasks.workunit.client.0.smithi196.stdout:5/738: rmdir d6/d17/d23/d53 39 2024-03-17T23:58:33.461 INFO:tasks.workunit.client.0.smithi196.stdout:1/620: mkdir d1/d13/d23/d62/dab/dca/dd1 0 2024-03-17T23:58:33.463 INFO:tasks.workunit.client.0.smithi196.stdout:4/639: rename d1/d68/d74 to d1/d26/d8b/de9 0 2024-03-17T23:58:33.463 INFO:tasks.workunit.client.0.smithi196.stdout:0/820: mkdir d5/d23/d24/d28/d47/d52/d61/d6c/d100 0 2024-03-17T23:58:33.465 INFO:tasks.workunit.client.0.smithi196.stdout:4/640: read d1/de/d50/d55/f6f [250132,92919] 0 2024-03-17T23:58:33.469 INFO:tasks.workunit.client.0.smithi196.stdout:6/724: mknod d2/c105 0 2024-03-17T23:58:33.470 INFO:tasks.workunit.client.0.smithi196.stdout:1/621: dwrite d1/db/dd/d34/f55 [0,4194304] 0 2024-03-17T23:58:33.470 INFO:tasks.workunit.client.0.smithi196.stdout:2/881: link d17/d19/l1c d17/d22/da0/d134/l13b 0 2024-03-17T23:58:33.472 INFO:tasks.workunit.client.0.smithi196.stdout:3/868: write d7/d33/ddc/f10a [989980,92727] 0 2024-03-17T23:58:33.477 INFO:tasks.workunit.client.0.smithi196.stdout:4/641: dread d1/fa7 [0,4194304] 0 2024-03-17T23:58:33.479 INFO:tasks.workunit.client.0.smithi196.stdout:6/725: dread d2/d14/f47 [0,4194304] 0 2024-03-17T23:58:33.479 INFO:tasks.workunit.client.0.smithi196.stdout:7/773: mknod da/d15/d1d/c108 0 2024-03-17T23:58:33.483 INFO:tasks.workunit.client.0.smithi196.stdout:1/622: truncate d1/f25 8465559 0 2024-03-17T23:58:33.484 INFO:tasks.workunit.client.0.smithi196.stdout:2/882: dwrite d17/d19/d137/d72/fb2 [0,4194304] 0 2024-03-17T23:58:33.486 INFO:tasks.workunit.client.0.smithi196.stdout:4/642: truncate d1/d26/fc4 186295 0 2024-03-17T23:58:33.487 INFO:tasks.workunit.client.0.smithi196.stdout:2/883: readlink d17/d28/l8e 0 2024-03-17T23:58:33.488 INFO:tasks.workunit.client.0.smithi196.stdout:1/623: chown d1/d13/d23/d47/d48/f54 5 1 2024-03-17T23:58:33.488 INFO:tasks.workunit.client.0.smithi196.stdout:6/726: chown d2/f45 212312 1 2024-03-17T23:58:33.494 INFO:tasks.workunit.client.0.smithi196.stdout:0/821: dread d5/d23/d85/f9c [0,4194304] 0 2024-03-17T23:58:33.494 INFO:tasks.workunit.client.0.smithi196.stdout:9/671: dwrite d9/df/d14/f5c [0,4194304] 0 2024-03-17T23:58:33.502 INFO:tasks.workunit.client.0.smithi196.stdout:5/739: truncate d6/d17/f26 2748599 0 2024-03-17T23:58:33.503 INFO:tasks.workunit.client.0.smithi196.stdout:3/869: mknod d7/d19/d26/df5/c113 0 2024-03-17T23:58:33.505 INFO:tasks.workunit.client.0.smithi196.stdout:4/643: symlink d1/d26/d57/d8c/d97/lea 0 2024-03-17T23:58:33.505 INFO:tasks.workunit.client.0.smithi196.stdout:4/644: readlink d1/d1b/l7f 0 2024-03-17T23:58:33.506 INFO:tasks.workunit.client.0.smithi196.stdout:4/645: write d1/d68/f87 [2764669,35036] 0 2024-03-17T23:58:33.507 INFO:tasks.workunit.client.0.smithi196.stdout:1/624: creat d1/d13/d23/d62/dab/dca/fd2 x:0 0 0 2024-03-17T23:58:33.508 INFO:tasks.workunit.client.0.smithi196.stdout:8/524: link de/d10/d54/l8e de/d10/d35/la1 0 2024-03-17T23:58:33.515 INFO:tasks.workunit.client.0.smithi196.stdout:5/740: read f4 [234144,112994] 0 2024-03-17T23:58:33.516 INFO:tasks.workunit.client.0.smithi196.stdout:2/884: symlink d17/d22/d12a/l13c 0 2024-03-17T23:58:33.520 INFO:tasks.workunit.client.0.smithi196.stdout:6/727: link d2/d7/dcd/dd3/f76 d2/d7/d2b/f106 0 2024-03-17T23:58:33.522 INFO:tasks.workunit.client.0.smithi196.stdout:1/625: mkdir d1/d13/d23/d62/dab/dd3 0 2024-03-17T23:58:33.524 INFO:tasks.workunit.client.0.smithi196.stdout:0/822: fsync d5/d23/f74 0 2024-03-17T23:58:33.527 INFO:tasks.workunit.client.0.smithi196.stdout:9/672: dread d9/d12/f21 [0,4194304] 0 2024-03-17T23:58:33.527 INFO:tasks.workunit.client.0.smithi196.stdout:2/885: dread - d17/d22/f39 zero size 2024-03-17T23:58:33.534 INFO:tasks.workunit.client.0.smithi196.stdout:8/525: write de/d2b/d30/f50 [603735,100366] 0 2024-03-17T23:58:33.537 INFO:tasks.workunit.client.0.smithi196.stdout:7/774: getdents da/d3e/d45/dd8/de4 0 2024-03-17T23:58:33.539 INFO:tasks.workunit.client.0.smithi196.stdout:3/870: truncate d7/d33/ddc/fdd 40477 0 2024-03-17T23:58:33.541 INFO:tasks.workunit.client.0.smithi196.stdout:4/646: creat d1/feb x:0 0 0 2024-03-17T23:58:33.541 INFO:tasks.workunit.client.0.smithi196.stdout:3/871: read - d7/d19/d78/da9/fe6 zero size 2024-03-17T23:58:33.542 INFO:tasks.workunit.client.0.smithi196.stdout:0/823: dread d5/d23/d24/d28/d47/d52/f3f [0,4194304] 0 2024-03-17T23:58:33.544 INFO:tasks.workunit.client.0.smithi196.stdout:6/728: creat d2/d14/dcc/d103/f107 x:0 0 0 2024-03-17T23:58:33.546 INFO:tasks.workunit.client.0.smithi196.stdout:2/886: mkdir d17/d28/d13d 0 2024-03-17T23:58:33.546 INFO:tasks.workunit.client.0.smithi196.stdout:7/775: mkdir da/d3e/d7f/d109 0 2024-03-17T23:58:33.547 INFO:tasks.workunit.client.0.smithi196.stdout:1/626: rmdir d1/d13/d23/d62/dab/dd3 0 2024-03-17T23:58:33.548 INFO:tasks.workunit.client.0.smithi196.stdout:4/647: rmdir d1/d26 39 2024-03-17T23:58:33.550 INFO:tasks.workunit.client.0.smithi196.stdout:6/729: read - d2/d14/d75/d7b/fb4 zero size 2024-03-17T23:58:33.550 INFO:tasks.workunit.client.0.smithi196.stdout:2/887: fdatasync d17/d22/da0/f7b 0 2024-03-17T23:58:33.550 INFO:tasks.workunit.client.0.smithi196.stdout:8/526: dwrite de/d10/d35/d88/f9b [0,4194304] 0 2024-03-17T23:58:33.557 INFO:tasks.workunit.client.0.smithi196.stdout:0/824: write d5/d23/d24/f6e [1734161,84710] 0 2024-03-17T23:58:33.558 INFO:tasks.workunit.client.0.smithi196.stdout:8/527: write de/d2b/d3c/f55 [107606,14781] 0 2024-03-17T23:58:33.558 INFO:tasks.workunit.client.0.smithi196.stdout:5/741: dread d6/d2d/f96 [4194304,4194304] 0 2024-03-17T23:58:33.563 INFO:tasks.workunit.client.0.smithi196.stdout:7/776: rmdir da/d3e/d7f/dc6/df0 39 2024-03-17T23:58:33.563 INFO:tasks.workunit.client.0.smithi196.stdout:5/742: write d6/d17/d3f/fae [783633,129904] 0 2024-03-17T23:58:33.566 INFO:tasks.workunit.client.0.smithi196.stdout:6/730: write d2/f2a [1144095,68404] 0 2024-03-17T23:58:33.570 INFO:tasks.workunit.client.0.smithi196.stdout:8/528: creat de/d10/d43/d71/fa2 x:0 0 0 2024-03-17T23:58:33.570 INFO:tasks.workunit.client.0.smithi196.stdout:0/825: unlink d5/d23/d24/d28/d47/lb9 0 2024-03-17T23:58:33.571 INFO:tasks.workunit.client.0.smithi196.stdout:1/627: dwrite d1/d13/d23/f82 [0,4194304] 0 2024-03-17T23:58:33.571 INFO:tasks.workunit.client.0.smithi196.stdout:2/888: write d17/f70 [1104288,96830] 0 2024-03-17T23:58:33.572 INFO:tasks.workunit.client.0.smithi196.stdout:7/777: chown da/d3e/d45/dd8/de4/l4b 0 1 2024-03-17T23:58:33.574 INFO:tasks.workunit.client.0.smithi196.stdout:8/529: write de/d2b/d30/f73 [1383354,99095] 0 2024-03-17T23:58:33.575 INFO:tasks.workunit.client.0.smithi196.stdout:5/743: truncate d6/d17/d1f/d5c/fa3 233782 0 2024-03-17T23:58:33.575 INFO:tasks.workunit.client.0.smithi196.stdout:6/731: fdatasync d2/d14/d42/f64 0 2024-03-17T23:58:33.576 INFO:tasks.workunit.client.0.smithi196.stdout:0/826: readlink d5/d23/d24/d72/lb3 0 2024-03-17T23:58:33.577 INFO:tasks.workunit.client.0.smithi196.stdout:2/889: write d17/d19/d137/fcf [5215,41629] 0 2024-03-17T23:58:33.579 INFO:tasks.workunit.client.0.smithi196.stdout:3/872: dread d7/d19/d78/d8b/ffd [0,4194304] 0 2024-03-17T23:58:33.581 INFO:tasks.workunit.client.0.smithi196.stdout:7/778: truncate da/d3e/d45/d4f/d75/fd1 1831359 0 2024-03-17T23:58:33.582 INFO:tasks.workunit.client.0.smithi196.stdout:7/779: write da/d15/d1d/d4c/f7d [1658342,82978] 0 2024-03-17T23:58:33.583 INFO:tasks.workunit.client.0.smithi196.stdout:3/873: dread - d7/d19/d78/d8b/fe8 zero size 2024-03-17T23:58:33.585 INFO:tasks.workunit.client.0.smithi196.stdout:2/890: dread - d17/d19/d137/d3b/fe7 zero size 2024-03-17T23:58:33.586 INFO:tasks.workunit.client.0.smithi196.stdout:4/648: rename d1/de/d50/d55/d4a/l54 to d1/d26/d57/dac/db2/lec 0 2024-03-17T23:58:33.587 INFO:tasks.workunit.client.0.smithi196.stdout:5/744: truncate d6/d2d/d33/d3b/f6d 4393834 0 2024-03-17T23:58:33.589 INFO:tasks.workunit.client.0.smithi196.stdout:2/891: write d17/d28/d96/f126 [983523,108198] 0 2024-03-17T23:58:33.590 INFO:tasks.workunit.client.0.smithi196.stdout:8/530: truncate de/d10/d43/f75 1978085 0 2024-03-17T23:58:33.591 INFO:tasks.workunit.client.0.smithi196.stdout:4/649: write d1/d11/f12 [1641930,116539] 0 2024-03-17T23:58:33.595 INFO:tasks.workunit.client.0.smithi196.stdout:5/745: symlink d6/d2d/d33/d3b/d65/l109 0 2024-03-17T23:58:33.596 INFO:tasks.workunit.client.0.smithi196.stdout:4/650: stat d1/d68/fce 0 2024-03-17T23:58:33.599 INFO:tasks.workunit.client.0.smithi196.stdout:2/892: write d17/d28/d96/fc3 [274146,14465] 0 2024-03-17T23:58:33.599 INFO:tasks.workunit.client.0.smithi196.stdout:0/827: dwrite d5/f18 [4194304,4194304] 0 2024-03-17T23:58:33.600 INFO:tasks.workunit.client.0.smithi196.stdout:7/780: truncate da/d15/d1a/d5e/da5/fd9 44947 0 2024-03-17T23:58:33.602 INFO:tasks.workunit.client.0.smithi196.stdout:0/828: write d5/f18 [8888646,103468] 0 2024-03-17T23:58:33.603 INFO:tasks.workunit.client.0.smithi196.stdout:1/628: getdents d1/d13/d4c/da0 0 2024-03-17T23:58:33.605 INFO:tasks.workunit.client.0.smithi196.stdout:5/746: unlink d6/d17/d1f/le0 0 2024-03-17T23:58:33.608 INFO:tasks.workunit.client.0.smithi196.stdout:6/732: getdents d2/d14/d35/d63 0 2024-03-17T23:58:33.610 INFO:tasks.workunit.client.0.smithi196.stdout:2/893: symlink d17/d28/dae/l13e 0 2024-03-17T23:58:33.610 INFO:tasks.workunit.client.0.smithi196.stdout:1/629: read - d1/d13/d23/d47/d48/d74/fa5 zero size 2024-03-17T23:58:33.615 INFO:tasks.workunit.client.0.smithi196.stdout:3/874: dwrite d7/d19/d26/d48/fcc [0,4194304] 0 2024-03-17T23:58:33.615 INFO:tasks.workunit.client.0.smithi196.stdout:2/894: chown d17/d19/d137/d3b/f4a 47354 1 2024-03-17T23:58:33.618 INFO:tasks.workunit.client.0.smithi196.stdout:3/875: write d7/d19/d78/dca/f106 [566123,25402] 0 2024-03-17T23:58:33.619 INFO:tasks.workunit.client.0.smithi196.stdout:0/829: readlink d5/d23/d24/d59/de6/lea 0 2024-03-17T23:58:33.626 INFO:tasks.workunit.client.0.smithi196.stdout:5/747: creat d6/d2d/d33/dc5/f10a x:0 0 0 2024-03-17T23:58:33.628 INFO:tasks.workunit.client.0.smithi196.stdout:4/651: dwrite d1/d26/f8e [4194304,4194304] 0 2024-03-17T23:58:33.630 INFO:tasks.workunit.client.0.smithi196.stdout:8/531: link de/d2b/d30/d33/c83 de/d10/d35/ca3 0 2024-03-17T23:58:33.632 INFO:tasks.workunit.client.0.smithi196.stdout:5/748: symlink d6/d2d/d33/d3b/d80/db9/l10b 0 2024-03-17T23:58:33.636 INFO:tasks.workunit.client.0.smithi196.stdout:0/830: dread d5/d23/d24/d28/d47/d52/f7e [0,4194304] 0 2024-03-17T23:58:33.636 INFO:tasks.workunit.client.0.smithi196.stdout:1/630: rmdir d1/db/dd/d43/da1 0 2024-03-17T23:58:33.637 INFO:tasks.workunit.client.0.smithi196.stdout:6/733: write d2/d66/d90/fab [855291,106247] 0 2024-03-17T23:58:33.637 INFO:tasks.workunit.client.0.smithi196.stdout:8/532: symlink de/d2b/d3c/d5d/d65/la4 0 2024-03-17T23:58:33.643 INFO:tasks.workunit.client.0.smithi196.stdout:2/895: dwrite d17/d22/f64 [0,4194304] 0 2024-03-17T23:58:33.647 INFO:tasks.workunit.client.0.smithi196.stdout:7/781: dwrite da/d3e/d45/d4f/d75/da8/f96 [0,4194304] 0 2024-03-17T23:58:33.650 INFO:tasks.workunit.client.0.smithi196.stdout:4/652: dread d1/d26/d57/d8c/d97/fbd [0,4194304] 0 2024-03-17T23:58:33.654 INFO:tasks.workunit.client.0.smithi196.stdout:8/533: write de/d2b/d3c/d5d/f74 [1598091,71792] 0 2024-03-17T23:58:33.663 INFO:tasks.workunit.client.0.smithi196.stdout:6/734: rename d2/d14/d50/d68/f9c to d2/def/f108 0 2024-03-17T23:58:33.664 INFO:tasks.workunit.client.0.smithi196.stdout:2/896: chown d17/d22/l32 7439 1 2024-03-17T23:58:33.665 INFO:tasks.workunit.client.0.smithi196.stdout:2/897: fdatasync d17/ff7 0 2024-03-17T23:58:33.665 INFO:tasks.workunit.client.0.smithi196.stdout:2/898: stat d17/d19/f10c 0 2024-03-17T23:58:33.667 INFO:tasks.workunit.client.0.smithi196.stdout:3/876: dread d7/d19/d26/d2b/d3c/d3d/f5e [0,4194304] 0 2024-03-17T23:58:33.668 INFO:tasks.workunit.client.0.smithi196.stdout:7/782: write da/f13 [4248821,27665] 0 2024-03-17T23:58:33.669 INFO:tasks.workunit.client.0.smithi196.stdout:4/653: truncate d1/d1b/f5f 43938 0 2024-03-17T23:58:33.670 INFO:tasks.workunit.client.0.smithi196.stdout:7/783: write da/d15/d1d/d29/fde [207836,3647] 0 2024-03-17T23:58:33.676 INFO:tasks.workunit.client.0.smithi196.stdout:6/735: chown d2/d66/l77 498091 1 2024-03-17T23:58:33.680 INFO:tasks.workunit.client.0.smithi196.stdout:5/749: rmdir d6/d17/d3f/d4e/d69/de7 0 2024-03-17T23:58:33.681 INFO:tasks.workunit.client.0.smithi196.stdout:8/534: dread de/d10/f24 [0,4194304] 0 2024-03-17T23:58:33.682 INFO:tasks.workunit.client.0.smithi196.stdout:2/899: write d17/f11d [1046400,37183] 0 2024-03-17T23:58:33.682 INFO:tasks.workunit.client.0.smithi196.stdout:3/877: mkdir d7/d19/d26/d2b/d114 0 2024-03-17T23:58:33.684 INFO:tasks.workunit.client.0.smithi196.stdout:7/784: mknod da/d3e/d7f/c10a 0 2024-03-17T23:58:33.686 INFO:tasks.workunit.client.0.smithi196.stdout:6/736: read - d2/d66/f78 zero size 2024-03-17T23:58:33.687 INFO:tasks.workunit.client.0.smithi196.stdout:2/900: unlink d17/f116 0 2024-03-17T23:58:33.687 INFO:tasks.workunit.client.0.smithi196.stdout:4/654: mkdir d1/d11/d5d/ded 0 2024-03-17T23:58:33.688 INFO:tasks.workunit.client.0.smithi196.stdout:0/831: dread d5/d23/f4a [0,4194304] 0 2024-03-17T23:58:33.688 INFO:tasks.workunit.client.0.smithi196.stdout:4/655: chown d1/dd2/le1 0 1 2024-03-17T23:58:33.689 INFO:tasks.workunit.client.0.smithi196.stdout:5/750: mkdir d6/d17/d3f/d4e/d69/ded/d10c 0 2024-03-17T23:58:33.690 INFO:tasks.workunit.client.0.smithi196.stdout:7/785: creat da/d3e/d7f/f10b x:0 0 0 2024-03-17T23:58:33.690 INFO:tasks.workunit.client.0.smithi196.stdout:2/901: write d17/d28/f135 [261872,29910] 0 2024-03-17T23:58:33.693 INFO:tasks.workunit.client.0.smithi196.stdout:5/751: chown d6/d17/d23/l7b 182706500 1 2024-03-17T23:58:33.693 INFO:tasks.workunit.client.0.smithi196.stdout:0/832: dread - d5/d23/d24/d30/f93 zero size 2024-03-17T23:58:33.696 INFO:tasks.workunit.client.0.smithi196.stdout:0/833: chown d5/d23/d24/d28/d47/d52/d61 1922637 1 2024-03-17T23:58:33.697 INFO:tasks.workunit.client.0.smithi196.stdout:2/902: unlink d17/d22/da0/f5a 0 2024-03-17T23:58:33.697 INFO:tasks.workunit.client.0.smithi196.stdout:6/737: write d2/d14/d42/d57/d5f/dbd/ff7 [765731,22502] 0 2024-03-17T23:58:33.699 INFO:tasks.workunit.client.0.smithi196.stdout:8/535: rmdir de/d2b/d30/d33/d96 0 2024-03-17T23:58:33.699 INFO:tasks.workunit.client.0.smithi196.stdout:6/738: write d2/f41 [4345874,28022] 0 2024-03-17T23:58:33.702 INFO:tasks.workunit.client.0.smithi196.stdout:3/878: rmdir d7/d19/d26/d2b/d3c/d3d/df9 0 2024-03-17T23:58:33.709 INFO:tasks.workunit.client.0.smithi196.stdout:7/786: dread da/d3e/d45/d4f/d75/fea [4194304,4194304] 0 2024-03-17T23:58:33.712 INFO:tasks.workunit.client.0.smithi196.stdout:0/834: dwrite d5/d23/d24/d28/d47/d52/dac/ff5 [0,4194304] 0 2024-03-17T23:58:33.715 INFO:tasks.workunit.client.0.smithi196.stdout:5/752: creat d6/d17/d23/d7e/f10d x:0 0 0 2024-03-17T23:58:33.716 INFO:tasks.workunit.client.0.smithi196.stdout:2/903: readlink d17/d22/lbd 0 2024-03-17T23:58:33.717 INFO:tasks.workunit.client.0.smithi196.stdout:6/739: creat d2/d14/d75/dc0/ddf/da1/f109 x:0 0 0 2024-03-17T23:58:33.720 INFO:tasks.workunit.client.0.smithi196.stdout:4/656: rename d1/d26/d33/l96 to d1/lee 0 2024-03-17T23:58:33.721 INFO:tasks.workunit.client.0.smithi196.stdout:7/787: rename da/d3e/d45/d4f to da/d3e/d45/d4f/d75/da8/d78/da4/d9b/d10c 22 2024-03-17T23:58:33.722 INFO:tasks.workunit.client.0.smithi196.stdout:0/835: unlink d5/d23/d24/d28/d47/d52/d49/lda 0 2024-03-17T23:58:33.725 INFO:tasks.workunit.client.0.smithi196.stdout:3/879: mkdir d7/d19/d115 0 2024-03-17T23:58:33.730 INFO:tasks.workunit.client.0.smithi196.stdout:4/657: dread d1/de/d50/d55/fb3 [0,4194304] 0 2024-03-17T23:58:33.733 INFO:tasks.workunit.client.0.smithi196.stdout:5/753: dwrite d6/d17/d1f/d7d/fb2 [0,4194304] 0 2024-03-17T23:58:33.736 INFO:tasks.workunit.client.0.smithi196.stdout:8/536: dread de/d2b/d30/f68 [0,4194304] 0 2024-03-17T23:58:33.740 INFO:tasks.workunit.client.0.smithi196.stdout:6/740: dwrite d2/d14/d50/d68/f70 [0,4194304] 0 2024-03-17T23:58:33.745 INFO:tasks.workunit.client.0.smithi196.stdout:5/754: dread - d6/d17/d23/d53/fa1 zero size 2024-03-17T23:58:33.747 INFO:tasks.workunit.client.0.smithi196.stdout:8/537: symlink de/d10/d35/d3e/d6c/la5 0 2024-03-17T23:58:33.747 INFO:tasks.workunit.client.0.smithi196.stdout:2/904: write d17/d22/f6e [1096265,78843] 0 2024-03-17T23:58:33.749 INFO:tasks.workunit.client.0.smithi196.stdout:5/755: chown d6/d2d/d33/d3b/c56 0 1 2024-03-17T23:58:33.749 INFO:tasks.workunit.client.0.smithi196.stdout:3/880: truncate d7/d19/d26/d48/d4d/f85 1700952 0 2024-03-17T23:58:33.750 INFO:tasks.workunit.client.0.smithi196.stdout:5/756: stat d6/d17/l37 0 2024-03-17T23:58:33.754 INFO:tasks.workunit.client.0.smithi196.stdout:2/905: rename d17/d19/d137/d12b/fba to d17/d1f/f13f 0 2024-03-17T23:58:33.755 INFO:tasks.workunit.client.0.smithi196.stdout:3/881: rmdir d7/d29/d9b 39 2024-03-17T23:58:33.761 INFO:tasks.workunit.client.0.smithi196.stdout:5/757: mknod d6/d15/dc0/de5/c10e 0 2024-03-17T23:58:33.761 INFO:tasks.workunit.client.0.smithi196.stdout:2/906: creat d17/d19/d44/f140 x:0 0 0 2024-03-17T23:58:33.766 INFO:tasks.workunit.client.0.smithi196.stdout:7/788: dread da/d15/da7/f68 [0,4194304] 0 2024-03-17T23:58:33.766 INFO:tasks.workunit.client.0.smithi196.stdout:6/741: dwrite d2/d14/f47 [0,4194304] 0 2024-03-17T23:58:33.770 INFO:tasks.workunit.client.0.smithi196.stdout:6/742: stat d2/d14/d75/d7b/fb4 0 2024-03-17T23:58:33.774 INFO:tasks.workunit.client.0.smithi196.stdout:2/907: rename d17/d1f/fa9 to d17/d22/d3d/d8f/dbe/f141 0 2024-03-17T23:58:33.781 INFO:tasks.workunit.client.0.smithi196.stdout:8/538: dwrite de/d10/d43/f75 [0,4194304] 0 2024-03-17T23:58:33.781 INFO:tasks.workunit.client.0.smithi196.stdout:7/789: creat da/d15/d1d/d29/dc4/f10d x:0 0 0 2024-03-17T23:58:33.787 INFO:tasks.workunit.client.0.smithi196.stdout:3/882: dread d7/d19/f23 [0,4194304] 0 2024-03-17T23:58:33.788 INFO:tasks.workunit.client.0.smithi196.stdout:3/883: dread - d7/d19/fa2 zero size 2024-03-17T23:58:33.789 INFO:tasks.workunit.client.0.smithi196.stdout:7/790: fsync da/d15/d1d/f32 0 2024-03-17T23:58:33.793 INFO:tasks.workunit.client.0.smithi196.stdout:8/539: creat de/d10/d54/fa6 x:0 0 0 2024-03-17T23:58:33.795 INFO:tasks.workunit.client.0.smithi196.stdout:2/908: dwrite d17/d22/d59/f80 [0,4194304] 0 2024-03-17T23:58:33.795 INFO:tasks.workunit.client.0.smithi196.stdout:3/884: readlink d7/d19/d26/l7c 0 2024-03-17T23:58:33.798 INFO:tasks.workunit.client.0.smithi196.stdout:7/791: truncate da/d15/d1d/d29/f101 501126 0 2024-03-17T23:58:33.798 INFO:tasks.workunit.client.0.smithi196.stdout:5/758: dwrite d6/d2d/f55 [0,4194304] 0 2024-03-17T23:58:33.800 INFO:tasks.workunit.client.0.smithi196.stdout:2/909: read d17/d19/d137/fcd [41599,67085] 0 2024-03-17T23:58:33.802 INFO:tasks.workunit.client.0.smithi196.stdout:6/743: write d2/d14/fb7 [4621125,93513] 0 2024-03-17T23:58:33.804 INFO:tasks.workunit.client.0.smithi196.stdout:7/792: write da/d3e/d45/d4f/d75/da8/f96 [144616,38785] 0 2024-03-17T23:58:33.812 INFO:tasks.workunit.client.0.smithi196.stdout:3/885: symlink d7/d19/d26/d2b/dee/l116 0 2024-03-17T23:58:33.819 INFO:tasks.workunit.client.0.smithi196.stdout:6/744: creat d2/d14/d75/d92/dd8/f10a x:0 0 0 2024-03-17T23:58:33.822 INFO:tasks.workunit.client.0.smithi196.stdout:7/793: link da/d15/da7/f7e da/d15/d1a/d5e/d70/dc5/f10e 0 2024-03-17T23:58:33.823 INFO:tasks.workunit.client.0.smithi196.stdout:3/886: write d7/f20 [705777,43796] 0 2024-03-17T23:58:33.826 INFO:tasks.workunit.client.0.smithi196.stdout:8/540: creat de/d10/d35/fa7 x:0 0 0 2024-03-17T23:58:33.828 INFO:tasks.workunit.client.0.smithi196.stdout:5/759: getdents d6/d17/d23/d53 0 2024-03-17T23:58:33.831 INFO:tasks.workunit.client.0.smithi196.stdout:6/745: getdents d2/d7/d100 0 2024-03-17T23:58:33.834 INFO:tasks.workunit.client.0.smithi196.stdout:2/910: truncate d17/d28/f29 2915360 0 2024-03-17T23:58:33.836 INFO:tasks.workunit.client.0.smithi196.stdout:5/760: mkdir d6/d17/d35/d10f 0 2024-03-17T23:58:33.837 INFO:tasks.workunit.client.0.smithi196.stdout:7/794: dwrite da/d3e/d7f/dc6/feb [0,4194304] 0 2024-03-17T23:58:33.839 INFO:tasks.workunit.client.0.smithi196.stdout:2/911: truncate d17/d22/d59/fd3 1735731 0 2024-03-17T23:58:33.839 INFO:tasks.workunit.client.0.smithi196.stdout:6/746: chown d2/d14/d75/d7b/f19 532298831 1 2024-03-17T23:58:33.843 INFO:tasks.workunit.client.0.smithi196.stdout:5/761: creat d6/d17/d1f/d7d/f110 x:0 0 0 2024-03-17T23:58:33.843 INFO:tasks.workunit.client.0.smithi196.stdout:7/795: fdatasync da/d15/d1a/faa 0 2024-03-17T23:58:33.845 INFO:tasks.workunit.client.0.smithi196.stdout:8/541: creat de/d2b/d30/fa8 x:0 0 0 2024-03-17T23:58:33.846 INFO:tasks.workunit.client.0.smithi196.stdout:6/747: fsync d2/d66/f69 0 2024-03-17T23:58:33.849 INFO:tasks.workunit.client.0.smithi196.stdout:6/748: truncate d2/d14/d75/dc0/ddf/de6/dd9/de5/ff6 177126 0 2024-03-17T23:58:33.851 INFO:tasks.workunit.client.0.smithi196.stdout:8/542: mknod de/d2b/d3c/ca9 0 2024-03-17T23:58:33.853 INFO:tasks.workunit.client.0.smithi196.stdout:2/912: link d17/d19/d137/d72/d81/led d17/d22/d3d/d8f/df2/d11e/l142 0 2024-03-17T23:58:33.853 INFO:tasks.workunit.client.0.smithi196.stdout:3/887: dread d7/d29/d9b/df8/f9f [0,4194304] 0 2024-03-17T23:58:33.856 INFO:tasks.workunit.client.0.smithi196.stdout:8/543: rename de/d2b/d3c/d5d/d65 to de/d10/d54/d5c/daa 0 2024-03-17T23:58:33.856 INFO:tasks.workunit.client.0.smithi196.stdout:3/888: chown d7/d19/d26/d2b/f42 58751 1 2024-03-17T23:58:33.860 INFO:tasks.workunit.client.0.smithi196.stdout:2/913: rmdir d17/d19/d137/d72/d81 39 2024-03-17T23:58:33.860 INFO:tasks.workunit.client.0.smithi196.stdout:5/762: truncate d6/ff 2829362 0 2024-03-17T23:58:33.862 INFO:tasks.workunit.client.0.smithi196.stdout:2/914: fsync d17/d22/da0/dc7/f129 0 2024-03-17T23:58:33.864 INFO:tasks.workunit.client.0.smithi196.stdout:6/749: dwrite d2/d14/d75/dc0/ddf/de6/dd9/de5/ff6 [0,4194304] 0 2024-03-17T23:58:33.867 INFO:tasks.workunit.client.0.smithi196.stdout:3/889: mkdir d7/d29/d117 0 2024-03-17T23:58:33.871 INFO:tasks.workunit.client.0.smithi196.stdout:8/544: write de/d2b/f47 [1822442,94465] 0 2024-03-17T23:58:33.876 INFO:tasks.workunit.client.0.smithi196.stdout:2/915: dwrite d17/d19/fc5 [0,4194304] 0 2024-03-17T23:58:33.877 INFO:tasks.workunit.client.0.smithi196.stdout:5/763: getdents d6/d2d 0 2024-03-17T23:58:33.878 INFO:tasks.workunit.client.0.smithi196.stdout:8/545: fdatasync de/d10/d54/d5c/daa/f76 0 2024-03-17T23:58:33.881 INFO:tasks.workunit.client.0.smithi196.stdout:6/750: getdents d2/d14/d35/d6a 0 2024-03-17T23:58:33.882 INFO:tasks.workunit.client.0.smithi196.stdout:3/890: dwrite d7/d19/d26/d48/fcc [4194304,4194304] 0 2024-03-17T23:58:33.890 INFO:tasks.workunit.client.0.smithi196.stdout:6/751: dread d2/d14/d42/d57/dc8/fc4 [0,4194304] 0 2024-03-17T23:58:33.893 INFO:tasks.workunit.client.0.smithi196.stdout:3/891: write d7/f80 [1021527,15712] 0 2024-03-17T23:58:33.894 INFO:tasks.workunit.client.0.smithi196.stdout:8/546: dread de/d2b/d3c/f6a [0,4194304] 0 2024-03-17T23:58:33.895 INFO:tasks.workunit.client.0.smithi196.stdout:8/547: stat de/d2b/l34 0 2024-03-17T23:58:33.895 INFO:tasks.workunit.client.0.smithi196.stdout:3/892: chown d7/d19/d26/d2b/d3c/d3d/c69 794 1 2024-03-17T23:58:33.895 INFO:tasks.workunit.client.0.smithi196.stdout:5/764: dread d6/d2d/f93 [0,4194304] 0 2024-03-17T23:58:33.896 INFO:tasks.workunit.client.0.smithi196.stdout:5/765: fdatasync d6/d2a/fb3 0 2024-03-17T23:58:33.900 INFO:tasks.workunit.client.0.smithi196.stdout:5/766: read - d6/d17/d23/d53/d97/fb0 zero size 2024-03-17T23:58:33.903 INFO:tasks.workunit.client.0.smithi196.stdout:2/916: rename d17/d19/d44/fe2 to d17/d19/f143 0 2024-03-17T23:58:33.904 INFO:tasks.workunit.client.0.smithi196.stdout:3/893: mknod d7/d19/d78/df2/c118 0 2024-03-17T23:58:33.907 INFO:tasks.workunit.client.0.smithi196.stdout:3/894: write d7/d33/f56 [2692403,40934] 0 2024-03-17T23:58:33.907 INFO:tasks.workunit.client.0.smithi196.stdout:8/548: mkdir de/d5e/dab 0 2024-03-17T23:58:33.909 INFO:tasks.workunit.client.0.smithi196.stdout:8/549: dread - de/f98 zero size 2024-03-17T23:58:33.914 INFO:tasks.workunit.client.0.smithi196.stdout:6/752: dwrite d2/d14/d35/d63/f38 [4194304,4194304] 0 2024-03-17T23:58:33.915 INFO:tasks.workunit.client.0.smithi196.stdout:8/550: symlink de/d10/d54/lac 0 2024-03-17T23:58:33.919 INFO:tasks.workunit.client.0.smithi196.stdout:3/895: symlink d7/d19/d26/d2b/dee/l119 0 2024-03-17T23:58:33.922 INFO:tasks.workunit.client.0.smithi196.stdout:5/767: dread d6/d17/f99 [0,4194304] 0 2024-03-17T23:58:33.923 INFO:tasks.workunit.client.0.smithi196.stdout:5/768: readlink d6/d2d/d33/l4b 0 2024-03-17T23:58:33.924 INFO:tasks.workunit.client.0.smithi196.stdout:5/769: chown d6/d15/dc0/de5/lf9 228 1 2024-03-17T23:58:33.925 INFO:tasks.workunit.client.0.smithi196.stdout:2/917: creat d17/d19/d137/d12b/df0/f144 x:0 0 0 2024-03-17T23:58:33.928 INFO:tasks.workunit.client.0.smithi196.stdout:3/896: write d7/d19/dc4/fef [1031901,22092] 0 2024-03-17T23:58:33.928 INFO:tasks.workunit.client.0.smithi196.stdout:2/918: stat d17/d22/f64 0 2024-03-17T23:58:33.929 INFO:tasks.workunit.client.0.smithi196.stdout:6/753: rmdir d2/d14/d42/d57/d5f/da0 0 2024-03-17T23:58:33.930 INFO:tasks.workunit.client.0.smithi196.stdout:3/897: chown d7 25905524 1 2024-03-17T23:58:33.932 INFO:tasks.workunit.client.0.smithi196.stdout:8/551: dwrite de/d10/d35/d3e/f97 [0,4194304] 0 2024-03-17T23:58:33.933 INFO:tasks.workunit.client.0.smithi196.stdout:5/770: rename d6/d2d/d33/d3b/d80/da0/fba to d6/d2d/d33/d84/f111 0 2024-03-17T23:58:33.935 INFO:tasks.workunit.client.0.smithi196.stdout:2/919: symlink d17/d28/d96/l145 0 2024-03-17T23:58:33.936 INFO:tasks.workunit.client.0.smithi196.stdout:6/754: creat d2/d14/d75/dc0/f10b x:0 0 0 2024-03-17T23:58:33.939 INFO:tasks.workunit.client.0.smithi196.stdout:2/920: write d17/d19/d44/f106 [378550,125707] 0 2024-03-17T23:58:33.939 INFO:tasks.workunit.client.0.smithi196.stdout:8/552: mknod de/d10/cad 0 2024-03-17T23:58:33.942 INFO:tasks.workunit.client.0.smithi196.stdout:2/921: read d17/d22/fa6 [2794169,93563] 0 2024-03-17T23:58:33.943 INFO:tasks.workunit.client.0.smithi196.stdout:3/898: link d7/d29/d9b/df8/c112 d7/d19/d26/d48/d4d/c11a 0 2024-03-17T23:58:33.947 INFO:tasks.workunit.client.0.smithi196.stdout:2/922: getdents d17/d22/d59/d10d 0 2024-03-17T23:58:33.948 INFO:tasks.workunit.client.0.smithi196.stdout:2/923: chown d17/d19/d137/fcd 9747 1 2024-03-17T23:58:33.950 INFO:tasks.workunit.client.0.smithi196.stdout:8/553: dread de/f23 [0,4194304] 0 2024-03-17T23:58:33.950 INFO:tasks.workunit.client.0.smithi196.stdout:6/755: truncate f1 681945 0 2024-03-17T23:58:33.952 INFO:tasks.workunit.client.0.smithi196.stdout:8/554: truncate de/d2b/f47 2817915 0 2024-03-17T23:58:33.952 INFO:tasks.workunit.client.0.smithi196.stdout:2/924: mknod d17/d22/d3d/d8f/d138/c146 0 2024-03-17T23:58:33.953 INFO:tasks.workunit.client.0.smithi196.stdout:3/899: dread d7/d19/f28 [0,4194304] 0 2024-03-17T23:58:33.956 INFO:tasks.workunit.client.0.smithi196.stdout:3/900: creat d7/d19/d26/df5/f11b x:0 0 0 2024-03-17T23:58:33.956 INFO:tasks.workunit.client.0.smithi196.stdout:2/925: truncate d17/f18 3663372 0 2024-03-17T23:58:33.957 INFO:tasks.workunit.client.0.smithi196.stdout:3/901: fdatasync d7/d19/d26/d2b/d103/fed 0 2024-03-17T23:58:33.958 INFO:tasks.workunit.client.0.smithi196.stdout:8/555: getdents de/d10/d54/d5c/daa 0 2024-03-17T23:58:33.958 INFO:tasks.workunit.client.0.smithi196.stdout:3/902: fsync d7/d19/d78/da9/ff0 0 2024-03-17T23:58:33.960 INFO:tasks.workunit.client.0.smithi196.stdout:6/756: truncate d2/d14/d75/d7b/fb1 2473568 0 2024-03-17T23:58:33.962 INFO:tasks.workunit.client.0.smithi196.stdout:3/903: symlink d7/d29/d9b/df8/l11c 0 2024-03-17T23:58:33.964 INFO:tasks.workunit.client.0.smithi196.stdout:3/904: write d7/d19/d26/d48/f74 [2095090,16588] 0 2024-03-17T23:58:33.970 INFO:tasks.workunit.client.0.smithi196.stdout:3/905: fsync d7/d19/d26/d2b/d103/fd7 0 2024-03-17T23:58:33.971 INFO:tasks.workunit.client.0.smithi196.stdout:2/926: truncate d17/d28/dae/fca 198048 0 2024-03-17T23:58:33.973 INFO:tasks.workunit.client.0.smithi196.stdout:6/757: write d2/d14/d42/f4b [814105,101670] 0 2024-03-17T23:58:33.976 INFO:tasks.workunit.client.0.smithi196.stdout:6/758: mknod d2/d14/d75/d7b/c10c 0 2024-03-17T23:58:33.978 INFO:tasks.workunit.client.0.smithi196.stdout:6/759: fdatasync d2/d14/d35/d6a/ff5 0 2024-03-17T23:58:33.978 INFO:tasks.workunit.client.0.smithi196.stdout:2/927: symlink d17/d22/d3d/d8f/dbe/l147 0 2024-03-17T23:58:33.980 INFO:tasks.workunit.client.0.smithi196.stdout:2/928: write d17/d28/d96/f126 [982500,27905] 0 2024-03-17T23:58:33.982 INFO:tasks.workunit.client.0.smithi196.stdout:6/760: creat d2/d14/d42/d57/dc8/f10d x:0 0 0 2024-03-17T23:58:33.982 INFO:tasks.workunit.client.0.smithi196.stdout:3/906: dwrite d7/d19/d78/da9/faa [0,4194304] 0 2024-03-17T23:58:33.988 INFO:tasks.workunit.client.0.smithi196.stdout:3/907: rename d7/d29/d117 to d7/d19/d26/d2b/d103/d11d 0 2024-03-17T23:58:33.988 INFO:tasks.workunit.client.0.smithi196.stdout:2/929: dread d17/d19/d44/fb1 [0,4194304] 0 2024-03-17T23:58:33.991 INFO:tasks.workunit.client.0.smithi196.stdout:3/908: creat d7/d19/d26/df5/f11e x:0 0 0 2024-03-17T23:58:33.992 INFO:tasks.workunit.client.0.smithi196.stdout:2/930: symlink d17/d19/d137/d12b/df0/l148 0 2024-03-17T23:58:33.993 INFO:tasks.workunit.client.0.smithi196.stdout:3/909: mknod d7/d19/d26/d2b/dcd/c11f 0 2024-03-17T23:58:33.996 INFO:tasks.workunit.client.0.smithi196.stdout:6/761: read d2/d14/d75/d7b/fb1 [143287,46700] 0 2024-03-17T23:58:33.996 INFO:tasks.workunit.client.0.smithi196.stdout:2/931: mkdir d17/d19/d137/d149 0 2024-03-17T23:58:33.998 INFO:tasks.workunit.client.0.smithi196.stdout:3/910: unlink d7/d19/d26/d2b/d3c/d3d/f5e 0 2024-03-17T23:58:33.999 INFO:tasks.workunit.client.0.smithi196.stdout:6/762: rmdir d2/d14/d50 39 2024-03-17T23:58:34.001 INFO:tasks.workunit.client.0.smithi196.stdout:6/763: truncate d2/def/f108 47049 0 2024-03-17T23:58:34.006 INFO:tasks.workunit.client.0.smithi196.stdout:3/911: rename d7/d19/d78/d8b to d7/d19/d26/d2b/dcd/d120 0 2024-03-17T23:58:34.007 INFO:tasks.workunit.client.0.smithi196.stdout:3/912: chown d7/d19/f111 64839 1 2024-03-17T23:58:34.012 INFO:tasks.workunit.client.0.smithi196.stdout:6/764: getdents d2/d14/d75/dc0/ddf/de6/dd9/de5 0 2024-03-17T23:58:34.013 INFO:tasks.workunit.client.0.smithi196.stdout:2/932: write d17/d1f/f23 [1090735,71564] 0 2024-03-17T23:58:34.016 INFO:tasks.workunit.client.0.smithi196.stdout:6/765: creat d2/d14/de2/f10e x:0 0 0 2024-03-17T23:58:34.016 INFO:tasks.workunit.client.0.smithi196.stdout:3/913: dwrite d7/d19/d26/df5/f11b [0,4194304] 0 2024-03-17T23:58:34.020 INFO:tasks.workunit.client.0.smithi196.stdout:2/933: unlink d17/d22/d59/fd3 0 2024-03-17T23:58:34.021 INFO:tasks.workunit.client.0.smithi196.stdout:6/766: mknod d2/def/c10f 0 2024-03-17T23:58:34.022 INFO:tasks.workunit.client.0.smithi196.stdout:3/914: unlink d7/d19/d26/d2b/c2d 0 2024-03-17T23:58:34.024 INFO:tasks.workunit.client.0.smithi196.stdout:2/934: symlink d17/d22/d3d/d8f/dbe/l14a 0 2024-03-17T23:58:34.027 INFO:tasks.workunit.client.0.smithi196.stdout:3/915: dread d7/d19/d26/d2b/f55 [0,4194304] 0 2024-03-17T23:58:34.028 INFO:tasks.workunit.client.0.smithi196.stdout:3/916: stat d7/d19/d78/df2/c118 0 2024-03-17T23:58:34.035 INFO:tasks.workunit.client.0.smithi196.stdout:2/935: truncate d17/d19/d137/fcf 346814 0 2024-03-17T23:58:34.036 INFO:tasks.workunit.client.0.smithi196.stdout:6/767: dread d2/d14/f1d [0,4194304] 0 2024-03-17T23:58:34.037 INFO:tasks.workunit.client.0.smithi196.stdout:2/936: read d17/f38 [10465,30282] 0 2024-03-17T23:58:34.045 INFO:tasks.workunit.client.0.smithi196.stdout:2/937: mknod d17/d28/d13d/c14b 0 2024-03-17T23:58:34.045 INFO:tasks.workunit.client.0.smithi196.stdout:3/917: dwrite d7/d19/d26/d48/f6c [0,4194304] 0 2024-03-17T23:58:34.046 INFO:tasks.workunit.client.0.smithi196.stdout:6/768: link d2/d14/d35/d6a/ff5 d2/d14/d8c/f110 0 2024-03-17T23:58:34.049 INFO:tasks.workunit.client.0.smithi196.stdout:3/918: mkdir d7/d19/d26/d2b/d103/d11d/d121 0 2024-03-17T23:58:34.050 INFO:tasks.workunit.client.0.smithi196.stdout:6/769: symlink d2/d14/d75/dc0/ddf/de6/dd9/de5/l111 0 2024-03-17T23:58:34.051 INFO:tasks.workunit.client.0.smithi196.stdout:6/770: write d2/d14/d35/f52 [3325071,105253] 0 2024-03-17T23:58:34.052 INFO:tasks.workunit.client.0.smithi196.stdout:3/919: mknod d7/d19/d26/d2b/d103/c122 0 2024-03-17T23:58:34.053 INFO:tasks.workunit.client.0.smithi196.stdout:6/771: write d2/d14/d42/d57/d5f/dbd/ff7 [1602432,29319] 0 2024-03-17T23:58:34.056 INFO:tasks.workunit.client.0.smithi196.stdout:3/920: mknod d7/d19/d26/d48/c123 0 2024-03-17T23:58:34.058 INFO:tasks.workunit.client.0.smithi196.stdout:6/772: mknod d2/d66/d90/c112 0 2024-03-17T23:58:34.061 INFO:tasks.workunit.client.0.smithi196.stdout:3/921: unlink d7/d19/d78/fb7 0 2024-03-17T23:58:34.061 INFO:tasks.workunit.client.0.smithi196.stdout:2/938: link d17/d22/da0/cb7 d17/d19/d137/d72/d81/c14c 0 2024-03-17T23:58:34.062 INFO:tasks.workunit.client.0.smithi196.stdout:3/922: write d7/d29/d9b/fea [439348,65564] 0 2024-03-17T23:58:34.063 INFO:tasks.workunit.client.0.smithi196.stdout:2/939: read f2 [3736896,54962] 0 2024-03-17T23:58:34.066 INFO:tasks.workunit.client.0.smithi196.stdout:6/773: mknod d2/d14/d42/c113 0 2024-03-17T23:58:34.066 INFO:tasks.workunit.client.0.smithi196.stdout:6/774: write d2/d14/d35/d63/f6c [52846,123144] 0 2024-03-17T23:58:34.068 INFO:tasks.workunit.client.0.smithi196.stdout:6/775: write d2/d14/d75/dc0/f10b [535048,113691] 0 2024-03-17T23:58:34.069 INFO:tasks.workunit.client.0.smithi196.stdout:6/776: stat d2/d7/f32 0 2024-03-17T23:58:34.074 INFO:tasks.workunit.client.0.smithi196.stdout:3/923: dwrite d7/d19/d78/da9/ff0 [0,4194304] 0 2024-03-17T23:58:34.082 INFO:tasks.workunit.client.0.smithi196.stdout:3/924: rename d7/d19/d26/d48/d4d/l70 to d7/d19/d26/d2b/dcd/l124 0 2024-03-17T23:58:34.083 INFO:tasks.workunit.client.0.smithi196.stdout:2/940: dwrite d17/f2a [0,4194304] 0 2024-03-17T23:58:34.084 INFO:tasks.workunit.client.0.smithi196.stdout:6/777: dread d2/faf [0,4194304] 0 2024-03-17T23:58:34.085 INFO:tasks.workunit.client.0.smithi196.stdout:2/941: dread - d17/d19/f12f zero size 2024-03-17T23:58:34.088 INFO:tasks.workunit.client.0.smithi196.stdout:3/925: read d7/d19/d26/d2b/f3b [219965,40911] 0 2024-03-17T23:58:34.089 INFO:tasks.workunit.client.0.smithi196.stdout:2/942: rename d17/d1f/c21 to d17/d22/d3d/c14d 0 2024-03-17T23:58:34.091 INFO:tasks.workunit.client.0.smithi196.stdout:2/943: chown d17/d22/d3d/d8f/f9f 0 1 2024-03-17T23:58:34.092 INFO:tasks.workunit.client.0.smithi196.stdout:3/926: unlink d7/d19/d78/f8e 0 2024-03-17T23:58:34.094 INFO:tasks.workunit.client.0.smithi196.stdout:6/778: dwrite d2/f41 [0,4194304] 0 2024-03-17T23:58:34.098 INFO:tasks.workunit.client.0.smithi196.stdout:3/927: symlink d7/d33/ddc/l125 0 2024-03-17T23:58:34.105 INFO:tasks.workunit.client.0.smithi196.stdout:2/944: dwrite d17/d22/d3d/d8f/df2/f131 [0,4194304] 0 2024-03-17T23:58:34.112 INFO:tasks.workunit.client.0.smithi196.stdout:6/779: getdents d2/d14/d75/d92 0 2024-03-17T23:58:34.114 INFO:tasks.workunit.client.0.smithi196.stdout:3/928: dwrite d7/d19/d78/da9/faa [0,4194304] 0 2024-03-17T23:58:34.117 INFO:tasks.workunit.client.0.smithi196.stdout:2/945: dwrite d17/d19/f12f [0,4194304] 0 2024-03-17T23:58:34.123 INFO:tasks.workunit.client.0.smithi196.stdout:3/929: mknod d7/c126 0 2024-03-17T23:58:34.130 INFO:tasks.workunit.client.0.smithi196.stdout:6/780: read d2/d14/d35/f52 [3370682,116609] 0 2024-03-17T23:58:34.134 INFO:tasks.workunit.client.0.smithi196.stdout:6/781: mknod d2/d14/d35/d6a/c114 0 2024-03-17T23:58:34.136 INFO:tasks.workunit.client.0.smithi196.stdout:6/782: readlink d2/d66/la2 0 2024-03-17T23:58:34.136 INFO:tasks.workunit.client.0.smithi196.stdout:2/946: dread d17/d22/d3d/f53 [0,4194304] 0 2024-03-17T23:58:34.138 INFO:tasks.workunit.client.0.smithi196.stdout:6/783: creat d2/d14/de2/f115 x:0 0 0 2024-03-17T23:58:34.139 INFO:tasks.workunit.client.0.smithi196.stdout:6/784: stat d2/d14/fb7 0 2024-03-17T23:58:34.147 INFO:tasks.workunit.client.0.smithi196.stdout:2/947: link d17/f2a d17/d22/d59/d10d/f14e 0 2024-03-17T23:58:34.148 INFO:tasks.workunit.client.0.smithi196.stdout:6/785: write d2/d14/d42/d57/fda [3266899,80433] 0 2024-03-17T23:58:34.151 INFO:tasks.workunit.client.0.smithi196.stdout:2/948: mkdir d17/d19/d137/d3b/d133/d14f 0 2024-03-17T23:58:34.155 INFO:tasks.workunit.client.0.smithi196.stdout:3/930: dread d7/fb [0,4194304] 0 2024-03-17T23:58:34.155 INFO:tasks.workunit.client.0.smithi196.stdout:6/786: link d2/d66/d90/cd0 d2/d14/d75/dc0/ddf/c116 0 2024-03-17T23:58:34.157 INFO:tasks.workunit.client.0.smithi196.stdout:2/949: link d17/d22/d3d/l101 d17/dce/l150 0 2024-03-17T23:58:34.160 INFO:tasks.workunit.client.0.smithi196.stdout:2/950: chown c8 537202 1 2024-03-17T23:58:34.160 INFO:tasks.workunit.client.0.smithi196.stdout:2/951: fdatasync d17/d22/d3d/d8f/fa5 0 2024-03-17T23:58:34.163 INFO:tasks.workunit.client.0.smithi196.stdout:2/952: write d17/d19/f143 [720329,127798] 0 2024-03-17T23:58:34.165 INFO:tasks.workunit.client.0.smithi196.stdout:2/953: stat d17/d1f/ld6 0 2024-03-17T23:58:34.166 INFO:tasks.workunit.client.0.smithi196.stdout:2/954: write d17/d28/f135 [667183,101302] 0 2024-03-17T23:58:34.166 INFO:tasks.workunit.client.0.smithi196.stdout:3/931: write d7/d19/f28 [1262132,79406] 0 2024-03-17T23:58:34.169 INFO:tasks.workunit.client.0.smithi196.stdout:3/932: creat d7/d19/d26/d2b/dcd/f127 x:0 0 0 2024-03-17T23:58:34.170 INFO:tasks.workunit.client.0.smithi196.stdout:3/933: write d7/d19/d78/da9/faa [4222615,103239] 0 2024-03-17T23:58:34.171 INFO:tasks.workunit.client.0.smithi196.stdout:2/955: rename d17/d19/d137/d3b/c5b to d17/d22/da0/dc7/c151 0 2024-03-17T23:58:34.172 INFO:tasks.workunit.client.0.smithi196.stdout:3/934: chown d7/d19/d26/d2b/d3c/d3d/f5a 159123 1 2024-03-17T23:58:34.175 INFO:tasks.workunit.client.0.smithi196.stdout:3/935: creat d7/f128 x:0 0 0 2024-03-17T23:58:34.181 INFO:tasks.workunit.client.0.smithi196.stdout:3/936: rename d7/d19/d26/d2b/f6e to d7/d19/d26/d48/d98/f129 0 2024-03-17T23:58:34.183 INFO:tasks.workunit.client.0.smithi196.stdout:3/937: write d7/d19/d78/dca/fd4 [9640748,93898] 0 2024-03-17T23:58:34.186 INFO:tasks.workunit.client.0.smithi196.stdout:2/956: truncate d17/d22/d3d/d8f/dbe/f141 7172392 0 2024-03-17T23:58:34.186 INFO:tasks.workunit.client.0.smithi196.stdout:3/938: read d7/f16 [786136,68320] 0 2024-03-17T23:58:34.188 INFO:tasks.workunit.client.0.smithi196.stdout:3/939: chown d7/d19/d26/d48/d4d/f85 12076 1 2024-03-17T23:58:34.189 INFO:tasks.workunit.client.0.smithi196.stdout:2/957: creat d17/d19/d137/d12b/df0/d127/f152 x:0 0 0 2024-03-17T23:58:34.190 INFO:tasks.workunit.client.0.smithi196.stdout:2/958: fdatasync d17/d22/fbb 0 2024-03-17T23:58:34.190 INFO:tasks.workunit.client.0.smithi196.stdout:3/940: creat d7/d19/d26/d48/d4d/dd9/f12a x:0 0 0 2024-03-17T23:58:34.191 INFO:tasks.workunit.client.0.smithi196.stdout:2/959: rmdir d17/d19/d137/d72 39 2024-03-17T23:58:34.192 INFO:tasks.workunit.client.0.smithi196.stdout:2/960: chown d17/d28/d13d/c14b 105300786 1 2024-03-17T23:58:34.194 INFO:tasks.workunit.client.0.smithi196.stdout:2/961: symlink d17/d19/d93/l153 0 2024-03-17T23:58:34.196 INFO:tasks.workunit.client.0.smithi196.stdout:3/941: rename d7/d19/d26/d48/f74 to d7/d29/f12b 0 2024-03-17T23:58:34.199 INFO:tasks.workunit.client.0.smithi196.stdout:3/942: unlink d7/d19/f28 0 2024-03-17T23:58:34.202 INFO:tasks.workunit.client.0.smithi196.stdout:3/943: creat d7/d19/d26/d2b/d3c/d3d/d7d/f12c x:0 0 0 2024-03-17T23:58:34.202 INFO:tasks.workunit.client.0.smithi196.stdout:2/962: dwrite d17/d19/f12f [0,4194304] 0 2024-03-17T23:58:34.207 INFO:tasks.workunit.client.0.smithi196.stdout:9/673: sync 2024-03-17T23:58:34.212 INFO:tasks.workunit.client.0.smithi196.stdout:3/944: mknod d7/d29/d9b/c12d 0 2024-03-17T23:58:34.212 INFO:tasks.workunit.client.0.smithi196.stdout:2/963: rename d17/d19/d137/c67 to d17/d22/d3d/d8f/df2/c154 0 2024-03-17T23:58:34.216 INFO:tasks.workunit.client.0.smithi196.stdout:9/674: rename d9/df/d4a/d5b/d62/dd1 to d9/d33/dd3 0 2024-03-17T23:58:34.220 INFO:tasks.workunit.client.0.smithi196.stdout:9/675: read d9/df/d4a/d5b/d62/dba/d60/d85/f98 [270690,12423] 0 2024-03-17T23:58:34.223 INFO:tasks.workunit.client.0.smithi196.stdout:3/945: dread d7/d19/d26/d2b/d3c/f77 [0,4194304] 0 2024-03-17T23:58:34.224 INFO:tasks.workunit.client.0.smithi196.stdout:2/964: creat d17/d22/da0/dc7/d103/f155 x:0 0 0 2024-03-17T23:58:34.224 INFO:tasks.workunit.client.0.smithi196.stdout:3/946: readlink d7/d19/d26/d2b/dee/lf7 0 2024-03-17T23:58:34.226 INFO:tasks.workunit.client.0.smithi196.stdout:9/676: creat d9/df/d4a/d89/db1/fd4 x:0 0 0 2024-03-17T23:58:34.227 INFO:tasks.workunit.client.0.smithi196.stdout:2/965: rmdir d17/d19/d137/d12b/df0/d127 39 2024-03-17T23:58:34.227 INFO:tasks.workunit.client.0.smithi196.stdout:2/966: readlink d17/d22/da0/lb6 0 2024-03-17T23:58:34.228 INFO:tasks.workunit.client.0.smithi196.stdout:3/947: symlink d7/d29/d9b/l12e 0 2024-03-17T23:58:34.229 INFO:tasks.workunit.client.0.smithi196.stdout:3/948: stat d7/d19/d78/da9/cd2 0 2024-03-17T23:58:34.229 INFO:tasks.workunit.client.0.smithi196.stdout:9/677: chown d9/df/d4a/d5b/d62/dba/d60/d85/d8e 293 1 2024-03-17T23:58:34.230 INFO:tasks.workunit.client.0.smithi196.stdout:3/949: dread - d7/d19/d26/d2b/dcd/f127 zero size 2024-03-17T23:58:34.234 INFO:tasks.workunit.client.0.smithi196.stdout:9/678: dread d9/d33/f42 [0,4194304] 0 2024-03-17T23:58:34.234 INFO:tasks.workunit.client.0.smithi196.stdout:3/950: read d7/d33/f90 [514388,58588] 0 2024-03-17T23:58:34.235 INFO:tasks.workunit.client.0.smithi196.stdout:3/951: write d7/d19/dc4/fef [1984423,43827] 0 2024-03-17T23:58:34.242 INFO:tasks.workunit.client.0.smithi196.stdout:3/952: truncate d7/d19/d78/dca/fd4 548568 0 2024-03-17T23:58:34.244 INFO:tasks.workunit.client.0.smithi196.stdout:2/967: dwrite d17/fdb [0,4194304] 0 2024-03-17T23:58:34.245 INFO:tasks.workunit.client.0.smithi196.stdout:2/968: chown d17/d68/la3 1062 1 2024-03-17T23:58:34.251 INFO:tasks.workunit.client.0.smithi196.stdout:2/969: dread d17/d19/d93/fd1 [0,4194304] 0 2024-03-17T23:58:34.252 INFO:tasks.workunit.client.0.smithi196.stdout:2/970: chown d17/d19/d44 879079918 1 2024-03-17T23:58:34.252 INFO:tasks.workunit.client.0.smithi196.stdout:2/971: chown d17/d28/c124 2946582 1 2024-03-17T23:58:34.255 INFO:tasks.workunit.client.0.smithi196.stdout:2/972: getdents d17/d19/d137/d71/de0 0 2024-03-17T23:58:34.263 INFO:tasks.workunit.client.0.smithi196.stdout:2/973: dwrite d17/d19/d44/f106 [0,4194304] 0 2024-03-17T23:58:34.266 INFO:tasks.workunit.client.0.smithi196.stdout:2/974: mknod d17/d19/d137/d3b/d133/d14f/c156 0 2024-03-17T23:58:34.272 INFO:tasks.workunit.client.0.smithi196.stdout:2/975: write d17/f18 [329081,97148] 0 2024-03-17T23:58:34.281 INFO:tasks.workunit.client.0.smithi196.stdout:2/976: dwrite d17/fda [0,4194304] 0 2024-03-17T23:58:34.282 INFO:tasks.workunit.client.0.smithi196.stdout:2/977: truncate d17/d68/f10a 61272 0 2024-03-17T23:58:34.285 INFO:tasks.workunit.client.0.smithi196.stdout:2/978: creat d17/d19/d137/f157 x:0 0 0 2024-03-17T23:58:34.286 INFO:tasks.workunit.client.0.smithi196.stdout:2/979: mkdir d17/d19/d137/d71/d158 0 2024-03-17T23:58:34.288 INFO:tasks.workunit.client.0.smithi196.stdout:2/980: creat d17/d22/d59/f159 x:0 0 0 2024-03-17T23:58:34.293 INFO:tasks.workunit.client.0.smithi196.stdout:2/981: rename d17/c8a to d17/d22/d3d/d8f/d114/c15a 0 2024-03-17T23:58:34.296 INFO:tasks.workunit.client.0.smithi196.stdout:2/982: getdents d17/d28/d96 0 2024-03-17T23:58:34.299 INFO:tasks.workunit.client.0.smithi196.stdout:2/983: symlink d17/d19/d137/d72/l15b 0 2024-03-17T23:58:34.306 INFO:tasks.workunit.client.0.smithi196.stdout:2/984: dwrite d17/d68/f111 [0,4194304] 0 2024-03-17T23:58:34.324 INFO:tasks.workunit.client.0.smithi196.stdout:2/985: dread d17/d22/f6c [0,4194304] 0 2024-03-17T23:58:34.327 INFO:tasks.workunit.client.0.smithi196.stdout:2/986: getdents d17/d19 0 2024-03-17T23:58:34.339 INFO:tasks.workunit.client.0.smithi196.stdout:2/987: dread d17/d19/d93/fc8 [0,4194304] 0 2024-03-17T23:58:34.340 INFO:tasks.workunit.client.0.smithi196.stdout:2/988: creat d17/d19/d93/f15c x:0 0 0 2024-03-17T23:58:34.349 INFO:tasks.workunit.client.0.smithi196.stdout:2/989: dwrite d17/d22/da0/f9e [0,4194304] 0 2024-03-17T23:58:34.352 INFO:tasks.workunit.client.0.smithi196.stdout:2/990: fsync d17/d28/f29 0 2024-03-17T23:58:34.354 INFO:tasks.workunit.client.0.smithi196.stdout:2/991: creat d17/d19/d137/d71/f15d x:0 0 0 2024-03-17T23:58:34.357 INFO:tasks.workunit.client.0.smithi196.stdout:2/992: symlink d17/d19/d137/d3b/l15e 0 2024-03-17T23:58:34.357 INFO:tasks.workunit.client.0.smithi196.stdout:2/993: chown d17/d22/d3d/l85 28 1 2024-03-17T23:58:34.358 INFO:tasks.workunit.client.0.smithi196.stdout:2/994: creat d17/d22/d3d/f15f x:0 0 0 2024-03-17T23:58:34.361 INFO:tasks.workunit.client.0.smithi196.stdout:2/995: creat d17/d19/d137/d12b/df0/f160 x:0 0 0 2024-03-17T23:58:34.361 INFO:tasks.workunit.client.0.smithi196.stdout:2/996: fsync d17/d19/d44/f106 0 2024-03-17T23:58:34.373 INFO:tasks.workunit.client.0.smithi196.stdout:1/631: sync 2024-03-17T23:58:34.374 INFO:tasks.workunit.client.0.smithi196.stdout:1/632: readlink d1/db/l20 0 2024-03-17T23:58:34.376 INFO:tasks.workunit.client.0.smithi196.stdout:1/633: creat d1/d13/d23/d47/d48/d7e/fd4 x:0 0 0 2024-03-17T23:58:34.377 INFO:tasks.workunit.client.0.smithi196.stdout:1/634: dread - d1/d13/d2a/d94/fc1 zero size 2024-03-17T23:58:34.378 INFO:tasks.workunit.client.0.smithi196.stdout:1/635: rmdir d1/db/dd/d34 39 2024-03-17T23:58:34.380 INFO:tasks.workunit.client.0.smithi196.stdout:1/636: mknod d1/d13/d23/cd5 0 2024-03-17T23:58:34.380 INFO:tasks.workunit.client.0.smithi196.stdout:1/637: chown d1/d13/d23/d47/d48/f7b 1 1 2024-03-17T23:58:34.382 INFO:tasks.workunit.client.0.smithi196.stdout:1/638: mknod d1/d13/d23/d62/cd6 0 2024-03-17T23:58:34.403 INFO:tasks.workunit.client.0.smithi196.stdout:1/639: dread d1/db/fe [0,4194304] 0 2024-03-17T23:58:34.404 INFO:tasks.workunit.client.0.smithi196.stdout:1/640: stat d1/d13/d2a/c31 0 2024-03-17T23:58:34.404 INFO:tasks.workunit.client.0.smithi196.stdout:1/641: stat d1/d13/d4c/dcd/lce 0 2024-03-17T23:58:34.411 INFO:tasks.workunit.client.0.smithi196.stdout:1/642: dwrite d1/d13/d23/d47/d48/fa9 [0,4194304] 0 2024-03-17T23:58:34.421 INFO:tasks.workunit.client.0.smithi196.stdout:1/643: write d1/db/dd/fc9 [1709270,93596] 0 2024-03-17T23:58:34.424 INFO:tasks.workunit.client.0.smithi196.stdout:1/644: truncate d1/db/dd/f5d 685668 0 2024-03-17T23:58:34.426 INFO:tasks.workunit.client.0.smithi196.stdout:1/645: creat d1/d13/d23/d62/dab/dca/fd7 x:0 0 0 2024-03-17T23:58:34.428 INFO:tasks.workunit.client.0.smithi196.stdout:1/646: write d1/d13/d23/d47/d48/f79 [496673,101854] 0 2024-03-17T23:58:34.429 INFO:tasks.workunit.client.0.smithi196.stdout:1/647: read d1/d13/d23/d47/d48/fa9 [2777485,109027] 0 2024-03-17T23:58:34.431 INFO:tasks.workunit.client.0.smithi196.stdout:1/648: write d1/db/fe [2999255,70741] 0 2024-03-17T23:58:34.435 INFO:tasks.workunit.client.0.smithi196.stdout:1/649: getdents d1/d13/d23/d62 0 2024-03-17T23:58:34.437 INFO:tasks.workunit.client.0.smithi196.stdout:1/650: chown d1/d13/d4c/da0/cac 15100078 1 2024-03-17T23:58:34.439 INFO:tasks.workunit.client.0.smithi196.stdout:1/651: symlink d1/d13/d4c/da0/ld8 0 2024-03-17T23:58:34.524 INFO:tasks.workunit.client.0.smithi196.stdout:0/836: sync 2024-03-17T23:58:34.527 INFO:tasks.workunit.client.0.smithi196.stdout:0/837: rename d5/d23/d24/d28/dc9/faf to d5/f101 0 2024-03-17T23:58:34.528 INFO:tasks.workunit.client.0.smithi196.stdout:0/838: truncate d5/d23/d85/fd6 642326 0 2024-03-17T23:58:34.530 INFO:tasks.workunit.client.0.smithi196.stdout:0/839: symlink d5/d23/d24/da8/l102 0 2024-03-17T23:58:34.533 INFO:tasks.workunit.client.0.smithi196.stdout:0/840: mknod d5/d23/d24/da3/c103 0 2024-03-17T23:58:34.540 INFO:tasks.workunit.client.0.smithi196.stdout:0/841: dwrite d5/f10 [0,4194304] 0 2024-03-17T23:58:34.541 INFO:tasks.workunit.client.0.smithi196.stdout:0/842: chown d5/f44 8251848 1 2024-03-17T23:58:34.541 INFO:tasks.workunit.client.0.smithi196.stdout:0/843: readlink d5/la7 0 2024-03-17T23:58:34.544 INFO:tasks.workunit.client.0.smithi196.stdout:0/844: truncate d5/d23/d24/d59/d94/db5/fe8 1037567 0 2024-03-17T23:58:34.546 INFO:tasks.workunit.client.0.smithi196.stdout:0/845: unlink d5/d23/d24/da3/ccd 0 2024-03-17T23:58:34.553 INFO:tasks.workunit.client.0.smithi196.stdout:0/846: dread d5/d23/d85/f9c [0,4194304] 0 2024-03-17T23:58:34.555 INFO:tasks.workunit.client.0.smithi196.stdout:0/847: mkdir d5/d23/d24/d30/d104 0 2024-03-17T23:58:34.557 INFO:tasks.workunit.client.0.smithi196.stdout:0/848: mknod d5/d23/d24/d28/d47/d52/d49/df8/c105 0 2024-03-17T23:58:34.559 INFO:tasks.workunit.client.0.smithi196.stdout:0/849: creat d5/f106 x:0 0 0 2024-03-17T23:58:34.560 INFO:tasks.workunit.client.0.smithi196.stdout:0/850: dread d5/d23/d85/fd6 [0,4194304] 0 2024-03-17T23:58:34.568 INFO:tasks.workunit.client.0.smithi196.stdout:0/851: dwrite d5/d23/d24/fb6 [0,4194304] 0 2024-03-17T23:58:34.572 INFO:tasks.workunit.client.0.smithi196.stdout:0/852: chown d5/d23/d85/dce/ff9 136750471 1 2024-03-17T23:58:34.580 INFO:tasks.workunit.client.0.smithi196.stdout:0/853: link d5/d23/d24/d28/dc9/db0/fc1 d5/d23/d24/da3/dbb/f107 0 2024-03-17T23:58:34.586 INFO:tasks.workunit.client.0.smithi196.stdout:0/854: truncate d5/d23/d24/d28/f37 6152079 0 2024-03-17T23:58:34.587 INFO:tasks.workunit.client.0.smithi196.stdout:0/855: truncate d5/d23/f74 29229 0 2024-03-17T23:58:34.596 INFO:tasks.workunit.client.0.smithi196.stdout:0/856: dwrite d5/d23/d85/dce/ff9 [0,4194304] 0 2024-03-17T23:58:34.598 INFO:tasks.workunit.client.0.smithi196.stdout:0/857: chown d5/d23/d24/d28/dc9/l69 0 1 2024-03-17T23:58:34.604 INFO:tasks.workunit.client.0.smithi196.stdout:0/858: symlink d5/d23/d24/d59/de6/l108 0 2024-03-17T23:58:34.606 INFO:tasks.workunit.client.0.smithi196.stdout:0/859: unlink d5/d23/d24/d28/lf1 0 2024-03-17T23:58:34.607 INFO:tasks.workunit.client.0.smithi196.stdout:0/860: stat d5/d23/d24/d28/d47/d52/d61/d6c/d82 0 2024-03-17T23:58:34.615 INFO:tasks.workunit.client.0.smithi196.stdout:0/861: dwrite d5/f10 [0,4194304] 0 2024-03-17T23:58:34.617 INFO:tasks.workunit.client.0.smithi196.stdout:0/862: stat d5/d23/d24/d28/d47/d52/d61/d6c/d82/cfd 0 2024-03-17T23:58:34.621 INFO:tasks.workunit.client.0.smithi196.stdout:0/863: truncate d5/d23/d85/fd6 101320 0 2024-03-17T23:58:34.633 INFO:tasks.workunit.client.0.smithi196.stdout:0/864: dwrite d5/d23/d24/d28/f37 [4194304,4194304] 0 2024-03-17T23:58:34.634 INFO:tasks.workunit.client.0.smithi196.stdout:0/865: readlink d5/d23/d24/d28/d47/d52/dac/ld8 0 2024-03-17T23:58:34.641 INFO:tasks.workunit.client.0.smithi196.stdout:0/866: dwrite d5/d23/d24/d28/f37 [4194304,4194304] 0 2024-03-17T23:58:34.646 INFO:tasks.workunit.client.0.smithi196.stdout:0/867: write d5/d23/d24/f5f [8008626,6571] 0 2024-03-17T23:58:34.649 INFO:tasks.workunit.client.0.smithi196.stdout:4/658: sync 2024-03-17T23:58:34.650 INFO:tasks.workunit.client.0.smithi196.stdout:0/868: creat d5/d23/d24/d28/d47/d52/d61/d6c/df0/f109 x:0 0 0 2024-03-17T23:58:34.651 INFO:tasks.workunit.client.0.smithi196.stdout:4/659: fsync d1/d26/d33/f88 0 2024-03-17T23:58:34.651 INFO:tasks.workunit.client.0.smithi196.stdout:0/869: write d5/d23/d24/d30/fec [1652513,79585] 0 2024-03-17T23:58:34.652 INFO:tasks.workunit.client.0.smithi196.stdout:4/660: chown d1/d26 45 1 2024-03-17T23:58:34.653 INFO:tasks.workunit.client.0.smithi196.stdout:4/661: write d1/d1b/d77/fb4 [2016716,26132] 0 2024-03-17T23:58:34.654 INFO:tasks.workunit.client.0.smithi196.stdout:0/870: symlink d5/d23/d24/d72/l10a 0 2024-03-17T23:58:34.655 INFO:tasks.workunit.client.0.smithi196.stdout:0/871: read - d5/d23/d24/d59/d8b/fcf zero size 2024-03-17T23:58:34.656 INFO:tasks.workunit.client.0.smithi196.stdout:4/662: mknod d1/dd2/dcb/cef 0 2024-03-17T23:58:34.661 INFO:tasks.workunit.client.0.smithi196.stdout:0/872: unlink d5/d23/d24/d28/f41 0 2024-03-17T23:58:34.664 INFO:tasks.workunit.client.0.smithi196.stdout:0/873: creat d5/d23/d24/d59/d94/f10b x:0 0 0 2024-03-17T23:58:34.666 INFO:tasks.workunit.client.0.smithi196.stdout:0/874: readlink d5/d23/l77 0 2024-03-17T23:58:34.667 INFO:tasks.workunit.client.0.smithi196.stdout:4/663: dwrite d1/d1b/d77/f90 [0,4194304] 0 2024-03-17T23:58:34.675 INFO:tasks.workunit.client.0.smithi196.stdout:0/875: creat d5/d23/d24/d28/d47/d52/d61/d6c/df7/f10c x:0 0 0 2024-03-17T23:58:34.675 INFO:tasks.workunit.client.0.smithi196.stdout:4/664: creat d1/d11/d5d/ded/ff0 x:0 0 0 2024-03-17T23:58:34.677 INFO:tasks.workunit.client.0.smithi196.stdout:4/665: rename d1/d26/d33/d85 to d1/d1b/d77/df1 0 2024-03-17T23:58:34.679 INFO:tasks.workunit.client.0.smithi196.stdout:4/666: readlink d1/lee 0 2024-03-17T23:58:34.681 INFO:tasks.workunit.client.0.smithi196.stdout:4/667: mkdir d1/de/d50/d55/de4/df2 0 2024-03-17T23:58:34.684 INFO:tasks.workunit.client.0.smithi196.stdout:0/876: truncate d5/d23/d24/d30/f6b 1201560 0 2024-03-17T23:58:34.685 INFO:tasks.workunit.client.0.smithi196.stdout:4/668: truncate d1/d1b/f5f 771524 0 2024-03-17T23:58:34.685 INFO:tasks.workunit.client.0.smithi196.stdout:0/877: chown d5/d23/d24/d59/f9e 37166 1 2024-03-17T23:58:34.687 INFO:tasks.workunit.client.0.smithi196.stdout:4/669: write d1/de/d50/f9e [315827,70656] 0 2024-03-17T23:58:34.688 INFO:tasks.workunit.client.0.smithi196.stdout:4/670: read d1/d26/f8e [4794592,106376] 0 2024-03-17T23:58:34.724 INFO:tasks.workunit.client.0.smithi196.stdout:4/671: truncate d1/de/d50/d55/fb7 859302 0 2024-03-17T23:58:34.731 INFO:tasks.workunit.client.0.smithi196.stdout:0/878: getdents d5/d23/d24/d28/d47/d52/d61/d6c/d82 0 2024-03-17T23:58:34.732 INFO:tasks.workunit.client.0.smithi196.stdout:0/879: read d5/f10 [1615708,15363] 0 2024-03-17T23:58:34.734 INFO:tasks.workunit.client.0.smithi196.stdout:0/880: write d5/d23/d24/d28/dc9/ffe [947634,98840] 0 2024-03-17T23:58:34.780 INFO:tasks.workunit.client.0.smithi196.stdout:0/881: truncate d5/d23/d24/d30/f6b 833248 0 2024-03-17T23:58:34.781 INFO:tasks.workunit.client.0.smithi196.stdout:0/882: readlink d5/d23/d24/d28/d47/d52/d61/lc3 0 2024-03-17T23:58:34.782 INFO:tasks.workunit.client.0.smithi196.stdout:0/883: write d5/d23/fdd [644675,97565] 0 2024-03-17T23:58:34.783 INFO:tasks.workunit.client.0.smithi196.stdout:0/884: rmdir d5 39 2024-03-17T23:58:34.786 INFO:tasks.workunit.client.0.smithi196.stdout:0/885: chown d5/d23/d24/d28/f96 5576940 1 2024-03-17T23:58:34.850 INFO:tasks.workunit.client.0.smithi196.stdout:7/796: sync 2024-03-17T23:58:34.851 INFO:tasks.workunit.client.0.smithi196.stdout:7/797: dread - da/d3e/d45/d4f/d75/da8/d78/fdd zero size 2024-03-17T23:58:34.852 INFO:tasks.workunit.client.0.smithi196.stdout:7/798: chown da/d3e/d45/dd8/de4/l49 9 1 2024-03-17T23:58:34.863 INFO:tasks.workunit.client.0.smithi196.stdout:7/799: dwrite da/d15/d1d/d4c/f6c [0,4194304] 0 2024-03-17T23:58:34.864 INFO:tasks.workunit.client.0.smithi196.stdout:7/800: chown da/d3e/d45/d4f/d75/da8/f96 103457117 1 2024-03-17T23:58:34.877 INFO:tasks.workunit.client.0.smithi196.stdout:7/801: dread da/d3e/d7f/f84 [0,4194304] 0 2024-03-17T23:58:34.878 INFO:tasks.workunit.client.0.smithi196.stdout:7/802: truncate da/d15/d1d/d29/dc4/f10d 969600 0 2024-03-17T23:58:34.887 INFO:tasks.workunit.client.0.smithi196.stdout:7/803: dwrite da/d15/d1a/d5e/f5f [0,4194304] 0 2024-03-17T23:58:34.897 INFO:tasks.workunit.client.0.smithi196.stdout:7/804: dwrite da/d3e/ddc/dff/ddf/f99 [0,4194304] 0 2024-03-17T23:58:34.907 INFO:tasks.workunit.client.0.smithi196.stdout:7/805: dwrite da/d3e/d45/dd8/de4/f67 [0,4194304] 0 2024-03-17T23:58:34.912 INFO:tasks.workunit.client.0.smithi196.stdout:7/806: dread da/d15/fc0 [0,4194304] 0 2024-03-17T23:58:34.925 INFO:tasks.workunit.client.0.smithi196.stdout:7/807: dwrite da/d15/d1d/d29/dc4/f10d [0,4194304] 0 2024-03-17T23:58:34.929 INFO:tasks.workunit.client.0.smithi196.stdout:7/808: fsync da/d15/d1d/d4c/f61 0 2024-03-17T23:58:34.930 INFO:tasks.workunit.client.0.smithi196.stdout:7/809: chown da/d15/d1d/f32 15834 1 2024-03-17T23:58:34.930 INFO:tasks.workunit.client.0.smithi196.stdout:7/810: chown da/d15/f17 873314216 1 2024-03-17T23:58:34.943 INFO:tasks.workunit.client.0.smithi196.stdout:7/811: dread da/f1c [0,4194304] 0 2024-03-17T23:58:34.951 INFO:tasks.workunit.client.0.smithi196.stdout:7/812: dwrite da/d15/da7/f7e [4194304,4194304] 0 2024-03-17T23:58:34.959 INFO:tasks.workunit.client.0.smithi196.stdout:7/813: write da/d3e/ddc/dff/f89 [494202,78561] 0 2024-03-17T23:58:34.966 INFO:tasks.workunit.client.0.smithi196.stdout:7/814: dwrite da/f91 [0,4194304] 0 2024-03-17T23:58:34.969 INFO:tasks.workunit.client.0.smithi196.stdout:7/815: mknod da/d3e/d45/d4f/d75/c10f 0 2024-03-17T23:58:34.974 INFO:tasks.workunit.client.0.smithi196.stdout:7/816: dread da/d3e/d45/f71 [0,4194304] 0 2024-03-17T23:58:34.975 INFO:tasks.workunit.client.0.smithi196.stdout:7/817: stat da/l11 0 2024-03-17T23:58:34.976 INFO:tasks.workunit.client.0.smithi196.stdout:7/818: write da/d15/d1d/d29/dc4/f10d [4002414,34184] 0 2024-03-17T23:58:34.977 INFO:tasks.workunit.client.0.smithi196.stdout:6/787: sync 2024-03-17T23:58:34.977 INFO:tasks.workunit.client.0.smithi196.stdout:9/679: sync 2024-03-17T23:58:34.977 INFO:tasks.workunit.client.0.smithi196.stdout:3/953: sync 2024-03-17T23:58:34.977 INFO:tasks.workunit.client.0.smithi196.stdout:8/556: sync 2024-03-17T23:58:34.978 INFO:tasks.workunit.client.0.smithi196.stdout:1/652: sync 2024-03-17T23:58:34.978 INFO:tasks.workunit.client.0.smithi196.stdout:5/771: sync 2024-03-17T23:58:34.978 INFO:tasks.workunit.client.0.smithi196.stdout:2/997: sync 2024-03-17T23:58:34.979 INFO:tasks.workunit.client.0.smithi196.stdout:1/653: fdatasync d1/db/dd/faa 0 2024-03-17T23:58:34.980 INFO:tasks.workunit.client.0.smithi196.stdout:8/557: chown de/f13 55850 1 2024-03-17T23:58:34.980 INFO:tasks.workunit.client.0.smithi196.stdout:6/788: dread - d2/d14/dcc/d103/f107 zero size 2024-03-17T23:58:34.982 INFO:tasks.workunit.client.0.smithi196.stdout:9/680: symlink d9/df/d4a/d8c/ld5 0 2024-03-17T23:58:34.982 INFO:tasks.workunit.client.0.smithi196.stdout:8/558: truncate de/f23 1711747 0 2024-03-17T23:58:34.982 INFO:tasks.workunit.client.0.smithi196.stdout:3/954: write d7/f8 [1404503,47283] 0 2024-03-17T23:58:34.984 INFO:tasks.workunit.client.0.smithi196.stdout:7/819: getdents da/d15/d1d/d29/dc4/dd4 0 2024-03-17T23:58:34.986 INFO:tasks.workunit.client.0.smithi196.stdout:7/820: stat da/f13 0 2024-03-17T23:58:34.986 INFO:tasks.workunit.client.0.smithi196.stdout:9/681: stat f6 0 2024-03-17T23:58:34.987 INFO:tasks.workunit.client.0.smithi196.stdout:3/955: symlink d7/d19/d26/d2b/dcd/l12f 0 2024-03-17T23:58:34.989 INFO:tasks.workunit.client.0.smithi196.stdout:8/559: fdatasync de/d2b/d30/f3a 0 2024-03-17T23:58:34.989 INFO:tasks.workunit.client.0.smithi196.stdout:2/998: mknod d17/d19/d137/d12b/df0/d127/c161 0 2024-03-17T23:58:34.993 INFO:tasks.workunit.client.0.smithi196.stdout:5/772: getdents d6/d17/d23/d53 0 2024-03-17T23:58:34.994 INFO:tasks.workunit.client.0.smithi196.stdout:8/560: creat de/d2b/d3c/fae x:0 0 0 2024-03-17T23:58:34.996 INFO:tasks.workunit.client.0.smithi196.stdout:1/654: write d1/db/f73 [388087,35451] 0 2024-03-17T23:58:34.997 INFO:tasks.workunit.client.0.smithi196.stdout:7/821: mkdir da/d3e/d45/d110 0 2024-03-17T23:58:34.999 INFO:tasks.workunit.client.0.smithi196.stdout:7/822: fdatasync da/d3e/d7f/fb2 0 2024-03-17T23:58:35.007 INFO:tasks.workunit.client.0.smithi196.stdout:6/789: link d2/d14/d35/d6a/c114 d2/d14/d42/d57/c117 0 2024-03-17T23:58:35.008 INFO:tasks.workunit.client.0.smithi196.stdout:1/655: mknod d1/db/dd/cd9 0 2024-03-17T23:58:35.009 INFO:tasks.workunit.client.0.smithi196.stdout:3/956: dread d7/d19/d26/d2b/d103/fd7 [0,4194304] 0 2024-03-17T23:58:35.012 INFO:tasks.workunit.client.0.smithi196.stdout:6/790: chown d2/d14/d35/f81 46235 1 2024-03-17T23:58:35.013 INFO:tasks.workunit.client.0.smithi196.stdout:8/561: creat de/d2b/faf x:0 0 0 2024-03-17T23:58:35.015 INFO:tasks.workunit.client.0.smithi196.stdout:9/682: dwrite d9/df/d4a/f5a [0,4194304] 0 2024-03-17T23:58:35.017 INFO:tasks.workunit.client.0.smithi196.stdout:7/823: creat da/d15/da7/f111 x:0 0 0 2024-03-17T23:58:35.017 INFO:tasks.workunit.client.0.smithi196.stdout:5/773: dwrite d6/d17/d1f/d5c/fd0 [0,4194304] 0 2024-03-17T23:58:35.019 INFO:tasks.workunit.client.0.smithi196.stdout:1/656: rename d1/d13/d23/d62/dab/dca/fd2 to d1/db/dd/d43/fda 0 2024-03-17T23:58:35.021 INFO:tasks.workunit.client.0.smithi196.stdout:2/999: dread d17/d19/d137/f62 [0,4194304] 0 2024-03-17T23:58:35.023 INFO:tasks.workunit.client.0.smithi196.stdout:8/562: write de/d10/f2e [4166260,46205] 0 2024-03-17T23:58:35.024 INFO:tasks.workunit.client.0.smithi196.stdout:3/957: creat d7/d19/d26/d48/d4d/f130 x:0 0 0 2024-03-17T23:58:35.026 INFO:tasks.workunit.client.0.smithi196.stdout:5/774: write d6/d17/d1f/f75 [809129,30329] 0 2024-03-17T23:58:35.027 INFO:tasks.workunit.client.0.smithi196.stdout:0/886: sync 2024-03-17T23:58:35.028 INFO:tasks.workunit.client.0.smithi196.stdout:4/672: sync 2024-03-17T23:58:35.028 INFO:tasks.workunit.client.0.smithi196.stdout:1/657: dread - d1/d13/d23/d47/d48/d74/fa5 zero size 2024-03-17T23:58:35.031 INFO:tasks.workunit.client.0.smithi196.stdout:1/658: read - d1/db/dd/d43/f98 zero size 2024-03-17T23:58:35.033 INFO:tasks.workunit.client.0.smithi196.stdout:8/563: creat de/d10/d43/d71/fb0 x:0 0 0 2024-03-17T23:58:35.036 INFO:tasks.workunit.client.0.smithi196.stdout:3/958: readlink d7/l2e 0 2024-03-17T23:58:35.037 INFO:tasks.workunit.client.0.smithi196.stdout:9/683: creat d9/df/d4a/d89/fd6 x:0 0 0 2024-03-17T23:58:35.038 INFO:tasks.workunit.client.0.smithi196.stdout:4/673: creat d1/d26/d33/ff3 x:0 0 0 2024-03-17T23:58:35.039 INFO:tasks.workunit.client.0.smithi196.stdout:8/564: readlink de/d2b/d3c/l9a 0 2024-03-17T23:58:35.040 INFO:tasks.workunit.client.0.smithi196.stdout:7/824: creat da/d15/d1d/d2e/f112 x:0 0 0 2024-03-17T23:58:35.041 INFO:tasks.workunit.client.0.smithi196.stdout:4/674: chown d1/dd2/dcb/fd5 938039 1 2024-03-17T23:58:35.045 INFO:tasks.workunit.client.0.smithi196.stdout:9/684: unlink d9/df/d4a/d5b/d6d/da8/lbd 0 2024-03-17T23:58:35.045 INFO:tasks.workunit.client.0.smithi196.stdout:1/659: dwrite d1/d13/d23/d47/d48/fcf [0,4194304] 0 2024-03-17T23:58:35.054 INFO:tasks.workunit.client.0.smithi196.stdout:1/660: chown d1/d13/d4c/da0/ld8 37224529 1 2024-03-17T23:58:35.058 INFO:tasks.workunit.client.0.smithi196.stdout:6/791: link d2/d14/d42/d57/d5f/lcf d2/d14/d75/d7b/d9e/l118 0 2024-03-17T23:58:35.059 INFO:tasks.workunit.client.0.smithi196.stdout:9/685: dwrite d9/df/d4a/d5b/da5/fb6 [0,4194304] 0 2024-03-17T23:58:35.061 INFO:tasks.workunit.client.0.smithi196.stdout:3/959: symlink d7/d19/d26/d2b/dcd/d120/de0/l131 0 2024-03-17T23:58:35.062 INFO:tasks.workunit.client.0.smithi196.stdout:9/686: chown d9/df/l54 5550232 1 2024-03-17T23:58:35.064 INFO:tasks.workunit.client.0.smithi196.stdout:6/792: dread d2/d14/d35/d63/f6c [0,4194304] 0 2024-03-17T23:58:35.067 INFO:tasks.workunit.client.0.smithi196.stdout:8/565: rename de/d2b/d30/d7c/c95 to de/d2b/d3c/d5d/cb1 0 2024-03-17T23:58:35.070 INFO:tasks.workunit.client.0.smithi196.stdout:3/960: rmdir d7 39 2024-03-17T23:58:35.071 INFO:tasks.workunit.client.0.smithi196.stdout:4/675: creat d1/d26/d57/ff4 x:0 0 0 2024-03-17T23:58:35.072 INFO:tasks.workunit.client.0.smithi196.stdout:5/775: dread d6/d17/d23/f74 [0,4194304] 0 2024-03-17T23:58:35.075 INFO:tasks.workunit.client.0.smithi196.stdout:6/793: unlink d2/d14/d35/f81 0 2024-03-17T23:58:35.076 INFO:tasks.workunit.client.0.smithi196.stdout:7/825: dread f8 [4194304,4194304] 0 2024-03-17T23:58:35.080 INFO:tasks.workunit.client.0.smithi196.stdout:8/566: dwrite f6 [0,4194304] 0 2024-03-17T23:58:35.080 INFO:tasks.workunit.client.0.smithi196.stdout:9/687: truncate d9/f44 917415 0 2024-03-17T23:58:35.082 INFO:tasks.workunit.client.0.smithi196.stdout:5/776: creat d6/d2d/db8/f112 x:0 0 0 2024-03-17T23:58:35.085 INFO:tasks.workunit.client.0.smithi196.stdout:8/567: fdatasync de/f2d 0 2024-03-17T23:58:35.085 INFO:tasks.workunit.client.0.smithi196.stdout:5/777: fsync d6/d17/d23/d53/f54 0 2024-03-17T23:58:35.088 INFO:tasks.workunit.client.0.smithi196.stdout:1/661: rename d1/db/f14 to d1/d13/d4c/dcd/fdb 0 2024-03-17T23:58:35.090 INFO:tasks.workunit.client.0.smithi196.stdout:4/676: mknod d1/d26/d57/d8c/cf5 0 2024-03-17T23:58:35.091 INFO:tasks.workunit.client.0.smithi196.stdout:3/961: dread d7/d19/d26/d2b/d3c/f77 [0,4194304] 0 2024-03-17T23:58:35.091 INFO:tasks.workunit.client.0.smithi196.stdout:1/662: dread - d1/d13/d2a/d94/fbb zero size 2024-03-17T23:58:35.092 INFO:tasks.workunit.client.0.smithi196.stdout:1/663: dread - d1/d13/d2a/d94/fbb zero size 2024-03-17T23:58:35.094 INFO:tasks.workunit.client.0.smithi196.stdout:3/962: write d7/d19/d26/d48/d4d/dd9/f12a [831769,70612] 0 2024-03-17T23:58:35.094 INFO:tasks.workunit.client.0.smithi196.stdout:9/688: mkdir d9/df/d4a/d89/db1/dd7 0 2024-03-17T23:58:35.123 INFO:tasks.workunit.client.0.smithi196.stdout:8/568: rmdir de/d10/d35/d3e/d6c 39 2024-03-17T23:58:35.124 INFO:tasks.workunit.client.0.smithi196.stdout:4/677: unlink d1/de/lc0 0 2024-03-17T23:58:35.125 INFO:tasks.workunit.client.0.smithi196.stdout:8/569: chown de/d2b 30631 1 2024-03-17T23:58:35.125 INFO:tasks.workunit.client.0.smithi196.stdout:1/664: symlink d1/d13/d23/d62/ldc 0 2024-03-17T23:58:35.126 INFO:tasks.workunit.client.0.smithi196.stdout:7/826: dwrite da/d3e/d7f/dc6/feb [0,4194304] 0 2024-03-17T23:58:35.129 INFO:tasks.workunit.client.0.smithi196.stdout:3/963: fsync d7/f20 0 2024-03-17T23:58:35.129 INFO:tasks.workunit.client.0.smithi196.stdout:9/689: truncate d9/df/d4a/d5b/d62/f7a 2017062 0 2024-03-17T23:58:35.133 INFO:tasks.workunit.client.0.smithi196.stdout:1/665: read - d1/db/dd/d43/f98 zero size 2024-03-17T23:58:35.133 INFO:tasks.workunit.client.0.smithi196.stdout:8/570: stat de/f19 0 2024-03-17T23:58:35.134 INFO:tasks.workunit.client.0.smithi196.stdout:4/678: write d1/d26/d33/fd8 [439985,12551] 0 2024-03-17T23:58:35.134 INFO:tasks.workunit.client.0.smithi196.stdout:3/964: fsync d7/d19/d26/f9d 0 2024-03-17T23:58:35.135 INFO:tasks.workunit.client.0.smithi196.stdout:5/778: write d6/fb [973022,47588] 0 2024-03-17T23:58:35.137 INFO:tasks.workunit.client.0.smithi196.stdout:9/690: chown d9/df/d4a/d89/fbf 0 1 2024-03-17T23:58:35.138 INFO:tasks.workunit.client.0.smithi196.stdout:6/794: dwrite d2/d14/d50/f80 [0,4194304] 0 2024-03-17T23:58:35.140 INFO:tasks.workunit.client.0.smithi196.stdout:7/827: rename da/d3e/d45/dd8/de4/d9e to da/d15/d1d/d29/d113 0 2024-03-17T23:58:35.143 INFO:tasks.workunit.client.0.smithi196.stdout:9/691: stat d9/df/d4a/d5b/da5/lc9 0 2024-03-17T23:58:35.145 INFO:tasks.workunit.client.0.smithi196.stdout:3/965: creat d7/d19/d78/d93/f132 x:0 0 0 2024-03-17T23:58:35.146 INFO:tasks.workunit.client.0.smithi196.stdout:4/679: dread d1/d11/f12 [0,4194304] 0 2024-03-17T23:58:35.153 INFO:tasks.workunit.client.0.smithi196.stdout:8/571: creat de/d10/d54/d5c/daa/fb2 x:0 0 0 2024-03-17T23:58:35.153 INFO:tasks.workunit.client.0.smithi196.stdout:5/779: mkdir d6/d17/d3f/d4e/d113 0 2024-03-17T23:58:35.154 INFO:tasks.workunit.client.0.smithi196.stdout:3/966: write d7/d19/d26/d2b/d3c/d3d/d7d/f12c [173778,22278] 0 2024-03-17T23:58:35.154 INFO:tasks.workunit.client.0.smithi196.stdout:6/795: creat d2/d7/d100/f119 x:0 0 0 2024-03-17T23:58:35.155 INFO:tasks.workunit.client.0.smithi196.stdout:7/828: symlink da/d15/d1a/d5e/da5/l114 0 2024-03-17T23:58:35.158 INFO:tasks.workunit.client.0.smithi196.stdout:8/572: write de/d10/d54/d5c/daa/fb2 [598839,35876] 0 2024-03-17T23:58:35.158 INFO:tasks.workunit.client.0.smithi196.stdout:5/780: dread f4 [0,4194304] 0 2024-03-17T23:58:35.160 INFO:tasks.workunit.client.0.smithi196.stdout:5/781: dread - d6/d2d/ff1 zero size 2024-03-17T23:58:35.160 INFO:tasks.workunit.client.0.smithi196.stdout:8/573: chown de/d10/d54/d5c/daa/f76 16094048 1 2024-03-17T23:58:35.161 INFO:tasks.workunit.client.0.smithi196.stdout:9/692: write f6 [1120543,57235] 0 2024-03-17T23:58:35.181 INFO:tasks.workunit.client.0.smithi196.stdout:1/666: rename d1/db/dd/d34/c5b to d1/d13/d23/d47/d48/d7e/cdd 0 2024-03-17T23:58:35.181 INFO:tasks.workunit.client.0.smithi196.stdout:3/967: symlink d7/d19/d26/de7/l133 0 2024-03-17T23:58:35.182 INFO:tasks.workunit.client.0.smithi196.stdout:6/796: chown d2/d14/d42/d57/d5f/l96 10925309 1 2024-03-17T23:58:35.186 INFO:tasks.workunit.client.0.smithi196.stdout:3/968: creat d7/d19/d26/d2b/d103/f134 x:0 0 0 2024-03-17T23:58:35.188 INFO:tasks.workunit.client.0.smithi196.stdout:6/797: stat d2/d14/d50/c85 0 2024-03-17T23:58:35.189 INFO:tasks.workunit.client.0.smithi196.stdout:6/798: fdatasync d2/d66/d90/fab 0 2024-03-17T23:58:35.192 INFO:tasks.workunit.client.0.smithi196.stdout:3/969: symlink d7/d19/d78/df2/l135 0 2024-03-17T23:58:35.194 INFO:tasks.workunit.client.0.smithi196.stdout:5/782: link d6/fa4 d6/d2d/d33/f114 0 2024-03-17T23:58:35.197 INFO:tasks.workunit.client.0.smithi196.stdout:9/693: link d9/df/d4a/d5b/d62/dba/d60/d85/d8e/l9d d9/d12/ld8 0 2024-03-17T23:58:35.199 INFO:tasks.workunit.client.0.smithi196.stdout:1/667: dwrite d1/d13/d23/d62/dab/fbd [0,4194304] 0 2024-03-17T23:58:35.199 INFO:tasks.workunit.client.0.smithi196.stdout:3/970: creat d7/d19/d78/df2/f136 x:0 0 0 2024-03-17T23:58:35.207 INFO:tasks.workunit.client.0.smithi196.stdout:5/783: creat d6/d2d/d33/d3b/d80/da0/f115 x:0 0 0 2024-03-17T23:58:35.211 INFO:tasks.workunit.client.0.smithi196.stdout:7/829: truncate da/d15/d1a/f44 5856046 0 2024-03-17T23:58:35.212 INFO:tasks.workunit.client.0.smithi196.stdout:1/668: chown d1/f25 12570 1 2024-03-17T23:58:35.215 INFO:tasks.workunit.client.0.smithi196.stdout:3/971: mkdir d7/d29/d9b/d137 0 2024-03-17T23:58:35.216 INFO:tasks.workunit.client.0.smithi196.stdout:6/799: fdatasync d2/d66/fa8 0 2024-03-17T23:58:35.217 INFO:tasks.workunit.client.0.smithi196.stdout:9/694: mknod d9/df/d4a/d5b/cd9 0 2024-03-17T23:58:35.219 INFO:tasks.workunit.client.0.smithi196.stdout:5/784: dwrite d6/d17/d1f/fe6 [0,4194304] 0 2024-03-17T23:58:35.221 INFO:tasks.workunit.client.0.smithi196.stdout:1/669: symlink d1/d13/d23/d62/dab/lde 0 2024-03-17T23:58:35.221 INFO:tasks.workunit.client.0.smithi196.stdout:6/800: write d2/d66/f69 [1571964,101018] 0 2024-03-17T23:58:35.224 INFO:tasks.workunit.client.0.smithi196.stdout:6/801: chown d2/d7/d2b/f84 381326 1 2024-03-17T23:58:35.237 INFO:tasks.workunit.client.0.smithi196.stdout:9/695: write d9/df/d4a/d5b/d6d/f73 [3172,16356] 0 2024-03-17T23:58:35.243 INFO:tasks.workunit.client.0.smithi196.stdout:9/696: creat d9/df/d14/d3d/fda x:0 0 0 2024-03-17T23:58:35.248 INFO:tasks.workunit.client.0.smithi196.stdout:9/697: creat d9/d12/fdb x:0 0 0 2024-03-17T23:58:35.250 INFO:tasks.workunit.client.0.smithi196.stdout:5/785: dwrite d6/f1b [0,4194304] 0 2024-03-17T23:58:35.252 INFO:tasks.workunit.client.0.smithi196.stdout:5/786: chown d6/d15/c45 14497746 1 2024-03-17T23:58:35.252 INFO:tasks.workunit.client.0.smithi196.stdout:6/802: dwrite d2/d66/fa8 [0,4194304] 0 2024-03-17T23:58:35.254 INFO:tasks.workunit.client.0.smithi196.stdout:7/830: dwrite da/d15/d1a/f44 [0,4194304] 0 2024-03-17T23:58:35.256 INFO:tasks.workunit.client.0.smithi196.stdout:9/698: mknod d9/df/d4a/d5b/d6d/cdc 0 2024-03-17T23:58:35.257 INFO:tasks.workunit.client.0.smithi196.stdout:7/831: dread - da/d15/da7/f111 zero size 2024-03-17T23:58:35.259 INFO:tasks.workunit.client.0.smithi196.stdout:3/972: dread d7/d19/f1c [0,4194304] 0 2024-03-17T23:58:35.259 INFO:tasks.workunit.client.0.smithi196.stdout:5/787: symlink d6/d2d/d33/d3b/d65/l116 0 2024-03-17T23:58:35.260 INFO:tasks.workunit.client.0.smithi196.stdout:9/699: symlink d9/d33/ldd 0 2024-03-17T23:58:35.260 INFO:tasks.workunit.client.0.smithi196.stdout:5/788: chown d6/d2d/l8d 571737 1 2024-03-17T23:58:35.261 INFO:tasks.workunit.client.0.smithi196.stdout:5/789: stat d6/d17/d35/f66 0 2024-03-17T23:58:35.262 INFO:tasks.workunit.client.0.smithi196.stdout:9/700: fsync d9/df/d4a/d5b/d62/dba/f76 0 2024-03-17T23:58:35.263 INFO:tasks.workunit.client.0.smithi196.stdout:6/803: truncate d2/d14/d42/f4b 1763540 0 2024-03-17T23:58:35.264 INFO:tasks.workunit.client.0.smithi196.stdout:3/973: truncate d7/d19/fa2 355709 0 2024-03-17T23:58:35.265 INFO:tasks.workunit.client.0.smithi196.stdout:9/701: mknod d9/df/d4a/cde 0 2024-03-17T23:58:35.266 INFO:tasks.workunit.client.0.smithi196.stdout:5/790: write d6/d17/d23/d7e/fdc [3252053,79955] 0 2024-03-17T23:58:35.269 INFO:tasks.workunit.client.0.smithi196.stdout:9/702: symlink d9/d12/d59/ldf 0 2024-03-17T23:58:35.271 INFO:tasks.workunit.client.0.smithi196.stdout:9/703: stat d9/df/d4a/d5b/d62/dba/d60/d5e/fb9 0 2024-03-17T23:58:35.273 INFO:tasks.workunit.client.0.smithi196.stdout:6/804: creat d2/d14/d75/d7b/f11a x:0 0 0 2024-03-17T23:58:35.275 INFO:tasks.workunit.client.0.smithi196.stdout:7/832: write da/d3e/d45/dd8/de4/d8f/f106 [1027685,34559] 0 2024-03-17T23:58:35.279 INFO:tasks.workunit.client.0.smithi196.stdout:9/704: read d9/df/d14/d27/fa6 [755573,111603] 0 2024-03-17T23:58:35.279 INFO:tasks.workunit.client.0.smithi196.stdout:5/791: getdents d6/d2d/d33/d3b/d80/da0 0 2024-03-17T23:58:35.280 INFO:tasks.workunit.client.0.smithi196.stdout:3/974: dwrite d7/ff [4194304,4194304] 0 2024-03-17T23:58:35.282 INFO:tasks.workunit.client.0.smithi196.stdout:7/833: rmdir da/d3e/d45/d4f/d75/da8/d78 39 2024-03-17T23:58:35.284 INFO:tasks.workunit.client.0.smithi196.stdout:6/805: mkdir d2/d14/d75/d7b/d11b 0 2024-03-17T23:58:35.286 INFO:tasks.workunit.client.0.smithi196.stdout:5/792: write d6/d17/d23/d53/f8f [3365376,16296] 0 2024-03-17T23:58:35.286 INFO:tasks.workunit.client.0.smithi196.stdout:3/975: mknod d7/d19/d26/d2b/c138 0 2024-03-17T23:58:35.288 INFO:tasks.workunit.client.0.smithi196.stdout:7/834: read da/d15/d1d/d29/f79 [2961766,44580] 0 2024-03-17T23:58:35.297 INFO:tasks.workunit.client.0.smithi196.stdout:5/793: fdatasync d6/ff 0 2024-03-17T23:58:35.302 INFO:tasks.workunit.client.0.smithi196.stdout:3/976: dwrite d7/d19/d26/d2b/dcd/d120/fe8 [0,4194304] 0 2024-03-17T23:58:35.303 INFO:tasks.workunit.client.0.smithi196.stdout:3/977: fsync d7/d19/dc4/fef 0 2024-03-17T23:58:35.307 INFO:tasks.workunit.client.0.smithi196.stdout:0/887: sync 2024-03-17T23:58:35.308 INFO:tasks.workunit.client.0.smithi196.stdout:6/806: dread d2/d14/d75/dc0/ddf/da1/fa5 [0,4194304] 0 2024-03-17T23:58:35.308 INFO:tasks.workunit.client.0.smithi196.stdout:5/794: symlink d6/d17/d3f/d4e/d69/daf/l117 0 2024-03-17T23:58:35.310 INFO:tasks.workunit.client.0.smithi196.stdout:0/888: write d5/f44 [1515298,99261] 0 2024-03-17T23:58:35.310 INFO:tasks.workunit.client.0.smithi196.stdout:9/705: dread d9/df/d4a/d5b/d6d/da8/fca [0,4194304] 0 2024-03-17T23:58:35.311 INFO:tasks.workunit.client.0.smithi196.stdout:6/807: truncate d2/f3e 2805702 0 2024-03-17T23:58:35.313 INFO:tasks.workunit.client.0.smithi196.stdout:3/978: unlink d7/lda 0 2024-03-17T23:58:35.314 INFO:tasks.workunit.client.0.smithi196.stdout:9/706: chown d9/f44 56060049 1 2024-03-17T23:58:35.314 INFO:tasks.workunit.client.0.smithi196.stdout:3/979: chown d7/d19/d26/d48/d4d/l62 125592845 1 2024-03-17T23:58:35.314 INFO:tasks.workunit.client.0.smithi196.stdout:9/707: stat d9/df/d4a/f5a 0 2024-03-17T23:58:35.316 INFO:tasks.workunit.client.0.smithi196.stdout:3/980: write d7/d19/d26/d48/f6c [5133438,104833] 0 2024-03-17T23:58:35.318 INFO:tasks.workunit.client.0.smithi196.stdout:7/835: dread da/d15/d1d/d29/dc4/ffc [0,4194304] 0 2024-03-17T23:58:35.323 INFO:tasks.workunit.client.0.smithi196.stdout:9/708: symlink d9/df/d14/d27/d9e/dc5/le0 0 2024-03-17T23:58:35.328 INFO:tasks.workunit.client.0.smithi196.stdout:5/795: creat d6/d17/d35/d10f/f118 x:0 0 0 2024-03-17T23:58:35.330 INFO:tasks.workunit.client.0.smithi196.stdout:6/808: dread d2/d14/d75/d7b/f4c [0,4194304] 0 2024-03-17T23:58:35.331 INFO:tasks.workunit.client.0.smithi196.stdout:5/796: dread - d6/d17/d23/d53/d97/fb0 zero size 2024-03-17T23:58:35.333 INFO:tasks.workunit.client.0.smithi196.stdout:0/889: link d5/d23/d24/d28/d47/d52/d61/l89 d5/d23/d24/d59/d8b/l10d 0 2024-03-17T23:58:35.334 INFO:tasks.workunit.client.0.smithi196.stdout:7/836: fdatasync da/d3e/fb9 0 2024-03-17T23:58:35.339 INFO:tasks.workunit.client.0.smithi196.stdout:9/709: mkdir d9/df/d4a/d89/db1/dd7/de1 0 2024-03-17T23:58:35.341 INFO:tasks.workunit.client.0.smithi196.stdout:0/890: mknod d5/d23/d24/d28/dc9/db0/c10e 0 2024-03-17T23:58:35.342 INFO:tasks.workunit.client.0.smithi196.stdout:6/809: dwrite d2/d14/d42/d57/dc8/fc4 [0,4194304] 0 2024-03-17T23:58:35.343 INFO:tasks.workunit.client.0.smithi196.stdout:5/797: write d6/d2d/d33/f114 [198790,14328] 0 2024-03-17T23:58:35.346 INFO:tasks.workunit.client.0.smithi196.stdout:5/798: write d6/d17/d1f/d5c/fd0 [942562,124902] 0 2024-03-17T23:58:35.347 INFO:tasks.workunit.client.0.smithi196.stdout:5/799: fsync d6/d2d/d33/f114 0 2024-03-17T23:58:35.350 INFO:tasks.workunit.client.0.smithi196.stdout:3/981: getdents d7/d19/d26/d2b 0 2024-03-17T23:58:35.353 INFO:tasks.workunit.client.0.smithi196.stdout:9/710: read d9/df/d4a/d5b/d62/dba/f3f [582423,63581] 0 2024-03-17T23:58:35.354 INFO:tasks.workunit.client.0.smithi196.stdout:0/891: mkdir d5/d23/d24/d28/d47/d52/d49/d10f 0 2024-03-17T23:58:35.355 INFO:tasks.workunit.client.0.smithi196.stdout:9/711: dread - d9/df/d4a/d5b/fa4 zero size 2024-03-17T23:58:35.358 INFO:tasks.workunit.client.0.smithi196.stdout:9/712: fsync d9/df/d14/d27/d9e/dc5/fcb 0 2024-03-17T23:58:35.358 INFO:tasks.workunit.client.0.smithi196.stdout:7/837: rename da/d3e/d45/d4f/d75/da8/d78/d81 to da/d3e/d45/d4f/d75/da8/d78/da4/d9b/d115 0 2024-03-17T23:58:35.359 INFO:tasks.workunit.client.0.smithi196.stdout:5/800: dwrite f0 [0,4194304] 0 2024-03-17T23:58:35.361 INFO:tasks.workunit.client.0.smithi196.stdout:7/838: truncate da/d15/d1a/d5e/da5/fd9 245400 0 2024-03-17T23:58:35.368 INFO:tasks.workunit.client.0.smithi196.stdout:6/810: link d2/d14/d42/f8f d2/d14/d42/d57/dc8/db3/f11c 0 2024-03-17T23:58:35.369 INFO:tasks.workunit.client.0.smithi196.stdout:6/811: write d2/d14/d75/dc0/ddf/da1/f109 [1001514,98701] 0 2024-03-17T23:58:35.372 INFO:tasks.workunit.client.0.smithi196.stdout:9/713: creat d9/df/d4a/d5b/d62/dba/d60/fe2 x:0 0 0 2024-03-17T23:58:35.376 INFO:tasks.workunit.client.0.smithi196.stdout:7/839: symlink da/d3e/d45/d4f/d75/da8/d78/l116 0 2024-03-17T23:58:35.379 INFO:tasks.workunit.client.0.smithi196.stdout:3/982: dwrite d7/d19/d26/d2b/f67 [4194304,4194304] 0 2024-03-17T23:58:35.379 INFO:tasks.workunit.client.0.smithi196.stdout:0/892: mkdir d5/d23/d24/d30/d110 0 2024-03-17T23:58:35.381 INFO:tasks.workunit.client.0.smithi196.stdout:5/801: write d6/fe [693639,1728] 0 2024-03-17T23:58:35.382 INFO:tasks.workunit.client.0.smithi196.stdout:9/714: truncate d9/df/d14/d27/fa6 769367 0 2024-03-17T23:58:35.383 INFO:tasks.workunit.client.0.smithi196.stdout:7/840: rmdir da/d15/d1d/d29/d113 39 2024-03-17T23:58:35.385 INFO:tasks.workunit.client.0.smithi196.stdout:0/893: unlink d5/d23/d24/d28/d47/f70 0 2024-03-17T23:58:35.387 INFO:tasks.workunit.client.0.smithi196.stdout:5/802: write d6/d17/d1f/d7d/d81/f4a [4514081,19479] 0 2024-03-17T23:58:35.387 INFO:tasks.workunit.client.0.smithi196.stdout:3/983: dread d7/d19/d78/da9/fd1 [0,4194304] 0 2024-03-17T23:58:35.388 INFO:tasks.workunit.client.0.smithi196.stdout:7/841: write da/d3e/d45/d4f/d75/da8/f88 [810473,64622] 0 2024-03-17T23:58:35.393 INFO:tasks.workunit.client.0.smithi196.stdout:0/894: unlink d5/d23/d24/d28/d47/d52/d61/d6c/df7/cd2 0 2024-03-17T23:58:35.395 INFO:tasks.workunit.client.0.smithi196.stdout:6/812: dread d2/d14/fb7 [0,4194304] 0 2024-03-17T23:58:35.398 INFO:tasks.workunit.client.0.smithi196.stdout:7/842: fsync da/d3e/d7f/f8b 0 2024-03-17T23:58:35.399 INFO:tasks.workunit.client.0.smithi196.stdout:5/803: truncate d6/d2d/f102 115242 0 2024-03-17T23:58:35.405 INFO:tasks.workunit.client.0.smithi196.stdout:9/715: dwrite d9/df/d4a/d5b/d62/dba/d60/d5e/f57 [0,4194304] 0 2024-03-17T23:58:35.410 INFO:tasks.workunit.client.0.smithi196.stdout:6/813: creat d2/d14/f11d x:0 0 0 2024-03-17T23:58:35.415 INFO:tasks.workunit.client.0.smithi196.stdout:5/804: dwrite d6/d17/d23/d53/d97/fb0 [0,4194304] 0 2024-03-17T23:58:35.419 INFO:tasks.workunit.client.0.smithi196.stdout:3/984: dread d7/ff [0,4194304] 0 2024-03-17T23:58:35.421 INFO:tasks.workunit.client.0.smithi196.stdout:6/814: symlink d2/d14/d50/d68/l11e 0 2024-03-17T23:58:35.422 INFO:tasks.workunit.client.0.smithi196.stdout:7/843: dread da/d3e/d45/d4f/d75/da8/f96 [0,4194304] 0 2024-03-17T23:58:35.424 INFO:tasks.workunit.client.0.smithi196.stdout:3/985: mkdir d7/d19/d26/d2b/dcd/d120/de0/d139 0 2024-03-17T23:58:35.425 INFO:tasks.workunit.client.0.smithi196.stdout:5/805: symlink d6/d17/d1f/d7d/d81/l119 0 2024-03-17T23:58:35.425 INFO:tasks.workunit.client.0.smithi196.stdout:6/815: chown d2/d14/d42/d57/d5f/dbd/df2 111980 1 2024-03-17T23:58:35.425 INFO:tasks.workunit.client.0.smithi196.stdout:9/716: dwrite d9/f11 [0,4194304] 0 2024-03-17T23:58:35.430 INFO:tasks.workunit.client.0.smithi196.stdout:7/844: write da/d3e/d45/d4f/d75/fd1 [2790327,68372] 0 2024-03-17T23:58:35.433 INFO:tasks.workunit.client.0.smithi196.stdout:9/717: write d9/df/d4a/d5b/d6d/da8/fbc [298361,29664] 0 2024-03-17T23:58:35.434 INFO:tasks.workunit.client.0.smithi196.stdout:5/806: getdents d6/d17/d35 0 2024-03-17T23:58:35.438 INFO:tasks.workunit.client.0.smithi196.stdout:7/845: mkdir da/d3e/d45/d4f/d75/da8/d117 0 2024-03-17T23:58:35.440 INFO:tasks.workunit.client.0.smithi196.stdout:9/718: symlink d9/df/d4a/d5b/da5/le3 0 2024-03-17T23:58:35.442 INFO:tasks.workunit.client.0.smithi196.stdout:7/846: symlink da/d15/d1a/d5e/d70/l118 0 2024-03-17T23:58:35.445 INFO:tasks.workunit.client.0.smithi196.stdout:6/816: truncate d2/d14/d75/dc0/f10b 629917 0 2024-03-17T23:58:35.448 INFO:tasks.workunit.client.0.smithi196.stdout:5/807: dread d6/d17/d1f/f4c [0,4194304] 0 2024-03-17T23:58:35.449 INFO:tasks.workunit.client.0.smithi196.stdout:6/817: creat d2/d14/d42/f11f x:0 0 0 2024-03-17T23:58:35.451 INFO:tasks.workunit.client.0.smithi196.stdout:3/986: dread d7/f21 [0,4194304] 0 2024-03-17T23:58:35.452 INFO:tasks.workunit.client.0.smithi196.stdout:6/818: stat d2/d14/de2/f115 0 2024-03-17T23:58:35.453 INFO:tasks.workunit.client.0.smithi196.stdout:7/847: dwrite da/d3e/d45/d4f/fed [0,4194304] 0 2024-03-17T23:58:35.455 INFO:tasks.workunit.client.0.smithi196.stdout:3/987: rmdir d7/d19/d26/d48 39 2024-03-17T23:58:35.461 INFO:tasks.workunit.client.0.smithi196.stdout:5/808: truncate d6/d2d/d33/f114 475037 0 2024-03-17T23:58:35.462 INFO:tasks.workunit.client.0.smithi196.stdout:3/988: dread d7/d19/f1c [0,4194304] 0 2024-03-17T23:58:35.464 INFO:tasks.workunit.client.0.smithi196.stdout:6/819: symlink d2/d14/d50/l120 0 2024-03-17T23:58:35.465 INFO:tasks.workunit.client.0.smithi196.stdout:7/848: truncate da/d3e/d45/dd8/de4/d8f/fb0 147634 0 2024-03-17T23:58:35.467 INFO:tasks.workunit.client.0.smithi196.stdout:5/809: rmdir d6/d2d/d9c/dc7 39 2024-03-17T23:58:35.470 INFO:tasks.workunit.client.0.smithi196.stdout:6/820: mkdir d2/d14/dcc/d103/d121 0 2024-03-17T23:58:35.472 INFO:tasks.workunit.client.0.smithi196.stdout:3/989: read d7/d19/d26/f2f [149356,75760] 0 2024-03-17T23:58:35.474 INFO:tasks.workunit.client.0.smithi196.stdout:5/810: creat d6/d15/dc0/de5/f11a x:0 0 0 2024-03-17T23:58:35.475 INFO:tasks.workunit.client.0.smithi196.stdout:6/821: creat d2/d14/d75/dc0/ddf/de6/dd9/f122 x:0 0 0 2024-03-17T23:58:35.476 INFO:tasks.workunit.client.0.smithi196.stdout:7/849: dread da/d3e/ddc/dff/f89 [0,4194304] 0 2024-03-17T23:58:35.477 INFO:tasks.workunit.client.0.smithi196.stdout:9/719: dread d9/df/d14/f72 [0,4194304] 0 2024-03-17T23:58:35.477 INFO:tasks.workunit.client.0.smithi196.stdout:7/850: fsync da/f103 0 2024-03-17T23:58:35.481 INFO:tasks.workunit.client.0.smithi196.stdout:9/720: chown d9/df/d4a/d5b/d62/l9f 20522725 1 2024-03-17T23:58:35.481 INFO:tasks.workunit.client.0.smithi196.stdout:6/822: truncate d2/d14/de2/f115 4150 0 2024-03-17T23:58:35.481 INFO:tasks.workunit.client.0.smithi196.stdout:7/851: write da/d3e/d45/d4f/d75/da8/f88 [4993943,49904] 0 2024-03-17T23:58:35.484 INFO:tasks.workunit.client.0.smithi196.stdout:7/852: stat da/d3e/d45/d4f/d75/da8/d78/fcc 0 2024-03-17T23:58:35.494 INFO:tasks.workunit.client.0.smithi196.stdout:7/853: symlink da/d15/da7/d93/l119 0 2024-03-17T23:58:35.494 INFO:tasks.workunit.client.0.smithi196.stdout:5/811: dwrite d6/d17/d23/f74 [0,4194304] 0 2024-03-17T23:58:35.495 INFO:tasks.workunit.client.0.smithi196.stdout:6/823: link d2/d66/la2 d2/d7/d100/l123 0 2024-03-17T23:58:35.495 INFO:tasks.workunit.client.0.smithi196.stdout:3/990: dwrite d7/d19/d26/d2b/d3c/f7b [0,4194304] 0 2024-03-17T23:58:35.505 INFO:tasks.workunit.client.0.smithi196.stdout:7/854: write da/d3e/d45/dd8/de4/d8f/f106 [685179,80767] 0 2024-03-17T23:58:35.505 INFO:tasks.workunit.client.0.smithi196.stdout:7/855: write da/d15/d1d/d2e/ff4 [333930,112036] 0 2024-03-17T23:58:35.505 INFO:tasks.workunit.client.0.smithi196.stdout:7/856: write da/d15/da7/f111 [998365,92224] 0 2024-03-17T23:58:35.506 INFO:tasks.workunit.client.0.smithi196.stdout:7/857: write da/d15/d1d/d4c/f7d [3447804,106282] 0 2024-03-17T23:58:35.513 INFO:tasks.workunit.client.0.smithi196.stdout:3/991: dread d7/d19/d78/d93/fbc [0,4194304] 0 2024-03-17T23:58:35.513 INFO:tasks.workunit.client.0.smithi196.stdout:5/812: write d6/d2d/d33/f114 [1320913,108083] 0 2024-03-17T23:58:35.514 INFO:tasks.workunit.client.0.smithi196.stdout:6/824: rename d2/d66/la2 to d2/d14/l124 0 2024-03-17T23:58:35.517 INFO:tasks.workunit.client.0.smithi196.stdout:5/813: write d6/d17/d23/f74 [3921460,32699] 0 2024-03-17T23:58:35.518 INFO:tasks.workunit.client.0.smithi196.stdout:6/825: write d2/f3e [3700190,128505] 0 2024-03-17T23:58:35.521 INFO:tasks.workunit.client.0.smithi196.stdout:3/992: rename d7/d19/d26/l5d to d7/d19/d26/d2b/d3c/d3d/l13a 0 2024-03-17T23:58:35.522 INFO:tasks.workunit.client.0.smithi196.stdout:7/858: dwrite da/d3e/d45/d4f/d75/da8/d78/fdd [0,4194304] 0 2024-03-17T23:58:35.525 INFO:tasks.workunit.client.0.smithi196.stdout:5/814: write d6/d2d/d33/d84/f111 [1910692,83197] 0 2024-03-17T23:58:35.527 INFO:tasks.workunit.client.0.smithi196.stdout:3/993: symlink d7/d19/d26/d2b/dee/l13b 0 2024-03-17T23:58:35.528 INFO:tasks.workunit.client.0.smithi196.stdout:6/826: write d2/d7/d2b/f67 [174460,1593] 0 2024-03-17T23:58:35.530 INFO:tasks.workunit.client.0.smithi196.stdout:5/815: rename d6/d17/d3f/d4e/l52 to d6/d17/d3f/d4e/d69/l11b 0 2024-03-17T23:58:35.532 INFO:tasks.workunit.client.0.smithi196.stdout:3/994: fsync d7/ff 0 2024-03-17T23:58:35.533 INFO:tasks.workunit.client.0.smithi196.stdout:6/827: mknod d2/d14/d75/dc0/ddf/de6/c125 0 2024-03-17T23:58:35.535 INFO:tasks.workunit.client.0.smithi196.stdout:6/828: write d2/d14/d42/d57/dc8/f10d [444130,115132] 0 2024-03-17T23:58:35.538 INFO:tasks.workunit.client.0.smithi196.stdout:3/995: mkdir d7/d19/d26/d2b/d3c/d3d/d13c 0 2024-03-17T23:58:35.539 INFO:tasks.workunit.client.0.smithi196.stdout:3/996: read - d7/d19/d26/d2b/dcd/feb zero size 2024-03-17T23:58:35.540 INFO:tasks.workunit.client.0.smithi196.stdout:7/859: getdents da/d15/d1d/d29 0 2024-03-17T23:58:35.542 INFO:tasks.workunit.client.0.smithi196.stdout:6/829: creat d2/d7/dcd/dd3/dba/f126 x:0 0 0 2024-03-17T23:58:35.543 INFO:tasks.workunit.client.0.smithi196.stdout:5/816: link d6/d17/d1f/lcc d6/d17/df5/l11c 0 2024-03-17T23:58:35.545 INFO:tasks.workunit.client.0.smithi196.stdout:7/860: truncate da/d3e/d7f/f8b 780277 0 2024-03-17T23:58:35.548 INFO:tasks.workunit.client.0.smithi196.stdout:3/997: link d7/d19/c8f d7/d19/d26/d2b/d3c/d3d/d7d/c13d 0 2024-03-17T23:58:35.549 INFO:tasks.workunit.client.0.smithi196.stdout:3/998: read - d7/d19/d78/d93/fc0 zero size 2024-03-17T23:58:35.553 INFO:tasks.workunit.client.0.smithi196.stdout:7/861: creat da/d3e/d45/d4f/d75/da8/f11a x:0 0 0 2024-03-17T23:58:35.554 INFO:tasks.workunit.client.0.smithi196.stdout:7/862: dread - da/d3e/d45/f100 zero size 2024-03-17T23:58:35.557 INFO:tasks.workunit.client.0.smithi196.stdout:5/817: dwrite d6/d17/d23/d53/d97/fb0 [0,4194304] 0 2024-03-17T23:58:35.561 INFO:tasks.workunit.client.0.smithi196.stdout:5/818: stat d6/d17/d23/d53/f8f 0 2024-03-17T23:58:35.563 INFO:tasks.workunit.client.0.smithi196.stdout:7/863: rename da/d15/d1d/d29/dc4/dd4 to da/d15/d1a/d5e/df3/d11b 0 2024-03-17T23:58:35.564 INFO:tasks.workunit.client.0.smithi196.stdout:3/999: dwrite d7/d19/d26/d2b/d3c/d3d/f5a [4194304,4194304] 0 2024-03-17T23:58:35.569 INFO:tasks.workunit.client.0.smithi196.stdout:5/819: rename d6/d17/d1f/d7d/d81/dfd/f108 to d6/d17/d1f/f11d 0 2024-03-17T23:58:35.569 INFO:tasks.workunit.client.0.smithi196.stdout:7/864: symlink da/d3e/ddc/dff/ddf/l11c 0 2024-03-17T23:58:35.596 INFO:tasks.workunit.client.0.smithi196.stdout:8/574: sync 2024-03-17T23:58:35.596 INFO:tasks.workunit.client.0.smithi196.stdout:4/680: sync 2024-03-17T23:58:35.598 INFO:tasks.workunit.client.0.smithi196.stdout:7/865: symlink da/d3e/d45/d4f/d75/da8/d78/l11d 0 2024-03-17T23:58:35.598 INFO:tasks.workunit.client.0.smithi196.stdout:4/681: chown d1/d11/l5b 0 1 2024-03-17T23:58:35.599 INFO:tasks.workunit.client.0.smithi196.stdout:7/866: stat da/d15/d1a/d5e/da5/fd9 0 2024-03-17T23:58:35.601 INFO:tasks.workunit.client.0.smithi196.stdout:5/820: rename d6/d2d/d33/cee to d6/d17/d3f/d4e/d69/ded/d10c/c11e 0 2024-03-17T23:58:35.601 INFO:tasks.workunit.client.0.smithi196.stdout:4/682: dread d1/fa7 [0,4194304] 0 2024-03-17T23:58:35.604 INFO:tasks.workunit.client.0.smithi196.stdout:5/821: read d6/d2d/d33/d3b/d80/db9/fde [719667,72536] 0 2024-03-17T23:58:35.604 INFO:tasks.workunit.client.0.smithi196.stdout:8/575: getdents de/d5e 0 2024-03-17T23:58:35.608 INFO:tasks.workunit.client.0.smithi196.stdout:4/683: creat d1/d1b/ff6 x:0 0 0 2024-03-17T23:58:35.612 INFO:tasks.workunit.client.0.smithi196.stdout:7/867: dwrite da/d3e/ddc/dff/ddf/f99 [0,4194304] 0 2024-03-17T23:58:35.620 INFO:tasks.workunit.client.0.smithi196.stdout:8/576: dwrite de/d10/d35/f4f [0,4194304] 0 2024-03-17T23:58:35.628 INFO:tasks.workunit.client.0.smithi196.stdout:5/822: dwrite d6/d17/d1f/d7d/dd7/fe8 [0,4194304] 0 2024-03-17T23:58:35.630 INFO:tasks.workunit.client.0.smithi196.stdout:8/577: rename f3 to de/d10/d54/d5c/daa/fb3 0 2024-03-17T23:58:35.631 INFO:tasks.workunit.client.0.smithi196.stdout:4/684: dwrite d1/de/d50/f9e [0,4194304] 0 2024-03-17T23:58:35.637 INFO:tasks.workunit.client.0.smithi196.stdout:7/868: truncate da/d15/f25 4553819 0 2024-03-17T23:58:35.638 INFO:tasks.workunit.client.0.smithi196.stdout:4/685: mkdir d1/df7 0 2024-03-17T23:58:35.644 INFO:tasks.workunit.client.0.smithi196.stdout:5/823: dwrite d6/d15/dc0/fdf [0,4194304] 0 2024-03-17T23:58:35.646 INFO:tasks.workunit.client.0.smithi196.stdout:8/578: dwrite de/d10/d35/d3e/f8d [0,4194304] 0 2024-03-17T23:58:35.646 INFO:tasks.workunit.client.0.smithi196.stdout:8/579: stat de/c29 0 2024-03-17T23:58:35.647 INFO:tasks.workunit.client.0.smithi196.stdout:5/824: chown d6/d17/d1f/ld8 3777995 1 2024-03-17T23:58:35.647 INFO:tasks.workunit.client.0.smithi196.stdout:8/580: stat de/d2b/d30/f68 0 2024-03-17T23:58:35.648 INFO:tasks.workunit.client.0.smithi196.stdout:5/825: readlink d6/d2d/d33/d3b/d65/l109 0 2024-03-17T23:58:35.649 INFO:tasks.workunit.client.0.smithi196.stdout:5/826: dread - d6/d17/d1f/f11d zero size 2024-03-17T23:58:35.652 INFO:tasks.workunit.client.0.smithi196.stdout:4/686: dread d1/d26/d33/f72 [0,4194304] 0 2024-03-17T23:58:35.657 INFO:tasks.workunit.client.0.smithi196.stdout:8/581: read de/ff [3970108,91947] 0 2024-03-17T23:58:35.658 INFO:tasks.workunit.client.0.smithi196.stdout:8/582: dread - de/d10/d35/fa7 zero size 2024-03-17T23:58:35.664 INFO:tasks.workunit.client.0.smithi196.stdout:8/583: unlink lb 0 2024-03-17T23:58:35.664 INFO:tasks.workunit.client.0.smithi196.stdout:5/827: dwrite d6/fb [0,4194304] 0 2024-03-17T23:58:35.665 INFO:tasks.workunit.client.0.smithi196.stdout:7/869: dread da/d15/d1a/f20 [0,4194304] 0 2024-03-17T23:58:35.666 INFO:tasks.workunit.client.0.smithi196.stdout:8/584: dread - de/d10/d54/d5c/d81/f94 zero size 2024-03-17T23:58:35.668 INFO:tasks.workunit.client.0.smithi196.stdout:5/828: symlink d6/d17/d1f/l11f 0 2024-03-17T23:58:35.669 INFO:tasks.workunit.client.0.smithi196.stdout:5/829: chown d6/d17/d1f/d7d/f104 22 1 2024-03-17T23:58:35.670 INFO:tasks.workunit.client.0.smithi196.stdout:8/585: mknod de/d10/d43/d71/cb4 0 2024-03-17T23:58:35.674 INFO:tasks.workunit.client.0.smithi196.stdout:7/870: dread da/d15/fc0 [0,4194304] 0 2024-03-17T23:58:35.674 INFO:tasks.workunit.client.0.smithi196.stdout:5/830: getdents d6/d2d/db8 0 2024-03-17T23:58:35.684 INFO:tasks.workunit.client.0.smithi196.stdout:5/831: dwrite d6/d2a/fb3 [0,4194304] 0 2024-03-17T23:58:35.684 INFO:tasks.workunit.client.0.smithi196.stdout:7/871: dwrite da/d3e/d7f/dc6/feb [0,4194304] 0 2024-03-17T23:58:35.688 INFO:tasks.workunit.client.0.smithi196.stdout:5/832: mkdir d6/d17/d23/d53/d120 0 2024-03-17T23:58:35.690 INFO:tasks.workunit.client.0.smithi196.stdout:7/872: creat da/d3e/d7f/dc6/f11e x:0 0 0 2024-03-17T23:58:35.697 INFO:tasks.workunit.client.0.smithi196.stdout:5/833: dwrite d6/d17/d35/f66 [0,4194304] 0 2024-03-17T23:58:35.708 INFO:tasks.workunit.client.0.smithi196.stdout:7/873: dread da/d3e/d45/d4f/d75/da8/f88 [0,4194304] 0 2024-03-17T23:58:35.715 INFO:tasks.workunit.client.0.smithi196.stdout:5/834: dread d6/d17/d23/d7e/fdc [0,4194304] 0 2024-03-17T23:58:35.716 INFO:tasks.workunit.client.0.smithi196.stdout:7/874: write da/d3e/d45/f73 [2261925,120584] 0 2024-03-17T23:58:35.716 INFO:tasks.workunit.client.0.smithi196.stdout:5/835: fdatasync d6/f1b 0 2024-03-17T23:58:35.720 INFO:tasks.workunit.client.0.smithi196.stdout:5/836: unlink d6/d17/d35/f85 0 2024-03-17T23:58:35.723 INFO:tasks.workunit.client.0.smithi196.stdout:5/837: read d6/d2d/d33/d3b/f5e [2162099,95220] 0 2024-03-17T23:58:35.726 INFO:tasks.workunit.client.0.smithi196.stdout:7/875: dwrite da/d15/fc0 [0,4194304] 0 2024-03-17T23:58:35.733 INFO:tasks.workunit.client.0.smithi196.stdout:5/838: truncate d6/d17/d1f/d7d/dd7/fe8 3232795 0 2024-03-17T23:58:35.737 INFO:tasks.workunit.client.0.smithi196.stdout:7/876: creat da/d15/f11f x:0 0 0 2024-03-17T23:58:35.738 INFO:tasks.workunit.client.0.smithi196.stdout:7/877: write da/d15/d1d/d29/f101 [26834,52545] 0 2024-03-17T23:58:35.741 INFO:tasks.workunit.client.0.smithi196.stdout:7/878: symlink da/d15/d1a/d5e/df3/l120 0 2024-03-17T23:58:35.743 INFO:tasks.workunit.client.0.smithi196.stdout:7/879: getdents da/d15/d1a/d5e/d70 0 2024-03-17T23:58:35.758 INFO:tasks.workunit.client.0.smithi196.stdout:7/880: dread da/d15/d1a/d5e/d70/dc5/fcb [0,4194304] 0 2024-03-17T23:58:35.759 INFO:tasks.workunit.client.0.smithi196.stdout:1/670: sync 2024-03-17T23:58:35.759 INFO:tasks.workunit.client.0.smithi196.stdout:7/881: write da/d3e/d7f/fb2 [3964004,108819] 0 2024-03-17T23:58:35.761 INFO:tasks.workunit.client.0.smithi196.stdout:1/671: read d1/d13/d23/d47/d48/f79 [87165,105654] 0 2024-03-17T23:58:35.763 INFO:tasks.workunit.client.0.smithi196.stdout:7/882: symlink da/d15/d1d/d2e/l121 0 2024-03-17T23:58:35.763 INFO:tasks.workunit.client.0.smithi196.stdout:1/672: dread - d1/d13/d23/fba zero size 2024-03-17T23:58:35.792 INFO:tasks.workunit.client.0.smithi196.stdout:7/883: rename da/c22 to da/d3e/d45/dfe/c122 0 2024-03-17T23:58:35.794 INFO:tasks.workunit.client.0.smithi196.stdout:7/884: fsync da/d3e/d45/d4f/d75/da8/d78/fcc 0 2024-03-17T23:58:35.800 INFO:tasks.workunit.client.0.smithi196.stdout:1/673: write d1/f4d [1600556,68735] 0 2024-03-17T23:58:35.802 INFO:tasks.workunit.client.0.smithi196.stdout:1/674: write d1/d13/d2a/f90 [4100964,108647] 0 2024-03-17T23:58:35.806 INFO:tasks.workunit.client.0.smithi196.stdout:1/675: rmdir d1/d13/d23/d62/dab 39 2024-03-17T23:58:35.808 INFO:tasks.workunit.client.0.smithi196.stdout:7/885: write da/d15/d1d/d29/f5a [1980026,8647] 0 2024-03-17T23:58:35.823 INFO:tasks.workunit.client.0.smithi196.stdout:7/886: dread da/f1c [0,4194304] 0 2024-03-17T23:58:35.825 INFO:tasks.workunit.client.0.smithi196.stdout:7/887: chown da/f5c 3 1 2024-03-17T23:58:35.827 INFO:tasks.workunit.client.0.smithi196.stdout:7/888: creat da/d3e/d45/d4f/d75/de7/f123 x:0 0 0 2024-03-17T23:58:35.830 INFO:tasks.workunit.client.0.smithi196.stdout:7/889: creat da/d3e/d45/d4f/f124 x:0 0 0 2024-03-17T23:58:35.832 INFO:tasks.workunit.client.0.smithi196.stdout:7/890: mkdir da/d3e/ddc/d125 0 2024-03-17T23:58:35.843 INFO:tasks.workunit.client.0.smithi196.stdout:7/891: dwrite da/d15/f25 [0,4194304] 0 2024-03-17T23:58:35.942 INFO:tasks.workunit.client.0.smithi196.stdout:0/895: sync 2024-03-17T23:58:35.945 INFO:tasks.workunit.client.0.smithi196.stdout:0/896: mkdir d5/d23/d24/d111 0 2024-03-17T23:58:35.946 INFO:tasks.workunit.client.0.smithi196.stdout:0/897: write d5/d23/d24/d72/fe5 [80930,95140] 0 2024-03-17T23:58:35.949 INFO:tasks.workunit.client.0.smithi196.stdout:0/898: creat d5/d23/d24/d28/d47/d52/dac/f112 x:0 0 0 2024-03-17T23:58:35.950 INFO:tasks.workunit.client.0.smithi196.stdout:0/899: creat d5/d23/d85/de7/f113 x:0 0 0 2024-03-17T23:58:35.951 INFO:tasks.workunit.client.0.smithi196.stdout:0/900: chown d5/d23/lc7 100 1 2024-03-17T23:58:36.058 INFO:tasks.workunit.client.0.smithi196.stdout:9/721: sync 2024-03-17T23:58:36.059 INFO:tasks.workunit.client.0.smithi196.stdout:9/722: write d9/df/fc4 [695729,63521] 0 2024-03-17T23:58:36.073 INFO:tasks.workunit.client.0.smithi196.stdout:9/723: dwrite d9/df/d14/d27/fa6 [0,4194304] 0 2024-03-17T23:58:36.126 INFO:tasks.workunit.client.0.smithi196.stdout:0/901: sync 2024-03-17T23:58:36.127 INFO:tasks.workunit.client.0.smithi196.stdout:4/687: sync 2024-03-17T23:58:36.127 INFO:tasks.workunit.client.0.smithi196.stdout:8/586: sync 2024-03-17T23:58:36.127 INFO:tasks.workunit.client.0.smithi196.stdout:5/839: sync 2024-03-17T23:58:36.127 INFO:tasks.workunit.client.0.smithi196.stdout:6/830: sync 2024-03-17T23:58:36.127 INFO:tasks.workunit.client.0.smithi196.stdout:7/892: sync 2024-03-17T23:58:36.127 INFO:tasks.workunit.client.0.smithi196.stdout:1/676: sync 2024-03-17T23:58:36.132 INFO:tasks.workunit.client.0.smithi196.stdout:7/893: fsync da/d3e/d7f/fbc 0 2024-03-17T23:58:36.132 INFO:tasks.workunit.client.0.smithi196.stdout:6/831: write d2/f3e [2007439,100087] 0 2024-03-17T23:58:36.132 INFO:tasks.workunit.client.0.smithi196.stdout:1/677: fsync d1/db/fe 0 2024-03-17T23:58:36.132 INFO:tasks.workunit.client.0.smithi196.stdout:4/688: creat d1/d26/d8b/ff8 x:0 0 0 2024-03-17T23:58:36.132 INFO:tasks.workunit.client.0.smithi196.stdout:5/840: mkdir d6/d2d/d33/d84/d121 0 2024-03-17T23:58:36.134 INFO:tasks.workunit.client.0.smithi196.stdout:8/587: unlink de/d2b/d30/d33/l9e 0 2024-03-17T23:58:36.135 INFO:tasks.workunit.client.0.smithi196.stdout:4/689: truncate d1/d11/fa6 335343 0 2024-03-17T23:58:36.135 INFO:tasks.workunit.client.0.smithi196.stdout:6/832: rmdir d2/d14/d75/dc0 39 2024-03-17T23:58:36.136 INFO:tasks.workunit.client.0.smithi196.stdout:8/588: chown de/d2b/d30/d33/f48 2071731 1 2024-03-17T23:58:36.138 INFO:tasks.workunit.client.0.smithi196.stdout:7/894: rename da/d3e/fdb to da/d3e/d45/dd8/de4/f126 0 2024-03-17T23:58:36.142 INFO:tasks.workunit.client.0.smithi196.stdout:7/895: unlink da/d15/d1d/d2e/ff4 0 2024-03-17T23:58:36.143 INFO:tasks.workunit.client.0.smithi196.stdout:5/841: mknod d6/d2d/d33/c122 0 2024-03-17T23:58:36.144 INFO:tasks.workunit.client.0.smithi196.stdout:7/896: write da/f91 [738302,11620] 0 2024-03-17T23:58:36.145 INFO:tasks.workunit.client.0.smithi196.stdout:4/690: dread d1/d11/f1c [0,4194304] 0 2024-03-17T23:58:36.149 INFO:tasks.workunit.client.0.smithi196.stdout:1/678: dread d1/db/dd/fc9 [0,4194304] 0 2024-03-17T23:58:36.152 INFO:tasks.workunit.client.0.smithi196.stdout:7/897: mkdir da/d3e/d45/d4f/db4/d127 0 2024-03-17T23:58:36.152 INFO:tasks.workunit.client.0.smithi196.stdout:1/679: fdatasync d1/d13/d2a/d94/fc1 0 2024-03-17T23:58:36.152 INFO:tasks.workunit.client.0.smithi196.stdout:4/691: dread - d1/d26/d57/d8c/d97/fa8 zero size 2024-03-17T23:58:36.163 INFO:tasks.workunit.client.0.smithi196.stdout:5/842: dwrite d6/d15/fb6 [0,4194304] 0 2024-03-17T23:58:36.165 INFO:tasks.workunit.client.0.smithi196.stdout:8/589: dread de/d10/d35/d88/f9b [0,4194304] 0 2024-03-17T23:58:36.180 INFO:tasks.workunit.client.0.smithi196.stdout:8/590: dread de/d2b/d30/f73 [0,4194304] 0 2024-03-17T23:58:36.181 INFO:tasks.workunit.client.0.smithi196.stdout:4/692: mkdir d1/d68/df9 0 2024-03-17T23:58:36.182 INFO:tasks.workunit.client.0.smithi196.stdout:7/898: symlink da/d3e/d45/d4f/d75/da8/d78/d9f/l128 0 2024-03-17T23:58:36.184 INFO:tasks.workunit.client.0.smithi196.stdout:4/693: fdatasync d1/d26/d8b/de9/fa3 0 2024-03-17T23:58:36.186 INFO:tasks.workunit.client.0.smithi196.stdout:7/899: creat da/d3e/d45/d4f/d75/f129 x:0 0 0 2024-03-17T23:58:36.187 INFO:tasks.workunit.client.0.smithi196.stdout:4/694: mkdir d1/d11/d5d/dfa 0 2024-03-17T23:58:36.189 INFO:tasks.workunit.client.0.smithi196.stdout:5/843: creat d6/f123 x:0 0 0 2024-03-17T23:58:36.192 INFO:tasks.workunit.client.0.smithi196.stdout:7/900: dread da/d15/d1a/d5e/d70/dc5/fcb [0,4194304] 0 2024-03-17T23:58:36.195 INFO:tasks.workunit.client.0.smithi196.stdout:7/901: truncate da/d15/d1d/d29/f5a 2741774 0 2024-03-17T23:58:36.197 INFO:tasks.workunit.client.0.smithi196.stdout:5/844: unlink d6/d2d/d33/d3b/f5e 0 2024-03-17T23:58:36.198 INFO:tasks.workunit.client.0.smithi196.stdout:5/845: readlink d6/d17/d23/d53/l82 0 2024-03-17T23:58:36.200 INFO:tasks.workunit.client.0.smithi196.stdout:5/846: fdatasync d6/d2d/f93 0 2024-03-17T23:58:36.202 INFO:tasks.workunit.client.0.smithi196.stdout:5/847: creat d6/d17/d3f/d4e/d69/ded/f124 x:0 0 0 2024-03-17T23:58:36.207 INFO:tasks.workunit.client.0.smithi196.stdout:5/848: getdents d6/d17/d1f/d7d/d81 0 2024-03-17T23:58:36.208 INFO:tasks.workunit.client.0.smithi196.stdout:7/902: dread da/d15/d1d/d29/f5a [0,4194304] 0 2024-03-17T23:58:36.208 INFO:tasks.workunit.client.0.smithi196.stdout:5/849: write d6/fb [3817449,97546] 0 2024-03-17T23:58:36.210 INFO:tasks.workunit.client.0.smithi196.stdout:5/850: write d6/d15/fb6 [2603111,121794] 0 2024-03-17T23:58:36.217 INFO:tasks.workunit.client.0.smithi196.stdout:9/724: sync 2024-03-17T23:58:36.218 INFO:tasks.workunit.client.0.smithi196.stdout:8/591: truncate de/d2b/d3c/f6a 259064 0 2024-03-17T23:58:36.219 INFO:tasks.workunit.client.0.smithi196.stdout:9/725: rmdir d9/df/d14/db0 39 2024-03-17T23:58:36.219 INFO:tasks.workunit.client.0.smithi196.stdout:8/592: stat de/d10/d54/fa6 0 2024-03-17T23:58:36.223 INFO:tasks.workunit.client.0.smithi196.stdout:5/851: dwrite d6/d17/d23/d53/f54 [0,4194304] 0 2024-03-17T23:58:36.225 INFO:tasks.workunit.client.0.smithi196.stdout:8/593: chown de/d2b/d30/f90 11 1 2024-03-17T23:58:36.230 INFO:tasks.workunit.client.0.smithi196.stdout:5/852: creat d6/d17/d3f/d4e/d69/ded/f125 x:0 0 0 2024-03-17T23:58:36.230 INFO:tasks.workunit.client.0.smithi196.stdout:4/695: dwrite d1/f8a [0,4194304] 0 2024-03-17T23:58:36.232 INFO:tasks.workunit.client.0.smithi196.stdout:8/594: symlink de/d10/d35/lb5 0 2024-03-17T23:58:36.235 INFO:tasks.workunit.client.0.smithi196.stdout:7/903: dread da/d15/d1d/d29/f79 [0,4194304] 0 2024-03-17T23:58:36.235 INFO:tasks.workunit.client.0.smithi196.stdout:5/853: readlink d6/d2d/d33/l87 0 2024-03-17T23:58:36.243 INFO:tasks.workunit.client.0.smithi196.stdout:8/595: mknod de/d10/d54/cb6 0 2024-03-17T23:58:36.247 INFO:tasks.workunit.client.0.smithi196.stdout:7/904: mknod da/d3e/d45/d4f/d75/de7/c12a 0 2024-03-17T23:58:36.252 INFO:tasks.workunit.client.0.smithi196.stdout:7/905: write da/d3e/d45/d4f/d75/de7/f123 [986324,91134] 0 2024-03-17T23:58:36.252 INFO:tasks.workunit.client.0.smithi196.stdout:5/854: creat d6/d2d/d33/d3b/d65/f126 x:0 0 0 2024-03-17T23:58:36.259 INFO:tasks.workunit.client.0.smithi196.stdout:8/596: dwrite de/f2d [0,4194304] 0 2024-03-17T23:58:36.268 INFO:tasks.workunit.client.0.smithi196.stdout:9/726: dwrite d9/df/d14/d27/f4c [0,4194304] 0 2024-03-17T23:58:36.268 INFO:tasks.workunit.client.0.smithi196.stdout:7/906: write da/d15/d1a/d5e/da5/fc8 [1153262,55297] 0 2024-03-17T23:58:36.271 INFO:tasks.workunit.client.0.smithi196.stdout:4/696: dwrite d1/d26/d33/f5c [0,4194304] 0 2024-03-17T23:58:36.273 INFO:tasks.workunit.client.0.smithi196.stdout:8/597: unlink de/d2b/d3c/d5d/f79 0 2024-03-17T23:58:36.277 INFO:tasks.workunit.client.0.smithi196.stdout:8/598: chown de/d10/d35/d3e/d6c 3 1 2024-03-17T23:58:36.278 INFO:tasks.workunit.client.0.smithi196.stdout:5/855: dwrite d6/d17/d3f/d4e/f73 [0,4194304] 0 2024-03-17T23:58:36.280 INFO:tasks.workunit.client.0.smithi196.stdout:8/599: symlink de/d5e/lb7 0 2024-03-17T23:58:36.284 INFO:tasks.workunit.client.0.smithi196.stdout:8/600: fdatasync de/d10/d35/d3e/d6c/f80 0 2024-03-17T23:58:36.286 INFO:tasks.workunit.client.0.smithi196.stdout:8/601: dread de/f5b [0,4194304] 0 2024-03-17T23:58:36.294 INFO:tasks.workunit.client.0.smithi196.stdout:9/727: dwrite d9/f44 [0,4194304] 0 2024-03-17T23:58:36.301 INFO:tasks.workunit.client.0.smithi196.stdout:9/728: creat d9/df/d4a/d5b/d62/dba/d60/d85/fe4 x:0 0 0 2024-03-17T23:58:36.302 INFO:tasks.workunit.client.0.smithi196.stdout:8/602: truncate de/d10/d35/d3e/f4c 2156470 0 2024-03-17T23:58:36.308 INFO:tasks.workunit.client.0.smithi196.stdout:5/856: dread d6/d17/f34 [0,4194304] 0 2024-03-17T23:58:36.310 INFO:tasks.workunit.client.0.smithi196.stdout:9/729: write d9/df/d14/f2e [2827140,61907] 0 2024-03-17T23:58:36.313 INFO:tasks.workunit.client.0.smithi196.stdout:9/730: dread - d9/df/d4a/d5b/d62/dba/d60/fe2 zero size 2024-03-17T23:58:36.316 INFO:tasks.workunit.client.0.smithi196.stdout:8/603: dwrite de/d2b/d30/f7b [0,4194304] 0 2024-03-17T23:58:36.316 INFO:tasks.workunit.client.0.smithi196.stdout:9/731: mkdir d9/dbb/de5 0 2024-03-17T23:58:36.325 INFO:tasks.workunit.client.0.smithi196.stdout:9/732: rename d9/df/d4a/d5b/da5/fb6 to d9/df/d4a/d5b/d62/dba/fe6 0 2024-03-17T23:58:36.335 INFO:tasks.workunit.client.0.smithi196.stdout:8/604: dread de/d2b/f38 [0,4194304] 0 2024-03-17T23:58:36.337 INFO:tasks.workunit.client.0.smithi196.stdout:8/605: chown de/d10/d54/d5c/daa/c66 306025 1 2024-03-17T23:58:36.339 INFO:tasks.workunit.client.0.smithi196.stdout:8/606: symlink de/d2b/d3c/lb8 0 2024-03-17T23:58:36.341 INFO:tasks.workunit.client.0.smithi196.stdout:8/607: mkdir de/d10/d35/d88/d93/db9 0 2024-03-17T23:58:36.346 INFO:tasks.workunit.client.0.smithi196.stdout:8/608: write de/d2b/d30/f3a [601583,3281] 0 2024-03-17T23:58:36.350 INFO:tasks.workunit.client.0.smithi196.stdout:9/733: dread d9/df/d14/f5c [0,4194304] 0 2024-03-17T23:58:36.352 INFO:tasks.workunit.client.0.smithi196.stdout:8/609: dread de/d10/d35/d3e/f8d [0,4194304] 0 2024-03-17T23:58:36.352 INFO:tasks.workunit.client.0.smithi196.stdout:9/734: chown d9/df/d14/db0/fc6 5327 1 2024-03-17T23:58:36.353 INFO:tasks.workunit.client.0.smithi196.stdout:9/735: chown d9/df/fc4 41 1 2024-03-17T23:58:36.353 INFO:tasks.workunit.client.0.smithi196.stdout:8/610: write de/d10/d35/d3e/f97 [3682273,25016] 0 2024-03-17T23:58:36.356 INFO:tasks.workunit.client.0.smithi196.stdout:9/736: creat d9/df/d4a/d8c/fe7 x:0 0 0 2024-03-17T23:58:36.358 INFO:tasks.workunit.client.0.smithi196.stdout:9/737: chown d9/df/d4a/d5b/d62/dba/d60/d5e/f56 82011 1 2024-03-17T23:58:36.360 INFO:tasks.workunit.client.0.smithi196.stdout:9/738: creat d9/df/d4a/fe8 x:0 0 0 2024-03-17T23:58:36.361 INFO:tasks.workunit.client.0.smithi196.stdout:8/611: truncate de/d2b/f47 2234849 0 2024-03-17T23:58:36.364 INFO:tasks.workunit.client.0.smithi196.stdout:9/739: getdents d9/df/d4a/d5b/d62/dba/d60 0 2024-03-17T23:58:36.367 INFO:tasks.workunit.client.0.smithi196.stdout:9/740: dread d9/df/d14/f5c [0,4194304] 0 2024-03-17T23:58:36.369 INFO:tasks.workunit.client.0.smithi196.stdout:0/902: sync 2024-03-17T23:58:36.369 INFO:tasks.workunit.client.0.smithi196.stdout:9/741: creat d9/dbb/fe9 x:0 0 0 2024-03-17T23:58:36.370 INFO:tasks.workunit.client.0.smithi196.stdout:0/903: write d5/d23/d24/d30/d4e/f8c [4931801,58301] 0 2024-03-17T23:58:36.375 INFO:tasks.workunit.client.0.smithi196.stdout:0/904: rename d5/f10 to d5/d23/d24/d28/d47/d52/d61/f114 0 2024-03-17T23:58:36.409 INFO:tasks.workunit.client.0.smithi196.stdout:0/905: mkdir d5/d23/d24/d28/d47/d115 0 2024-03-17T23:58:36.420 INFO:tasks.workunit.client.0.smithi196.stdout:9/742: dwrite d9/df/d14/d27/f31 [0,4194304] 0 2024-03-17T23:58:36.425 INFO:tasks.workunit.client.0.smithi196.stdout:0/906: dwrite d5/d23/d24/d28/dc9/ffe [0,4194304] 0 2024-03-17T23:58:36.425 INFO:tasks.workunit.client.0.smithi196.stdout:9/743: write d9/f8a [810200,786] 0 2024-03-17T23:58:36.430 INFO:tasks.workunit.client.0.smithi196.stdout:0/907: mknod d5/d23/d24/d59/c116 0 2024-03-17T23:58:36.430 INFO:tasks.workunit.client.0.smithi196.stdout:9/744: rmdir d9/df/d4a/d5b 39 2024-03-17T23:58:36.435 INFO:tasks.workunit.client.0.smithi196.stdout:0/908: link d5/d23/d24/d72/f8e d5/d23/d85/de7/f117 0 2024-03-17T23:58:36.437 INFO:tasks.workunit.client.0.smithi196.stdout:0/909: mkdir d5/d23/d24/d28/d47/d118 0 2024-03-17T23:58:36.440 INFO:tasks.workunit.client.0.smithi196.stdout:0/910: creat d5/d23/d24/d111/f119 x:0 0 0 2024-03-17T23:58:36.450 INFO:tasks.workunit.client.0.smithi196.stdout:9/745: dread d9/df/d4a/d5b/d62/dba/d60/d85/d8e/fb8 [0,4194304] 0 2024-03-17T23:58:36.451 INFO:tasks.workunit.client.0.smithi196.stdout:0/911: dwrite d5/d23/f4a [4194304,4194304] 0 2024-03-17T23:58:36.455 INFO:tasks.workunit.client.0.smithi196.stdout:0/912: mknod d5/d23/d24/d28/d47/d52/d49/df8/c11a 0 2024-03-17T23:58:36.457 INFO:tasks.workunit.client.0.smithi196.stdout:9/746: dread d9/df/d14/d27/f4c [0,4194304] 0 2024-03-17T23:58:36.457 INFO:tasks.workunit.client.0.smithi196.stdout:0/913: chown d5/d23/d24/l38 0 1 2024-03-17T23:58:36.458 INFO:tasks.workunit.client.0.smithi196.stdout:0/914: chown d5/d23/d24/d30/fec 974447 1 2024-03-17T23:58:36.463 INFO:tasks.workunit.client.0.smithi196.stdout:9/747: dread d9/df/d14/f72 [0,4194304] 0 2024-03-17T23:58:36.463 INFO:tasks.workunit.client.0.smithi196.stdout:9/748: stat d9/l37 0 2024-03-17T23:58:36.464 INFO:tasks.workunit.client.0.smithi196.stdout:9/749: dread - d9/f9a zero size 2024-03-17T23:58:36.471 INFO:tasks.workunit.client.0.smithi196.stdout:0/915: dwrite d5/d23/d24/da3/dbb/fd5 [0,4194304] 0 2024-03-17T23:58:36.477 INFO:tasks.workunit.client.0.smithi196.stdout:0/916: link d5/d23/d24/d59/d94/ldb d5/d23/d24/d30/d104/l11b 0 2024-03-17T23:58:36.481 INFO:tasks.workunit.client.0.smithi196.stdout:0/917: creat d5/d23/d24/d28/d47/d52/d61/d6c/f11c x:0 0 0 2024-03-17T23:58:36.482 INFO:tasks.workunit.client.0.smithi196.stdout:0/918: chown d5/d23/d24/d59/de6/lfc 2221991 1 2024-03-17T23:58:36.483 INFO:tasks.workunit.client.0.smithi196.stdout:0/919: stat d5/cbf 0 2024-03-17T23:58:36.485 INFO:tasks.workunit.client.0.smithi196.stdout:0/920: symlink d5/d23/d24/d59/l11d 0 2024-03-17T23:58:36.486 INFO:tasks.workunit.client.0.smithi196.stdout:9/750: dread d9/df/d4a/d5b/d62/dba/d60/f90 [0,4194304] 0 2024-03-17T23:58:36.488 INFO:tasks.workunit.client.0.smithi196.stdout:0/921: read d5/d23/d24/d28/f26 [2796422,68671] 0 2024-03-17T23:58:36.488 INFO:tasks.workunit.client.0.smithi196.stdout:9/751: creat d9/df/d4a/d5b/d62/dba/d60/d5e/fea x:0 0 0 2024-03-17T23:58:36.489 INFO:tasks.workunit.client.0.smithi196.stdout:0/922: truncate d5/f106 447292 0 2024-03-17T23:58:36.492 INFO:tasks.workunit.client.0.smithi196.stdout:0/923: symlink d5/d23/d24/d28/d47/d52/d61/d6c/d82/l11e 0 2024-03-17T23:58:36.493 INFO:tasks.workunit.client.0.smithi196.stdout:0/924: chown d5/d23/d24/d28/d47/d52/d49/df8/c11a 1908775 1 2024-03-17T23:58:36.499 INFO:tasks.workunit.client.0.smithi196.stdout:9/752: truncate f5 4704536 0 2024-03-17T23:58:36.501 INFO:tasks.workunit.client.0.smithi196.stdout:9/753: symlink d9/leb 0 2024-03-17T23:58:36.501 INFO:tasks.workunit.client.0.smithi196.stdout:0/925: write d5/d23/d24/d59/d8b/f6a [674439,66713] 0 2024-03-17T23:58:36.505 INFO:tasks.workunit.client.0.smithi196.stdout:0/926: getdents d5/d23/d24/d59/d8b 0 2024-03-17T23:58:36.508 INFO:tasks.workunit.client.0.smithi196.stdout:9/754: truncate d9/f8a 4009304 0 2024-03-17T23:58:36.510 INFO:tasks.workunit.client.0.smithi196.stdout:0/927: unlink d5/d23/d24/d28/d47/d52/d61/d6c/df0/lf3 0 2024-03-17T23:58:36.517 INFO:tasks.workunit.client.0.smithi196.stdout:0/928: dwrite d5/f106 [0,4194304] 0 2024-03-17T23:58:36.524 INFO:tasks.workunit.client.0.smithi196.stdout:0/929: link d5/d23/d24/d30/d4e/fdc d5/d23/d24/d28/d47/f11f 0 2024-03-17T23:58:36.525 INFO:tasks.workunit.client.0.smithi196.stdout:0/930: fdatasync d5/d23/d24/d28/d47/d52/f7e 0 2024-03-17T23:58:36.531 INFO:tasks.workunit.client.0.smithi196.stdout:0/931: dread d5/d23/d24/d72/f8e [0,4194304] 0 2024-03-17T23:58:36.543 INFO:tasks.workunit.client.0.smithi196.stdout:6/833: sync 2024-03-17T23:58:36.544 INFO:tasks.workunit.client.0.smithi196.stdout:0/932: dread d5/d23/d24/fb6 [0,4194304] 0 2024-03-17T23:58:36.547 INFO:tasks.workunit.client.0.smithi196.stdout:0/933: creat d5/d23/d24/d59/d8b/f120 x:0 0 0 2024-03-17T23:58:36.548 INFO:tasks.workunit.client.0.smithi196.stdout:0/934: chown d5/d23/d24/d28/d47/d52/d61/lc3 70527089 1 2024-03-17T23:58:36.551 INFO:tasks.workunit.client.0.smithi196.stdout:0/935: chown d5/d23/d24/d59/de6/cee 643643173 1 2024-03-17T23:58:36.552 INFO:tasks.workunit.client.0.smithi196.stdout:6/834: write d2/d14/d75/dc0/f10b [69959,33051] 0 2024-03-17T23:58:36.555 INFO:tasks.workunit.client.0.smithi196.stdout:0/936: creat d5/d23/d24/d28/d47/d52/d49/f121 x:0 0 0 2024-03-17T23:58:36.555 INFO:tasks.workunit.client.0.smithi196.stdout:6/835: rmdir d2/d14/d75/dc0/ddf/de6/dd9/de5 39 2024-03-17T23:58:36.556 INFO:tasks.workunit.client.0.smithi196.stdout:0/937: mknod d5/d23/c122 0 2024-03-17T23:58:36.559 INFO:tasks.workunit.client.0.smithi196.stdout:0/938: unlink d5/d23/d24/d59/de6/lea 0 2024-03-17T23:58:36.561 INFO:tasks.workunit.client.0.smithi196.stdout:0/939: fdatasync d5/d23/d24/d59/d94/fb1 0 2024-03-17T23:58:36.563 INFO:tasks.workunit.client.0.smithi196.stdout:0/940: mknod d5/c123 0 2024-03-17T23:58:36.564 INFO:tasks.workunit.client.0.smithi196.stdout:0/941: chown d5/d23/lc7 658 1 2024-03-17T23:58:36.569 INFO:tasks.workunit.client.0.smithi196.stdout:6/836: dread d2/d7/d2b/f84 [0,4194304] 0 2024-03-17T23:58:36.574 INFO:tasks.workunit.client.0.smithi196.stdout:0/942: dwrite d5/f64 [0,4194304] 0 2024-03-17T23:58:36.583 INFO:tasks.workunit.client.0.smithi196.stdout:0/943: dwrite d5/d23/d24/d111/f119 [0,4194304] 0 2024-03-17T23:58:36.587 INFO:tasks.workunit.client.0.smithi196.stdout:0/944: unlink d5/d23/d24/d28/d47/d52/d61/lc3 0 2024-03-17T23:58:36.588 INFO:tasks.workunit.client.0.smithi196.stdout:0/945: chown d5/d23/fb7 19 1 2024-03-17T23:58:36.590 INFO:tasks.workunit.client.0.smithi196.stdout:6/837: dread d2/d14/d75/d7b/f6f [4194304,4194304] 0 2024-03-17T23:58:36.591 INFO:tasks.workunit.client.0.smithi196.stdout:0/946: read d5/d23/d24/d28/d47/d52/f42 [1015912,34668] 0 2024-03-17T23:58:36.593 INFO:tasks.workunit.client.0.smithi196.stdout:6/838: truncate d2/d14/d75/d7b/d9e/fe4 496727 0 2024-03-17T23:58:36.595 INFO:tasks.workunit.client.0.smithi196.stdout:6/839: read d2/d66/d90/fab [1086515,53974] 0 2024-03-17T23:58:36.596 INFO:tasks.workunit.client.0.smithi196.stdout:0/947: creat d5/d23/d24/d28/d47/d52/d49/d10f/f124 x:0 0 0 2024-03-17T23:58:36.599 INFO:tasks.workunit.client.0.smithi196.stdout:6/840: dread d2/d14/d75/d7b/d9e/fe4 [0,4194304] 0 2024-03-17T23:58:36.601 INFO:tasks.workunit.client.0.smithi196.stdout:0/948: rename d5/d23/d24/d28/d47/d52/dac/ld8 to d5/d23/d24/d28/d47/d115/l125 0 2024-03-17T23:58:36.601 INFO:tasks.workunit.client.0.smithi196.stdout:6/841: rmdir d2/d14/d75/d7b/d9e 39 2024-03-17T23:58:36.603 INFO:tasks.workunit.client.0.smithi196.stdout:6/842: write d2/d14/d42/d57/dc8/f87 [3953813,50761] 0 2024-03-17T23:58:36.605 INFO:tasks.workunit.client.0.smithi196.stdout:0/949: creat d5/d23/d24/d28/d47/d52/d61/d6c/d100/f126 x:0 0 0 2024-03-17T23:58:36.615 INFO:tasks.workunit.client.0.smithi196.stdout:0/950: write d5/d23/f74 [671359,84989] 0 2024-03-17T23:58:36.619 INFO:tasks.workunit.client.0.smithi196.stdout:0/951: getdents d5/d23/d24/d59/d94/db5 0 2024-03-17T23:58:36.620 INFO:tasks.workunit.client.0.smithi196.stdout:6/843: dwrite d2/d14/d42/f8f [0,4194304] 0 2024-03-17T23:58:36.623 INFO:tasks.workunit.client.0.smithi196.stdout:6/844: rmdir d2/d14/d50 39 2024-03-17T23:58:36.628 INFO:tasks.workunit.client.0.smithi196.stdout:6/845: write d2/f45 [2263633,79911] 0 2024-03-17T23:58:36.630 INFO:tasks.workunit.client.0.smithi196.stdout:6/846: readlink d2/d14/d42/d57/led 0 2024-03-17T23:58:36.635 INFO:tasks.workunit.client.0.smithi196.stdout:6/847: getdents d2/d7/dcd 0 2024-03-17T23:58:36.635 INFO:tasks.workunit.client.0.smithi196.stdout:6/848: readlink d2/d14/d75/d7b/l13 0 2024-03-17T23:58:36.636 INFO:tasks.workunit.client.0.smithi196.stdout:0/952: dread d5/d23/d24/f5f [0,4194304] 0 2024-03-17T23:58:36.639 INFO:tasks.workunit.client.0.smithi196.stdout:6/849: symlink d2/d14/d75/d7b/l127 0 2024-03-17T23:58:36.640 INFO:tasks.workunit.client.0.smithi196.stdout:0/953: write d5/d23/d24/d28/f2e [262485,42703] 0 2024-03-17T23:58:36.642 INFO:tasks.workunit.client.0.smithi196.stdout:6/850: mkdir d2/d14/d42/d57/d5f/d128 0 2024-03-17T23:58:36.643 INFO:tasks.workunit.client.0.smithi196.stdout:0/954: unlink d5/d23/d24/d28/d47/d52/d49/ff4 0 2024-03-17T23:58:36.646 INFO:tasks.workunit.client.0.smithi196.stdout:6/851: fdatasync d2/fbc 0 2024-03-17T23:58:36.652 INFO:tasks.workunit.client.0.smithi196.stdout:0/955: rename d5/f1c to d5/d23/d24/d28/d47/d52/d61/d6c/f127 0 2024-03-17T23:58:36.652 INFO:tasks.workunit.client.0.smithi196.stdout:6/852: dread d2/d14/d42/d57/dc8/f10d [0,4194304] 0 2024-03-17T23:58:36.658 INFO:tasks.workunit.client.0.smithi196.stdout:6/853: dread d2/d14/d42/d57/dc8/db3/f11c [0,4194304] 0 2024-03-17T23:58:36.659 INFO:tasks.workunit.client.0.smithi196.stdout:6/854: stat d2/d14/d8c/f98 0 2024-03-17T23:58:36.660 INFO:tasks.workunit.client.0.smithi196.stdout:0/956: dread d5/d23/d24/d28/d47/f11f [0,4194304] 0 2024-03-17T23:58:36.661 INFO:tasks.workunit.client.0.smithi196.stdout:6/855: write d2/d14/d75/dc0/ddf/da1/f109 [1998783,84111] 0 2024-03-17T23:58:36.663 INFO:tasks.workunit.client.0.smithi196.stdout:0/957: creat d5/d23/d24/d59/de6/f128 x:0 0 0 2024-03-17T23:58:36.667 INFO:tasks.workunit.client.0.smithi196.stdout:0/958: dread d5/d23/d24/d59/d94/fc8 [0,4194304] 0 2024-03-17T23:58:36.669 INFO:tasks.workunit.client.0.smithi196.stdout:0/959: unlink d5/d23/d24/d30/f90 0 2024-03-17T23:58:36.671 INFO:tasks.workunit.client.0.smithi196.stdout:0/960: mkdir d5/d23/d24/d30/d104/d129 0 2024-03-17T23:58:36.672 INFO:tasks.workunit.client.0.smithi196.stdout:0/961: creat d5/f12a x:0 0 0 2024-03-17T23:58:36.673 INFO:tasks.workunit.client.0.smithi196.stdout:0/962: stat d5/d23/d24/d28/d47/d52/d49/df8 0 2024-03-17T23:58:36.674 INFO:tasks.workunit.client.0.smithi196.stdout:0/963: chown d5/d23/d24/d72 0 1 2024-03-17T23:58:36.675 INFO:tasks.workunit.client.0.smithi196.stdout:0/964: chown d5/d23/d24/d28/d47/d52/d49/df8/c11a 3493163 1 2024-03-17T23:58:36.677 INFO:tasks.workunit.client.0.smithi196.stdout:0/965: mknod d5/d23/d24/d28/d47/d52/d61/c12b 0 2024-03-17T23:58:36.678 INFO:tasks.workunit.client.0.smithi196.stdout:0/966: symlink d5/d23/d24/d59/d94/db5/l12c 0 2024-03-17T23:58:36.680 INFO:tasks.workunit.client.0.smithi196.stdout:0/967: symlink d5/d23/d24/d59/d8b/de4/l12d 0 2024-03-17T23:58:36.681 INFO:tasks.workunit.client.0.smithi196.stdout:0/968: readlink d5/d23/d24/da3/lfb 0 2024-03-17T23:58:36.684 INFO:tasks.workunit.client.0.smithi196.stdout:0/969: link d5/d23/d24/d30/cbd d5/d23/d24/d30/d110/c12e 0 2024-03-17T23:58:36.692 INFO:tasks.workunit.client.0.smithi196.stdout:0/970: dwrite d5/fb8 [0,4194304] 0 2024-03-17T23:58:36.698 INFO:tasks.workunit.client.0.smithi196.stdout:0/971: fsync d5/d23/d24/f5e 0 2024-03-17T23:58:36.732 INFO:tasks.workunit.client.0.smithi196.stdout:1/680: sync 2024-03-17T23:58:36.738 INFO:tasks.workunit.client.0.smithi196.stdout:1/681: write d1/db/dd/f12 [3396456,9554] 0 2024-03-17T23:58:36.742 INFO:tasks.workunit.client.0.smithi196.stdout:1/682: creat d1/d13/d23/fdf x:0 0 0 2024-03-17T23:58:36.743 INFO:tasks.workunit.client.0.smithi196.stdout:0/972: dwrite d5/d23/d24/d72/f8e [0,4194304] 0 2024-03-17T23:58:36.744 INFO:tasks.workunit.client.0.smithi196.stdout:1/683: write d1/d13/d2a/d94/fc1 [813159,65545] 0 2024-03-17T23:58:36.746 INFO:tasks.workunit.client.0.smithi196.stdout:0/973: chown d5/d23/d24/c8f 849 1 2024-03-17T23:58:36.749 INFO:tasks.workunit.client.0.smithi196.stdout:1/684: creat d1/d13/d23/d47/d48/d74/db2/d75/fe0 x:0 0 0 2024-03-17T23:58:36.752 INFO:tasks.workunit.client.0.smithi196.stdout:0/974: rename d5/d23/lc7 to d5/d23/d24/d59/d94/l12f 0 2024-03-17T23:58:36.753 INFO:tasks.workunit.client.0.smithi196.stdout:1/685: creat d1/d13/d2a/d94/fe1 x:0 0 0 2024-03-17T23:58:36.758 INFO:tasks.workunit.client.0.smithi196.stdout:0/975: rename d5/d23/d24/d28/dc9/fd9 to d5/f130 0 2024-03-17T23:58:36.759 INFO:tasks.workunit.client.0.smithi196.stdout:1/686: dread d1/d13/d23/f37 [0,4194304] 0 2024-03-17T23:58:36.761 INFO:tasks.workunit.client.0.smithi196.stdout:0/976: creat d5/d23/d85/dce/f131 x:0 0 0 2024-03-17T23:58:36.761 INFO:tasks.workunit.client.0.smithi196.stdout:1/687: truncate d1/db/dd/d34/f42 821412 0 2024-03-17T23:58:36.762 INFO:tasks.workunit.client.0.smithi196.stdout:1/688: chown d1/f8 23098 1 2024-03-17T23:58:36.762 INFO:tasks.workunit.client.0.smithi196.stdout:0/977: rmdir d5/d23/d24/da3/dbb 39 2024-03-17T23:58:36.764 INFO:tasks.workunit.client.0.smithi196.stdout:0/978: write d5/d23/d24/d28/dc9/ffe [972913,109193] 0 2024-03-17T23:58:36.767 INFO:tasks.workunit.client.0.smithi196.stdout:1/689: rename d1/d13/d2a/cb8 to d1/d13/d23/ce2 0 2024-03-17T23:58:36.768 INFO:tasks.workunit.client.0.smithi196.stdout:0/979: truncate d5/d23/d24/d28/d47/d52/f7e 1330350 0 2024-03-17T23:58:36.768 INFO:tasks.workunit.client.0.smithi196.stdout:1/690: dread - d1/d13/d23/d47/d48/fbc zero size 2024-03-17T23:58:36.774 INFO:tasks.workunit.client.0.smithi196.stdout:1/691: link d1/d13/d2a/c7f d1/d13/d23/d70/ce3 0 2024-03-17T23:58:36.777 INFO:tasks.workunit.client.0.smithi196.stdout:1/692: rename d1/db/dd/d43/c77 to d1/d13/d23/d47/d48/d74/db2/ce4 0 2024-03-17T23:58:36.779 INFO:tasks.workunit.client.0.smithi196.stdout:1/693: rmdir d1/d13/d23/d47/d48/d74/db2 39 2024-03-17T23:58:36.781 INFO:tasks.workunit.client.0.smithi196.stdout:1/694: mkdir d1/db/de5 0 2024-03-17T23:58:36.784 INFO:tasks.workunit.client.0.smithi196.stdout:1/695: mkdir d1/d13/d23/d62/d71/de6 0 2024-03-17T23:58:36.785 INFO:tasks.workunit.client.0.smithi196.stdout:1/696: chown d1/db/f1f 33 1 2024-03-17T23:58:36.785 INFO:tasks.workunit.client.0.smithi196.stdout:1/697: readlink d1/d13/d23/d62/d71/lae 0 2024-03-17T23:58:36.793 INFO:tasks.workunit.client.0.smithi196.stdout:1/698: write d1/d13/d23/f37 [1271822,58692] 0 2024-03-17T23:58:36.797 INFO:tasks.workunit.client.0.smithi196.stdout:1/699: creat d1/db/de5/fe7 x:0 0 0 2024-03-17T23:58:36.799 INFO:tasks.workunit.client.0.smithi196.stdout:1/700: chown d1/db/dd/d34/f8a 996 1 2024-03-17T23:58:36.801 INFO:tasks.workunit.client.0.smithi196.stdout:1/701: write d1/d13/d23/d47/d48/fcf [1492805,124608] 0 2024-03-17T23:58:36.802 INFO:tasks.workunit.client.0.smithi196.stdout:1/702: chown d1/d13/d4c/dcd 7253457 1 2024-03-17T23:58:36.803 INFO:tasks.workunit.client.0.smithi196.stdout:1/703: stat d1/d13/d23/d47/d48/d74 0 2024-03-17T23:58:36.803 INFO:tasks.workunit.client.0.smithi196.stdout:1/704: write d1/db/fe [3083098,9396] 0 2024-03-17T23:58:36.808 INFO:tasks.workunit.client.0.smithi196.stdout:1/705: getdents d1/d13/d2a 0 2024-03-17T23:58:36.810 INFO:tasks.workunit.client.0.smithi196.stdout:1/706: read - d1/d13/d23/d47/d48/d74/db2/d75/fe0 zero size 2024-03-17T23:58:36.815 INFO:tasks.workunit.client.0.smithi196.stdout:1/707: write d1/db/dd/d34/f7a [365306,106692] 0 2024-03-17T23:58:36.816 INFO:tasks.workunit.client.0.smithi196.stdout:1/708: creat d1/d13/d4c/fe8 x:0 0 0 2024-03-17T23:58:36.818 INFO:tasks.workunit.client.0.smithi196.stdout:1/709: mkdir d1/d13/d91/de9 0 2024-03-17T23:58:36.819 INFO:tasks.workunit.client.0.smithi196.stdout:1/710: chown d1/d13/d23/d47/d48/f80 60741 1 2024-03-17T23:58:36.823 INFO:tasks.workunit.client.0.smithi196.stdout:1/711: link d1/d13/d4c/fe8 d1/d13/d23/d62/dab/dca/fea 0 2024-03-17T23:58:36.823 INFO:tasks.workunit.client.0.smithi196.stdout:1/712: dread - d1/d13/d2a/d94/fbb zero size 2024-03-17T23:58:36.826 INFO:tasks.workunit.client.0.smithi196.stdout:1/713: rename d1/d13/d23/d47/d48/l66 to d1/db/dd/d43/leb 0 2024-03-17T23:58:36.832 INFO:tasks.workunit.client.0.smithi196.stdout:1/714: write d1/d13/d23/d70/fa8 [865059,80542] 0 2024-03-17T23:58:36.839 INFO:tasks.workunit.client.0.smithi196.stdout:1/715: dwrite d1/d13/d23/d47/d48/fcf [0,4194304] 0 2024-03-17T23:58:36.847 INFO:tasks.workunit.client.0.smithi196.stdout:1/716: dwrite d1/db/dd/f12 [0,4194304] 0 2024-03-17T23:58:36.853 INFO:tasks.workunit.client.0.smithi196.stdout:1/717: unlink d1/d13/f41 0 2024-03-17T23:58:36.863 INFO:tasks.workunit.client.0.smithi196.stdout:1/718: dwrite d1/d13/d4c/fe8 [0,4194304] 0 2024-03-17T23:58:36.872 INFO:tasks.workunit.client.0.smithi196.stdout:1/719: dwrite d1/d13/d23/f49 [0,4194304] 0 2024-03-17T23:58:36.878 INFO:tasks.workunit.client.0.smithi196.stdout:1/720: dread d1/d13/d23/d47/d48/d74/db2/d75/f7d [0,4194304] 0 2024-03-17T23:58:36.881 INFO:tasks.workunit.client.0.smithi196.stdout:1/721: unlink d1/f4d 0 2024-03-17T23:58:36.883 INFO:tasks.workunit.client.0.smithi196.stdout:1/722: creat d1/d13/d23/d47/d48/d74/db2/fec x:0 0 0 2024-03-17T23:58:36.885 INFO:tasks.workunit.client.0.smithi196.stdout:7/907: sync 2024-03-17T23:58:36.887 INFO:tasks.workunit.client.0.smithi196.stdout:1/723: rename d1/db/de5 to d1/d13/d23/d62/dab/ded 0 2024-03-17T23:58:36.888 INFO:tasks.workunit.client.0.smithi196.stdout:1/724: write d1/d13/f3b [3872392,27492] 0 2024-03-17T23:58:36.889 INFO:tasks.workunit.client.0.smithi196.stdout:7/908: link da/d15/da7/d93/l119 da/d3e/d45/d4f/d75/l12b 0 2024-03-17T23:58:36.912 INFO:tasks.workunit.client.0.smithi196.stdout:1/725: mknod d1/d13/d4c/cee 0 2024-03-17T23:58:36.915 INFO:tasks.workunit.client.0.smithi196.stdout:1/726: rename d1/d13/d23/d62/d71/c81 to d1/d13/d4c/cef 0 2024-03-17T23:58:36.918 INFO:tasks.workunit.client.0.smithi196.stdout:1/727: creat d1/db/ff0 x:0 0 0 2024-03-17T23:58:36.919 INFO:tasks.workunit.client.0.smithi196.stdout:1/728: dread - d1/d13/d23/d62/dab/dca/fd7 zero size 2024-03-17T23:58:36.924 INFO:tasks.workunit.client.0.smithi196.stdout:1/729: mkdir d1/db/dd/df1 0 2024-03-17T23:58:36.927 INFO:tasks.workunit.client.0.smithi196.stdout:7/909: dwrite da/d15/d1d/f23 [0,4194304] 0 2024-03-17T23:58:36.929 INFO:tasks.workunit.client.0.smithi196.stdout:1/730: link d1/d13/d4c/da0/cac d1/d13/d2a/d94/cf2 0 2024-03-17T23:58:36.929 INFO:tasks.workunit.client.0.smithi196.stdout:1/731: stat d1/db/c97 0 2024-03-17T23:58:36.930 INFO:tasks.workunit.client.0.smithi196.stdout:7/910: symlink da/l12c 0 2024-03-17T23:58:36.933 INFO:tasks.workunit.client.0.smithi196.stdout:7/911: mkdir da/d15/d1d/d2e/d12d 0 2024-03-17T23:58:36.934 INFO:tasks.workunit.client.0.smithi196.stdout:7/912: chown da/d3e/d45/dd8 0 1 2024-03-17T23:58:36.936 INFO:tasks.workunit.client.0.smithi196.stdout:7/913: fdatasync da/d3e/d7f/fe2 0 2024-03-17T23:58:36.938 INFO:tasks.workunit.client.0.smithi196.stdout:1/732: dwrite d1/d13/d4c/fe8 [0,4194304] 0 2024-03-17T23:58:36.945 INFO:tasks.workunit.client.0.smithi196.stdout:1/733: dread d1/d13/d2a/d94/fc1 [0,4194304] 0 2024-03-17T23:58:36.952 INFO:tasks.workunit.client.0.smithi196.stdout:1/734: write d1/db/dd/f56 [730919,79912] 0 2024-03-17T23:58:36.955 INFO:tasks.workunit.client.0.smithi196.stdout:7/914: dread da/d15/f8c [0,4194304] 0 2024-03-17T23:58:36.957 INFO:tasks.workunit.client.0.smithi196.stdout:7/915: mknod da/d15/d1a/d5e/d70/c12e 0 2024-03-17T23:58:36.964 INFO:tasks.workunit.client.0.smithi196.stdout:7/916: dwrite da/fa6 [0,4194304] 0 2024-03-17T23:58:36.969 INFO:tasks.workunit.client.0.smithi196.stdout:7/917: write da/d15/f17 [3351996,7285] 0 2024-03-17T23:58:36.972 INFO:tasks.workunit.client.0.smithi196.stdout:7/918: mknod da/d3e/d45/d4f/d75/da8/d117/c12f 0 2024-03-17T23:58:36.974 INFO:tasks.workunit.client.0.smithi196.stdout:7/919: rename da/d3e/d45/d4f/dda to da/d3e/d45/d4f/d75/d130 0 2024-03-17T23:58:36.975 INFO:tasks.workunit.client.0.smithi196.stdout:7/920: fsync da/d3e/d45/d4f/d75/da8/ff8 0 2024-03-17T23:58:36.976 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T23:58:36.977 INFO:tasks.workunit.client.0.smithi196.stdout:7/921: rmdir da/d15/d1d/d29/dc4 39 2024-03-17T23:58:36.978 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T23:58:36.980 INFO:tasks.workunit.client.0.smithi196.stdout:7/922: fdatasync da/d15/d1d/f3f 0 2024-03-17T23:58:36.985 INFO:tasks.workunit.client.0.smithi196.stdout:7/923: link da/d15/cca da/d3e/d45/dd8/c131 0 2024-03-17T23:58:36.988 INFO:tasks.workunit.client.0.smithi196.stdout:7/924: rename da/d15/fc0 to da/d15/d1a/d5e/d70/f132 0 2024-03-17T23:58:36.989 INFO:tasks.workunit.client.0.smithi196.stdout:7/925: chown da/d15/d1d/d2e/fb6 123 1 2024-03-17T23:58:36.993 INFO:tasks.workunit.client.0.smithi196.stdout:7/926: getdents da/d3e/d45/d4f/d75/d130 0 2024-03-17T23:58:36.996 INFO:tasks.workunit.client.0.smithi196.stdout:7/927: symlink da/d3e/ddc/dff/ddf/l133 0 2024-03-17T23:58:37.000 INFO:tasks.workunit.client.0.smithi196.stdout:7/928: getdents da/d15/d1d/d29/d113 0 2024-03-17T23:58:37.004 INFO:tasks.workunit.client.0.smithi196.stdout:7/929: write da/d3e/fb9 [1032857,47975] 0 2024-03-17T23:58:37.006 INFO:tasks.workunit.client.0.smithi196.stdout:7/930: dread - da/d15/d1d/d4c/fce zero size 2024-03-17T23:58:37.021 INFO:tasks.workunit.client.0.smithi196.stdout:7/931: dread da/d3e/d7f/fbc [0,4194304] 0 2024-03-17T23:58:37.030 INFO:tasks.workunit.client.0.smithi196.stdout:7/932: dwrite da/d15/d1d/d29/fde [0,4194304] 0 2024-03-17T23:58:37.035 INFO:tasks.workunit.client.0.smithi196.stdout:7/933: link da/d15/d1d/d2e/f105 da/d15/d1a/d5e/d70/dfb/f134 0 2024-03-17T23:58:37.037 INFO:tasks.workunit.client.0.smithi196.stdout:7/934: mkdir da/d15/d1d/d4c/d135 0 2024-03-17T23:58:37.043 INFO:tasks.workunit.client.0.smithi196.stdout:7/935: rename da/d15/d1a/d5e to da/d15/d1d/d29/d113/d136 0 2024-03-17T23:58:37.043 INFO:tasks.workunit.client.0.smithi196.stdout:4/697: sync 2024-03-17T23:58:37.045 INFO:tasks.workunit.client.0.smithi196.stdout:7/936: mknod da/c137 0 2024-03-17T23:58:37.045 INFO:tasks.workunit.client.0.smithi196.stdout:4/698: read d1/de/f2d [2867715,63059] 0 2024-03-17T23:58:37.048 INFO:tasks.workunit.client.0.smithi196.stdout:4/699: rename d1/d11/f6a to d1/d68/df9/ffb 0 2024-03-17T23:58:37.050 INFO:tasks.workunit.client.0.smithi196.stdout:4/700: fsync d1/fa7 0 2024-03-17T23:58:37.054 INFO:tasks.workunit.client.0.smithi196.stdout:7/937: dwrite da/d15/d1d/f23 [4194304,4194304] 0 2024-03-17T23:58:37.057 INFO:tasks.workunit.client.0.smithi196.stdout:7/938: creat da/d3e/d45/d4f/d75/da8/d78/da4/f138 x:0 0 0 2024-03-17T23:58:37.057 INFO:tasks.workunit.client.0.smithi196.stdout:4/701: write d1/de/f56 [1282258,85788] 0 2024-03-17T23:58:37.058 INFO:tasks.workunit.client.0.smithi196.stdout:7/939: chown da/l11 4 1 2024-03-17T23:58:37.058 INFO:tasks.workunit.client.0.smithi196.stdout:4/702: read - d1/d26/d33/ff3 zero size 2024-03-17T23:58:37.059 INFO:tasks.workunit.client.0.smithi196.stdout:4/703: chown d1/d26/c46 0 1 2024-03-17T23:58:37.060 INFO:tasks.workunit.client.0.smithi196.stdout:7/940: unlink da/d3e/d7f/fe2 0 2024-03-17T23:58:37.063 INFO:tasks.workunit.client.0.smithi196.stdout:7/941: creat da/d3e/d45/d4f/db4/d127/f139 x:0 0 0 2024-03-17T23:58:37.064 INFO:tasks.workunit.client.0.smithi196.stdout:4/704: getdents d1/d26/d8b/de9 0 2024-03-17T23:58:37.067 INFO:tasks.workunit.client.0.smithi196.stdout:4/705: unlink d1/d26/d33/l73 0 2024-03-17T23:58:37.068 INFO:tasks.workunit.client.0.smithi196.stdout:7/942: mknod da/d15/d1d/d29/d113/d136/c13a 0 2024-03-17T23:58:37.073 INFO:tasks.workunit.client.0.smithi196.stdout:7/943: dread da/d3e/d45/dd8/de4/f126 [0,4194304] 0 2024-03-17T23:58:37.077 INFO:tasks.workunit.client.0.smithi196.stdout:7/944: mkdir da/d3e/d45/d4f/d75/d130/d13b 0 2024-03-17T23:58:37.081 INFO:tasks.workunit.client.0.smithi196.stdout:4/706: dwrite d1/d26/d8b/de9/f9c [0,4194304] 0 2024-03-17T23:58:37.084 INFO:tasks.workunit.client.0.smithi196.stdout:4/707: read d1/d26/d33/d40/fad [406685,33342] 0 2024-03-17T23:58:37.087 INFO:tasks.workunit.client.0.smithi196.stdout:4/708: mknod d1/de/d50/cfc 0 2024-03-17T23:58:37.087 INFO:tasks.workunit.client.0.smithi196.stdout:7/945: dwrite da/d15/d1d/d4c/f7d [0,4194304] 0 2024-03-17T23:58:37.096 INFO:tasks.workunit.client.0.smithi196.stdout:4/709: stat d1/de/d50/d55/cc2 0 2024-03-17T23:58:37.097 INFO:tasks.workunit.client.0.smithi196.stdout:7/946: chown da/d15/d1d/d29/f79 8497498 1 2024-03-17T23:58:37.102 INFO:tasks.workunit.client.0.smithi196.stdout:7/947: mknod da/d3e/d45/d4f/d75/da8/d117/c13c 0 2024-03-17T23:58:37.103 INFO:tasks.workunit.client.0.smithi196.stdout:4/710: dread d1/d11/f12 [0,4194304] 0 2024-03-17T23:58:37.104 INFO:tasks.workunit.client.0.smithi196.stdout:4/711: fsync d1/feb 0 2024-03-17T23:58:37.106 INFO:tasks.workunit.client.0.smithi196.stdout:4/712: symlink d1/d26/d33/d40/lfd 0 2024-03-17T23:58:37.114 INFO:tasks.workunit.client.0.smithi196.stdout:4/713: dwrite d1/d26/d33/f88 [0,4194304] 0 2024-03-17T23:58:37.119 INFO:tasks.workunit.client.0.smithi196.stdout:4/714: unlink d1/d26/d57/d8c/ca4 0 2024-03-17T23:58:37.121 INFO:tasks.workunit.client.0.smithi196.stdout:4/715: write d1/d26/d8b/de9/f9c [2351822,38088] 0 2024-03-17T23:58:37.126 INFO:tasks.workunit.client.0.smithi196.stdout:4/716: write d1/f58 [3701007,75079] 0 2024-03-17T23:58:37.134 INFO:tasks.workunit.client.0.smithi196.stdout:4/717: dwrite d1/d26/d33/f66 [0,4194304] 0 2024-03-17T23:58:37.141 INFO:tasks.workunit.client.0.smithi196.stdout:4/718: dwrite d1/d26/d33/f88 [0,4194304] 0 2024-03-17T23:58:37.148 INFO:tasks.workunit.client.0.smithi196.stdout:4/719: fdatasync d1/d26/d33/f72 0 2024-03-17T23:58:37.149 INFO:tasks.workunit.client.0.smithi196.stdout:4/720: write d1/d26/fe2 [770185,27646] 0 2024-03-17T23:58:37.150 INFO:tasks.workunit.client.0.smithi196.stdout:4/721: mkdir d1/d68/dfe 0 2024-03-17T23:58:37.174 INFO:tasks.workunit.client.0.smithi196.stdout:4/722: dread d1/de/d50/fc9 [0,4194304] 0 2024-03-17T23:58:37.193 INFO:tasks.workunit.client.0.smithi196.stdout:4/723: symlink d1/d1b/lff 0 2024-03-17T23:58:37.195 INFO:tasks.workunit.client.0.smithi196.stdout:4/724: symlink d1/de/l100 0 2024-03-17T23:58:37.195 INFO:tasks.workunit.client.0.smithi196.stdout:4/725: fsync d1/de/d50/f9e 0 2024-03-17T23:58:37.221 INFO:tasks.workunit.client.0.smithi196.stdout:4/726: dwrite d1/d26/d57/d8c/d97/fbd [0,4194304] 0 2024-03-17T23:58:37.223 INFO:tasks.workunit.client.0.smithi196.stdout:4/727: creat d1/d1b/d77/f101 x:0 0 0 2024-03-17T23:58:37.229 INFO:tasks.workunit.client.0.smithi196.stdout:4/728: dwrite d1/de/d50/f9e [0,4194304] 0 2024-03-17T23:58:37.231 INFO:tasks.workunit.client.0.smithi196.stdout:4/729: creat d1/d26/d57/d8c/d97/f102 x:0 0 0 2024-03-17T23:58:37.234 INFO:tasks.workunit.client.0.smithi196.stdout:4/730: mknod d1/c103 0 2024-03-17T23:58:37.236 INFO:tasks.workunit.client.0.smithi196.stdout:4/731: unlink d1/d26/d8b/de9/f9c 0 2024-03-17T23:58:37.240 INFO:tasks.workunit.client.0.smithi196.stdout:4/732: rename d1/d11/f95 to d1/d11/d5d/dfa/f104 0 2024-03-17T23:58:37.248 INFO:tasks.workunit.client.0.smithi196.stdout:4/733: dwrite d1/de/d50/fc9 [4194304,4194304] 0 2024-03-17T23:58:37.263 INFO:tasks.workunit.client.0.smithi196.stdout:4/734: truncate d1/de/d50/fc9 3006358 0 2024-03-17T23:58:37.265 INFO:tasks.workunit.client.0.smithi196.stdout:4/735: truncate d1/d26/f7e 4923984 0 2024-03-17T23:58:37.266 INFO:tasks.workunit.client.0.smithi196.stdout:4/736: write d1/d11/f1c [888680,104105] 0 2024-03-17T23:58:37.271 INFO:tasks.workunit.client.0.smithi196.stdout:4/737: dread d1/d1b/f5f [0,4194304] 0 2024-03-17T23:58:37.272 INFO:tasks.workunit.client.0.smithi196.stdout:4/738: stat d1/f8a 0 2024-03-17T23:58:37.274 INFO:tasks.workunit.client.0.smithi196.stdout:4/739: symlink d1/d26/d57/d8c/d97/l105 0 2024-03-17T23:58:37.274 INFO:tasks.workunit.client.0.smithi196.stdout:4/740: fsync d1/d26/d33/f5c 0 2024-03-17T23:58:37.277 INFO:tasks.workunit.client.0.smithi196.stdout:4/741: unlink d1/f2c 0 2024-03-17T23:58:37.288 INFO:tasks.workunit.client.0.smithi196.stdout:4/742: dwrite d1/d26/d33/d40/fad [0,4194304] 0 2024-03-17T23:58:37.294 INFO:tasks.workunit.client.0.smithi196.stdout:4/743: mknod d1/d26/d33/d40/da1/c106 0 2024-03-17T23:58:37.296 INFO:tasks.workunit.client.0.smithi196.stdout:4/744: truncate d1/d26/d33/d40/f5e 4113926 0 2024-03-17T23:58:37.303 INFO:tasks.workunit.client.0.smithi196.stdout:4/745: write d1/d1b/f79 [4958681,88080] 0 2024-03-17T23:58:37.305 INFO:tasks.workunit.client.0.smithi196.stdout:4/746: truncate d1/d26/d8b/de9/fbf 471080 0 2024-03-17T23:58:37.307 INFO:tasks.workunit.client.0.smithi196.stdout:4/747: mknod d1/d11/d5d/dfa/c107 0 2024-03-17T23:58:37.315 INFO:tasks.workunit.client.0.smithi196.stdout:4/748: dwrite d1/de/d50/fc9 [0,4194304] 0 2024-03-17T23:58:37.318 INFO:tasks.workunit.client.0.smithi196.stdout:4/749: truncate d1/d1b/f5f 1641451 0 2024-03-17T23:58:37.318 INFO:tasks.workunit.client.0.smithi196.stdout:4/750: fdatasync d1/d26/fcc 0 2024-03-17T23:58:37.321 INFO:tasks.workunit.client.0.smithi196.stdout:4/751: rename d1/dd2/dcb/fd5 to d1/dd2/f108 0 2024-03-17T23:58:37.337 INFO:tasks.workunit.client.0.smithi196.stdout:4/752: dread d1/d11/f3d [0,4194304] 0 2024-03-17T23:58:37.338 INFO:tasks.workunit.client.0.smithi196.stdout:4/753: write d1/d26/d33/f5c [4636795,113258] 0 2024-03-17T23:58:37.342 INFO:tasks.workunit.client.0.smithi196.stdout:4/754: mkdir d1/d26/d33/d40/da1/d109 0 2024-03-17T23:58:37.344 INFO:tasks.workunit.client.0.smithi196.stdout:4/755: symlink d1/d26/d8b/de9/l10a 0 2024-03-17T23:58:37.349 INFO:tasks.workunit.client.0.smithi196.stdout:5/857: sync 2024-03-17T23:58:37.350 INFO:tasks.workunit.client.0.smithi196.stdout:0/980: sync 2024-03-17T23:58:37.350 INFO:tasks.workunit.client.0.smithi196.stdout:8/612: sync 2024-03-17T23:58:37.353 INFO:tasks.workunit.client.0.smithi196.stdout:0/981: rmdir d5/d23/d24/d28/d47/d52 39 2024-03-17T23:58:37.355 INFO:tasks.workunit.client.0.smithi196.stdout:8/613: write f7 [5084080,51057] 0 2024-03-17T23:58:37.427 INFO:tasks.workunit.client.0.smithi196.stdout:4/756: dwrite d1/d26/d57/d8c/d97/fa8 [0,4194304] 0 2024-03-17T23:58:37.429 INFO:tasks.workunit.client.0.smithi196.stdout:8/614: unlink de/d2b/d3c/f7f 0 2024-03-17T23:58:37.434 INFO:tasks.workunit.client.0.smithi196.stdout:5/858: dwrite d6/d15/dc0/de5/f11a [0,4194304] 0 2024-03-17T23:58:37.434 INFO:tasks.workunit.client.0.smithi196.stdout:8/615: truncate de/d2b/faf 993689 0 2024-03-17T23:58:37.436 INFO:tasks.workunit.client.0.smithi196.stdout:5/859: dread - d6/d17/d1f/d7d/f104 zero size 2024-03-17T23:58:37.438 INFO:tasks.workunit.client.0.smithi196.stdout:4/757: dread d1/d11/f3d [0,4194304] 0 2024-03-17T23:58:37.440 INFO:tasks.workunit.client.0.smithi196.stdout:0/982: dwrite d5/f106 [0,4194304] 0 2024-03-17T23:58:37.446 INFO:tasks.workunit.client.0.smithi196.stdout:4/758: dwrite d1/d26/d33/f5c [0,4194304] 0 2024-03-17T23:58:37.448 INFO:tasks.workunit.client.0.smithi196.stdout:8/616: symlink de/d10/d54/lba 0 2024-03-17T23:58:37.449 INFO:tasks.workunit.client.0.smithi196.stdout:8/617: truncate de/d2b/d3c/f6a 4958383 0 2024-03-17T23:58:37.451 INFO:tasks.workunit.client.0.smithi196.stdout:4/759: readlink d1/de/d50/l99 0 2024-03-17T23:58:37.453 INFO:tasks.workunit.client.0.smithi196.stdout:0/983: creat d5/d23/d24/d28/d47/d52/d61/f132 x:0 0 0 2024-03-17T23:58:37.454 INFO:tasks.workunit.client.0.smithi196.stdout:4/760: symlink d1/d26/d8b/l10b 0 2024-03-17T23:58:37.455 INFO:tasks.workunit.client.0.smithi196.stdout:0/984: write d5/d23/d24/d28/d47/d52/d49/d10f/f124 [744267,85575] 0 2024-03-17T23:58:37.458 INFO:tasks.workunit.client.0.smithi196.stdout:4/761: creat d1/d26/d57/de6/f10c x:0 0 0 2024-03-17T23:58:37.461 INFO:tasks.workunit.client.0.smithi196.stdout:4/762: read d1/d26/f8e [1932027,14633] 0 2024-03-17T23:58:37.463 INFO:tasks.workunit.client.0.smithi196.stdout:8/618: write de/f15 [2850920,36029] 0 2024-03-17T23:58:37.465 INFO:tasks.workunit.client.0.smithi196.stdout:0/985: dwrite d5/d23/d85/de7/f117 [0,4194304] 0 2024-03-17T23:58:37.466 INFO:tasks.workunit.client.0.smithi196.stdout:4/763: mkdir d1/d11/d5d/d10d 0 2024-03-17T23:58:37.470 INFO:tasks.workunit.client.0.smithi196.stdout:8/619: dread de/d2b/faf [0,4194304] 0 2024-03-17T23:58:37.473 INFO:tasks.workunit.client.0.smithi196.stdout:4/764: unlink d1/d1b/lff 0 2024-03-17T23:58:37.481 INFO:tasks.workunit.client.0.smithi196.stdout:8/620: unlink de/l17 0 2024-03-17T23:58:37.484 INFO:tasks.workunit.client.0.smithi196.stdout:8/621: creat de/fbb x:0 0 0 2024-03-17T23:58:37.487 INFO:tasks.workunit.client.0.smithi196.stdout:8/622: rmdir de/d2b/d3c/d5d 39 2024-03-17T23:58:37.487 INFO:tasks.workunit.client.0.smithi196.stdout:0/986: dwrite d5/faa [0,4194304] 0 2024-03-17T23:58:37.490 INFO:tasks.workunit.client.0.smithi196.stdout:8/623: write de/f23 [1408402,77793] 0 2024-03-17T23:58:37.491 INFO:tasks.workunit.client.0.smithi196.stdout:0/987: mknod d5/d23/d24/d59/d94/c133 0 2024-03-17T23:58:37.493 INFO:tasks.workunit.client.0.smithi196.stdout:8/624: dread - de/d10/d35/f52 zero size 2024-03-17T23:58:37.498 INFO:tasks.workunit.client.0.smithi196.stdout:0/988: fsync d5/d23/d24/d28/d47/d52/d61/d6c/f127 0 2024-03-17T23:58:37.501 INFO:tasks.workunit.client.0.smithi196.stdout:8/625: dwrite f7 [0,4194304] 0 2024-03-17T23:58:37.508 INFO:tasks.workunit.client.0.smithi196.stdout:8/626: symlink de/d2b/d30/d7c/lbc 0 2024-03-17T23:58:37.509 INFO:tasks.workunit.client.0.smithi196.stdout:8/627: stat de/f1f 0 2024-03-17T23:58:37.509 INFO:tasks.workunit.client.0.smithi196.stdout:0/989: dread d5/f130 [0,4194304] 0 2024-03-17T23:58:37.510 INFO:tasks.workunit.client.0.smithi196.stdout:8/628: write de/d2b/d30/f68 [397074,82693] 0 2024-03-17T23:58:37.511 INFO:tasks.workunit.client.0.smithi196.stdout:0/990: symlink d5/d23/d24/d111/l134 0 2024-03-17T23:58:37.514 INFO:tasks.workunit.client.0.smithi196.stdout:0/991: mknod d5/d23/d24/d28/d47/d118/c135 0 2024-03-17T23:58:37.517 INFO:tasks.workunit.client.0.smithi196.stdout:0/992: creat d5/d23/d24/d28/d47/d52/dac/f136 x:0 0 0 2024-03-17T23:58:37.520 INFO:tasks.workunit.client.0.smithi196.stdout:0/993: unlink d5/d23/d24/d59/d8b/c75 0 2024-03-17T23:58:37.521 INFO:tasks.workunit.client.0.smithi196.stdout:0/994: rmdir d5 39 2024-03-17T23:58:37.524 INFO:tasks.workunit.client.0.smithi196.stdout:8/629: dwrite de/d2b/f87 [0,4194304] 0 2024-03-17T23:58:37.537 INFO:tasks.workunit.client.0.smithi196.stdout:0/995: dwrite d5/d23/d24/d28/d47/f11f [0,4194304] 0 2024-03-17T23:58:37.543 INFO:tasks.workunit.client.0.smithi196.stdout:8/630: dwrite de/d2b/d3c/d5d/f64 [0,4194304] 0 2024-03-17T23:58:37.544 INFO:tasks.workunit.client.0.smithi196.stdout:0/996: creat d5/d23/d24/d28/d47/d52/d61/d6c/d82/f137 x:0 0 0 2024-03-17T23:58:37.545 INFO:tasks.workunit.client.0.smithi196.stdout:0/997: read d5/f130 [863586,45440] 0 2024-03-17T23:58:37.548 INFO:tasks.workunit.client.0.smithi196.stdout:8/631: link de/d10/d35/f4f de/d10/d54/d5c/d81/fbd 0 2024-03-17T23:58:37.549 INFO:tasks.workunit.client.0.smithi196.stdout:8/632: chown de/d10/d54/d5c/d81 5020 1 2024-03-17T23:58:37.550 INFO:tasks.workunit.client.0.smithi196.stdout:8/633: mkdir de/d10/d54/dbe 0 2024-03-17T23:58:37.551 INFO:tasks.workunit.client.0.smithi196.stdout:0/998: link d5/d23/d85/fca d5/d23/d24/d30/d104/d129/f138 0 2024-03-17T23:58:37.553 INFO:tasks.workunit.client.0.smithi196.stdout:8/634: mkdir de/d10/d35/d88/d93/dbf 0 2024-03-17T23:58:37.555 INFO:tasks.workunit.client.0.smithi196.stdout:8/635: write de/d10/d35/d3e/f8d [462689,37444] 0 2024-03-17T23:58:37.557 INFO:tasks.workunit.client.0.smithi196.stdout:0/999: rename d5/d23/d24/d30/d4e/c7a to d5/d23/d24/da3/c139 0 2024-03-17T23:58:37.559 INFO:tasks.workunit.client.0.smithi196.stdout:8/636: creat de/d10/d54/dbe/fc0 x:0 0 0 2024-03-17T23:58:37.563 INFO:tasks.workunit.client.0.smithi196.stdout:8/637: getdents de/d10/d35 0 2024-03-17T23:58:37.566 INFO:tasks.workunit.client.0.smithi196.stdout:8/638: dread de/d2b/d30/f3a [0,4194304] 0 2024-03-17T23:58:37.571 INFO:tasks.workunit.client.0.smithi196.stdout:8/639: link de/d10/d54/d5c/daa/c72 de/d10/d54/d5c/d81/cc1 0 2024-03-17T23:58:37.572 INFO:tasks.workunit.client.0.smithi196.stdout:8/640: rmdir de/d10/d35/d3e 39 2024-03-17T23:58:37.583 INFO:tasks.workunit.client.0.smithi196.stdout:8/641: dread de/d2b/d30/d33/f3d [0,4194304] 0 2024-03-17T23:58:37.610 INFO:tasks.workunit.client.0.smithi196.stdout:9/755: sync 2024-03-17T23:58:37.620 INFO:tasks.workunit.client.0.smithi196.stdout:9/756: write d9/d12/d59/f7d [1041605,71017] 0 2024-03-17T23:58:37.626 INFO:tasks.workunit.client.0.smithi196.stdout:8/642: dwrite de/d10/d35/f52 [0,4194304] 0 2024-03-17T23:58:37.627 INFO:tasks.workunit.client.0.smithi196.stdout:9/757: creat d9/df/d4a/d5b/d62/dba/d60/d85/fec x:0 0 0 2024-03-17T23:58:37.628 INFO:tasks.workunit.client.0.smithi196.stdout:9/758: rename d9/df to d9/df/d55/dcf/ded 22 2024-03-17T23:58:37.633 INFO:tasks.workunit.client.0.smithi196.stdout:9/759: truncate d9/fd 9491998 0 2024-03-17T23:58:37.636 INFO:tasks.workunit.client.0.smithi196.stdout:8/643: dread de/d10/d54/f67 [0,4194304] 0 2024-03-17T23:58:37.636 INFO:tasks.workunit.client.0.smithi196.stdout:9/760: symlink d9/df/d4a/d5b/d62/dba/d60/d85/d8e/d99/lee 0 2024-03-17T23:58:37.638 INFO:tasks.workunit.client.0.smithi196.stdout:8/644: mknod de/cc2 0 2024-03-17T23:58:37.639 INFO:tasks.workunit.client.0.smithi196.stdout:9/761: mkdir d9/df/d4a/d5b/d6d/da8/def 0 2024-03-17T23:58:37.641 INFO:tasks.workunit.client.0.smithi196.stdout:8/645: read de/d10/d35/d3e/f9c [934664,30230] 0 2024-03-17T23:58:37.641 INFO:tasks.workunit.client.0.smithi196.stdout:9/762: truncate d9/df/d4a/d89/fd6 603607 0 2024-03-17T23:58:37.646 INFO:tasks.workunit.client.0.smithi196.stdout:9/763: link d9/df/d4a/d5b/d62/dba/d60/d5e/fb9 d9/dbb/ff0 0 2024-03-17T23:58:37.650 INFO:tasks.workunit.client.0.smithi196.stdout:8/646: dwrite de/d10/d35/d88/f9b [0,4194304] 0 2024-03-17T23:58:37.653 INFO:tasks.workunit.client.0.smithi196.stdout:8/647: symlink de/d10/d54/d5c/daa/lc3 0 2024-03-17T23:58:37.656 INFO:tasks.workunit.client.0.smithi196.stdout:9/764: dwrite d9/df/d4a/d5b/d62/dba/d60/d85/f98 [0,4194304] 0 2024-03-17T23:58:37.658 INFO:tasks.workunit.client.0.smithi196.stdout:8/648: unlink de/d2b/l63 0 2024-03-17T23:58:37.661 INFO:tasks.workunit.client.0.smithi196.stdout:9/765: rename d9/df/d4a/d5b/cd9 to d9/df/d4a/d5b/d6d/da8/dc7/cf1 0 2024-03-17T23:58:37.663 INFO:tasks.workunit.client.0.smithi196.stdout:9/766: chown d9/df/d4a/d89 56000027 1 2024-03-17T23:58:37.663 INFO:tasks.workunit.client.0.smithi196.stdout:9/767: chown d9/df/d14 48908 1 2024-03-17T23:58:37.665 INFO:tasks.workunit.client.0.smithi196.stdout:8/649: truncate de/d5e/f70 14308 0 2024-03-17T23:58:37.666 INFO:tasks.workunit.client.0.smithi196.stdout:9/768: chown d9/df/d14/d27/d9e/dc5 52894190 1 2024-03-17T23:58:37.666 INFO:tasks.workunit.client.0.smithi196.stdout:9/769: chown d9/df/d4a/c5d 23485872 1 2024-03-17T23:58:37.667 INFO:tasks.workunit.client.0.smithi196.stdout:8/650: mkdir de/d10/d35/d88/dc4 0 2024-03-17T23:58:37.667 INFO:tasks.workunit.client.0.smithi196.stdout:8/651: fdatasync de/d10/d43/d71/fa2 0 2024-03-17T23:58:37.668 INFO:tasks.workunit.client.0.smithi196.stdout:8/652: fdatasync f6 0 2024-03-17T23:58:37.669 INFO:tasks.workunit.client.0.smithi196.stdout:9/770: mkdir d9/df/d14/d3d/df2 0 2024-03-17T23:58:37.671 INFO:tasks.workunit.client.0.smithi196.stdout:8/653: creat de/d10/d54/d5c/fc5 x:0 0 0 2024-03-17T23:58:37.672 INFO:tasks.workunit.client.0.smithi196.stdout:8/654: chown de/d10/l11 91 1 2024-03-17T23:58:37.673 INFO:tasks.workunit.client.0.smithi196.stdout:8/655: truncate de/d2b/d30/f7b 5855715 0 2024-03-17T23:58:37.680 INFO:tasks.workunit.client.0.smithi196.stdout:9/771: rename d9/df/d4a/d5b/d62/dba to d9/df/d14/d27/df3 0 2024-03-17T23:58:37.686 INFO:tasks.workunit.client.0.smithi196.stdout:8/656: rename de/d2b/f87 to de/d2b/d3c/d5d/fc6 0 2024-03-17T23:58:37.687 INFO:tasks.workunit.client.0.smithi196.stdout:9/772: rename d9/df/d4a/d89 to d9/df/d4a/d89/db1/df4 22 2024-03-17T23:58:37.687 INFO:tasks.workunit.client.0.smithi196.stdout:8/657: write f7 [2805375,53661] 0 2024-03-17T23:58:37.690 INFO:tasks.workunit.client.0.smithi196.stdout:9/773: chown d9/df/d14/d27/df3/d60/ca3 4396 1 2024-03-17T23:58:37.690 INFO:tasks.workunit.client.0.smithi196.stdout:9/774: write d9/dbb/fe9 [850826,100720] 0 2024-03-17T23:58:37.692 INFO:tasks.workunit.client.0.smithi196.stdout:9/775: readlink d9/df/d14/d27/df3/l43 0 2024-03-17T23:58:37.696 INFO:tasks.workunit.client.0.smithi196.stdout:9/776: symlink d9/df/d14/d27/df3/d60/d85/lf5 0 2024-03-17T23:58:37.700 INFO:tasks.workunit.client.0.smithi196.stdout:8/658: truncate de/d10/d35/d3e/f8d 3167359 0 2024-03-17T23:58:37.703 INFO:tasks.workunit.client.0.smithi196.stdout:8/659: symlink de/d2b/d3c/d5d/lc7 0 2024-03-17T23:58:37.704 INFO:tasks.workunit.client.0.smithi196.stdout:9/777: dwrite f6 [0,4194304] 0 2024-03-17T23:58:37.707 INFO:tasks.workunit.client.0.smithi196.stdout:9/778: read d9/df/d4a/d89/fd6 [428107,90397] 0 2024-03-17T23:58:37.709 INFO:tasks.workunit.client.0.smithi196.stdout:9/779: symlink d9/d12/lf6 0 2024-03-17T23:58:37.714 INFO:tasks.workunit.client.0.smithi196.stdout:9/780: rename d9/df/l1b to d9/df/d4a/d89/lf7 0 2024-03-17T23:58:37.717 INFO:tasks.workunit.client.0.smithi196.stdout:9/781: unlink d9/df/d14/d27/df3/d60/f28 0 2024-03-17T23:58:37.718 INFO:tasks.workunit.client.0.smithi196.stdout:9/782: rmdir d9/dbb 39 2024-03-17T23:58:37.719 INFO:tasks.workunit.client.0.smithi196.stdout:8/660: dread de/d2b/d30/d33/f48 [0,4194304] 0 2024-03-17T23:58:37.721 INFO:tasks.workunit.client.0.smithi196.stdout:9/783: unlink d9/df/d4a/d5b/d62/l9f 0 2024-03-17T23:58:37.722 INFO:tasks.workunit.client.0.smithi196.stdout:9/784: chown d9/df/d4a/d89 0 1 2024-03-17T23:58:37.724 INFO:tasks.workunit.client.0.smithi196.stdout:8/661: link de/d10/d43/d71/c8b de/d10/d54/d5c/daa/cc8 0 2024-03-17T23:58:37.726 INFO:tasks.workunit.client.0.smithi196.stdout:8/662: mkdir de/d2b/d30/d7c/dc9 0 2024-03-17T23:58:37.734 INFO:tasks.workunit.client.0.smithi196.stdout:8/663: dwrite de/f23 [0,4194304] 0 2024-03-17T23:58:37.735 INFO:tasks.workunit.client.0.smithi196.stdout:9/785: write d9/df/d4a/d5b/d62/f7c [822170,92854] 0 2024-03-17T23:58:37.738 INFO:tasks.workunit.client.0.smithi196.stdout:9/786: mknod d9/df/d4a/d5b/d6d/da8/dc7/cf8 0 2024-03-17T23:58:37.740 INFO:tasks.workunit.client.0.smithi196.stdout:8/664: unlink de/d2b/d3c/l9a 0 2024-03-17T23:58:37.743 INFO:tasks.workunit.client.0.smithi196.stdout:9/787: dread d9/d12/f3c [0,4194304] 0 2024-03-17T23:58:37.745 INFO:tasks.workunit.client.0.smithi196.stdout:8/665: getdents de/d2b/d30 0 2024-03-17T23:58:37.748 INFO:tasks.workunit.client.0.smithi196.stdout:9/788: rename d9/df/d4a/fe8 to d9/df/d4a/d5b/d6d/da8/def/ff9 0 2024-03-17T23:58:37.749 INFO:tasks.workunit.client.0.smithi196.stdout:9/789: fsync d9/df/d14/d3d/fda 0 2024-03-17T23:58:37.750 INFO:tasks.workunit.client.0.smithi196.stdout:8/666: mknod de/d2b/d3c/cca 0 2024-03-17T23:58:37.754 INFO:tasks.workunit.client.0.smithi196.stdout:8/667: getdents de 0 2024-03-17T23:58:37.762 INFO:tasks.workunit.client.0.smithi196.stdout:8/668: dwrite de/d2b/d3c/f55 [0,4194304] 0 2024-03-17T23:58:37.771 INFO:tasks.workunit.client.0.smithi196.stdout:9/790: dread f5 [0,4194304] 0 2024-03-17T23:58:37.772 INFO:tasks.workunit.client.0.smithi196.stdout:8/669: write de/d10/f2c [797658,33530] 0 2024-03-17T23:58:37.775 INFO:tasks.workunit.client.0.smithi196.stdout:9/791: mknod d9/dbb/de5/cfa 0 2024-03-17T23:58:37.778 INFO:tasks.workunit.client.0.smithi196.stdout:9/792: creat d9/df/d55/dcf/ffb x:0 0 0 2024-03-17T23:58:37.781 INFO:tasks.workunit.client.0.smithi196.stdout:8/670: dwrite de/d10/d54/d5c/daa/fb2 [0,4194304] 0 2024-03-17T23:58:37.786 INFO:tasks.workunit.client.0.smithi196.stdout:8/671: write de/f5b [223936,51795] 0 2024-03-17T23:58:37.786 INFO:tasks.workunit.client.0.smithi196.stdout:9/793: getdents d9/df/d55/dcf 0 2024-03-17T23:58:37.787 INFO:tasks.workunit.client.0.smithi196.stdout:8/672: write de/d2b/d30/f50 [4533559,93036] 0 2024-03-17T23:58:37.790 INFO:tasks.workunit.client.0.smithi196.stdout:9/794: symlink d9/df/d14/db0/lfc 0 2024-03-17T23:58:37.791 INFO:tasks.workunit.client.0.smithi196.stdout:8/673: mkdir de/d10/d35/d88/dc4/dcb 0 2024-03-17T23:58:37.793 INFO:tasks.workunit.client.0.smithi196.stdout:9/795: symlink d9/df/d55/lfd 0 2024-03-17T23:58:37.794 INFO:tasks.workunit.client.0.smithi196.stdout:9/796: dread - d9/df/d4a/d8c/fe7 zero size 2024-03-17T23:58:37.795 INFO:tasks.workunit.client.0.smithi196.stdout:6/856: sync 2024-03-17T23:58:37.800 INFO:tasks.workunit.client.0.smithi196.stdout:9/797: creat d9/df/d14/d27/df3/d60/ffe x:0 0 0 2024-03-17T23:58:37.802 INFO:tasks.workunit.client.0.smithi196.stdout:9/798: write d9/df/d14/f5c [1176196,73835] 0 2024-03-17T23:58:37.806 INFO:tasks.workunit.client.0.smithi196.stdout:9/799: creat d9/df/d14/d27/df3/d60/d85/d8e/fff x:0 0 0 2024-03-17T23:58:37.935 INFO:tasks.workunit.client.0.smithi196.stdout:9/800: symlink d9/df/d4a/d5b/d6d/l100 0 2024-03-17T23:58:37.937 INFO:tasks.workunit.client.0.smithi196.stdout:6/857: dwrite d2/d14/d75/d7b/f19 [0,4194304] 0 2024-03-17T23:58:37.941 INFO:tasks.workunit.client.0.smithi196.stdout:9/801: chown d9/df/d14/d27/df3/d60/d85/d8e/d99 1 1 2024-03-17T23:58:37.942 INFO:tasks.workunit.client.0.smithi196.stdout:9/802: stat d9/df/c32 0 2024-03-17T23:58:37.946 INFO:tasks.workunit.client.0.smithi196.stdout:6/858: rmdir d2/d14/d42/d57/d5f/dbd/df2 0 2024-03-17T23:58:37.953 INFO:tasks.workunit.client.0.smithi196.stdout:9/803: dwrite d9/f11 [0,4194304] 0 2024-03-17T23:58:37.957 INFO:tasks.workunit.client.0.smithi196.stdout:6/859: dread d2/d7/d2b/f84 [0,4194304] 0 2024-03-17T23:58:37.959 INFO:tasks.workunit.client.0.smithi196.stdout:6/860: write d2/d14/de2/f115 [671541,6945] 0 2024-03-17T23:58:37.961 INFO:tasks.workunit.client.0.smithi196.stdout:6/861: fsync d2/d14/dcc/fe0 0 2024-03-17T23:58:37.964 INFO:tasks.workunit.client.0.smithi196.stdout:9/804: dwrite d9/df/d14/d27/df3/d60/d85/fe4 [0,4194304] 0 2024-03-17T23:58:37.967 INFO:tasks.workunit.client.0.smithi196.stdout:9/805: creat d9/df/d14/d3d/f101 x:0 0 0 2024-03-17T23:58:37.969 INFO:tasks.workunit.client.0.smithi196.stdout:9/806: chown d9/d33/f42 33 1 2024-03-17T23:58:37.980 INFO:tasks.workunit.client.0.smithi196.stdout:9/807: dwrite d9/df/d4a/d8c/fc2 [0,4194304] 0 2024-03-17T23:58:37.984 INFO:tasks.workunit.client.0.smithi196.stdout:6/862: dread d2/d14/d42/d57/dc8/fc4 [0,4194304] 0 2024-03-17T23:58:37.993 INFO:tasks.workunit.client.0.smithi196.stdout:9/808: dwrite d9/d12/fdb [0,4194304] 0 2024-03-17T23:58:37.994 INFO:tasks.workunit.client.0.smithi196.stdout:1/735: sync 2024-03-17T23:58:37.996 INFO:tasks.workunit.client.0.smithi196.stdout:1/736: stat d1/d13/d23/d47/d48/d7e/fd4 0 2024-03-17T23:58:37.997 INFO:tasks.workunit.client.0.smithi196.stdout:9/809: rmdir d9/df 39 2024-03-17T23:58:38.001 INFO:tasks.workunit.client.0.smithi196.stdout:1/737: mkdir d1/db/dd/d43/df3 0 2024-03-17T23:58:38.001 INFO:tasks.workunit.client.0.smithi196.stdout:6/863: dread d2/f41 [0,4194304] 0 2024-03-17T23:58:38.002 INFO:tasks.workunit.client.0.smithi196.stdout:1/738: fsync d1/db/f73 0 2024-03-17T23:58:38.004 INFO:tasks.workunit.client.0.smithi196.stdout:1/739: fsync d1/db/f73 0 2024-03-17T23:58:38.006 INFO:tasks.workunit.client.0.smithi196.stdout:6/864: mkdir d2/d14/d50/d129 0 2024-03-17T23:58:38.007 INFO:tasks.workunit.client.0.smithi196.stdout:1/740: creat d1/db/dd/d43/ff4 x:0 0 0 2024-03-17T23:58:38.007 INFO:tasks.workunit.client.0.smithi196.stdout:1/741: chown d1/f4 296174763 1 2024-03-17T23:58:38.009 INFO:tasks.workunit.client.0.smithi196.stdout:1/742: readlink d1/db/l19 0 2024-03-17T23:58:38.016 INFO:tasks.workunit.client.0.smithi196.stdout:6/865: dwrite d2/faf [4194304,4194304] 0 2024-03-17T23:58:38.017 INFO:tasks.workunit.client.0.smithi196.stdout:6/866: chown d2/d7/dcd/dd3/f8b 814377 1 2024-03-17T23:58:38.020 INFO:tasks.workunit.client.0.smithi196.stdout:6/867: symlink d2/d7/dcd/dd3/dba/l12a 0 2024-03-17T23:58:38.023 INFO:tasks.workunit.client.0.smithi196.stdout:6/868: fsync d2/d14/d42/d57/f82 0 2024-03-17T23:58:38.026 INFO:tasks.workunit.client.0.smithi196.stdout:1/743: dwrite d1/d13/d23/d47/d48/d74/db2/d75/f7d [0,4194304] 0 2024-03-17T23:58:38.029 INFO:tasks.workunit.client.0.smithi196.stdout:9/810: dread d9/df/d14/d27/df3/d60/d5e/f57 [0,4194304] 0 2024-03-17T23:58:38.032 INFO:tasks.workunit.client.0.smithi196.stdout:1/744: dread - d1/d13/d23/d47/d48/d74/db2/d75/fb6 zero size 2024-03-17T23:58:38.033 INFO:tasks.workunit.client.0.smithi196.stdout:6/869: write d2/d14/d42/f64 [432347,85899] 0 2024-03-17T23:58:38.034 INFO:tasks.workunit.client.0.smithi196.stdout:1/745: stat d1/d13/d23/d70 0 2024-03-17T23:58:38.034 INFO:tasks.workunit.client.0.smithi196.stdout:9/811: creat d9/df/d14/d3d/f102 x:0 0 0 2024-03-17T23:58:38.035 INFO:tasks.workunit.client.0.smithi196.stdout:6/870: write d2/d14/d75/dc0/ddf/da1/f109 [502008,37934] 0 2024-03-17T23:58:38.038 INFO:tasks.workunit.client.0.smithi196.stdout:1/746: mkdir d1/d13/d91/de9/df5 0 2024-03-17T23:58:38.040 INFO:tasks.workunit.client.0.smithi196.stdout:9/812: rename d9/d12/f17 to d9/df/d4a/d5b/d6d/da8/f103 0 2024-03-17T23:58:38.042 INFO:tasks.workunit.client.0.smithi196.stdout:6/871: dread d2/d14/d42/d57/dc8/fc4 [0,4194304] 0 2024-03-17T23:58:38.043 INFO:tasks.workunit.client.0.smithi196.stdout:9/813: write d9/df/d4a/d5b/fa4 [680741,2370] 0 2024-03-17T23:58:38.047 INFO:tasks.workunit.client.0.smithi196.stdout:6/872: creat d2/d14/dcc/d103/f12b x:0 0 0 2024-03-17T23:58:38.049 INFO:tasks.workunit.client.0.smithi196.stdout:6/873: mknod d2/d7/d100/c12c 0 2024-03-17T23:58:38.051 INFO:tasks.workunit.client.0.smithi196.stdout:1/747: truncate d1/d13/d23/f37 1199483 0 2024-03-17T23:58:38.051 INFO:tasks.workunit.client.0.smithi196.stdout:9/814: write d9/d12/d59/f6e [708902,13413] 0 2024-03-17T23:58:38.052 INFO:tasks.workunit.client.0.smithi196.stdout:1/748: chown d1/d13/d23/d47/d48/f54 227 1 2024-03-17T23:58:38.053 INFO:tasks.workunit.client.0.smithi196.stdout:9/815: chown d9/df/d14/d27/d9e/dc5/fcb 21 1 2024-03-17T23:58:38.054 INFO:tasks.workunit.client.0.smithi196.stdout:6/874: dread d2/d14/dcc/fe0 [0,4194304] 0 2024-03-17T23:58:38.054 INFO:tasks.workunit.client.0.smithi196.stdout:1/749: mknod d1/d13/d23/d47/d48/d74/cf6 0 2024-03-17T23:58:38.055 INFO:tasks.workunit.client.0.smithi196.stdout:1/750: chown d1/d13/d91/de9/df5 121 1 2024-03-17T23:58:38.061 INFO:tasks.workunit.client.0.smithi196.stdout:9/816: write d9/df/d4a/d5b/d62/f79 [2158229,88519] 0 2024-03-17T23:58:38.061 INFO:tasks.workunit.client.0.smithi196.stdout:6/875: dread d2/d14/d35/fc6 [0,4194304] 0 2024-03-17T23:58:38.065 INFO:tasks.workunit.client.0.smithi196.stdout:9/817: mknod d9/dbb/de5/c104 0 2024-03-17T23:58:38.068 INFO:tasks.workunit.client.0.smithi196.stdout:9/818: creat d9/df/f105 x:0 0 0 2024-03-17T23:58:38.073 INFO:tasks.workunit.client.0.smithi196.stdout:9/819: truncate d9/df/d14/d27/df3/d60/d5e/fa2 290208 0 2024-03-17T23:58:38.074 INFO:tasks.workunit.client.0.smithi196.stdout:1/751: dread d1/db/f1f [0,4194304] 0 2024-03-17T23:58:38.074 INFO:tasks.workunit.client.0.smithi196.stdout:6/876: dwrite d2/d7/f32 [0,4194304] 0 2024-03-17T23:58:38.078 INFO:tasks.workunit.client.0.smithi196.stdout:1/752: symlink d1/d13/d23/d62/dab/dca/lf7 0 2024-03-17T23:58:38.079 INFO:tasks.workunit.client.0.smithi196.stdout:6/877: creat d2/d14/d42/d57/dc8/f12d x:0 0 0 2024-03-17T23:58:38.086 INFO:tasks.workunit.client.0.smithi196.stdout:6/878: chown d2/f45 9 1 2024-03-17T23:58:38.086 INFO:tasks.workunit.client.0.smithi196.stdout:7/948: sync 2024-03-17T23:58:38.086 INFO:tasks.workunit.client.0.smithi196.stdout:9/820: dwrite d9/df/d55/dcf/ffb [0,4194304] 0 2024-03-17T23:58:38.088 INFO:tasks.workunit.client.0.smithi196.stdout:6/879: dread - d2/d14/d42/d57/dc8/db3/fcb zero size 2024-03-17T23:58:38.094 INFO:tasks.workunit.client.0.smithi196.stdout:9/821: dread d9/df/d4a/d89/fd6 [0,4194304] 0 2024-03-17T23:58:38.094 INFO:tasks.workunit.client.0.smithi196.stdout:6/880: truncate d2/d66/d90/f97 300781 0 2024-03-17T23:58:38.096 INFO:tasks.workunit.client.0.smithi196.stdout:9/822: stat d9/df/d14/d3d/f102 0 2024-03-17T23:58:38.097 INFO:tasks.workunit.client.0.smithi196.stdout:1/753: write d1/db/dd/d43/f4a [2414813,49926] 0 2024-03-17T23:58:38.099 INFO:tasks.workunit.client.0.smithi196.stdout:6/881: unlink d2/d14/l30 0 2024-03-17T23:58:38.102 INFO:tasks.workunit.client.0.smithi196.stdout:1/754: mknod d1/d13/d23/d47/d48/d74/db2/d75/cf8 0 2024-03-17T23:58:38.102 INFO:tasks.workunit.client.0.smithi196.stdout:6/882: read - d2/d7/dcd/dd3/f76 zero size 2024-03-17T23:58:38.103 INFO:tasks.workunit.client.0.smithi196.stdout:7/949: dwrite da/d15/da7/f68 [0,4194304] 0 2024-03-17T23:58:38.105 INFO:tasks.workunit.client.0.smithi196.stdout:7/950: write da/d15/da7/f68 [2360133,100684] 0 2024-03-17T23:58:38.105 INFO:tasks.workunit.client.0.smithi196.stdout:9/823: rename d9/df/d4a/d5b/d62 to d9/df/d55/dcf/d106 0 2024-03-17T23:58:38.108 INFO:tasks.workunit.client.0.smithi196.stdout:6/883: unlink d2/d14/d42/d57/dc8/f87 0 2024-03-17T23:58:38.108 INFO:tasks.workunit.client.0.smithi196.stdout:9/824: dread - d9/df/d14/d27/df3/d60/fe2 zero size 2024-03-17T23:58:38.109 INFO:tasks.workunit.client.0.smithi196.stdout:6/884: chown d2/d14/d42/f8f 2412 1 2024-03-17T23:58:38.110 INFO:tasks.workunit.client.0.smithi196.stdout:9/825: mknod d9/dbb/c107 0 2024-03-17T23:58:38.114 INFO:tasks.workunit.client.0.smithi196.stdout:9/826: symlink d9/df/d14/db0/l108 0 2024-03-17T23:58:38.116 INFO:tasks.workunit.client.0.smithi196.stdout:9/827: write d9/df/d14/d27/df3/d60/d5e/f56 [1600472,48321] 0 2024-03-17T23:58:38.119 INFO:tasks.workunit.client.0.smithi196.stdout:9/828: creat d9/df/d4a/d8c/f109 x:0 0 0 2024-03-17T23:58:38.122 INFO:tasks.workunit.client.0.smithi196.stdout:6/885: write d2/d14/d75/d7b/f7c [2557421,115049] 0 2024-03-17T23:58:38.123 INFO:tasks.workunit.client.0.smithi196.stdout:6/886: stat d2/d14/de2/c102 0 2024-03-17T23:58:38.123 INFO:tasks.workunit.client.0.smithi196.stdout:6/887: readlink d2/d66/l77 0 2024-03-17T23:58:38.125 INFO:tasks.workunit.client.0.smithi196.stdout:9/829: dread d9/d12/fdb [0,4194304] 0 2024-03-17T23:58:38.125 INFO:tasks.workunit.client.0.smithi196.stdout:6/888: truncate d2/d14/f11d 672058 0 2024-03-17T23:58:38.127 INFO:tasks.workunit.client.0.smithi196.stdout:9/830: creat d9/df/d55/dcf/f10a x:0 0 0 2024-03-17T23:58:38.128 INFO:tasks.workunit.client.0.smithi196.stdout:6/889: creat d2/d14/dcc/d103/d121/f12e x:0 0 0 2024-03-17T23:58:38.130 INFO:tasks.workunit.client.0.smithi196.stdout:6/890: mknod d2/d14/d75/dc0/ddf/da1/c12f 0 2024-03-17T23:58:38.136 INFO:tasks.workunit.client.0.smithi196.stdout:6/891: truncate d2/d7/d2b/f4a 3490951 0 2024-03-17T23:58:38.141 INFO:tasks.workunit.client.0.smithi196.stdout:6/892: write d2/d14/d8c/f110 [857494,93479] 0 2024-03-17T23:58:38.143 INFO:tasks.workunit.client.0.smithi196.stdout:6/893: chown d2/d14/d50/d68/fee 44308 1 2024-03-17T23:58:38.144 INFO:tasks.workunit.client.0.smithi196.stdout:6/894: symlink d2/d7/l130 0 2024-03-17T23:58:38.146 INFO:tasks.workunit.client.0.smithi196.stdout:6/895: symlink d2/d14/d50/l131 0 2024-03-17T23:58:38.149 INFO:tasks.workunit.client.0.smithi196.stdout:6/896: mkdir d2/d14/d8c/d132 0 2024-03-17T23:58:38.151 INFO:tasks.workunit.client.0.smithi196.stdout:6/897: symlink d2/d14/d75/dc0/ddf/de6/l133 0 2024-03-17T23:58:38.152 INFO:tasks.workunit.client.0.smithi196.stdout:6/898: chown d2/d14/d75/d7b/f4c 2082 1 2024-03-17T23:58:38.153 INFO:tasks.workunit.client.0.smithi196.stdout:6/899: rmdir d2/def 39 2024-03-17T23:58:38.155 INFO:tasks.workunit.client.0.smithi196.stdout:6/900: symlink d2/d14/d75/d92/dd8/l134 0 2024-03-17T23:58:38.166 INFO:tasks.workunit.client.0.smithi196.stdout:6/901: dwrite d2/d7/dcd/dd3/f76 [0,4194304] 0 2024-03-17T23:58:38.226 INFO:tasks.workunit.client.0.smithi196.stdout:6/902: write d2/d66/d90/f97 [625750,101155] 0 2024-03-17T23:58:38.228 INFO:tasks.workunit.client.0.smithi196.stdout:6/903: symlink d2/d14/d42/l135 0 2024-03-17T23:58:38.236 INFO:tasks.workunit.client.0.smithi196.stdout:6/904: dwrite d2/d14/dcc/d103/f12b [0,4194304] 0 2024-03-17T23:58:38.249 INFO:tasks.workunit.client.0.smithi196.stdout:4/765: sync 2024-03-17T23:58:38.249 INFO:tasks.workunit.client.0.smithi196.stdout:5/860: sync 2024-03-17T23:58:38.249 INFO:tasks.workunit.client.0.smithi196.stdout:8/674: sync 2024-03-17T23:58:38.250 INFO:tasks.workunit.client.0.smithi196.stdout:6/905: dwrite d2/def/f108 [0,4194304] 0 2024-03-17T23:58:38.251 INFO:tasks.workunit.client.0.smithi196.stdout:4/766: chown d1/de/d50/d55/de4 293645 1 2024-03-17T23:58:38.253 INFO:tasks.workunit.client.0.smithi196.stdout:6/906: chown d2/d14/dcc/d103/d121/f12e 47 1 2024-03-17T23:58:38.253 INFO:tasks.workunit.client.0.smithi196.stdout:8/675: mkdir de/d10/d54/d5c/dcc 0 2024-03-17T23:58:38.255 INFO:tasks.workunit.client.0.smithi196.stdout:4/767: creat d1/dd2/dcb/f10e x:0 0 0 2024-03-17T23:58:38.257 INFO:tasks.workunit.client.0.smithi196.stdout:6/907: rename d2/d14/de2/fec to d2/d14/d35/d6a/f136 0 2024-03-17T23:58:38.258 INFO:tasks.workunit.client.0.smithi196.stdout:4/768: fdatasync d1/d26/d33/d40/f89 0 2024-03-17T23:58:38.260 INFO:tasks.workunit.client.0.smithi196.stdout:8/676: creat de/d2b/d30/d7c/dc9/fcd x:0 0 0 2024-03-17T23:58:38.260 INFO:tasks.workunit.client.0.smithi196.stdout:6/908: mknod d2/d14/d8c/c137 0 2024-03-17T23:58:38.261 INFO:tasks.workunit.client.0.smithi196.stdout:4/769: truncate d1/d11/fa6 806840 0 2024-03-17T23:58:38.266 INFO:tasks.workunit.client.0.smithi196.stdout:4/770: truncate d1/d1b/d77/df1/f92 70606 0 2024-03-17T23:58:38.268 INFO:tasks.workunit.client.0.smithi196.stdout:6/909: chown d2/d14/d75/dc0/fde 493 1 2024-03-17T23:58:38.269 INFO:tasks.workunit.client.0.smithi196.stdout:5/861: dread d6/f8 [0,4194304] 0 2024-03-17T23:58:38.270 INFO:tasks.workunit.client.0.smithi196.stdout:5/862: chown d6/f8a 5105 1 2024-03-17T23:58:38.273 INFO:tasks.workunit.client.0.smithi196.stdout:5/863: symlink d6/d17/d23/l127 0 2024-03-17T23:58:38.274 INFO:tasks.workunit.client.0.smithi196.stdout:8/677: write de/d10/d54/f92 [495365,75816] 0 2024-03-17T23:58:38.277 INFO:tasks.workunit.client.0.smithi196.stdout:4/771: dwrite d1/de/f56 [0,4194304] 0 2024-03-17T23:58:38.277 INFO:tasks.workunit.client.0.smithi196.stdout:5/864: dread d6/d17/d1f/d5c/fa3 [0,4194304] 0 2024-03-17T23:58:38.280 INFO:tasks.workunit.client.0.smithi196.stdout:4/772: rename d1/d11/f3d to d1/dd2/f10f 0 2024-03-17T23:58:38.281 INFO:tasks.workunit.client.0.smithi196.stdout:5/865: rmdir d6/d17/d1f/d7d/d89 39 2024-03-17T23:58:38.282 INFO:tasks.workunit.client.0.smithi196.stdout:4/773: fdatasync d1/d26/d8b/de9/fa3 0 2024-03-17T23:58:38.286 INFO:tasks.workunit.client.0.smithi196.stdout:8/678: dread de/d10/d54/d5c/daa/f76 [0,4194304] 0 2024-03-17T23:58:38.286 INFO:tasks.workunit.client.0.smithi196.stdout:8/679: stat de/d5e 0 2024-03-17T23:58:38.298 INFO:tasks.workunit.client.0.smithi196.stdout:8/680: dwrite de/d2b/d30/f90 [0,4194304] 0 2024-03-17T23:58:38.304 INFO:tasks.workunit.client.0.smithi196.stdout:5/866: dread d6/d17/d1f/d7d/d81/f8c [0,4194304] 0 2024-03-17T23:58:38.304 INFO:tasks.workunit.client.0.smithi196.stdout:8/681: mknod de/d5e/cce 0 2024-03-17T23:58:38.310 INFO:tasks.workunit.client.0.smithi196.stdout:5/867: mknod d6/d2d/d9c/dc7/c128 0 2024-03-17T23:58:38.310 INFO:tasks.workunit.client.0.smithi196.stdout:5/868: chown d6/d2d 0 1 2024-03-17T23:58:38.311 INFO:tasks.workunit.client.0.smithi196.stdout:5/869: chown d6/d2d/d33/dc5/dce/lea 10372851 1 2024-03-17T23:58:38.315 INFO:tasks.workunit.client.0.smithi196.stdout:8/682: dwrite de/d10/f24 [0,4194304] 0 2024-03-17T23:58:38.318 INFO:tasks.workunit.client.0.smithi196.stdout:5/870: link d6/d17/d3f/da5/cf2 d6/d17/d1f/c129 0 2024-03-17T23:58:38.325 INFO:tasks.workunit.client.0.smithi196.stdout:8/683: write de/f19 [1750717,64541] 0 2024-03-17T23:58:38.328 INFO:tasks.workunit.client.0.smithi196.stdout:8/684: readlink de/d10/d35/l36 0 2024-03-17T23:58:38.329 INFO:tasks.workunit.client.0.smithi196.stdout:8/685: chown de/d10/d54/d5c/fa0 157 1 2024-03-17T23:58:38.330 INFO:tasks.workunit.client.0.smithi196.stdout:8/686: write de/f31 [2036749,93377] 0 2024-03-17T23:58:38.333 INFO:tasks.workunit.client.0.smithi196.stdout:5/871: dwrite d6/d17/d3f/d4e/d69/fc4 [0,4194304] 0 2024-03-17T23:58:38.335 INFO:tasks.workunit.client.0.smithi196.stdout:8/687: rename de/d10/d35/d3e/c9d to de/d2b/d30/d33/ccf 0 2024-03-17T23:58:38.336 INFO:tasks.workunit.client.0.smithi196.stdout:8/688: write de/f98 [284918,35873] 0 2024-03-17T23:58:38.337 INFO:tasks.workunit.client.0.smithi196.stdout:5/872: rmdir d6/d17/d1f/d7d/d81 39 2024-03-17T23:58:38.338 INFO:tasks.workunit.client.0.smithi196.stdout:8/689: fsync de/d10/d35/f4f 0 2024-03-17T23:58:38.341 INFO:tasks.workunit.client.0.smithi196.stdout:5/873: fsync d6/d17/d1f/d7d/d89/fb1 0 2024-03-17T23:58:38.343 INFO:tasks.workunit.client.0.smithi196.stdout:8/690: fdatasync de/d10/d35/d3e/f8d 0 2024-03-17T23:58:38.349 INFO:tasks.workunit.client.0.smithi196.stdout:8/691: mknod de/d2b/d30/d7c/cd0 0 2024-03-17T23:58:38.351 INFO:tasks.workunit.client.0.smithi196.stdout:8/692: mkdir de/d10/d35/d88/dd1 0 2024-03-17T23:58:38.353 INFO:tasks.workunit.client.0.smithi196.stdout:8/693: read de/d2b/d30/f50 [1476644,14411] 0 2024-03-17T23:58:38.355 INFO:tasks.workunit.client.0.smithi196.stdout:8/694: chown de/d10/d54/d5c/daa/f76 14607 1 2024-03-17T23:58:38.356 INFO:tasks.workunit.client.0.smithi196.stdout:8/695: stat de/d10/d54/dbe 0 2024-03-17T23:58:38.356 INFO:tasks.workunit.client.0.smithi196.stdout:5/874: dwrite d6/d17/d1f/d7d/d81/f9d [0,4194304] 0 2024-03-17T23:58:38.358 INFO:tasks.workunit.client.0.smithi196.stdout:5/875: read d6/f8 [913447,84169] 0 2024-03-17T23:58:38.360 INFO:tasks.workunit.client.0.smithi196.stdout:8/696: dread de/d5e/f60 [0,4194304] 0 2024-03-17T23:58:38.361 INFO:tasks.workunit.client.0.smithi196.stdout:5/876: creat d6/d2d/d33/d3b/f12a x:0 0 0 2024-03-17T23:58:38.362 INFO:tasks.workunit.client.0.smithi196.stdout:5/877: chown f1 4196 1 2024-03-17T23:58:38.363 INFO:tasks.workunit.client.0.smithi196.stdout:8/697: symlink de/d10/d35/d3e/ld2 0 2024-03-17T23:58:38.366 INFO:tasks.workunit.client.0.smithi196.stdout:8/698: mknod de/d2b/d9f/cd3 0 2024-03-17T23:58:38.373 INFO:tasks.workunit.client.0.smithi196.stdout:8/699: dwrite de/fbb [0,4194304] 0 2024-03-17T23:58:38.377 INFO:tasks.workunit.client.0.smithi196.stdout:8/700: mknod de/d10/d35/d88/cd4 0 2024-03-17T23:58:38.377 INFO:tasks.workunit.client.0.smithi196.stdout:8/701: stat de/d2b/d30 0 2024-03-17T23:58:38.379 INFO:tasks.workunit.client.0.smithi196.stdout:8/702: rmdir de/d10/d35/d88/dc4 39 2024-03-17T23:58:38.380 INFO:tasks.workunit.client.0.smithi196.stdout:8/703: dread - de/d10/d35/fa7 zero size 2024-03-17T23:58:38.382 INFO:tasks.workunit.client.0.smithi196.stdout:8/704: fsync de/f85 0 2024-03-17T23:58:38.385 INFO:tasks.workunit.client.0.smithi196.stdout:8/705: creat de/d10/d35/d88/dd1/fd5 x:0 0 0 2024-03-17T23:58:38.390 INFO:tasks.workunit.client.0.smithi196.stdout:8/706: dread de/d2b/d3c/f55 [0,4194304] 0 2024-03-17T23:58:38.392 INFO:tasks.workunit.client.0.smithi196.stdout:8/707: mkdir de/d2b/d30/d7c/dd6 0 2024-03-17T23:58:38.394 INFO:tasks.workunit.client.0.smithi196.stdout:8/708: chown de/d10/d35/d3e/f4c 190815 1 2024-03-17T23:58:38.400 INFO:tasks.workunit.client.0.smithi196.stdout:8/709: dread de/d10/d54/d5c/daa/fb3 [0,4194304] 0 2024-03-17T23:58:38.403 INFO:tasks.workunit.client.0.smithi196.stdout:8/710: dread de/d10/d35/d3e/f5f [0,4194304] 0 2024-03-17T23:58:38.404 INFO:tasks.workunit.client.0.smithi196.stdout:8/711: chown de/d10/d35/d88/d93/dbf 493757 1 2024-03-17T23:58:38.414 INFO:tasks.workunit.client.0.smithi196.stdout:8/712: dwrite de/d2b/d30/f51 [4194304,4194304] 0 2024-03-17T23:58:38.419 INFO:tasks.workunit.client.0.smithi196.stdout:8/713: symlink de/d10/d35/ld7 0 2024-03-17T23:58:38.419 INFO:tasks.workunit.client.0.smithi196.stdout:8/714: chown de/d2b/d30/fa8 989583 1 2024-03-17T23:58:38.420 INFO:tasks.workunit.client.0.smithi196.stdout:8/715: stat de/d2b/c40 0 2024-03-17T23:58:38.421 INFO:tasks.workunit.client.0.smithi196.stdout:8/716: readlink de/d2b/d3c/lb8 0 2024-03-17T23:58:38.422 INFO:tasks.workunit.client.0.smithi196.stdout:8/717: creat de/d5e/fd8 x:0 0 0 2024-03-17T23:58:38.429 INFO:tasks.workunit.client.0.smithi196.stdout:8/718: dwrite de/d10/d54/f92 [0,4194304] 0 2024-03-17T23:58:38.432 INFO:tasks.workunit.client.0.smithi196.stdout:8/719: creat de/d10/d35/d88/dd1/fd9 x:0 0 0 2024-03-17T23:58:38.434 INFO:tasks.workunit.client.0.smithi196.stdout:8/720: symlink de/d10/d35/lda 0 2024-03-17T23:58:38.440 INFO:tasks.workunit.client.0.smithi196.stdout:1/755: sync 2024-03-17T23:58:38.441 INFO:tasks.workunit.client.0.smithi196.stdout:8/721: truncate de/f23 167051 0 2024-03-17T23:58:38.450 INFO:tasks.workunit.client.0.smithi196.stdout:1/756: dwrite d1/d13/d23/d47/d48/d74/db2/fec [0,4194304] 0 2024-03-17T23:58:38.491 INFO:tasks.workunit.client.0.smithi196.stdout:1/757: mknod d1/d13/d23/d62/cf9 0 2024-03-17T23:58:38.491 INFO:tasks.workunit.client.0.smithi196.stdout:8/722: dwrite de/d10/d35/d3e/f8d [0,4194304] 0 2024-03-17T23:58:38.497 INFO:tasks.workunit.client.0.smithi196.stdout:1/758: stat d1/d13/d23/d62/c96 0 2024-03-17T23:58:38.497 INFO:tasks.workunit.client.0.smithi196.stdout:8/723: rmdir de/d2b/d30 39 2024-03-17T23:58:38.501 INFO:tasks.workunit.client.0.smithi196.stdout:1/759: creat d1/d13/d23/d47/d48/dc4/ffa x:0 0 0 2024-03-17T23:58:38.502 INFO:tasks.workunit.client.0.smithi196.stdout:8/724: dread de/d2b/d30/f7b [4194304,4194304] 0 2024-03-17T23:58:38.505 INFO:tasks.workunit.client.0.smithi196.stdout:8/725: fdatasync de/f13 0 2024-03-17T23:58:38.510 INFO:tasks.workunit.client.0.smithi196.stdout:8/726: fdatasync de/d10/d54/d5c/daa/f91 0 2024-03-17T23:58:38.510 INFO:tasks.workunit.client.0.smithi196.stdout:1/760: dwrite d1/d13/d4c/fe8 [0,4194304] 0 2024-03-17T23:58:38.511 INFO:tasks.workunit.client.0.smithi196.stdout:8/727: readlink de/d10/d54/lba 0 2024-03-17T23:58:38.515 INFO:tasks.workunit.client.0.smithi196.stdout:8/728: symlink de/d2b/d30/d7c/ldb 0 2024-03-17T23:58:38.521 INFO:tasks.workunit.client.0.smithi196.stdout:1/761: dwrite d1/d13/f3b [4194304,4194304] 0 2024-03-17T23:58:38.524 INFO:tasks.workunit.client.0.smithi196.stdout:8/729: dread de/d10/d35/d3e/f8d [0,4194304] 0 2024-03-17T23:58:38.531 INFO:tasks.workunit.client.0.smithi196.stdout:1/762: unlink d1/d13/d23/d62/lb5 0 2024-03-17T23:58:38.533 INFO:tasks.workunit.client.0.smithi196.stdout:1/763: stat d1/db/dd/d43/fda 0 2024-03-17T23:58:38.535 INFO:tasks.workunit.client.0.smithi196.stdout:1/764: readlink d1/db/l28 0 2024-03-17T23:58:38.538 INFO:tasks.workunit.client.0.smithi196.stdout:8/730: dwrite de/f85 [0,4194304] 0 2024-03-17T23:58:38.539 INFO:tasks.workunit.client.0.smithi196.stdout:1/765: rename d1/d13/d4c/l5f to d1/d13/d91/lfb 0 2024-03-17T23:58:38.541 INFO:tasks.workunit.client.0.smithi196.stdout:1/766: read - d1/d13/d2a/d94/fe1 zero size 2024-03-17T23:58:38.542 INFO:tasks.workunit.client.0.smithi196.stdout:8/731: creat de/d2b/d9f/fdc x:0 0 0 2024-03-17T23:58:38.543 INFO:tasks.workunit.client.0.smithi196.stdout:8/732: dread de/f23 [0,4194304] 0 2024-03-17T23:58:38.544 INFO:tasks.workunit.client.0.smithi196.stdout:8/733: chown de/d2b/d30/fa8 197 1 2024-03-17T23:58:38.545 INFO:tasks.workunit.client.0.smithi196.stdout:1/767: unlink d1/d13/d4c/da0/cac 0 2024-03-17T23:58:38.546 INFO:tasks.workunit.client.0.smithi196.stdout:8/734: creat de/d5e/fdd x:0 0 0 2024-03-17T23:58:38.547 INFO:tasks.workunit.client.0.smithi196.stdout:1/768: mknod d1/d13/d23/d70/cfc 0 2024-03-17T23:58:38.548 INFO:tasks.workunit.client.0.smithi196.stdout:1/769: readlink d1/d13/d23/d47/d48/d7e/l99 0 2024-03-17T23:58:38.550 INFO:tasks.workunit.client.0.smithi196.stdout:1/770: fsync d1/d13/d2a/d94/fc1 0 2024-03-17T23:58:38.551 INFO:tasks.workunit.client.0.smithi196.stdout:1/771: readlink d1/d13/d2a/l6d 0 2024-03-17T23:58:38.554 INFO:tasks.workunit.client.0.smithi196.stdout:1/772: symlink d1/lfd 0 2024-03-17T23:58:38.556 INFO:tasks.workunit.client.0.smithi196.stdout:1/773: dread - d1/d13/d23/d47/d48/d74/db2/d75/fb6 zero size 2024-03-17T23:58:38.557 INFO:tasks.workunit.client.0.smithi196.stdout:1/774: readlink d1/db/l8f 0 2024-03-17T23:58:38.557 INFO:tasks.workunit.client.0.smithi196.stdout:8/735: dwrite de/d2b/d3c/d5d/f64 [0,4194304] 0 2024-03-17T23:58:38.559 INFO:tasks.workunit.client.0.smithi196.stdout:8/736: write de/f2d [5140987,78332] 0 2024-03-17T23:58:38.560 INFO:tasks.workunit.client.0.smithi196.stdout:1/775: rmdir d1/d13/d4c/da0 39 2024-03-17T23:58:38.562 INFO:tasks.workunit.client.0.smithi196.stdout:8/737: mkdir de/d10/d54/d5c/daa/dde 0 2024-03-17T23:58:38.563 INFO:tasks.workunit.client.0.smithi196.stdout:8/738: fsync de/d10/f2c 0 2024-03-17T23:58:38.565 INFO:tasks.workunit.client.0.smithi196.stdout:1/776: rename d1/d13/d23/d47/d48/d74/db2 to d1/d13/d23/d62/dab/dca/dd1/dfe 0 2024-03-17T23:58:38.566 INFO:tasks.workunit.client.0.smithi196.stdout:8/739: symlink de/d2b/d30/d7c/dd6/ldf 0 2024-03-17T23:58:38.567 INFO:tasks.workunit.client.0.smithi196.stdout:1/777: creat d1/d13/d23/d47/d48/d7e/fff x:0 0 0 2024-03-17T23:58:38.569 INFO:tasks.workunit.client.0.smithi196.stdout:1/778: creat d1/d13/d23/d62/dab/dca/f100 x:0 0 0 2024-03-17T23:58:38.570 INFO:tasks.workunit.client.0.smithi196.stdout:8/740: rename de/d2b/d9f/fdc to de/d10/fe0 0 2024-03-17T23:58:38.571 INFO:tasks.workunit.client.0.smithi196.stdout:1/779: chown d1/c78 182463 1 2024-03-17T23:58:38.572 INFO:tasks.workunit.client.0.smithi196.stdout:8/741: truncate de/f23 1124752 0 2024-03-17T23:58:38.573 INFO:tasks.workunit.client.0.smithi196.stdout:1/780: mkdir d1/d13/d91/de9/d101 0 2024-03-17T23:58:38.574 INFO:tasks.workunit.client.0.smithi196.stdout:1/781: rmdir d1/d13/d23/d62/dab/dca/dd1 39 2024-03-17T23:58:38.576 INFO:tasks.workunit.client.0.smithi196.stdout:1/782: truncate d1/f16 7534981 0 2024-03-17T23:58:38.584 INFO:tasks.workunit.client.0.smithi196.stdout:7/951: sync 2024-03-17T23:58:38.586 INFO:tasks.workunit.client.0.smithi196.stdout:7/952: symlink da/d15/da7/l13d 0 2024-03-17T23:58:38.588 INFO:tasks.workunit.client.0.smithi196.stdout:7/953: mknod da/d3e/d45/d4f/d75/da8/c13e 0 2024-03-17T23:58:38.599 INFO:tasks.workunit.client.0.smithi196.stdout:7/954: dwrite da/d15/d1d/d4c/fce [0,4194304] 0 2024-03-17T23:58:38.603 INFO:tasks.workunit.client.0.smithi196.stdout:7/955: mknod da/d3e/d45/d4f/d75/da8/d78/da4/c13f 0 2024-03-17T23:58:38.604 INFO:tasks.workunit.client.0.smithi196.stdout:7/956: dread - da/d15/d1d/d2e/f105 zero size 2024-03-17T23:58:38.608 INFO:tasks.workunit.client.0.smithi196.stdout:7/957: link da/d3e/d45/d4f/d75/da8/ff8 da/d3e/d45/d4f/d75/de7/f140 0 2024-03-17T23:58:38.611 INFO:tasks.workunit.client.0.smithi196.stdout:1/783: dread d1/f9 [4194304,4194304] 0 2024-03-17T23:58:38.612 INFO:tasks.workunit.client.0.smithi196.stdout:1/784: stat d1/db/dd/d34/f8a 0 2024-03-17T23:58:38.614 INFO:tasks.workunit.client.0.smithi196.stdout:7/958: dread da/d15/d1d/d29/d113/d136/d70/f9a [0,4194304] 0 2024-03-17T23:58:38.618 INFO:tasks.workunit.client.0.smithi196.stdout:7/959: rename da/d15/d1d/d4c/f4e to da/d15/d1d/d29/d113/d136/d70/dc5/f141 0 2024-03-17T23:58:38.618 INFO:tasks.workunit.client.0.smithi196.stdout:7/960: dread - da/d3e/ddc/f107 zero size 2024-03-17T23:58:38.619 INFO:tasks.workunit.client.0.smithi196.stdout:1/785: write d1/db/dd/d43/fa7 [73947,12119] 0 2024-03-17T23:58:38.620 INFO:tasks.workunit.client.0.smithi196.stdout:1/786: chown d1/d13/d23/l26 1879459 1 2024-03-17T23:58:38.623 INFO:tasks.workunit.client.0.smithi196.stdout:7/961: rename da/d15/d1d/f32 to da/d3e/d45/d4f/d75/da8/d78/d9f/f142 0 2024-03-17T23:58:38.624 INFO:tasks.workunit.client.0.smithi196.stdout:1/787: creat d1/d13/d23/d62/dab/ded/f102 x:0 0 0 2024-03-17T23:58:38.626 INFO:tasks.workunit.client.0.smithi196.stdout:7/962: creat da/d3e/d45/d4f/d75/da8/d78/da4/d9b/f143 x:0 0 0 2024-03-17T23:58:38.628 INFO:tasks.workunit.client.0.smithi196.stdout:1/788: read d1/d13/d23/f37 [711542,130671] 0 2024-03-17T23:58:38.634 INFO:tasks.workunit.client.0.smithi196.stdout:1/789: rename d1/c22 to d1/d13/d23/d47/d48/d74/c103 0 2024-03-17T23:58:38.637 INFO:tasks.workunit.client.0.smithi196.stdout:1/790: getdents d1/d13 0 2024-03-17T23:58:38.640 INFO:tasks.workunit.client.0.smithi196.stdout:7/963: dwrite da/d15/d1d/f30 [0,4194304] 0 2024-03-17T23:58:38.642 INFO:tasks.workunit.client.0.smithi196.stdout:7/964: write da/d15/d1d/d29/fde [1771478,78977] 0 2024-03-17T23:58:38.645 INFO:tasks.workunit.client.0.smithi196.stdout:7/965: unlink da/d3e/d45/d4f/d75/da8/d78/da4/c58 0 2024-03-17T23:58:38.647 INFO:tasks.workunit.client.0.smithi196.stdout:7/966: write da/d3e/d45/d4f/d75/da8/f88 [2983234,93062] 0 2024-03-17T23:58:38.649 INFO:tasks.workunit.client.0.smithi196.stdout:1/791: write d1/f8 [3638423,109709] 0 2024-03-17T23:58:38.650 INFO:tasks.workunit.client.0.smithi196.stdout:7/967: creat da/d15/d1d/d29/d113/d136/da5/f144 x:0 0 0 2024-03-17T23:58:38.653 INFO:tasks.workunit.client.0.smithi196.stdout:1/792: mkdir d1/db/d104 0 2024-03-17T23:58:38.653 INFO:tasks.workunit.client.0.smithi196.stdout:7/968: truncate da/d15/d1d/d29/dc4/ffc 4718396 0 2024-03-17T23:58:38.655 INFO:tasks.workunit.client.0.smithi196.stdout:7/969: chown da/d15/d1d/d29/d113/d136/d70/f80 6 1 2024-03-17T23:58:38.659 INFO:tasks.workunit.client.0.smithi196.stdout:7/970: getdents da 0 2024-03-17T23:58:38.662 INFO:tasks.workunit.client.0.smithi196.stdout:1/793: dwrite d1/d13/d23/d47/d48/d7e/fd4 [0,4194304] 0 2024-03-17T23:58:38.665 INFO:tasks.workunit.client.0.smithi196.stdout:7/971: mknod da/d3e/d45/d4f/d75/da8/d78/d9f/c145 0 2024-03-17T23:58:38.669 INFO:tasks.workunit.client.0.smithi196.stdout:7/972: mknod da/d3e/d45/d4f/d75/d130/d13b/c146 0 2024-03-17T23:58:38.670 INFO:tasks.workunit.client.0.smithi196.stdout:1/794: link d1/db/l20 d1/db/dd/d43/df3/l105 0 2024-03-17T23:58:38.677 INFO:tasks.workunit.client.0.smithi196.stdout:7/973: dwrite da/d15/d1d/f23 [4194304,4194304] 0 2024-03-17T23:58:38.680 INFO:tasks.workunit.client.0.smithi196.stdout:7/974: dread da/d15/d1d/d29/d113/d136/da5/fd9 [0,4194304] 0 2024-03-17T23:58:38.682 INFO:tasks.workunit.client.0.smithi196.stdout:7/975: stat da/d3e/d7f/dc6/df0 0 2024-03-17T23:58:38.684 INFO:tasks.workunit.client.0.smithi196.stdout:7/976: mkdir da/d15/d1d/d2e/d147 0 2024-03-17T23:58:38.686 INFO:tasks.workunit.client.0.smithi196.stdout:7/977: mknod da/d15/c148 0 2024-03-17T23:58:38.692 INFO:tasks.workunit.client.0.smithi196.stdout:1/795: dread d1/d13/d2a/f90 [0,4194304] 0 2024-03-17T23:58:38.695 INFO:tasks.workunit.client.0.smithi196.stdout:1/796: mknod d1/d13/d91/c106 0 2024-03-17T23:58:38.698 INFO:tasks.workunit.client.0.smithi196.stdout:7/978: truncate da/d3e/d45/d4f/fed 2534564 0 2024-03-17T23:58:38.702 INFO:tasks.workunit.client.0.smithi196.stdout:7/979: rename da/d3e/d45/d4f/d75/fea to da/d3e/d7f/dc6/df0/f149 0 2024-03-17T23:58:38.703 INFO:tasks.workunit.client.0.smithi196.stdout:7/980: mknod da/d3e/d7f/d109/c14a 0 2024-03-17T23:58:38.705 INFO:tasks.workunit.client.0.smithi196.stdout:7/981: read - da/d15/d1d/d2e/f112 zero size 2024-03-17T23:58:38.707 INFO:tasks.workunit.client.0.smithi196.stdout:7/982: chown da/d3e/d45/d4f/d75/da8/d117 107977 1 2024-03-17T23:58:38.707 INFO:tasks.workunit.client.0.smithi196.stdout:1/797: dwrite d1/d13/d23/d47/d48/f80 [0,4194304] 0 2024-03-17T23:58:38.711 INFO:tasks.workunit.client.0.smithi196.stdout:7/983: read da/d15/d1d/d29/d113/d136/f62 [2847414,107604] 0 2024-03-17T23:58:38.712 INFO:tasks.workunit.client.0.smithi196.stdout:1/798: getdents d1/d13/d23/d47/d48/dc4 0 2024-03-17T23:58:38.714 INFO:tasks.workunit.client.0.smithi196.stdout:7/984: mkdir da/d3e/d45/d4f/d75/d14b 0 2024-03-17T23:58:38.716 INFO:tasks.workunit.client.0.smithi196.stdout:9/831: sync 2024-03-17T23:58:38.719 INFO:tasks.workunit.client.0.smithi196.stdout:7/985: dread da/d3e/d45/d4f/d75/da8/f88 [4194304,4194304] 0 2024-03-17T23:58:38.719 INFO:tasks.workunit.client.0.smithi196.stdout:1/799: dread d1/fa [0,4194304] 0 2024-03-17T23:58:38.720 INFO:tasks.workunit.client.0.smithi196.stdout:9/832: getdents d9/df/d14/d27/df3/d60/d85 0 2024-03-17T23:58:38.723 INFO:tasks.workunit.client.0.smithi196.stdout:1/800: creat d1/d13/d4c/dcd/f107 x:0 0 0 2024-03-17T23:58:38.724 INFO:tasks.workunit.client.0.smithi196.stdout:9/833: mknod d9/df/d4a/d5b/d6d/c10b 0 2024-03-17T23:58:38.726 INFO:tasks.workunit.client.0.smithi196.stdout:1/801: unlink d1/d13/d23/fb0 0 2024-03-17T23:58:38.726 INFO:tasks.workunit.client.0.smithi196.stdout:7/986: dread da/d15/d1d/d29/d113/d136/da5/fc8 [0,4194304] 0 2024-03-17T23:58:38.727 INFO:tasks.workunit.client.0.smithi196.stdout:9/834: creat d9/df/d55/dcf/d106/f10c x:0 0 0 2024-03-17T23:58:38.729 INFO:tasks.workunit.client.0.smithi196.stdout:9/835: dread - d9/df/d4a/d89/db1/fd4 zero size 2024-03-17T23:58:38.729 INFO:tasks.workunit.client.0.smithi196.stdout:1/802: symlink d1/db/dd/l108 0 2024-03-17T23:58:38.732 INFO:tasks.workunit.client.0.smithi196.stdout:7/987: dread da/d15/d1d/d2e/f69 [0,4194304] 0 2024-03-17T23:58:38.734 INFO:tasks.workunit.client.0.smithi196.stdout:1/803: symlink d1/d13/d23/d62/dab/dca/dd1/dfe/d75/l109 0 2024-03-17T23:58:38.736 INFO:tasks.workunit.client.0.smithi196.stdout:7/988: dread da/d3e/d45/dd8/de4/d8f/fb0 [0,4194304] 0 2024-03-17T23:58:38.743 INFO:tasks.workunit.client.0.smithi196.stdout:9/836: dread d9/df/d4a/d5b/da5/fad [0,4194304] 0 2024-03-17T23:58:38.747 INFO:tasks.workunit.client.0.smithi196.stdout:7/989: dwrite da/d3e/d45/d4f/d75/da8/f11a [0,4194304] 0 2024-03-17T23:58:38.748 INFO:tasks.workunit.client.0.smithi196.stdout:9/837: symlink d9/df/d55/l10d 0 2024-03-17T23:58:38.750 INFO:tasks.workunit.client.0.smithi196.stdout:7/990: readlink da/d3e/d45/d4f/d75/da8/lc2 0 2024-03-17T23:58:38.752 INFO:tasks.workunit.client.0.smithi196.stdout:9/838: rename d9/f44 to d9/df/d55/f10e 0 2024-03-17T23:58:38.762 INFO:tasks.workunit.client.0.smithi196.stdout:7/991: dwrite da/d3e/d45/d4f/d75/fd1 [0,4194304] 0 2024-03-17T23:58:38.765 INFO:tasks.workunit.client.0.smithi196.stdout:1/804: dread d1/d13/f3b [0,4194304] 0 2024-03-17T23:58:38.768 INFO:tasks.workunit.client.0.smithi196.stdout:1/805: symlink d1/db/dd/d34/l10a 0 2024-03-17T23:58:38.770 INFO:tasks.workunit.client.0.smithi196.stdout:1/806: truncate d1/d13/d23/fba 870616 0 2024-03-17T23:58:38.770 INFO:tasks.workunit.client.0.smithi196.stdout:9/839: dwrite d9/d12/d59/f65 [0,4194304] 0 2024-03-17T23:58:38.770 INFO:tasks.workunit.client.0.smithi196.stdout:7/992: rmdir da/d3e/ddc/d125 0 2024-03-17T23:58:38.771 INFO:tasks.workunit.client.0.smithi196.stdout:1/807: readlink d1/db/l19 0 2024-03-17T23:58:38.774 INFO:tasks.workunit.client.0.smithi196.stdout:1/808: write d1/db/dd/fc9 [3374435,9048] 0 2024-03-17T23:58:38.775 INFO:tasks.workunit.client.0.smithi196.stdout:9/840: write d9/df/d14/d27/df3/fb2 [2148121,106890] 0 2024-03-17T23:58:38.777 INFO:tasks.workunit.client.0.smithi196.stdout:1/809: dread - d1/d13/d23/d47/d48/d7e/fff zero size 2024-03-17T23:58:38.777 INFO:tasks.workunit.client.0.smithi196.stdout:7/993: rename da/d15/d1d/d29/d113/d136/laf to da/d3e/d7f/dc6/df0/l14c 0 2024-03-17T23:58:38.780 INFO:tasks.workunit.client.0.smithi196.stdout:7/994: fdatasync da/d15/d1d/d29/d113/d136/d70/f80 0 2024-03-17T23:58:38.785 INFO:tasks.workunit.client.0.smithi196.stdout:1/810: link d1/d13/d23/d62/d71/ca4 d1/db/d104/c10b 0 2024-03-17T23:58:38.787 INFO:tasks.workunit.client.0.smithi196.stdout:7/995: link da/d3e/d45/d4f/d75/da8/f96 da/d15/d1d/d2e/d12d/f14d 0 2024-03-17T23:58:38.787 INFO:tasks.workunit.client.0.smithi196.stdout:1/811: mkdir d1/d13/d91/de9/d10c 0 2024-03-17T23:58:38.792 INFO:tasks.workunit.client.0.smithi196.stdout:1/812: dread d1/d13/f3b [0,4194304] 0 2024-03-17T23:58:38.795 INFO:tasks.workunit.client.0.smithi196.stdout:7/996: dwrite da/d15/d1a/faa [0,4194304] 0 2024-03-17T23:58:38.801 INFO:tasks.workunit.client.0.smithi196.stdout:1/813: creat d1/d13/d23/d47/f10d x:0 0 0 2024-03-17T23:58:38.801 INFO:tasks.workunit.client.0.smithi196.stdout:9/841: dread d9/d12/d59/f63 [0,4194304] 0 2024-03-17T23:58:38.807 INFO:tasks.workunit.client.0.smithi196.stdout:7/997: rmdir da/d15/d1d/d29/d113/d136/da5 39 2024-03-17T23:58:38.813 INFO:tasks.workunit.client.0.smithi196.stdout:1/814: link d1/db/dd/c2c d1/d13/d2a/d94/c10e 0 2024-03-17T23:58:38.815 INFO:tasks.workunit.client.0.smithi196.stdout:1/815: write d1/d13/d23/d47/f10d [820560,22230] 0 2024-03-17T23:58:38.817 INFO:tasks.workunit.client.0.smithi196.stdout:1/816: readlink d1/db/lc 0 2024-03-17T23:58:38.820 INFO:tasks.workunit.client.0.smithi196.stdout:7/998: dread da/d3e/d7f/f84 [0,4194304] 0 2024-03-17T23:58:38.823 INFO:tasks.workunit.client.0.smithi196.stdout:9/842: dread d9/df/d14/d27/df3/d60/d85/d8e/fb8 [0,4194304] 0 2024-03-17T23:58:38.824 INFO:tasks.workunit.client.0.smithi196.stdout:1/817: dread d1/db/dd/f56 [0,4194304] 0 2024-03-17T23:58:38.825 INFO:tasks.workunit.client.0.smithi196.stdout:9/843: mkdir d9/dbb/de5/d10f 0 2024-03-17T23:58:38.826 INFO:tasks.workunit.client.0.smithi196.stdout:1/818: fdatasync d1/db/f15 0 2024-03-17T23:58:38.830 INFO:tasks.workunit.client.0.smithi196.stdout:1/819: read d1/f7c [896430,22074] 0 2024-03-17T23:58:38.834 INFO:tasks.workunit.client.0.smithi196.stdout:9/844: dread d9/df/d14/d3d/f8b [0,4194304] 0 2024-03-17T23:58:38.836 INFO:tasks.workunit.client.0.smithi196.stdout:7/999: dread da/d3e/d45/d4f/fed [0,4194304] 0 2024-03-17T23:58:38.837 INFO:tasks.workunit.client.0.smithi196.stdout:9/845: fdatasync d9/df/d14/d27/f49 0 2024-03-17T23:58:38.839 INFO:tasks.workunit.client.0.smithi196.stdout:9/846: mkdir d9/df/d55/d110 0 2024-03-17T23:58:38.845 INFO:tasks.workunit.client.0.smithi196.stdout:9/847: dwrite d9/df/d4a/d5b/d6d/f73 [0,4194304] 0 2024-03-17T23:58:38.847 INFO:tasks.workunit.client.0.smithi196.stdout:9/848: chown d9/df/d14/d27/df3/d60/l77 528 1 2024-03-17T23:58:38.859 INFO:tasks.workunit.client.0.smithi196.stdout:9/849: dwrite d9/d33/f52 [0,4194304] 0 2024-03-17T23:58:38.861 INFO:tasks.workunit.client.0.smithi196.stdout:9/850: mknod d9/df/d4a/d5b/d6d/da8/def/c111 0 2024-03-17T23:58:38.862 INFO:tasks.workunit.client.0.smithi196.stdout:9/851: read - d9/df/d14/d3d/f101 zero size 2024-03-17T23:58:38.865 INFO:tasks.workunit.client.0.smithi196.stdout:9/852: getdents d9/df/d4a/d5b/d6d/da8 0 2024-03-17T23:58:38.874 INFO:tasks.workunit.client.0.smithi196.stdout:9/853: dwrite d9/df/d14/d3d/f3e [0,4194304] 0 2024-03-17T23:58:38.877 INFO:tasks.workunit.client.0.smithi196.stdout:9/854: chown d9/df/d14/d27/df3/d60/d85/d8e/l9d 2002228 1 2024-03-17T23:58:38.879 INFO:tasks.workunit.client.0.smithi196.stdout:9/855: rename d9/df/d4a/d5b/d6d/da8/dc7/cf8 to d9/df/d4a/d5b/d6d/da8/c112 0 2024-03-17T23:58:38.881 INFO:tasks.workunit.client.0.smithi196.stdout:9/856: creat d9/dbb/f113 x:0 0 0 2024-03-17T23:58:38.884 INFO:tasks.workunit.client.0.smithi196.stdout:9/857: getdents d9/d12 0 2024-03-17T23:58:38.884 INFO:tasks.workunit.client.0.smithi196.stdout:9/858: dread - d9/df/d4a/d8c/f109 zero size 2024-03-17T23:58:38.886 INFO:tasks.workunit.client.0.smithi196.stdout:9/859: mkdir d9/dbb/de5/d114 0 2024-03-17T23:58:38.893 INFO:tasks.workunit.client.0.smithi196.stdout:9/860: dwrite d9/df/d4a/d8c/f109 [0,4194304] 0 2024-03-17T23:58:38.894 INFO:tasks.workunit.client.0.smithi196.stdout:9/861: chown d9/df/d14/d27/f3a 4082 1 2024-03-17T23:58:38.896 INFO:tasks.workunit.client.0.smithi196.stdout:9/862: creat d9/dbb/f115 x:0 0 0 2024-03-17T23:58:38.897 INFO:tasks.workunit.client.0.smithi196.stdout:9/863: write d9/df/d14/d27/df3/d60/ffe [649875,30188] 0 2024-03-17T23:58:38.901 INFO:tasks.workunit.client.0.smithi196.stdout:9/864: symlink d9/df/d4a/d5b/da5/l116 0 2024-03-17T23:58:38.902 INFO:tasks.workunit.client.0.smithi196.stdout:9/865: write d9/df/d14/d27/f31 [1043098,106828] 0 2024-03-17T23:58:38.905 INFO:tasks.workunit.client.0.smithi196.stdout:9/866: creat d9/f117 x:0 0 0 2024-03-17T23:58:38.907 INFO:tasks.workunit.client.0.smithi196.stdout:9/867: chown d9/df/d14/d27/df3/d60/d5e/f81 15105 1 2024-03-17T23:58:38.909 INFO:tasks.workunit.client.0.smithi196.stdout:6/910: sync 2024-03-17T23:58:38.910 INFO:tasks.workunit.client.0.smithi196.stdout:6/911: readlink d2/d14/l55 0 2024-03-17T23:58:38.911 INFO:tasks.workunit.client.0.smithi196.stdout:9/868: write d9/df/d4a/f80 [421457,118268] 0 2024-03-17T23:58:38.914 INFO:tasks.workunit.client.0.smithi196.stdout:9/869: creat d9/d12/f118 x:0 0 0 2024-03-17T23:58:38.917 INFO:tasks.workunit.client.0.smithi196.stdout:9/870: getdents d9/df/d14/d27/df3/d60/d85 0 2024-03-17T23:58:38.921 INFO:tasks.workunit.client.0.smithi196.stdout:6/912: dread d2/f45 [4194304,4194304] 0 2024-03-17T23:58:38.935 INFO:tasks.workunit.client.0.smithi196.stdout:9/871: truncate d9/df/d14/d27/df3/fb2 3280540 0 2024-03-17T23:58:38.937 INFO:tasks.workunit.client.0.smithi196.stdout:6/913: read d2/d14/d42/f4f [723340,116054] 0 2024-03-17T23:58:38.940 INFO:tasks.workunit.client.0.smithi196.stdout:6/914: symlink d2/d66/de3/l138 0 2024-03-17T23:58:38.942 INFO:tasks.workunit.client.0.smithi196.stdout:6/915: write d2/d14/d75/d7b/fb4 [1019904,91327] 0 2024-03-17T23:58:38.947 INFO:tasks.workunit.client.0.smithi196.stdout:6/916: dread d2/d14/d75/dc0/f10b [0,4194304] 0 2024-03-17T23:58:38.948 INFO:tasks.workunit.client.0.smithi196.stdout:6/917: fsync d2/d14/dcc/d103/f107 0 2024-03-17T23:58:38.950 INFO:tasks.workunit.client.0.smithi196.stdout:9/872: dwrite d9/df/d4a/d5b/d6d/da8/fca [0,4194304] 0 2024-03-17T23:58:38.952 INFO:tasks.workunit.client.0.smithi196.stdout:6/918: creat d2/d14/d75/d7b/d11b/f139 x:0 0 0 2024-03-17T23:58:38.955 INFO:tasks.workunit.client.0.smithi196.stdout:6/919: creat d2/d7/dcd/f13a x:0 0 0 2024-03-17T23:58:38.955 INFO:tasks.workunit.client.0.smithi196.stdout:9/873: mkdir d9/df/d119 0 2024-03-17T23:58:38.956 INFO:tasks.workunit.client.0.smithi196.stdout:9/874: chown d9/d12/f3c 701661331 1 2024-03-17T23:58:38.957 INFO:tasks.workunit.client.0.smithi196.stdout:6/920: creat d2/d7/d100/f13b x:0 0 0 2024-03-17T23:58:38.959 INFO:tasks.workunit.client.0.smithi196.stdout:6/921: chown d2/d14/d42/d57/ca6 1371537 1 2024-03-17T23:58:38.961 INFO:tasks.workunit.client.0.smithi196.stdout:6/922: mknod d2/d14/d42/c13c 0 2024-03-17T23:58:38.962 INFO:tasks.workunit.client.0.smithi196.stdout:6/923: fdatasync d2/d14/dcc/d103/f12b 0 2024-03-17T23:58:38.964 INFO:tasks.workunit.client.0.smithi196.stdout:6/924: fsync d2/d14/d42/d57/dc8/fc4 0 2024-03-17T23:58:38.969 INFO:tasks.workunit.client.0.smithi196.stdout:6/925: write d2/d7/d2b/f106 [252411,7071] 0 2024-03-17T23:58:38.972 INFO:tasks.workunit.client.0.smithi196.stdout:6/926: unlink d2/d14/d75/dc0/ddf/da1/fa9 0 2024-03-17T23:58:38.973 INFO:tasks.workunit.client.0.smithi196.stdout:6/927: fsync d2/d14/d42/d57/dc8/db3/fcb 0 2024-03-17T23:58:38.977 INFO:tasks.workunit.client.0.smithi196.stdout:6/928: link d2/d14/d75/d7b/l13 d2/l13d 0 2024-03-17T23:58:38.978 INFO:tasks.workunit.client.0.smithi196.stdout:6/929: dread - d2/d7/d2b/fe7 zero size 2024-03-17T23:58:38.986 INFO:tasks.workunit.client.0.smithi196.stdout:6/930: dwrite d2/d14/d75/d7b/f19 [4194304,4194304] 0 2024-03-17T23:58:38.989 INFO:tasks.workunit.client.0.smithi196.stdout:6/931: symlink d2/d14/d42/d57/dc8/l13e 0 2024-03-17T23:58:38.993 INFO:tasks.workunit.client.0.smithi196.stdout:6/932: write d2/d14/d42/f4f [1681409,29977] 0 2024-03-17T23:58:38.995 INFO:tasks.workunit.client.0.smithi196.stdout:6/933: mkdir d2/d66/de3/d13f 0 2024-03-17T23:58:39.017 INFO:tasks.workunit.client.0.smithi196.stdout:6/934: dread d2/d14/d50/f80 [0,4194304] 0 2024-03-17T23:58:39.030 INFO:tasks.workunit.client.0.smithi196.stdout:6/935: dread d2/d14/d75/d92/dd8/ff4 [0,4194304] 0 2024-03-17T23:58:39.032 INFO:tasks.workunit.client.0.smithi196.stdout:6/936: creat d2/d14/d8c/f140 x:0 0 0 2024-03-17T23:58:39.033 INFO:tasks.workunit.client.0.smithi196.stdout:6/937: write d2/d7/dcd/dd3/dba/f126 [894084,20695] 0 2024-03-17T23:58:39.034 INFO:tasks.workunit.client.0.smithi196.stdout:6/938: write d2/f3e [1483072,8470] 0 2024-03-17T23:58:39.036 INFO:tasks.workunit.client.0.smithi196.stdout:6/939: creat d2/d7/d100/f141 x:0 0 0 2024-03-17T23:58:39.037 INFO:tasks.workunit.client.0.smithi196.stdout:6/940: fsync d2/d14/d42/d57/d5f/dbd/feb 0 2024-03-17T23:58:39.039 INFO:tasks.workunit.client.0.smithi196.stdout:6/941: readlink d2/d14/d50/l89 0 2024-03-17T23:58:39.043 INFO:tasks.workunit.client.0.smithi196.stdout:6/942: getdents d2/d7 0 2024-03-17T23:58:39.045 INFO:tasks.workunit.client.0.smithi196.stdout:6/943: chown d2/d14/d75/dc0/ddf/c116 0 1 2024-03-17T23:58:39.050 INFO:tasks.workunit.client.0.smithi196.stdout:6/944: dwrite d2/d66/d90/fab [0,4194304] 0 2024-03-17T23:58:39.052 INFO:tasks.workunit.client.0.smithi196.stdout:6/945: chown d2/d14/d42/d57/dc8/f12d 199671 1 2024-03-17T23:58:39.058 INFO:tasks.workunit.client.0.smithi196.stdout:6/946: dwrite d2/d14/f47 [0,4194304] 0 2024-03-17T23:58:39.061 INFO:tasks.workunit.client.0.smithi196.stdout:6/947: mknod d2/d14/d75/d7b/c142 0 2024-03-17T23:58:39.067 INFO:tasks.workunit.client.0.smithi196.stdout:6/948: rename d2/faf to d2/d14/d75/d92/dd8/f143 0 2024-03-17T23:58:39.068 INFO:tasks.workunit.client.0.smithi196.stdout:6/949: mkdir d2/d7/d144 0 2024-03-17T23:58:39.070 INFO:tasks.workunit.client.0.smithi196.stdout:6/950: mkdir d2/d7/dcd/dd3/dba/d145 0 2024-03-17T23:58:39.073 INFO:tasks.workunit.client.0.smithi196.stdout:6/951: getdents d2/d14/d75/dc0/ddf/de6/dd9/de5 0 2024-03-17T23:58:39.085 INFO:tasks.workunit.client.0.smithi196.stdout:6/952: dwrite d2/d14/d42/d57/d5f/f8d [0,4194304] 0 2024-03-17T23:58:39.112 INFO:tasks.workunit.client.0.smithi196.stdout:6/953: dread d2/d14/dcc/d103/f12b [0,4194304] 0 2024-03-17T23:58:39.113 INFO:tasks.workunit.client.0.smithi196.stdout:6/954: fdatasync d2/d66/fa8 0 2024-03-17T23:58:39.115 INFO:tasks.workunit.client.0.smithi196.stdout:6/955: mkdir d2/d14/d35/d146 0 2024-03-17T23:58:39.133 INFO:tasks.workunit.client.0.smithi196.stdout:5/878: sync 2024-03-17T23:58:39.133 INFO:tasks.workunit.client.0.smithi196.stdout:4/774: sync 2024-03-17T23:58:39.134 INFO:tasks.workunit.client.0.smithi196.stdout:4/775: chown d1/d26/d33/d3f 24 1 2024-03-17T23:58:39.136 INFO:tasks.workunit.client.0.smithi196.stdout:6/956: dread d2/d14/d75/dc0/ddf/f7f [0,4194304] 0 2024-03-17T23:58:39.140 INFO:tasks.workunit.client.0.smithi196.stdout:6/957: link d2/d14/d75/d7b/fb4 d2/d14/d75/dc0/f147 0 2024-03-17T23:58:39.143 INFO:tasks.workunit.client.0.smithi196.stdout:6/958: unlink d2/d7/d2b/f84 0 2024-03-17T23:58:39.145 INFO:tasks.workunit.client.0.smithi196.stdout:6/959: write d2/d14/d35/d6a/ff5 [1028756,122353] 0 2024-03-17T23:58:39.151 INFO:tasks.workunit.client.0.smithi196.stdout:6/960: dwrite d2/f45 [4194304,4194304] 0 2024-03-17T23:58:39.155 INFO:tasks.workunit.client.0.smithi196.stdout:6/961: write d2/d14/d75/dc0/ddf/de6/dd9/de5/ff6 [2513381,113041] 0 2024-03-17T23:58:39.157 INFO:tasks.workunit.client.0.smithi196.stdout:5/879: dread d6/d2d/f55 [0,4194304] 0 2024-03-17T23:58:39.160 INFO:tasks.workunit.client.0.smithi196.stdout:5/880: read d6/d15/fb6 [2695137,92397] 0 2024-03-17T23:58:39.162 INFO:tasks.workunit.client.0.smithi196.stdout:5/881: readlink d6/d17/d3f/l61 0 2024-03-17T23:58:39.182 INFO:tasks.workunit.client.0.smithi196.stdout:6/962: dread d2/d7/d2b/f6e [0,4194304] 0 2024-03-17T23:58:39.224 INFO:tasks.workunit.client.0.smithi196.stdout:6/963: mknod d2/d14/d42/d57/dc8/c148 0 2024-03-17T23:58:39.225 INFO:tasks.workunit.client.0.smithi196.stdout:6/964: dread - d2/d14/dcc/d103/d121/f12e zero size 2024-03-17T23:58:39.232 INFO:tasks.workunit.client.0.smithi196.stdout:6/965: dwrite d2/d14/d42/f4f [4194304,4194304] 0 2024-03-17T23:58:39.234 INFO:tasks.workunit.client.0.smithi196.stdout:6/966: rmdir d2/d14/d42/d57/d5f/dbd 39 2024-03-17T23:58:39.238 INFO:tasks.workunit.client.0.smithi196.stdout:6/967: link d2/f3e d2/d14/d75/d7b/f149 0 2024-03-17T23:58:39.240 INFO:tasks.workunit.client.0.smithi196.stdout:6/968: rmdir d2/d14/d75/dc0/ddf/da1 39 2024-03-17T23:58:39.241 INFO:tasks.workunit.client.0.smithi196.stdout:6/969: mkdir d2/def/d14a 0 2024-03-17T23:58:39.242 INFO:tasks.workunit.client.0.smithi196.stdout:6/970: chown d2/d14/d75/dc0/f10b 102724 1 2024-03-17T23:58:39.242 INFO:tasks.workunit.client.0.smithi196.stdout:6/971: readlink d2/d14/l55 0 2024-03-17T23:58:39.243 INFO:tasks.workunit.client.0.smithi196.stdout:6/972: fdatasync f1 0 2024-03-17T23:58:39.243 INFO:tasks.workunit.client.0.smithi196.stdout:6/973: readlink d2/d66/l77 0 2024-03-17T23:58:39.245 INFO:tasks.workunit.client.0.smithi196.stdout:6/974: getdents d2/d14/dcc 0 2024-03-17T23:58:39.247 INFO:tasks.workunit.client.0.smithi196.stdout:6/975: creat d2/d7/dcd/dfb/f14b x:0 0 0 2024-03-17T23:58:39.248 INFO:tasks.workunit.client.0.smithi196.stdout:6/976: symlink d2/d14/de2/l14c 0 2024-03-17T23:58:39.250 INFO:tasks.workunit.client.0.smithi196.stdout:6/977: creat d2/d14/f14d x:0 0 0 2024-03-17T23:58:39.261 INFO:tasks.workunit.client.0.smithi196.stdout:8/742: sync 2024-03-17T23:58:39.287 INFO:tasks.workunit.client.0.smithi196.stdout:6/978: write d2/d14/d75/d92/dd8/ff4 [2593317,84644] 0 2024-03-17T23:58:39.293 INFO:tasks.workunit.client.0.smithi196.stdout:8/743: dwrite de/d2b/d30/d33/f5a [0,4194304] 0 2024-03-17T23:58:39.299 INFO:tasks.workunit.client.0.smithi196.stdout:8/744: rmdir de/d5e/dab 0 2024-03-17T23:58:39.301 INFO:tasks.workunit.client.0.smithi196.stdout:8/745: fsync de/d10/d54/fa6 0 2024-03-17T23:58:39.303 INFO:tasks.workunit.client.0.smithi196.stdout:6/979: dread d2/d7/dcd/dd3/f5a [0,4194304] 0 2024-03-17T23:58:39.305 INFO:tasks.workunit.client.0.smithi196.stdout:6/980: creat d2/d7/dcd/dfb/f14e x:0 0 0 2024-03-17T23:58:39.306 INFO:tasks.workunit.client.0.smithi196.stdout:6/981: stat d2/d66/l77 0 2024-03-17T23:58:39.311 INFO:tasks.workunit.client.0.smithi196.stdout:6/982: truncate d2/d7/d2b/f67 1016080 0 2024-03-17T23:58:39.312 INFO:tasks.workunit.client.0.smithi196.stdout:6/983: truncate d2/d14/d42/f64 1183076 0 2024-03-17T23:58:39.312 INFO:tasks.workunit.client.0.smithi196.stdout:8/746: dwrite de/d2b/d30/d33/f3d [0,4194304] 0 2024-03-17T23:58:39.315 INFO:tasks.workunit.client.0.smithi196.stdout:6/984: rename d2/d14/d75/dc0/ddf/de6/c125 to d2/d14/d75/dc0/ddf/de6/c14f 0 2024-03-17T23:58:39.318 INFO:tasks.workunit.client.0.smithi196.stdout:6/985: creat d2/d14/dcc/d103/f150 x:0 0 0 2024-03-17T23:58:39.318 INFO:tasks.workunit.client.0.smithi196.stdout:8/747: rmdir de/d10/d35/d88/dc4 39 2024-03-17T23:58:39.320 INFO:tasks.workunit.client.0.smithi196.stdout:6/986: creat d2/def/f151 x:0 0 0 2024-03-17T23:58:39.322 INFO:tasks.workunit.client.0.smithi196.stdout:6/987: write d2/fbc [7341867,15208] 0 2024-03-17T23:58:39.322 INFO:tasks.workunit.client.0.smithi196.stdout:8/748: mkdir de/d2b/d3c/d5d/de1 0 2024-03-17T23:58:39.324 INFO:tasks.workunit.client.0.smithi196.stdout:6/988: mkdir d2/d7/d144/d152 0 2024-03-17T23:58:39.325 INFO:tasks.workunit.client.0.smithi196.stdout:6/989: stat d2/d14/d50/d68 0 2024-03-17T23:58:39.331 INFO:tasks.workunit.client.0.smithi196.stdout:8/749: dwrite de/d5e/fd8 [0,4194304] 0 2024-03-17T23:58:39.338 INFO:tasks.workunit.client.0.smithi196.stdout:8/750: rename de/d10/d35/d3e/d6c/f80 to de/d10/d35/d88/d93/db9/fe2 0 2024-03-17T23:58:39.341 INFO:tasks.workunit.client.0.smithi196.stdout:6/990: dwrite d2/d14/d35/d6a/f136 [0,4194304] 0 2024-03-17T23:58:39.342 INFO:tasks.workunit.client.0.smithi196.stdout:8/751: truncate de/d10/d35/d3e/f4c 667769 0 2024-03-17T23:58:39.345 INFO:tasks.workunit.client.0.smithi196.stdout:6/991: stat d2/d14/d35/fc6 0 2024-03-17T23:58:39.346 INFO:tasks.workunit.client.0.smithi196.stdout:8/752: read de/d10/f2e [4156022,25264] 0 2024-03-17T23:58:39.349 INFO:tasks.workunit.client.0.smithi196.stdout:6/992: mkdir d2/d7/d100/d153 0 2024-03-17T23:58:39.350 INFO:tasks.workunit.client.0.smithi196.stdout:6/993: read - d2/d14/d35/d6a/fea zero size 2024-03-17T23:58:39.350 INFO:tasks.workunit.client.0.smithi196.stdout:8/753: write de/d2b/d3c/f55 [4106168,95491] 0 2024-03-17T23:58:39.353 INFO:tasks.workunit.client.0.smithi196.stdout:6/994: symlink d2/d7/d2b/l154 0 2024-03-17T23:58:39.353 INFO:tasks.workunit.client.0.smithi196.stdout:8/754: write de/d10/d43/d71/fa2 [980364,13156] 0 2024-03-17T23:58:39.362 INFO:tasks.workunit.client.0.smithi196.stdout:6/995: truncate d2/fbc 2865566 0 2024-03-17T23:58:39.371 INFO:tasks.workunit.client.0.smithi196.stdout:6/996: dwrite d2/def/f108 [0,4194304] 0 2024-03-17T23:58:39.373 INFO:tasks.workunit.client.0.smithi196.stdout:6/997: fdatasync d2/d14/d42/f4f 0 2024-03-17T23:58:39.378 INFO:tasks.workunit.client.0.smithi196.stdout:8/755: dread de/fbb [0,4194304] 0 2024-03-17T23:58:39.380 INFO:tasks.workunit.client.0.smithi196.stdout:8/756: chown de/d10/d35/la1 16168599 1 2024-03-17T23:58:39.382 INFO:tasks.workunit.client.0.smithi196.stdout:6/998: dread d2/d66/d90/f97 [0,4194304] 0 2024-03-17T23:58:39.384 INFO:tasks.workunit.client.0.smithi196.stdout:6/999: chown d2/d14/d42/d57/d5f 15 1 2024-03-17T23:58:39.385 INFO:tasks.workunit.client.0.smithi196.stdout:8/757: truncate f6 6429399 0 2024-03-17T23:58:39.385 INFO:tasks.workunit.client.0.smithi196.stdout:1/820: sync 2024-03-17T23:58:39.387 INFO:tasks.workunit.client.0.smithi196.stdout:8/758: mknod de/d10/d54/d5c/ce3 0 2024-03-17T23:58:39.388 INFO:tasks.workunit.client.0.smithi196.stdout:8/759: chown de/d2b/d30/d33/c53 3 1 2024-03-17T23:58:39.394 INFO:tasks.workunit.client.0.smithi196.stdout:1/821: dwrite d1/d13/d23/d62/dab/ded/f102 [0,4194304] 0 2024-03-17T23:58:39.396 INFO:tasks.workunit.client.0.smithi196.stdout:8/760: write de/d10/d35/d3e/f4c [1277644,30928] 0 2024-03-17T23:58:39.397 INFO:tasks.workunit.client.0.smithi196.stdout:8/761: readlink de/d10/d35/d88/l89 0 2024-03-17T23:58:39.410 INFO:tasks.workunit.client.0.smithi196.stdout:8/762: dwrite de/d10/d54/d5c/fa0 [0,4194304] 0 2024-03-17T23:58:39.412 INFO:tasks.workunit.client.0.smithi196.stdout:1/822: dread d1/d13/d4c/dcd/fdb [0,4194304] 0 2024-03-17T23:58:39.412 INFO:tasks.workunit.client.0.smithi196.stdout:8/763: symlink de/d2b/d3c/le4 0 2024-03-17T23:58:39.413 INFO:tasks.workunit.client.0.smithi196.stdout:1/823: dread - d1/db/dd/d43/f98 zero size 2024-03-17T23:58:39.415 INFO:tasks.workunit.client.0.smithi196.stdout:1/824: getdents d1/d13/d91/de9/d10c 0 2024-03-17T23:58:39.416 INFO:tasks.workunit.client.0.smithi196.stdout:1/825: readlink d1/d13/d23/d62/d71/l88 0 2024-03-17T23:58:39.417 INFO:tasks.workunit.client.0.smithi196.stdout:8/764: truncate de/d2b/faf 1262474 0 2024-03-17T23:58:39.418 INFO:tasks.workunit.client.0.smithi196.stdout:1/826: rmdir d1/d13/d23/d47/d48/dc4 39 2024-03-17T23:58:39.420 INFO:tasks.workunit.client.0.smithi196.stdout:8/765: dread de/d10/d35/d3e/f5f [0,4194304] 0 2024-03-17T23:58:39.420 INFO:tasks.workunit.client.0.smithi196.stdout:1/827: fsync d1/d13/d23/f37 0 2024-03-17T23:58:39.422 INFO:tasks.workunit.client.0.smithi196.stdout:1/828: chown d1/d13/d23/d62/dab/dca/dd1/dfe/d75/fe0 124770 1 2024-03-17T23:58:39.426 INFO:tasks.workunit.client.0.smithi196.stdout:1/829: rename d1/d13/d4c/da0 to d1/d13/d91/de9/df5/d10f 0 2024-03-17T23:58:39.431 INFO:tasks.workunit.client.0.smithi196.stdout:8/766: dread de/f1f [0,4194304] 0 2024-03-17T23:58:39.432 INFO:tasks.workunit.client.0.smithi196.stdout:1/830: write d1/db/dd/d34/f8d [783733,111572] 0 2024-03-17T23:58:39.434 INFO:tasks.workunit.client.0.smithi196.stdout:1/831: mkdir d1/d13/d23/d70/d110 0 2024-03-17T23:58:39.436 INFO:tasks.workunit.client.0.smithi196.stdout:8/767: rename de/c32 to de/d2b/d3c/ce5 0 2024-03-17T23:58:39.439 INFO:tasks.workunit.client.0.smithi196.stdout:8/768: truncate de/f98 1053030 0 2024-03-17T23:58:39.441 INFO:tasks.workunit.client.0.smithi196.stdout:8/769: fsync f6 0 2024-03-17T23:58:39.443 INFO:tasks.workunit.client.0.smithi196.stdout:1/832: truncate d1/f16 2065677 0 2024-03-17T23:58:39.444 INFO:tasks.workunit.client.0.smithi196.stdout:8/770: mkdir de/d10/d54/d5c/dcc/de6 0 2024-03-17T23:58:39.445 INFO:tasks.workunit.client.0.smithi196.stdout:8/771: stat de/d10/d43/l4d 0 2024-03-17T23:58:39.446 INFO:tasks.workunit.client.0.smithi196.stdout:1/833: unlink d1/d13/d23/d47/d48/fbc 0 2024-03-17T23:58:39.448 INFO:tasks.workunit.client.0.smithi196.stdout:1/834: truncate d1/d13/d23/d47/d48/d7e/fff 144205 0 2024-03-17T23:58:39.449 INFO:tasks.workunit.client.0.smithi196.stdout:1/835: symlink d1/d13/d91/de9/df5/l111 0 2024-03-17T23:58:39.453 INFO:tasks.workunit.client.0.smithi196.stdout:9/875: sync 2024-03-17T23:58:39.454 INFO:tasks.workunit.client.0.smithi196.stdout:8/772: dwrite de/fbb [0,4194304] 0 2024-03-17T23:58:39.461 INFO:tasks.workunit.client.0.smithi196.stdout:8/773: write de/d10/d54/f92 [867106,127745] 0 2024-03-17T23:58:39.466 INFO:tasks.workunit.client.0.smithi196.stdout:1/836: dread d1/d13/d23/d47/d48/fcf [0,4194304] 0 2024-03-17T23:58:39.470 INFO:tasks.workunit.client.0.smithi196.stdout:8/774: write de/d10/d54/d5c/daa/fb3 [1671454,56923] 0 2024-03-17T23:58:39.471 INFO:tasks.workunit.client.0.smithi196.stdout:9/876: dwrite d9/d12/d59/f63 [0,4194304] 0 2024-03-17T23:58:39.474 INFO:tasks.workunit.client.0.smithi196.stdout:8/775: unlink de/d10/d54/fa6 0 2024-03-17T23:58:39.477 INFO:tasks.workunit.client.0.smithi196.stdout:9/877: write d9/df/d14/d27/df3/d60/d5e/fb9 [1642159,26089] 0 2024-03-17T23:58:39.481 INFO:tasks.workunit.client.0.smithi196.stdout:8/776: link de/d10/d43/l4d de/d2b/d30/d7c/dc9/le7 0 2024-03-17T23:58:39.482 INFO:tasks.workunit.client.0.smithi196.stdout:1/837: dwrite d1/db/dd/f93 [4194304,4194304] 0 2024-03-17T23:58:39.487 INFO:tasks.workunit.client.0.smithi196.stdout:1/838: creat d1/d13/d91/de9/f112 x:0 0 0 2024-03-17T23:58:39.489 INFO:tasks.workunit.client.0.smithi196.stdout:1/839: fsync d1/d13/d2a/f90 0 2024-03-17T23:58:39.490 INFO:tasks.workunit.client.0.smithi196.stdout:9/878: truncate d9/d12/d59/f65 3581289 0 2024-03-17T23:58:39.491 INFO:tasks.workunit.client.0.smithi196.stdout:8/777: write de/d10/d54/d5c/daa/f76 [1193015,15767] 0 2024-03-17T23:58:39.492 INFO:tasks.workunit.client.0.smithi196.stdout:9/879: fdatasync d9/df/d14/d3d/f101 0 2024-03-17T23:58:39.493 INFO:tasks.workunit.client.0.smithi196.stdout:1/840: creat d1/db/dd/f113 x:0 0 0 2024-03-17T23:58:39.494 INFO:tasks.workunit.client.0.smithi196.stdout:8/778: mknod de/d2b/d3c/d5d/ce8 0 2024-03-17T23:58:39.495 INFO:tasks.workunit.client.0.smithi196.stdout:1/841: write d1/d13/d23/d62/dab/ded/f102 [3628747,104871] 0 2024-03-17T23:58:39.496 INFO:tasks.workunit.client.0.smithi196.stdout:9/880: symlink d9/df/d14/l11a 0 2024-03-17T23:58:39.497 INFO:tasks.workunit.client.0.smithi196.stdout:9/881: readlink d9/df/d55/lfd 0 2024-03-17T23:58:39.499 INFO:tasks.workunit.client.0.smithi196.stdout:8/779: mkdir de/d10/d35/de9 0 2024-03-17T23:58:39.500 INFO:tasks.workunit.client.0.smithi196.stdout:5/882: sync 2024-03-17T23:58:39.501 INFO:tasks.workunit.client.0.smithi196.stdout:4/776: sync 2024-03-17T23:58:39.503 INFO:tasks.workunit.client.0.smithi196.stdout:9/882: rename d9/df/d4a/d5b/d6d/fd0 to d9/df/d14/d27/df3/d60/f11b 0 2024-03-17T23:58:39.504 INFO:tasks.workunit.client.0.smithi196.stdout:8/780: mkdir de/d10/d35/d88/dd1/dea 0 2024-03-17T23:58:39.508 INFO:tasks.workunit.client.0.smithi196.stdout:5/883: rename d6/d17/d1f/d5c/fef to d6/d17/d3f/d4e/d69/f12b 0 2024-03-17T23:58:39.509 INFO:tasks.workunit.client.0.smithi196.stdout:9/883: write d9/df/d14/d27/f4c [1199193,9744] 0 2024-03-17T23:58:39.512 INFO:tasks.workunit.client.0.smithi196.stdout:4/777: creat d1/d26/d57/d8c/f110 x:0 0 0 2024-03-17T23:58:39.515 INFO:tasks.workunit.client.0.smithi196.stdout:4/778: creat d1/de/d50/d55/de4/f111 x:0 0 0 2024-03-17T23:58:39.518 INFO:tasks.workunit.client.0.smithi196.stdout:4/779: mknod d1/d11/d5d/dfa/c112 0 2024-03-17T23:58:39.520 INFO:tasks.workunit.client.0.smithi196.stdout:9/884: creat d9/df/f11c x:0 0 0 2024-03-17T23:58:39.521 INFO:tasks.workunit.client.0.smithi196.stdout:9/885: write d9/df/d14/d27/d9e/dc5/fcb [621513,79434] 0 2024-03-17T23:58:39.522 INFO:tasks.workunit.client.0.smithi196.stdout:4/780: creat d1/d68/f113 x:0 0 0 2024-03-17T23:58:39.524 INFO:tasks.workunit.client.0.smithi196.stdout:8/781: truncate de/d2b/d30/f68 593038 0 2024-03-17T23:58:39.525 INFO:tasks.workunit.client.0.smithi196.stdout:9/886: creat d9/df/d4a/d8c/f11d x:0 0 0 2024-03-17T23:58:39.527 INFO:tasks.workunit.client.0.smithi196.stdout:8/782: creat de/d2b/d30/feb x:0 0 0 2024-03-17T23:58:39.528 INFO:tasks.workunit.client.0.smithi196.stdout:5/884: dread d6/d2a/fb3 [0,4194304] 0 2024-03-17T23:58:39.530 INFO:tasks.workunit.client.0.smithi196.stdout:9/887: creat d9/df/d14/d27/df3/d60/d85/d8e/f11e x:0 0 0 2024-03-17T23:58:39.537 INFO:tasks.workunit.client.0.smithi196.stdout:4/781: dread d1/d26/d33/f88 [0,4194304] 0 2024-03-17T23:58:39.538 INFO:tasks.workunit.client.0.smithi196.stdout:9/888: dread d9/d12/d59/f63 [4194304,4194304] 0 2024-03-17T23:58:39.541 INFO:tasks.workunit.client.0.smithi196.stdout:5/885: rename d6/d17/d3f/da5/lab to d6/d2d/d33/d3b/d80/db9/l12c 0 2024-03-17T23:58:39.541 INFO:tasks.workunit.client.0.smithi196.stdout:8/783: truncate de/d10/f2e 2967636 0 2024-03-17T23:58:39.544 INFO:tasks.workunit.client.0.smithi196.stdout:9/889: creat d9/df/d14/d27/df3/d60/d85/d8e/d99/f11f x:0 0 0 2024-03-17T23:58:39.544 INFO:tasks.workunit.client.0.smithi196.stdout:9/890: chown d9/df/d4a/d5b/d6d/da8/fbc 6 1 2024-03-17T23:58:39.546 INFO:tasks.workunit.client.0.smithi196.stdout:5/886: rmdir d6/d2d/d33/d3b/d80/da0 39 2024-03-17T23:58:39.546 INFO:tasks.workunit.client.0.smithi196.stdout:8/784: chown de/d2b/d3c/d5d/lc7 67006 1 2024-03-17T23:58:39.552 INFO:tasks.workunit.client.0.smithi196.stdout:9/891: symlink d9/df/d14/d27/d9e/dc5/l120 0 2024-03-17T23:58:39.556 INFO:tasks.workunit.client.0.smithi196.stdout:4/782: dwrite d1/d26/d33/f88 [0,4194304] 0 2024-03-17T23:58:39.562 INFO:tasks.workunit.client.0.smithi196.stdout:5/887: dwrite d6/d17/f106 [0,4194304] 0 2024-03-17T23:58:39.565 INFO:tasks.workunit.client.0.smithi196.stdout:5/888: read d6/d17/d1f/d5c/fd0 [3425572,16391] 0 2024-03-17T23:58:39.571 INFO:tasks.workunit.client.0.smithi196.stdout:4/783: getdents d1/df7 0 2024-03-17T23:58:39.572 INFO:tasks.workunit.client.0.smithi196.stdout:4/784: chown d1/d26/d57/dac 101 1 2024-03-17T23:58:39.574 INFO:tasks.workunit.client.0.smithi196.stdout:9/892: dread d9/df/d14/d27/df3/f3f [0,4194304] 0 2024-03-17T23:58:39.574 INFO:tasks.workunit.client.0.smithi196.stdout:8/785: dread de/d2b/d3c/f55 [0,4194304] 0 2024-03-17T23:58:39.574 INFO:tasks.workunit.client.0.smithi196.stdout:4/785: dread - d1/de/d50/d55/de4/f111 zero size 2024-03-17T23:58:39.575 INFO:tasks.workunit.client.0.smithi196.stdout:5/889: link d6/d17/d23/l127 d6/d2d/l12d 0 2024-03-17T23:58:39.581 INFO:tasks.workunit.client.0.smithi196.stdout:4/786: dread d1/d26/d33/f88 [0,4194304] 0 2024-03-17T23:58:39.581 INFO:tasks.workunit.client.0.smithi196.stdout:9/893: creat d9/df/d14/d27/df3/d60/d5e/f121 x:0 0 0 2024-03-17T23:58:39.588 INFO:tasks.workunit.client.0.smithi196.stdout:4/787: write d1/d1b/f59 [36325,102672] 0 2024-03-17T23:58:39.590 INFO:tasks.workunit.client.0.smithi196.stdout:4/788: chown d1/d26/d57/dac 322945193 1 2024-03-17T23:58:39.590 INFO:tasks.workunit.client.0.smithi196.stdout:5/890: dwrite f3 [0,4194304] 0 2024-03-17T23:58:39.596 INFO:tasks.workunit.client.0.smithi196.stdout:5/891: creat d6/d15/f12e x:0 0 0 2024-03-17T23:58:39.597 INFO:tasks.workunit.client.0.smithi196.stdout:9/894: dread d9/df/d14/d27/df3/d60/d5e/f57 [0,4194304] 0 2024-03-17T23:58:39.604 INFO:tasks.workunit.client.0.smithi196.stdout:9/895: unlink d9/d12/f16 0 2024-03-17T23:58:39.605 INFO:tasks.workunit.client.0.smithi196.stdout:4/789: dwrite d1/d1b/d77/f101 [0,4194304] 0 2024-03-17T23:58:39.607 INFO:tasks.workunit.client.0.smithi196.stdout:4/790: stat d1/d26/d57/d8c/d97/f102 0 2024-03-17T23:58:39.610 INFO:tasks.workunit.client.0.smithi196.stdout:5/892: getdents d6/d2d/d33/d3b/d65 0 2024-03-17T23:58:39.613 INFO:tasks.workunit.client.0.smithi196.stdout:4/791: getdents d1/de/d50/d55/de4 0 2024-03-17T23:58:39.614 INFO:tasks.workunit.client.0.smithi196.stdout:5/893: truncate d6/d17/d35/f4f 5082102 0 2024-03-17T23:58:39.614 INFO:tasks.workunit.client.0.smithi196.stdout:4/792: chown d1/d26/d57/de6 0 1 2024-03-17T23:58:39.618 INFO:tasks.workunit.client.0.smithi196.stdout:4/793: symlink d1/d26/d33/d40/da1/l114 0 2024-03-17T23:58:39.619 INFO:tasks.workunit.client.0.smithi196.stdout:5/894: write d6/d17/d1f/f11d [214360,130195] 0 2024-03-17T23:58:39.620 INFO:tasks.workunit.client.0.smithi196.stdout:9/896: dread d9/f4e [0,4194304] 0 2024-03-17T23:58:39.627 INFO:tasks.workunit.client.0.smithi196.stdout:9/897: dread d9/df/d14/d27/df3/d60/f61 [4194304,4194304] 0 2024-03-17T23:58:39.629 INFO:tasks.workunit.client.0.smithi196.stdout:9/898: symlink d9/dbb/de5/l122 0 2024-03-17T23:58:39.630 INFO:tasks.workunit.client.0.smithi196.stdout:4/794: truncate d1/de/d50/f9e 1582817 0 2024-03-17T23:58:39.631 INFO:tasks.workunit.client.0.smithi196.stdout:4/795: write d1/d1b/d77/fb4 [2840387,103132] 0 2024-03-17T23:58:39.635 INFO:tasks.workunit.client.0.smithi196.stdout:9/899: unlink d9/df/d4a/d5b/d6d/da8/fca 0 2024-03-17T23:58:39.639 INFO:tasks.workunit.client.0.smithi196.stdout:5/895: dwrite d6/d17/d23/d7e/f10d [0,4194304] 0 2024-03-17T23:58:39.641 INFO:tasks.workunit.client.0.smithi196.stdout:4/796: unlink d1/de/c93 0 2024-03-17T23:58:39.647 INFO:tasks.workunit.client.0.smithi196.stdout:4/797: truncate d1/d1b/ff6 60952 0 2024-03-17T23:58:39.647 INFO:tasks.workunit.client.0.smithi196.stdout:5/896: write d6/d2a/fb3 [2217643,107507] 0 2024-03-17T23:58:39.655 INFO:tasks.workunit.client.0.smithi196.stdout:9/900: dwrite d9/df/f7b [0,4194304] 0 2024-03-17T23:58:39.657 INFO:tasks.workunit.client.0.smithi196.stdout:5/897: dread d6/d17/f106 [0,4194304] 0 2024-03-17T23:58:39.662 INFO:tasks.workunit.client.0.smithi196.stdout:5/898: mkdir d6/d15/dc0/d105/d12f 0 2024-03-17T23:58:39.664 INFO:tasks.workunit.client.0.smithi196.stdout:9/901: write d9/df/d4a/d89/db1/fb3 [83604,28940] 0 2024-03-17T23:58:39.664 INFO:tasks.workunit.client.0.smithi196.stdout:4/798: dread d1/d1b/d77/f90 [0,4194304] 0 2024-03-17T23:58:39.665 INFO:tasks.workunit.client.0.smithi196.stdout:4/799: read - d1/d26/d57/d8c/f110 zero size 2024-03-17T23:58:39.668 INFO:tasks.workunit.client.0.smithi196.stdout:9/902: creat d9/df/d14/d3d/df2/f123 x:0 0 0 2024-03-17T23:58:39.669 INFO:tasks.workunit.client.0.smithi196.stdout:4/800: chown d1/d26/d33/d40/da1/c106 296414525 1 2024-03-17T23:58:39.671 INFO:tasks.workunit.client.0.smithi196.stdout:4/801: write d1/feb [666514,106963] 0 2024-03-17T23:58:39.671 INFO:tasks.workunit.client.0.smithi196.stdout:9/903: symlink d9/l124 0 2024-03-17T23:58:39.676 INFO:tasks.workunit.client.0.smithi196.stdout:5/899: dwrite d6/f123 [0,4194304] 0 2024-03-17T23:58:39.677 INFO:tasks.workunit.client.0.smithi196.stdout:9/904: write d9/df/d14/d27/fa6 [2316646,17653] 0 2024-03-17T23:58:39.677 INFO:tasks.workunit.client.0.smithi196.stdout:4/802: truncate d1/d26/d33/d40/f5e 2572814 0 2024-03-17T23:58:39.679 INFO:tasks.workunit.client.0.smithi196.stdout:5/900: unlink d6/d17/d23/l7b 0 2024-03-17T23:58:39.680 INFO:tasks.workunit.client.0.smithi196.stdout:4/803: chown d1/d26/d8b/de9/l10a 697364 1 2024-03-17T23:58:39.680 INFO:tasks.workunit.client.0.smithi196.stdout:9/905: truncate d9/f25 422804 0 2024-03-17T23:58:39.683 INFO:tasks.workunit.client.0.smithi196.stdout:9/906: chown d9/d12/c1f 7 1 2024-03-17T23:58:39.684 INFO:tasks.workunit.client.0.smithi196.stdout:4/804: symlink d1/d26/d57/dac/l115 0 2024-03-17T23:58:39.692 INFO:tasks.workunit.client.0.smithi196.stdout:4/805: dwrite d1/d26/fe2 [0,4194304] 0 2024-03-17T23:58:39.724 INFO:tasks.workunit.client.0.smithi196.stdout:1/842: sync 2024-03-17T23:58:39.725 INFO:tasks.workunit.client.0.smithi196.stdout:1/843: stat d1/d13/d23/d47/d48/d7e/f87 0 2024-03-17T23:58:39.734 INFO:tasks.workunit.client.0.smithi196.stdout:5/901: write d6/d17/d23/d7e/fc8 [2090990,128816] 0 2024-03-17T23:58:39.736 INFO:tasks.workunit.client.0.smithi196.stdout:4/806: creat d1/de/d50/d55/de4/f116 x:0 0 0 2024-03-17T23:58:39.738 INFO:tasks.workunit.client.0.smithi196.stdout:1/844: chown d1/d13/d23/d62/dd0 3081833 1 2024-03-17T23:58:39.740 INFO:tasks.workunit.client.0.smithi196.stdout:9/907: dwrite d9/df/d55/f10e [0,4194304] 0 2024-03-17T23:58:39.747 INFO:tasks.workunit.client.0.smithi196.stdout:1/845: creat d1/d13/d23/d62/d71/f114 x:0 0 0 2024-03-17T23:58:39.760 INFO:tasks.workunit.client.0.smithi196.stdout:8/786: sync 2024-03-17T23:58:39.761 INFO:tasks.workunit.client.0.smithi196.stdout:8/787: stat de/d5e/f60 0 2024-03-17T23:58:39.762 INFO:tasks.workunit.client.0.smithi196.stdout:5/902: dread d6/d2d/f96 [4194304,4194304] 0 2024-03-17T23:58:39.772 INFO:tasks.workunit.client.0.smithi196.stdout:5/903: dwrite d6/d2d/d33/d3b/f12a [0,4194304] 0 2024-03-17T23:58:39.778 INFO:tasks.workunit.client.0.smithi196.stdout:5/904: truncate d6/d17/d35/f4f 2453410 0 2024-03-17T23:58:39.787 INFO:tasks.workunit.client.0.smithi196.stdout:1/846: rmdir d1/d13/d2a/d94 39 2024-03-17T23:58:39.819 INFO:tasks.workunit.client.0.smithi196.stdout:4/807: dwrite d1/d26/d33/d40/da1/fc1 [0,4194304] 0 2024-03-17T23:58:39.821 INFO:tasks.workunit.client.0.smithi196.stdout:4/808: chown d1/d1b/f75 5746 1 2024-03-17T23:58:39.826 INFO:tasks.workunit.client.0.smithi196.stdout:9/908: truncate d9/df/d14/d27/df3/d60/d5e/f57 4151308 0 2024-03-17T23:58:39.827 INFO:tasks.workunit.client.0.smithi196.stdout:9/909: symlink d9/d12/d59/l125 0 2024-03-17T23:58:39.828 INFO:tasks.workunit.client.0.smithi196.stdout:4/809: link d1/dd2/le1 d1/d26/d57/l117 0 2024-03-17T23:58:39.831 INFO:tasks.workunit.client.0.smithi196.stdout:1/847: rename d1/d13/d23/d47/d48/d74/lc6 to d1/d13/d23/l115 0 2024-03-17T23:58:39.833 INFO:tasks.workunit.client.0.smithi196.stdout:9/910: getdents d9/df/d119 0 2024-03-17T23:58:39.836 INFO:tasks.workunit.client.0.smithi196.stdout:9/911: chown d9/df/d4a/d5b/d6d/da8/dc7/cf1 163 1 2024-03-17T23:58:39.840 INFO:tasks.workunit.client.0.smithi196.stdout:1/848: rename d1/d13/d2a/c31 to d1/d13/d23/d47/d48/c116 0 2024-03-17T23:58:39.843 INFO:tasks.workunit.client.0.smithi196.stdout:8/788: creat de/d10/fec x:0 0 0 2024-03-17T23:58:39.848 INFO:tasks.workunit.client.0.smithi196.stdout:8/789: mknod de/d2b/d30/ced 0 2024-03-17T23:58:39.852 INFO:tasks.workunit.client.0.smithi196.stdout:5/905: dwrite d6/d17/f26 [0,4194304] 0 2024-03-17T23:58:39.854 INFO:tasks.workunit.client.0.smithi196.stdout:1/849: dwrite d1/d13/d23/d62/dab/ded/fe7 [0,4194304] 0 2024-03-17T23:58:39.855 INFO:tasks.workunit.client.0.smithi196.stdout:5/906: truncate d6/d15/f12e 555765 0 2024-03-17T23:58:39.861 INFO:tasks.workunit.client.0.smithi196.stdout:8/790: mknod de/d10/d35/d88/d93/db9/cee 0 2024-03-17T23:58:39.862 INFO:tasks.workunit.client.0.smithi196.stdout:4/810: write d1/d26/d8b/de9/fa3 [306524,54552] 0 2024-03-17T23:58:39.862 INFO:tasks.workunit.client.0.smithi196.stdout:9/912: dread d9/df/d14/d27/f3a [0,4194304] 0 2024-03-17T23:58:39.864 INFO:tasks.workunit.client.0.smithi196.stdout:9/913: write d9/df/d14/d27/f31 [2994902,41419] 0 2024-03-17T23:58:39.869 INFO:tasks.workunit.client.0.smithi196.stdout:5/907: rmdir d6/d17/d1f 39 2024-03-17T23:58:39.871 INFO:tasks.workunit.client.0.smithi196.stdout:1/850: dread d1/f16 [0,4194304] 0 2024-03-17T23:58:39.874 INFO:tasks.workunit.client.0.smithi196.stdout:5/908: truncate d6/d2a/f31 7863648 0 2024-03-17T23:58:39.875 INFO:tasks.workunit.client.0.smithi196.stdout:8/791: getdents de/d10/d35/d88/dd1/dea 0 2024-03-17T23:58:39.877 INFO:tasks.workunit.client.0.smithi196.stdout:1/851: write d1/d13/f3b [3029403,86864] 0 2024-03-17T23:58:39.879 INFO:tasks.workunit.client.0.smithi196.stdout:4/811: rename d1/d26/d33/d3f/cda to d1/c118 0 2024-03-17T23:58:39.880 INFO:tasks.workunit.client.0.smithi196.stdout:1/852: symlink d1/d13/d91/de9/l117 0 2024-03-17T23:58:39.884 INFO:tasks.workunit.client.0.smithi196.stdout:1/853: mkdir d1/d13/d23/d62/dab/dca/dd1/dfe/d75/d118 0 2024-03-17T23:58:39.886 INFO:tasks.workunit.client.0.smithi196.stdout:9/914: rename d9/df/d14/d27/df3/d60/ffe to d9/df/f126 0 2024-03-17T23:58:39.888 INFO:tasks.workunit.client.0.smithi196.stdout:5/909: getdents d6/d17/d1f/d7d/d89 0 2024-03-17T23:58:39.890 INFO:tasks.workunit.client.0.smithi196.stdout:8/792: rename de/f98 to de/d10/d54/d5c/dcc/fef 0 2024-03-17T23:58:39.892 INFO:tasks.workunit.client.0.smithi196.stdout:1/854: dwrite d1/d13/d4c/fc2 [0,4194304] 0 2024-03-17T23:58:39.894 INFO:tasks.workunit.client.0.smithi196.stdout:9/915: write d9/df/d14/d27/df3/d60/d85/d8e/fb8 [4328388,106111] 0 2024-03-17T23:58:39.895 INFO:tasks.workunit.client.0.smithi196.stdout:4/812: link d1/d26/d33/d3f/f6e d1/d11/f119 0 2024-03-17T23:58:39.896 INFO:tasks.workunit.client.0.smithi196.stdout:4/813: readlink d1/d1b/l7f 0 2024-03-17T23:58:39.897 INFO:tasks.workunit.client.0.smithi196.stdout:5/910: mkdir d6/d2d/d33/d3b/d80/da0/d130 0 2024-03-17T23:58:39.898 INFO:tasks.workunit.client.0.smithi196.stdout:5/911: write d6/d17/d35/f66 [3669117,64025] 0 2024-03-17T23:58:39.903 INFO:tasks.workunit.client.0.smithi196.stdout:9/916: creat d9/d12/f127 x:0 0 0 2024-03-17T23:58:39.903 INFO:tasks.workunit.client.0.smithi196.stdout:9/917: stat d9/df/d14/db0/lfc 0 2024-03-17T23:58:39.904 INFO:tasks.workunit.client.0.smithi196.stdout:9/918: fsync d9/df/d14/d27/df3/d60/d5e/fea 0 2024-03-17T23:58:39.905 INFO:tasks.workunit.client.0.smithi196.stdout:9/919: truncate d9/df/f126 1584228 0 2024-03-17T23:58:39.905 INFO:tasks.workunit.client.0.smithi196.stdout:1/855: truncate d1/d13/d23/d47/d48/d74/f84 272023 0 2024-03-17T23:58:39.907 INFO:tasks.workunit.client.0.smithi196.stdout:9/920: chown d9/df/d4a/d5b/da5/le3 6847 1 2024-03-17T23:58:39.908 INFO:tasks.workunit.client.0.smithi196.stdout:4/814: creat d1/d1b/d77/f11a x:0 0 0 2024-03-17T23:58:39.910 INFO:tasks.workunit.client.0.smithi196.stdout:8/793: unlink de/d2b/d30/f50 0 2024-03-17T23:58:39.914 INFO:tasks.workunit.client.0.smithi196.stdout:8/794: dread de/fbb [0,4194304] 0 2024-03-17T23:58:39.915 INFO:tasks.workunit.client.0.smithi196.stdout:1/856: rename d1/d13/d23/d62/d71/lae to d1/d13/d23/d47/d48/d7e/l119 0 2024-03-17T23:58:39.916 INFO:tasks.workunit.client.0.smithi196.stdout:1/857: chown d1 22 1 2024-03-17T23:58:39.917 INFO:tasks.workunit.client.0.smithi196.stdout:9/921: unlink d9/d12/f21 0 2024-03-17T23:58:39.920 INFO:tasks.workunit.client.0.smithi196.stdout:5/912: creat d6/d2d/d33/d3b/d80/da0/d130/f131 x:0 0 0 2024-03-17T23:58:39.924 INFO:tasks.workunit.client.0.smithi196.stdout:9/922: write d9/df/d55/dcf/d106/f10c [112240,74053] 0 2024-03-17T23:58:39.924 INFO:tasks.workunit.client.0.smithi196.stdout:9/923: stat d9/dbb/fe9 0 2024-03-17T23:58:39.929 INFO:tasks.workunit.client.0.smithi196.stdout:8/795: creat de/d2b/d30/d7c/ff0 x:0 0 0 2024-03-17T23:58:39.932 INFO:tasks.workunit.client.0.smithi196.stdout:9/924: rename d9/dbb/f115 to d9/d12/d59/f128 0 2024-03-17T23:58:39.934 INFO:tasks.workunit.client.0.smithi196.stdout:8/796: write de/d10/d35/d88/d93/db9/fe2 [5079534,74504] 0 2024-03-17T23:58:39.935 INFO:tasks.workunit.client.0.smithi196.stdout:1/858: getdents d1/d13/d23/d62/dab/dca/dd1/dfe/d75 0 2024-03-17T23:58:39.936 INFO:tasks.workunit.client.0.smithi196.stdout:5/913: getdents d6/d17/d3f 0 2024-03-17T23:58:39.937 INFO:tasks.workunit.client.0.smithi196.stdout:4/815: dwrite d1/d1b/f75 [0,4194304] 0 2024-03-17T23:58:39.938 INFO:tasks.workunit.client.0.smithi196.stdout:9/925: rename d9/d12/d59/f6e to d9/df/d14/db0/f129 0 2024-03-17T23:58:39.940 INFO:tasks.workunit.client.0.smithi196.stdout:9/926: chown d9/df/d14/l11a 11 1 2024-03-17T23:58:39.946 INFO:tasks.workunit.client.0.smithi196.stdout:8/797: unlink de/d10/d35/d3e/f5f 0 2024-03-17T23:58:39.947 INFO:tasks.workunit.client.0.smithi196.stdout:5/914: mkdir d6/d2d/db8/d132 0 2024-03-17T23:58:39.949 INFO:tasks.workunit.client.0.smithi196.stdout:4/816: creat d1/d11/f11b x:0 0 0 2024-03-17T23:58:39.951 INFO:tasks.workunit.client.0.smithi196.stdout:9/927: rename d9/df/d4a/d8c to d9/df/d14/d27/df3/d60/d85/d12a 0 2024-03-17T23:58:39.951 INFO:tasks.workunit.client.0.smithi196.stdout:8/798: rmdir de/d10/d43/d71 39 2024-03-17T23:58:39.952 INFO:tasks.workunit.client.0.smithi196.stdout:5/915: truncate f1 4850407 0 2024-03-17T23:58:39.954 INFO:tasks.workunit.client.0.smithi196.stdout:5/916: chown d6/d17/c18 101229 1 2024-03-17T23:58:39.954 INFO:tasks.workunit.client.0.smithi196.stdout:1/859: link d1/d13/d23/d47/d48/d7e/cbf d1/d13/d23/d47/d48/d7e/c11a 0 2024-03-17T23:58:39.955 INFO:tasks.workunit.client.0.smithi196.stdout:9/928: mknod d9/df/d14/db0/dce/c12b 0 2024-03-17T23:58:39.959 INFO:tasks.workunit.client.0.smithi196.stdout:9/929: write d9/df/d14/d27/f31 [3785910,120421] 0 2024-03-17T23:58:39.960 INFO:tasks.workunit.client.0.smithi196.stdout:8/799: rename de/d2b/l34 to de/d2b/d3c/d5d/lf1 0 2024-03-17T23:58:39.961 INFO:tasks.workunit.client.0.smithi196.stdout:9/930: readlink d9/df/d14/d27/df3/d60/d5e/lc3 0 2024-03-17T23:58:39.962 INFO:tasks.workunit.client.0.smithi196.stdout:4/817: dwrite d1/de/d50/d55/de4/f111 [0,4194304] 0 2024-03-17T23:58:39.962 INFO:tasks.workunit.client.0.smithi196.stdout:1/860: creat d1/f11b x:0 0 0 2024-03-17T23:58:39.964 INFO:tasks.workunit.client.0.smithi196.stdout:5/917: creat d6/d17/d23/f133 x:0 0 0 2024-03-17T23:58:39.971 INFO:tasks.workunit.client.0.smithi196.stdout:8/800: fsync de/d2b/d30/d33/f48 0 2024-03-17T23:58:39.973 INFO:tasks.workunit.client.0.smithi196.stdout:8/801: chown de/d10/d35/d88/dd1 98953 1 2024-03-17T23:58:39.973 INFO:tasks.workunit.client.0.smithi196.stdout:1/861: mknod d1/d13/d23/d62/d71/de6/c11c 0 2024-03-17T23:58:39.975 INFO:tasks.workunit.client.0.smithi196.stdout:9/931: mkdir d9/df/d55/d12c 0 2024-03-17T23:58:39.976 INFO:tasks.workunit.client.0.smithi196.stdout:8/802: read de/d2b/d3c/d5d/f64 [1065504,101844] 0 2024-03-17T23:58:39.978 INFO:tasks.workunit.client.0.smithi196.stdout:1/862: unlink d1/d13/d23/d47/f10d 0 2024-03-17T23:58:39.983 INFO:tasks.workunit.client.0.smithi196.stdout:8/803: mknod de/d10/d54/d5c/cf2 0 2024-03-17T23:58:39.984 INFO:tasks.workunit.client.0.smithi196.stdout:1/863: dread d1/d13/d23/d62/dab/ded/f102 [0,4194304] 0 2024-03-17T23:58:39.985 INFO:tasks.workunit.client.0.smithi196.stdout:9/932: rename d9/df/d14/d27/d9e/dc5 to d9/df/d4a/d89/db1/dd7/d12d 0 2024-03-17T23:58:39.988 INFO:tasks.workunit.client.0.smithi196.stdout:1/864: fdatasync d1/db/dd/f72 0 2024-03-17T23:58:39.990 INFO:tasks.workunit.client.0.smithi196.stdout:4/818: fsync d1/d26/d8b/de9/fbf 0 2024-03-17T23:58:39.991 INFO:tasks.workunit.client.0.smithi196.stdout:1/865: fsync d1/d13/d23/d62/dab/dca/dd1/dfe/d75/f7d 0 2024-03-17T23:58:39.991 INFO:tasks.workunit.client.0.smithi196.stdout:8/804: rename de/d10/d54/d5c/cf2 to de/d2b/d30/d7c/dc9/cf3 0 2024-03-17T23:58:39.993 INFO:tasks.workunit.client.0.smithi196.stdout:5/918: dwrite d6/d2d/d33/f9b [0,4194304] 0 2024-03-17T23:58:40.007 INFO:tasks.workunit.client.0.smithi196.stdout:9/933: dwrite d9/df/d14/d27/df3/d60/d5e/f121 [0,4194304] 0 2024-03-17T23:58:40.008 INFO:tasks.workunit.client.0.smithi196.stdout:5/919: unlink d6/d17/d23/d53/f8f 0 2024-03-17T23:58:40.009 INFO:tasks.workunit.client.0.smithi196.stdout:1/866: dread d1/d13/d23/d47/d48/fcf [0,4194304] 0 2024-03-17T23:58:40.010 INFO:tasks.workunit.client.0.smithi196.stdout:4/819: mkdir d1/d26/d33/d40/da1/d109/d11c 0 2024-03-17T23:58:40.015 INFO:tasks.workunit.client.0.smithi196.stdout:4/820: chown d1/d11/fa6 106810035 1 2024-03-17T23:58:40.016 INFO:tasks.workunit.client.0.smithi196.stdout:8/805: creat de/d10/d35/d88/dd1/dea/ff4 x:0 0 0 2024-03-17T23:58:40.016 INFO:tasks.workunit.client.0.smithi196.stdout:1/867: chown d1/d13/d23/d62/dab/dca/dd1/dfe/d75/fb6 3471320 1 2024-03-17T23:58:40.017 INFO:tasks.workunit.client.0.smithi196.stdout:9/934: fdatasync d9/d33/f42 0 2024-03-17T23:58:40.017 INFO:tasks.workunit.client.0.smithi196.stdout:5/920: rename d6/d2d/c63 to d6/d17/d1f/c134 0 2024-03-17T23:58:40.018 INFO:tasks.workunit.client.0.smithi196.stdout:4/821: mkdir d1/de/d50/d55/de4/df2/d11d 0 2024-03-17T23:58:40.020 INFO:tasks.workunit.client.0.smithi196.stdout:9/935: creat d9/df/d14/d3d/f12e x:0 0 0 2024-03-17T23:58:40.020 INFO:tasks.workunit.client.0.smithi196.stdout:4/822: read d1/d26/d33/fd8 [127394,73853] 0 2024-03-17T23:58:40.022 INFO:tasks.workunit.client.0.smithi196.stdout:1/868: dread d1/fa [0,4194304] 0 2024-03-17T23:58:40.027 INFO:tasks.workunit.client.0.smithi196.stdout:8/806: rename de/d5e/f70 to de/d10/ff5 0 2024-03-17T23:58:40.028 INFO:tasks.workunit.client.0.smithi196.stdout:1/869: symlink d1/d13/d91/de9/df5/d10f/l11d 0 2024-03-17T23:58:40.029 INFO:tasks.workunit.client.0.smithi196.stdout:9/936: dread d9/df/d4a/d89/db1/dd7/d12d/fcb [0,4194304] 0 2024-03-17T23:58:40.034 INFO:tasks.workunit.client.0.smithi196.stdout:8/807: mknod de/d10/d35/d88/d93/db9/cf6 0 2024-03-17T23:58:40.034 INFO:tasks.workunit.client.0.smithi196.stdout:5/921: dwrite d6/d17/d1f/d5c/fd0 [0,4194304] 0 2024-03-17T23:58:40.037 INFO:tasks.workunit.client.0.smithi196.stdout:8/808: write de/d2b/d30/d7c/dc9/fcd [716534,9353] 0 2024-03-17T23:58:40.039 INFO:tasks.workunit.client.0.smithi196.stdout:9/937: rename d9/df/d14/d27/d9e to d9/df/d4a/d89/db1/d12f 0 2024-03-17T23:58:40.041 INFO:tasks.workunit.client.0.smithi196.stdout:5/922: fsync d6/d17/d23/d53/d97/fe4 0 2024-03-17T23:58:40.041 INFO:tasks.workunit.client.0.smithi196.stdout:1/870: dwrite d1/d13/d2a/d94/fe1 [0,4194304] 0 2024-03-17T23:58:40.044 INFO:tasks.workunit.client.0.smithi196.stdout:9/938: write d9/d12/f127 [477834,96345] 0 2024-03-17T23:58:40.044 INFO:tasks.workunit.client.0.smithi196.stdout:8/809: creat de/d10/d35/d88/d93/ff7 x:0 0 0 2024-03-17T23:58:40.047 INFO:tasks.workunit.client.0.smithi196.stdout:5/923: dread - d6/d17/d23/d53/fa1 zero size 2024-03-17T23:58:40.052 INFO:tasks.workunit.client.0.smithi196.stdout:4/823: dwrite d1/d1b/d77/fdd [0,4194304] 0 2024-03-17T23:58:40.054 INFO:tasks.workunit.client.0.smithi196.stdout:8/810: creat de/d5e/ff8 x:0 0 0 2024-03-17T23:58:40.058 INFO:tasks.workunit.client.0.smithi196.stdout:4/824: chown d1/d11/cdf 800 1 2024-03-17T23:58:40.061 INFO:tasks.workunit.client.0.smithi196.stdout:9/939: dwrite d9/d12/f118 [0,4194304] 0 2024-03-17T23:58:40.062 INFO:tasks.workunit.client.0.smithi196.stdout:8/811: creat de/d2b/d3c/ff9 x:0 0 0 2024-03-17T23:58:40.067 INFO:tasks.workunit.client.0.smithi196.stdout:5/924: truncate d6/d2d/f102 461105 0 2024-03-17T23:58:40.068 INFO:tasks.workunit.client.0.smithi196.stdout:4/825: write d1/d11/d5d/dfa/f104 [837255,92669] 0 2024-03-17T23:58:40.070 INFO:tasks.workunit.client.0.smithi196.stdout:9/940: creat d9/df/d4a/d89/db1/dd7/f130 x:0 0 0 2024-03-17T23:58:40.071 INFO:tasks.workunit.client.0.smithi196.stdout:4/826: creat d1/de/d50/d55/d4a/f11e x:0 0 0 2024-03-17T23:58:40.074 INFO:tasks.workunit.client.0.smithi196.stdout:4/827: chown d1/d26/d33/d40/lfd 151 1 2024-03-17T23:58:40.079 INFO:tasks.workunit.client.0.smithi196.stdout:9/941: rmdir d9/df/d4a/d89/db1/dd7/de1 0 2024-03-17T23:58:40.082 INFO:tasks.workunit.client.0.smithi196.stdout:5/925: dwrite d6/d15/f12e [0,4194304] 0 2024-03-17T23:58:40.082 INFO:tasks.workunit.client.0.smithi196.stdout:9/942: mkdir d9/dbb/d131 0 2024-03-17T23:58:40.082 INFO:tasks.workunit.client.0.smithi196.stdout:5/926: fsync d6/d17/d23/d53/d97/fe4 0 2024-03-17T23:58:40.087 INFO:tasks.workunit.client.0.smithi196.stdout:1/871: dread d1/db/fe [0,4194304] 0 2024-03-17T23:58:40.088 INFO:tasks.workunit.client.0.smithi196.stdout:9/943: rename d9/df/d14/l50 to d9/df/d4a/d89/db1/l132 0 2024-03-17T23:58:40.096 INFO:tasks.workunit.client.0.smithi196.stdout:8/812: dread de/d2b/d3c/d5d/f64 [0,4194304] 0 2024-03-17T23:58:40.103 INFO:tasks.workunit.client.0.smithi196.stdout:9/944: symlink d9/dbb/l133 0 2024-03-17T23:58:40.109 INFO:tasks.workunit.client.0.smithi196.stdout:4/828: dread d1/d11/d5d/dfa/f104 [0,4194304] 0 2024-03-17T23:58:40.110 INFO:tasks.workunit.client.0.smithi196.stdout:9/945: mknod d9/df/d14/d27/c134 0 2024-03-17T23:58:40.110 INFO:tasks.workunit.client.0.smithi196.stdout:9/946: fdatasync d9/df/d4a/d5b/d6d/f73 0 2024-03-17T23:58:40.111 INFO:tasks.workunit.client.0.smithi196.stdout:5/927: dwrite d6/d17/d23/fc6 [0,4194304] 0 2024-03-17T23:58:40.113 INFO:tasks.workunit.client.0.smithi196.stdout:1/872: dread d1/db/dd/fc9 [0,4194304] 0 2024-03-17T23:58:40.116 INFO:tasks.workunit.client.0.smithi196.stdout:9/947: readlink d9/df/d4a/d89/lf7 0 2024-03-17T23:58:40.125 INFO:tasks.workunit.client.0.smithi196.stdout:8/813: dwrite de/d5e/f60 [0,4194304] 0 2024-03-17T23:58:40.125 INFO:tasks.workunit.client.0.smithi196.stdout:4/829: dwrite d1/d1b/d77/fb4 [0,4194304] 0 2024-03-17T23:58:40.136 INFO:tasks.workunit.client.0.smithi196.stdout:4/830: dwrite d1/d11/d5d/ded/ff0 [0,4194304] 0 2024-03-17T23:58:40.141 INFO:tasks.workunit.client.0.smithi196.stdout:8/814: mkdir de/d10/d35/d88/d93/dfa 0 2024-03-17T23:58:40.142 INFO:tasks.workunit.client.0.smithi196.stdout:1/873: mkdir d1/d13/d23/d47/d48/d11e 0 2024-03-17T23:58:40.145 INFO:tasks.workunit.client.0.smithi196.stdout:9/948: rename d9/dbb/de5/l122 to d9/df/d4a/d5b/l135 0 2024-03-17T23:58:40.148 INFO:tasks.workunit.client.0.smithi196.stdout:1/874: mkdir d1/d13/d23/d47/d48/d11e/d11f 0 2024-03-17T23:58:40.148 INFO:tasks.workunit.client.0.smithi196.stdout:9/949: mknod d9/df/d4a/d89/db1/dd7/d12d/c136 0 2024-03-17T23:58:40.152 INFO:tasks.workunit.client.0.smithi196.stdout:5/928: dread d6/d17/d1f/d7d/fb2 [0,4194304] 0 2024-03-17T23:58:40.153 INFO:tasks.workunit.client.0.smithi196.stdout:4/831: dwrite d1/dd2/f108 [0,4194304] 0 2024-03-17T23:58:40.154 INFO:tasks.workunit.client.0.smithi196.stdout:4/832: dread - d1/d26/d8b/ff8 zero size 2024-03-17T23:58:40.156 INFO:tasks.workunit.client.0.smithi196.stdout:1/875: truncate d1/d13/d23/d62/dab/dca/dd1/dfe/d75/fe0 193750 0 2024-03-17T23:58:40.157 INFO:tasks.workunit.client.0.smithi196.stdout:1/876: fsync d1/d13/d23/d47/d48/d7e/fff 0 2024-03-17T23:58:40.157 INFO:tasks.workunit.client.0.smithi196.stdout:8/815: rename de/d2b/d30/f68 to de/d10/d35/d88/dd1/dea/ffb 0 2024-03-17T23:58:40.159 INFO:tasks.workunit.client.0.smithi196.stdout:8/816: chown de/d10/d54/d5c/ce3 20050535 1 2024-03-17T23:58:40.161 INFO:tasks.workunit.client.0.smithi196.stdout:5/929: creat d6/d17/d3f/d4e/d69/ded/d10c/f135 x:0 0 0 2024-03-17T23:58:40.162 INFO:tasks.workunit.client.0.smithi196.stdout:4/833: creat d1/d11/d5d/f11f x:0 0 0 2024-03-17T23:58:40.170 INFO:tasks.workunit.client.0.smithi196.stdout:1/877: read d1/db/dd/f5d [155767,61438] 0 2024-03-17T23:58:40.170 INFO:tasks.workunit.client.0.smithi196.stdout:8/817: unlink de/d2b/d3c/le4 0 2024-03-17T23:58:40.171 INFO:tasks.workunit.client.0.smithi196.stdout:9/950: dread d9/df/d55/dcf/ffb [0,4194304] 0 2024-03-17T23:58:40.172 INFO:tasks.workunit.client.0.smithi196.stdout:8/818: fdatasync de/d10/f24 0 2024-03-17T23:58:40.174 INFO:tasks.workunit.client.0.smithi196.stdout:4/834: symlink d1/d1b/d77/l120 0 2024-03-17T23:58:40.175 INFO:tasks.workunit.client.0.smithi196.stdout:9/951: fdatasync d9/d12/d59/f63 0 2024-03-17T23:58:40.177 INFO:tasks.workunit.client.0.smithi196.stdout:8/819: rmdir de/d10/d35 39 2024-03-17T23:58:40.187 INFO:tasks.workunit.client.0.smithi196.stdout:4/835: mkdir d1/de/d50/d55/d4a/d121 0 2024-03-17T23:58:40.188 INFO:tasks.workunit.client.0.smithi196.stdout:9/952: mkdir d9/d12/d137 0 2024-03-17T23:58:40.192 INFO:tasks.workunit.client.0.smithi196.stdout:1/878: creat d1/db/dd/df1/f120 x:0 0 0 2024-03-17T23:58:40.196 INFO:tasks.workunit.client.0.smithi196.stdout:5/930: dwrite d6/ff [0,4194304] 0 2024-03-17T23:58:40.198 INFO:tasks.workunit.client.0.smithi196.stdout:5/931: fdatasync d6/d2d/d33/d3b/d80/da0/f115 0 2024-03-17T23:58:40.199 INFO:tasks.workunit.client.0.smithi196.stdout:9/953: dwrite d9/df/d14/d27/df3/d60/fe2 [0,4194304] 0 2024-03-17T23:58:40.204 INFO:tasks.workunit.client.0.smithi196.stdout:9/954: read d9/df/d4a/d89/fd6 [191975,81458] 0 2024-03-17T23:58:40.211 INFO:tasks.workunit.client.0.smithi196.stdout:9/955: dwrite d9/df/d14/d27/df3/d60/d85/f98 [0,4194304] 0 2024-03-17T23:58:40.227 INFO:tasks.workunit.client.0.smithi196.stdout:8/820: mkdir de/d10/d35/d88/dc4/dfc 0 2024-03-17T23:58:40.231 INFO:tasks.workunit.client.0.smithi196.stdout:5/932: rmdir d6/d17/d3f/d4e/d113 0 2024-03-17T23:58:40.231 INFO:tasks.workunit.client.0.smithi196.stdout:1/879: dread d1/d13/d23/d47/f63 [0,4194304] 0 2024-03-17T23:58:40.232 INFO:tasks.workunit.client.0.smithi196.stdout:9/956: creat d9/df/d4a/d5b/f138 x:0 0 0 2024-03-17T23:58:40.235 INFO:tasks.workunit.client.0.smithi196.stdout:8/821: dread de/d10/d54/d5c/daa/fb3 [0,4194304] 0 2024-03-17T23:58:40.238 INFO:tasks.workunit.client.0.smithi196.stdout:1/880: mkdir d1/d13/d23/d121 0 2024-03-17T23:58:40.240 INFO:tasks.workunit.client.0.smithi196.stdout:8/822: fdatasync de/d10/f3b 0 2024-03-17T23:58:40.243 INFO:tasks.workunit.client.0.smithi196.stdout:9/957: dwrite d9/df/d14/d27/df3/d60/d85/fe4 [0,4194304] 0 2024-03-17T23:58:40.244 INFO:tasks.workunit.client.0.smithi196.stdout:5/933: rename d6/d17/d3f/d4e/d69/ded/d10c/c11e to d6/c136 0 2024-03-17T23:58:40.246 INFO:tasks.workunit.client.0.smithi196.stdout:1/881: dread d1/db/dd/d34/f42 [0,4194304] 0 2024-03-17T23:58:40.247 INFO:tasks.workunit.client.0.smithi196.stdout:5/934: chown d6/d2d/d33/d84/f111 406836 1 2024-03-17T23:58:40.248 INFO:tasks.workunit.client.0.smithi196.stdout:8/823: mknod de/d10/d35/d3e/cfd 0 2024-03-17T23:58:40.249 INFO:tasks.workunit.client.0.smithi196.stdout:8/824: readlink de/d2b/d3c/d5d/lc7 0 2024-03-17T23:58:40.263 INFO:tasks.workunit.client.0.smithi196.stdout:5/935: creat d6/d15/dc0/f137 x:0 0 0 2024-03-17T23:58:40.264 INFO:tasks.workunit.client.0.smithi196.stdout:1/882: mknod d1/d13/d4c/dcd/c122 0 2024-03-17T23:58:40.265 INFO:tasks.workunit.client.0.smithi196.stdout:4/836: dwrite d1/d26/d57/d8c/d97/fd6 [0,4194304] 0 2024-03-17T23:58:40.267 INFO:tasks.workunit.client.0.smithi196.stdout:1/883: fdatasync d1/f11b 0 2024-03-17T23:58:40.268 INFO:tasks.workunit.client.0.smithi196.stdout:9/958: mkdir d9/df/d14/db0/dd2/d139 0 2024-03-17T23:58:40.273 INFO:tasks.workunit.client.0.smithi196.stdout:8/825: creat de/d10/d35/d88/ffe x:0 0 0 2024-03-17T23:58:40.274 INFO:tasks.workunit.client.0.smithi196.stdout:9/959: read d9/df/d14/d27/df3/d60/f90 [3951155,59516] 0 2024-03-17T23:58:40.274 INFO:tasks.workunit.client.0.smithi196.stdout:5/936: truncate d6/d2d/d33/d3b/d80/da0/fcf 283984 0 2024-03-17T23:58:40.275 INFO:tasks.workunit.client.0.smithi196.stdout:5/937: stat d6/d2d/d33/d3b/d80/cff 0 2024-03-17T23:58:40.276 INFO:tasks.workunit.client.0.smithi196.stdout:1/884: creat d1/d13/d23/d62/dab/ded/f123 x:0 0 0 2024-03-17T23:58:40.276 INFO:tasks.workunit.client.0.smithi196.stdout:5/938: chown d6/d2d/db8/l100 813253528 1 2024-03-17T23:58:40.278 INFO:tasks.workunit.client.0.smithi196.stdout:9/960: symlink d9/df/d4a/d5b/d6d/da8/l13a 0 2024-03-17T23:58:40.278 INFO:tasks.workunit.client.0.smithi196.stdout:1/885: write d1/f11b [42463,23035] 0 2024-03-17T23:58:40.282 INFO:tasks.workunit.client.0.smithi196.stdout:8/826: creat de/d2b/d3c/d5d/fff x:0 0 0 2024-03-17T23:58:40.283 INFO:tasks.workunit.client.0.smithi196.stdout:9/961: write d9/d12/fdb [660687,16932] 0 2024-03-17T23:58:40.283 INFO:tasks.workunit.client.0.smithi196.stdout:1/886: symlink d1/d13/d23/d62/dab/ded/l124 0 2024-03-17T23:58:40.286 INFO:tasks.workunit.client.0.smithi196.stdout:4/837: dwrite d1/d1b/d77/fb4 [4194304,4194304] 0 2024-03-17T23:58:40.295 INFO:tasks.workunit.client.0.smithi196.stdout:9/962: creat d9/df/d14/f13b x:0 0 0 2024-03-17T23:58:40.298 INFO:tasks.workunit.client.0.smithi196.stdout:9/963: write d9/df/f7b [1115567,97760] 0 2024-03-17T23:58:40.300 INFO:tasks.workunit.client.0.smithi196.stdout:5/939: truncate d6/d17/d23/fc6 499088 0 2024-03-17T23:58:40.301 INFO:tasks.workunit.client.0.smithi196.stdout:4/838: getdents d1/d11/d5d/ded 0 2024-03-17T23:58:40.302 INFO:tasks.workunit.client.0.smithi196.stdout:5/940: write d6/fa4 [1458485,62332] 0 2024-03-17T23:58:40.302 INFO:tasks.workunit.client.0.smithi196.stdout:9/964: mknod d9/dbb/d131/c13c 0 2024-03-17T23:58:40.304 INFO:tasks.workunit.client.0.smithi196.stdout:4/839: chown d1/dd2/dcb/cef 2 1 2024-03-17T23:58:40.307 INFO:tasks.workunit.client.0.smithi196.stdout:5/941: symlink d6/d17/d3f/l138 0 2024-03-17T23:58:40.308 INFO:tasks.workunit.client.0.smithi196.stdout:4/840: readlink d1/de/d50/d55/l86 0 2024-03-17T23:58:40.309 INFO:tasks.workunit.client.0.smithi196.stdout:9/965: truncate d9/f25 635339 0 2024-03-17T23:58:40.311 INFO:tasks.workunit.client.0.smithi196.stdout:4/841: read d1/d68/f6b [768233,8525] 0 2024-03-17T23:58:40.311 INFO:tasks.workunit.client.0.smithi196.stdout:9/966: dread - d9/df/d14/d27/df3/f93 zero size 2024-03-17T23:58:40.313 INFO:tasks.workunit.client.0.smithi196.stdout:5/942: creat d6/d17/d23/f139 x:0 0 0 2024-03-17T23:58:40.315 INFO:tasks.workunit.client.0.smithi196.stdout:5/943: chown d6/d2d/f93 44856080 1 2024-03-17T23:58:40.315 INFO:tasks.workunit.client.0.smithi196.stdout:8/827: dread de/d10/d35/d3e/f97 [0,4194304] 0 2024-03-17T23:58:40.316 INFO:tasks.workunit.client.0.smithi196.stdout:1/887: dread d1/d13/d23/d47/f52 [0,4194304] 0 2024-03-17T23:58:40.316 INFO:tasks.workunit.client.0.smithi196.stdout:9/967: creat d9/df/d4a/d5b/d6d/da8/f13d x:0 0 0 2024-03-17T23:58:40.318 INFO:tasks.workunit.client.0.smithi196.stdout:5/944: fdatasync d6/d15/dc0/fdf 0 2024-03-17T23:58:40.318 INFO:tasks.workunit.client.0.smithi196.stdout:4/842: fsync d1/d26/d33/d40/f5e 0 2024-03-17T23:58:40.320 INFO:tasks.workunit.client.0.smithi196.stdout:8/828: mkdir de/d10/d54/d100 0 2024-03-17T23:58:40.321 INFO:tasks.workunit.client.0.smithi196.stdout:1/888: chown d1/d13/d23/l115 1 1 2024-03-17T23:58:40.323 INFO:tasks.workunit.client.0.smithi196.stdout:1/889: write d1/d13/d4c/fe8 [744097,101399] 0 2024-03-17T23:58:40.328 INFO:tasks.workunit.client.0.smithi196.stdout:4/843: stat d1/l9 0 2024-03-17T23:58:40.330 INFO:tasks.workunit.client.0.smithi196.stdout:5/945: creat d6/d17/d35/f13a x:0 0 0 2024-03-17T23:58:40.330 INFO:tasks.workunit.client.0.smithi196.stdout:5/946: fdatasync d6/d2d/d33/f114 0 2024-03-17T23:58:40.331 INFO:tasks.workunit.client.0.smithi196.stdout:5/947: chown d6/d17/d1f/d5c 37449 1 2024-03-17T23:58:40.333 INFO:tasks.workunit.client.0.smithi196.stdout:1/890: write d1/d13/d23/d47/d48/fcf [3460642,92012] 0 2024-03-17T23:58:40.333 INFO:tasks.workunit.client.0.smithi196.stdout:9/968: write d9/fd [7407049,116194] 0 2024-03-17T23:58:40.336 INFO:tasks.workunit.client.0.smithi196.stdout:8/829: mkdir de/d10/d35/d88/d93/dbf/d101 0 2024-03-17T23:58:40.336 INFO:tasks.workunit.client.0.smithi196.stdout:8/830: chown de 25082911 1 2024-03-17T23:58:40.336 INFO:tasks.workunit.client.0.smithi196.stdout:1/891: write d1/d13/d23/d62/dab/dca/fea [4665307,88692] 0 2024-03-17T23:58:40.338 INFO:tasks.workunit.client.0.smithi196.stdout:8/831: chown de/d10/d35/d88/d93 58 1 2024-03-17T23:58:40.338 INFO:tasks.workunit.client.0.smithi196.stdout:9/969: fsync d9/df/d14/f6b 0 2024-03-17T23:58:40.341 INFO:tasks.workunit.client.0.smithi196.stdout:4/844: link d1/d26/d57/ff4 d1/d26/d33/f122 0 2024-03-17T23:58:40.342 INFO:tasks.workunit.client.0.smithi196.stdout:4/845: truncate d1/d11/d5d/ded/ff0 4441412 0 2024-03-17T23:58:40.343 INFO:tasks.workunit.client.0.smithi196.stdout:5/948: rename d6/d17/d1f/d7d/d81/f4a to d6/d2d/d9c/f13b 0 2024-03-17T23:58:40.344 INFO:tasks.workunit.client.0.smithi196.stdout:8/832: symlink de/d10/d35/d88/dc4/dfc/l102 0 2024-03-17T23:58:40.346 INFO:tasks.workunit.client.0.smithi196.stdout:5/949: mkdir d6/d2d/d9c/dc7/d13c 0 2024-03-17T23:58:40.348 INFO:tasks.workunit.client.0.smithi196.stdout:1/892: rename d1/d13/d23/d62/dab/lde to d1/db/dd/d43/df3/l125 0 2024-03-17T23:58:40.349 INFO:tasks.workunit.client.0.smithi196.stdout:4/846: mkdir d1/de/d50/d55/d4a/d121/d123 0 2024-03-17T23:58:40.350 INFO:tasks.workunit.client.0.smithi196.stdout:8/833: symlink de/d5e/l103 0 2024-03-17T23:58:40.354 INFO:tasks.workunit.client.0.smithi196.stdout:4/847: mknod d1/d26/d33/d40/da1/c124 0 2024-03-17T23:58:40.358 INFO:tasks.workunit.client.0.smithi196.stdout:4/848: fdatasync d1/f1d 0 2024-03-17T23:58:40.359 INFO:tasks.workunit.client.0.smithi196.stdout:8/834: dwrite de/f85 [0,4194304] 0 2024-03-17T23:58:40.362 INFO:tasks.workunit.client.0.smithi196.stdout:4/849: creat d1/de/f125 x:0 0 0 2024-03-17T23:58:40.365 INFO:tasks.workunit.client.0.smithi196.stdout:8/835: stat de/d10/d54/d5c/d81/cc1 0 2024-03-17T23:58:40.365 INFO:tasks.workunit.client.0.smithi196.stdout:5/950: dread d6/d17/d3f/d4e/d69/fc4 [0,4194304] 0 2024-03-17T23:58:40.368 INFO:tasks.workunit.client.0.smithi196.stdout:5/951: write d6/d17/d23/f74 [3645810,90328] 0 2024-03-17T23:58:40.368 INFO:tasks.workunit.client.0.smithi196.stdout:8/836: symlink de/d10/d35/d88/d93/dbf/l104 0 2024-03-17T23:58:40.370 INFO:tasks.workunit.client.0.smithi196.stdout:5/952: readlink d6/d2d/d33/l4b 0 2024-03-17T23:58:40.372 INFO:tasks.workunit.client.0.smithi196.stdout:4/850: getdents d1/de/d50/d55 0 2024-03-17T23:58:40.373 INFO:tasks.workunit.client.0.smithi196.stdout:5/953: mknod d6/d17/d1f/d7d/d89/c13d 0 2024-03-17T23:58:40.373 INFO:tasks.workunit.client.0.smithi196.stdout:8/837: dread de/f5b [0,4194304] 0 2024-03-17T23:58:40.375 INFO:tasks.workunit.client.0.smithi196.stdout:4/851: creat d1/d68/dfe/f126 x:0 0 0 2024-03-17T23:58:40.377 INFO:tasks.workunit.client.0.smithi196.stdout:5/954: mkdir d6/d17/df5/d13e 0 2024-03-17T23:58:40.380 INFO:tasks.workunit.client.0.smithi196.stdout:4/852: unlink d1/d26/d33/d40/da1/fc1 0 2024-03-17T23:58:40.383 INFO:tasks.workunit.client.0.smithi196.stdout:4/853: read d1/d26/d33/f88 [416402,56524] 0 2024-03-17T23:58:40.383 INFO:tasks.workunit.client.0.smithi196.stdout:8/838: dwrite de/d2b/d30/d33/f5a [4194304,4194304] 0 2024-03-17T23:58:40.386 INFO:tasks.workunit.client.0.smithi196.stdout:5/955: unlink d6/d17/d3f/da5/lb7 0 2024-03-17T23:58:40.387 INFO:tasks.workunit.client.0.smithi196.stdout:8/839: fsync de/d10/d54/f67 0 2024-03-17T23:58:40.388 INFO:tasks.workunit.client.0.smithi196.stdout:5/956: mknod d6/d15/dc0/c13f 0 2024-03-17T23:58:40.389 INFO:tasks.workunit.client.0.smithi196.stdout:8/840: read f6 [3670259,35713] 0 2024-03-17T23:58:40.395 INFO:tasks.workunit.client.0.smithi196.stdout:4/854: write d1/d26/d57/ff4 [403298,121704] 0 2024-03-17T23:58:40.397 INFO:tasks.workunit.client.0.smithi196.stdout:5/957: creat d6/d17/d23/d53/d120/f140 x:0 0 0 2024-03-17T23:58:40.397 INFO:tasks.workunit.client.0.smithi196.stdout:8/841: creat de/d10/d35/de9/f105 x:0 0 0 2024-03-17T23:58:40.399 INFO:tasks.workunit.client.0.smithi196.stdout:5/958: read d6/d17/d1f/f11d [61062,113985] 0 2024-03-17T23:58:40.402 INFO:tasks.workunit.client.0.smithi196.stdout:5/959: chown d6/d17/d1f/d5c/c78 1557 1 2024-03-17T23:58:40.409 INFO:tasks.workunit.client.0.smithi196.stdout:4/855: dwrite d1/d26/d33/d3f/f7a [0,4194304] 0 2024-03-17T23:58:40.411 INFO:tasks.workunit.client.0.smithi196.stdout:4/856: chown d1/c5 392873 1 2024-03-17T23:58:40.414 INFO:tasks.workunit.client.0.smithi196.stdout:4/857: creat d1/df7/f127 x:0 0 0 2024-03-17T23:58:40.416 INFO:tasks.workunit.client.0.smithi196.stdout:4/858: creat d1/d26/d8b/f128 x:0 0 0 2024-03-17T23:58:40.418 INFO:tasks.workunit.client.0.smithi196.stdout:5/960: dread d6/d2d/db8/fcb [0,4194304] 0 2024-03-17T23:58:40.421 INFO:tasks.workunit.client.0.smithi196.stdout:5/961: rmdir d6/d17/d1f/d7d/d81 39 2024-03-17T23:58:40.428 INFO:tasks.workunit.client.0.smithi196.stdout:5/962: write d6/d2d/f96 [586261,119354] 0 2024-03-17T23:58:40.430 INFO:tasks.workunit.client.0.smithi196.stdout:4/859: dread d1/d26/f3b [0,4194304] 0 2024-03-17T23:58:40.433 INFO:tasks.workunit.client.0.smithi196.stdout:4/860: unlink d1/d11/f1c 0 2024-03-17T23:58:40.442 INFO:tasks.workunit.client.0.smithi196.stdout:5/963: dwrite f3 [0,4194304] 0 2024-03-17T23:58:40.447 INFO:tasks.workunit.client.0.smithi196.stdout:5/964: dread d6/d2d/d33/d3b/f12a [0,4194304] 0 2024-03-17T23:58:40.451 INFO:tasks.workunit.client.0.smithi196.stdout:4/861: dread d1/d26/d57/d8c/d97/fa8 [0,4194304] 0 2024-03-17T23:58:40.454 INFO:tasks.workunit.client.0.smithi196.stdout:5/965: link d6/d15/f12e d6/d17/d3f/f141 0 2024-03-17T23:58:40.456 INFO:tasks.workunit.client.0.smithi196.stdout:5/966: creat d6/d2d/d33/d3b/d80/da0/f142 x:0 0 0 2024-03-17T23:58:40.457 INFO:tasks.workunit.client.0.smithi196.stdout:5/967: fdatasync d6/d17/d1f/f50 0 2024-03-17T23:58:40.460 INFO:tasks.workunit.client.0.smithi196.stdout:4/862: dwrite d1/d26/d57/d8c/d97/fd6 [0,4194304] 0 2024-03-17T23:58:40.462 INFO:tasks.workunit.client.0.smithi196.stdout:4/863: write d1/de/d50/fc9 [1275763,10627] 0 2024-03-17T23:58:40.463 INFO:tasks.workunit.client.0.smithi196.stdout:4/864: readlink d1/d11/l4c 0 2024-03-17T23:58:40.469 INFO:tasks.workunit.client.0.smithi196.stdout:4/865: symlink d1/de/d50/d55/de4/l129 0 2024-03-17T23:58:40.469 INFO:tasks.workunit.client.0.smithi196.stdout:5/968: dwrite d6/d2d/d33/d3b/d80/da0/d130/f131 [0,4194304] 0 2024-03-17T23:58:40.473 INFO:tasks.workunit.client.0.smithi196.stdout:5/969: creat d6/d2d/d33/d3b/d80/da0/f143 x:0 0 0 2024-03-17T23:58:40.478 INFO:tasks.workunit.client.0.smithi196.stdout:5/970: unlink d6/d17/d3f/da5/cf2 0 2024-03-17T23:58:40.481 INFO:tasks.workunit.client.0.smithi196.stdout:5/971: rename d6/d2d/l8d to d6/d2d/d9c/dc7/l144 0 2024-03-17T23:58:40.483 INFO:tasks.workunit.client.0.smithi196.stdout:4/866: truncate d1/de/d50/fc9 91423 0 2024-03-17T23:58:40.487 INFO:tasks.workunit.client.0.smithi196.stdout:4/867: creat d1/f12a x:0 0 0 2024-03-17T23:58:40.490 INFO:tasks.workunit.client.0.smithi196.stdout:4/868: link d1/d26/d57/d8c/fd4 d1/d68/f12b 0 2024-03-17T23:58:40.494 INFO:tasks.workunit.client.0.smithi196.stdout:5/972: write d6/d2d/d33/dc5/f10a [718897,90892] 0 2024-03-17T23:58:40.497 INFO:tasks.workunit.client.0.smithi196.stdout:5/973: getdents d6/d15/dc0/d105/d12f 0 2024-03-17T23:58:40.499 INFO:tasks.workunit.client.0.smithi196.stdout:4/869: dwrite d1/d68/dfe/f126 [0,4194304] 0 2024-03-17T23:58:40.501 INFO:tasks.workunit.client.0.smithi196.stdout:4/870: truncate d1/d68/f12b 77495 0 2024-03-17T23:58:40.507 INFO:tasks.workunit.client.0.smithi196.stdout:4/871: write d1/d26/d57/d8c/d97/fa8 [3309974,17365] 0 2024-03-17T23:58:40.509 INFO:tasks.workunit.client.0.smithi196.stdout:4/872: creat d1/de/f12c x:0 0 0 2024-03-17T23:58:40.509 INFO:tasks.workunit.client.0.smithi196.stdout:5/974: dread d6/d2d/d33/f114 [0,4194304] 0 2024-03-17T23:58:40.512 INFO:tasks.workunit.client.0.smithi196.stdout:5/975: symlink d6/d17/d35/d10f/l145 0 2024-03-17T23:58:40.514 INFO:tasks.workunit.client.0.smithi196.stdout:4/873: rename d1/de/f4b to d1/d11/d5d/ded/f12d 0 2024-03-17T23:58:40.515 INFO:tasks.workunit.client.0.smithi196.stdout:4/874: fsync d1/d26/d33/ff3 0 2024-03-17T23:58:40.516 INFO:tasks.workunit.client.0.smithi196.stdout:5/976: mknod d6/d17/d23/d53/c146 0 2024-03-17T23:58:40.517 INFO:tasks.workunit.client.0.smithi196.stdout:5/977: readlink d6/d17/d1f/d5c/lf8 0 2024-03-17T23:58:40.524 INFO:tasks.workunit.client.0.smithi196.stdout:4/875: dread d1/de/d50/f9e [0,4194304] 0 2024-03-17T23:58:40.525 INFO:tasks.workunit.client.0.smithi196.stdout:5/978: dwrite d6/d17/d23/f133 [0,4194304] 0 2024-03-17T23:58:40.525 INFO:tasks.workunit.client.0.smithi196.stdout:4/876: dread - d1/d68/f113 zero size 2024-03-17T23:58:40.528 INFO:tasks.workunit.client.0.smithi196.stdout:4/877: chown d1/d11/lc6 753 1 2024-03-17T23:58:40.529 INFO:tasks.workunit.client.0.smithi196.stdout:5/979: symlink d6/d17/d23/d53/d120/l147 0 2024-03-17T23:58:40.530 INFO:tasks.workunit.client.0.smithi196.stdout:4/878: mkdir d1/d1b/d77/df1/d12e 0 2024-03-17T23:58:40.532 INFO:tasks.workunit.client.0.smithi196.stdout:5/980: unlink d6/d17/d23/d7e/fc8 0 2024-03-17T23:58:40.535 INFO:tasks.workunit.client.0.smithi196.stdout:4/879: rename d1/d11/la9 to d1/d26/d57/d8c/l12f 0 2024-03-17T23:58:40.536 INFO:tasks.workunit.client.0.smithi196.stdout:5/981: mknod d6/d2d/d33/d3b/d80/da0/d130/c148 0 2024-03-17T23:58:40.538 INFO:tasks.workunit.client.0.smithi196.stdout:4/880: write d1/d1b/d77/f90 [1425246,112468] 0 2024-03-17T23:58:40.539 INFO:tasks.workunit.client.0.smithi196.stdout:5/982: mknod d6/d15/c149 0 2024-03-17T23:58:40.539 INFO:tasks.workunit.client.0.smithi196.stdout:5/983: stat d6/f64 0 2024-03-17T23:58:40.542 INFO:tasks.workunit.client.0.smithi196.stdout:4/881: rename d1/d26/d57/dac/ld1 to d1/dd2/dcb/l130 0 2024-03-17T23:58:40.543 INFO:tasks.workunit.client.0.smithi196.stdout:5/984: getdents d6/d2d/d9c/dc7/d13c 0 2024-03-17T23:58:40.544 INFO:tasks.workunit.client.0.smithi196.stdout:4/882: mkdir d1/de/d50/d55/d131 0 2024-03-17T23:58:40.545 INFO:tasks.workunit.client.0.smithi196.stdout:5/985: mknod d6/d15/dc0/c14a 0 2024-03-17T23:58:40.546 INFO:tasks.workunit.client.0.smithi196.stdout:4/883: creat d1/d11/d5d/ded/f132 x:0 0 0 2024-03-17T23:58:40.547 INFO:tasks.workunit.client.0.smithi196.stdout:5/986: fsync d6/d17/d23/f9f 0 2024-03-17T23:58:40.549 INFO:tasks.workunit.client.0.smithi196.stdout:4/884: mknod d1/de/d50/d55/d4a/d121/c133 0 2024-03-17T23:58:40.551 INFO:tasks.workunit.client.0.smithi196.stdout:5/987: rename d6/d15/c79 to d6/d2d/d9c/c14b 0 2024-03-17T23:58:40.553 INFO:tasks.workunit.client.0.smithi196.stdout:4/885: mkdir d1/de/d50/d55/d131/d134 0 2024-03-17T23:58:40.555 INFO:tasks.workunit.client.0.smithi196.stdout:5/988: truncate d6/d17/d1f/d5c/fa9 945897 0 2024-03-17T23:58:40.559 INFO:tasks.workunit.client.0.smithi196.stdout:5/989: creat d6/d17/d3f/d4e/d69/ded/f14c x:0 0 0 2024-03-17T23:58:40.560 INFO:tasks.workunit.client.0.smithi196.stdout:5/990: readlink d6/d2d/d9c/dc7/ld3 0 2024-03-17T23:58:40.568 INFO:tasks.workunit.client.0.smithi196.stdout:4/886: write d1/d1b/d77/df1/f92 [276950,111206] 0 2024-03-17T23:58:40.569 INFO:tasks.workunit.client.0.smithi196.stdout:5/991: write d6/f8 [1842409,39376] 0 2024-03-17T23:58:40.570 INFO:tasks.workunit.client.0.smithi196.stdout:4/887: write d1/d11/d5d/ded/f132 [84247,28465] 0 2024-03-17T23:58:40.575 INFO:tasks.workunit.client.0.smithi196.stdout:5/992: creat d6/d17/d1f/d7d/f14d x:0 0 0 2024-03-17T23:58:40.575 INFO:tasks.workunit.client.0.smithi196.stdout:4/888: getdents d1/de/d50/d55/d4a/d121 0 2024-03-17T23:58:40.577 INFO:tasks.workunit.client.0.smithi196.stdout:5/993: rename f4 to d6/d2d/d33/dc5/f14e 0 2024-03-17T23:58:40.578 INFO:tasks.workunit.client.0.smithi196.stdout:5/994: dread - d6/d17/d35/d10f/f118 zero size 2024-03-17T23:58:40.580 INFO:tasks.workunit.client.0.smithi196.stdout:5/995: mkdir d6/d17/d23/d53/d14f 0 2024-03-17T23:58:40.588 INFO:tasks.workunit.client.0.smithi196.stdout:5/996: write d6/d15/fb6 [1541272,85912] 0 2024-03-17T23:58:40.590 INFO:tasks.workunit.client.0.smithi196.stdout:5/997: unlink d6/d2d/f96 0 2024-03-17T23:58:40.592 INFO:tasks.workunit.client.0.smithi196.stdout:5/998: mknod d6/d17/d3f/da5/c150 0 2024-03-17T23:58:40.599 INFO:tasks.workunit.client.0.smithi196.stdout:5/999: dread d6/d17/d23/d7e/fdc [0,4194304] 0 2024-03-17T23:58:40.923 INFO:tasks.workunit.client.0.smithi196.stdout:1/893: sync 2024-03-17T23:58:40.923 INFO:tasks.workunit.client.0.smithi196.stdout:9/970: sync 2024-03-17T23:58:40.923 INFO:tasks.workunit.client.0.smithi196.stdout:4/889: sync 2024-03-17T23:58:40.923 INFO:tasks.workunit.client.0.smithi196.stdout:8/842: sync 2024-03-17T23:58:40.924 INFO:tasks.workunit.client.0.smithi196.stdout:4/890: write d1/dd2/f108 [828103,64701] 0 2024-03-17T23:58:40.930 INFO:tasks.workunit.client.0.smithi196.stdout:1/894: link d1/d13/d2a/f90 d1/d13/d91/de9/df5/f126 0 2024-03-17T23:58:40.932 INFO:tasks.workunit.client.0.smithi196.stdout:1/895: fdatasync d1/f11b 0 2024-03-17T23:58:40.936 INFO:tasks.workunit.client.0.smithi196.stdout:4/891: dwrite d1/f8a [0,4194304] 0 2024-03-17T23:58:40.937 INFO:tasks.workunit.client.0.smithi196.stdout:4/892: chown d1/d1b/d77/lb8 18 1 2024-03-17T23:58:40.937 INFO:tasks.workunit.client.0.smithi196.stdout:9/971: rename d9/df/d14/d27/df3/f76 to d9/df/d14/db0/dd2/f13e 0 2024-03-17T23:58:40.939 INFO:tasks.workunit.client.0.smithi196.stdout:1/896: mknod d1/d13/d23/d62/dab/dca/dd1/c127 0 2024-03-17T23:58:40.940 INFO:tasks.workunit.client.0.smithi196.stdout:4/893: symlink d1/de/d50/d55/de4/df2/l135 0 2024-03-17T23:58:40.942 INFO:tasks.workunit.client.0.smithi196.stdout:9/972: creat d9/df/d14/db0/f13f x:0 0 0 2024-03-17T23:58:40.942 INFO:tasks.workunit.client.0.smithi196.stdout:9/973: stat d9 0 2024-03-17T23:58:40.943 INFO:tasks.workunit.client.0.smithi196.stdout:8/843: dread de/d2b/d3c/d5d/fc6 [0,4194304] 0 2024-03-17T23:58:40.943 INFO:tasks.workunit.client.0.smithi196.stdout:1/897: creat d1/d13/f128 x:0 0 0 2024-03-17T23:58:40.946 INFO:tasks.workunit.client.0.smithi196.stdout:8/844: mknod de/d10/d54/d5c/daa/dde/c106 0 2024-03-17T23:58:40.951 INFO:tasks.workunit.client.0.smithi196.stdout:8/845: chown de/d10/d35/l36 6 1 2024-03-17T23:58:40.952 INFO:tasks.workunit.client.0.smithi196.stdout:4/894: dwrite d1/d11/d5d/dfa/f104 [0,4194304] 0 2024-03-17T23:58:40.956 INFO:tasks.workunit.client.0.smithi196.stdout:9/974: creat d9/df/d4a/d89/db1/dd7/f140 x:0 0 0 2024-03-17T23:58:40.959 INFO:tasks.workunit.client.0.smithi196.stdout:8/846: dread de/d10/ff5 [0,4194304] 0 2024-03-17T23:58:40.960 INFO:tasks.workunit.client.0.smithi196.stdout:9/975: mknod d9/dbb/de5/c141 0 2024-03-17T23:58:40.962 INFO:tasks.workunit.client.0.smithi196.stdout:8/847: dread - de/d5e/ff8 zero size 2024-03-17T23:58:40.962 INFO:tasks.workunit.client.0.smithi196.stdout:4/895: dwrite d1/d1b/f75 [0,4194304] 0 2024-03-17T23:58:40.964 INFO:tasks.workunit.client.0.smithi196.stdout:4/896: chown d1/d11/f12 2279874 1 2024-03-17T23:58:40.966 INFO:tasks.workunit.client.0.smithi196.stdout:8/848: mknod de/d10/d35/d88/dd1/dea/c107 0 2024-03-17T23:58:40.967 INFO:tasks.workunit.client.0.smithi196.stdout:9/976: rename d9/df/d55/dcf/f10a to d9/df/d55/d110/f142 0 2024-03-17T23:58:40.968 INFO:tasks.workunit.client.0.smithi196.stdout:1/898: truncate d1/d13/f3b 6609326 0 2024-03-17T23:58:40.969 INFO:tasks.workunit.client.0.smithi196.stdout:8/849: rmdir de/d2b 39 2024-03-17T23:58:40.971 INFO:tasks.workunit.client.0.smithi196.stdout:9/977: mkdir d9/df/d55/d110/d143 0 2024-03-17T23:58:40.972 INFO:tasks.workunit.client.0.smithi196.stdout:9/978: dread - d9/df/d14/d3d/f12e zero size 2024-03-17T23:58:40.973 INFO:tasks.workunit.client.0.smithi196.stdout:9/979: chown d9/df/d4a/f80 55 1 2024-03-17T23:58:40.974 INFO:tasks.workunit.client.0.smithi196.stdout:1/899: creat d1/d13/d23/d47/f129 x:0 0 0 2024-03-17T23:58:40.976 INFO:tasks.workunit.client.0.smithi196.stdout:9/980: mknod d9/df/d4a/d89/db1/d12f/c144 0 2024-03-17T23:58:40.977 INFO:tasks.workunit.client.0.smithi196.stdout:8/850: dread de/d10/d35/d3e/f97 [0,4194304] 0 2024-03-17T23:58:40.977 INFO:tasks.workunit.client.0.smithi196.stdout:4/897: write d1/d26/d57/d8c/fd4 [55794,66525] 0 2024-03-17T23:58:40.979 INFO:tasks.workunit.client.0.smithi196.stdout:9/981: dread - d9/df/d4a/d89/db1/dd7/f140 zero size 2024-03-17T23:58:40.979 INFO:tasks.workunit.client.0.smithi196.stdout:4/898: dread - d1/df7/f127 zero size 2024-03-17T23:58:40.980 INFO:tasks.workunit.client.0.smithi196.stdout:9/982: stat d9/df/d55/dcf/d106 0 2024-03-17T23:58:40.981 INFO:tasks.workunit.client.0.smithi196.stdout:1/900: mknod d1/d13/d91/de9/df5/d10f/c12a 0 2024-03-17T23:58:40.982 INFO:tasks.workunit.client.0.smithi196.stdout:8/851: symlink de/d10/d35/l108 0 2024-03-17T23:58:40.984 INFO:tasks.workunit.client.0.smithi196.stdout:4/899: link d1/d1b/d77/f101 d1/d26/d8b/de9/f136 0 2024-03-17T23:58:40.986 INFO:tasks.workunit.client.0.smithi196.stdout:1/901: unlink d1/d13/d23/d62/dab/dca/dd1/dfe/d75/fe0 0 2024-03-17T23:58:40.987 INFO:tasks.workunit.client.0.smithi196.stdout:4/900: mkdir d1/de/d50/d55/d4a/d121/d137 0 2024-03-17T23:58:40.987 INFO:tasks.workunit.client.0.smithi196.stdout:4/901: dread - d1/d68/f113 zero size 2024-03-17T23:58:40.991 INFO:tasks.workunit.client.0.smithi196.stdout:9/983: getdents d9/df/d4a/d89/db1/d12f 0 2024-03-17T23:58:40.995 INFO:tasks.workunit.client.0.smithi196.stdout:9/984: write d9/df/d14/d27/df3/d60/d85/d12a/fc2 [2414202,123697] 0 2024-03-17T23:58:40.996 INFO:tasks.workunit.client.0.smithi196.stdout:4/902: rmdir d1/d26/d33/d40/da1/d109/d11c 0 2024-03-17T23:58:40.998 INFO:tasks.workunit.client.0.smithi196.stdout:1/902: dwrite d1/d13/d23/d62/dab/dca/f100 [0,4194304] 0 2024-03-17T23:58:41.008 INFO:tasks.workunit.client.0.smithi196.stdout:1/903: rename d1/d13/d23/fba to d1/d13/d23/d70/f12b 0 2024-03-17T23:58:41.008 INFO:tasks.workunit.client.0.smithi196.stdout:9/985: dwrite d9/df/d4a/d5b/d6d/da8/f103 [0,4194304] 0 2024-03-17T23:58:41.014 INFO:tasks.workunit.client.0.smithi196.stdout:1/904: write d1/d13/d2a/d94/fc1 [981624,54742] 0 2024-03-17T23:58:41.015 INFO:tasks.workunit.client.0.smithi196.stdout:4/903: truncate d1/d11/d5d/dfa/f104 1538508 0 2024-03-17T23:58:41.024 INFO:tasks.workunit.client.0.smithi196.stdout:9/986: truncate d9/d12/f118 1458059 0 2024-03-17T23:58:41.024 INFO:tasks.workunit.client.0.smithi196.stdout:4/904: write d1/d26/f8e [1654344,5322] 0 2024-03-17T23:58:41.025 INFO:tasks.workunit.client.0.smithi196.stdout:1/905: dwrite d1/d13/d23/d47/d48/d7e/fff [0,4194304] 0 2024-03-17T23:58:41.027 INFO:tasks.workunit.client.0.smithi196.stdout:4/905: chown d1/de/d50/l99 48189539 1 2024-03-17T23:58:41.028 INFO:tasks.workunit.client.0.smithi196.stdout:9/987: symlink d9/df/d4a/d5b/da5/l145 0 2024-03-17T23:58:41.035 INFO:tasks.workunit.client.0.smithi196.stdout:9/988: rename d9/df/d55 to d9/df/d4a/d5b/d6d/da8/def/d146 0 2024-03-17T23:58:41.039 INFO:tasks.workunit.client.0.smithi196.stdout:4/906: dwrite d1/d26/d8b/ff8 [0,4194304] 0 2024-03-17T23:58:41.046 INFO:tasks.workunit.client.0.smithi196.stdout:1/906: dread d1/d13/d23/d47/d48/fa9 [0,4194304] 0 2024-03-17T23:58:41.048 INFO:tasks.workunit.client.0.smithi196.stdout:4/907: truncate d1/d68/df9/ffb 806046 0 2024-03-17T23:58:41.049 INFO:tasks.workunit.client.0.smithi196.stdout:1/907: symlink d1/d13/d91/de9/d10c/l12c 0 2024-03-17T23:58:41.054 INFO:tasks.workunit.client.0.smithi196.stdout:4/908: rename d1/d68/f113 to d1/de/d50/d55/de4/df2/f138 0 2024-03-17T23:58:41.056 INFO:tasks.workunit.client.0.smithi196.stdout:4/909: unlink d1/d61/l7b 0 2024-03-17T23:58:41.059 INFO:tasks.workunit.client.0.smithi196.stdout:1/908: rename d1/d13/d23/fdf to d1/db/dd/f12d 0 2024-03-17T23:58:41.060 INFO:tasks.workunit.client.0.smithi196.stdout:9/989: dread d9/df/d14/d27/df3/d60/d5e/f81 [0,4194304] 0 2024-03-17T23:58:41.062 INFO:tasks.workunit.client.0.smithi196.stdout:1/909: mknod d1/db/c12e 0 2024-03-17T23:58:41.066 INFO:tasks.workunit.client.0.smithi196.stdout:1/910: creat d1/d13/d91/de9/d10c/f12f x:0 0 0 2024-03-17T23:58:41.066 INFO:tasks.workunit.client.0.smithi196.stdout:4/910: dwrite d1/d68/dfe/f126 [0,4194304] 0 2024-03-17T23:58:41.076 INFO:tasks.workunit.client.0.smithi196.stdout:4/911: truncate d1/d26/d33/d40/fad 4558941 0 2024-03-17T23:58:41.076 INFO:tasks.workunit.client.0.smithi196.stdout:9/990: write d9/df/d14/d27/df3/d60/f11b [917352,57694] 0 2024-03-17T23:58:41.077 INFO:tasks.workunit.client.0.smithi196.stdout:4/912: creat d1/d68/dfe/f139 x:0 0 0 2024-03-17T23:58:41.077 INFO:tasks.workunit.client.0.smithi196.stdout:9/991: symlink d9/df/d4a/d89/l147 0 2024-03-17T23:58:41.079 INFO:tasks.workunit.client.0.smithi196.stdout:4/913: symlink d1/de/d50/d55/d4a/d121/l13a 0 2024-03-17T23:58:41.080 INFO:tasks.workunit.client.0.smithi196.stdout:4/914: dread - d1/d26/d57/d8c/d97/f102 zero size 2024-03-17T23:58:41.081 INFO:tasks.workunit.client.0.smithi196.stdout:9/992: rename d9/df/d4a/d5b/d6d/cdc to d9/df/d14/db0/dd2/c148 0 2024-03-17T23:58:41.082 INFO:tasks.workunit.client.0.smithi196.stdout:4/915: read d1/d1b/d77/f101 [385976,67165] 0 2024-03-17T23:58:41.084 INFO:tasks.workunit.client.0.smithi196.stdout:4/916: write d1/d26/d8b/ff8 [3948180,26121] 0 2024-03-17T23:58:41.086 INFO:tasks.workunit.client.0.smithi196.stdout:9/993: rename d9/df/d14/d27/f31 to d9/df/d14/d27/df3/d60/f149 0 2024-03-17T23:58:41.091 INFO:tasks.workunit.client.0.smithi196.stdout:9/994: truncate d9/df/d14/d3d/f8b 1379908 0 2024-03-17T23:58:41.093 INFO:tasks.workunit.client.0.smithi196.stdout:1/911: dread d1/db/dd/d34/f8d [0,4194304] 0 2024-03-17T23:58:41.094 INFO:tasks.workunit.client.0.smithi196.stdout:4/917: link d1/d26/fc4 d1/d61/f13b 0 2024-03-17T23:58:41.095 INFO:tasks.workunit.client.0.smithi196.stdout:1/912: fdatasync d1/d13/d23/d47/f63 0 2024-03-17T23:58:41.097 INFO:tasks.workunit.client.0.smithi196.stdout:9/995: read d9/d33/f5f [1186614,63371] 0 2024-03-17T23:58:41.100 INFO:tasks.workunit.client.0.smithi196.stdout:9/996: write d9/df/d4a/d89/db1/fd4 [250165,6668] 0 2024-03-17T23:58:41.104 INFO:tasks.workunit.client.0.smithi196.stdout:4/918: dwrite d1/d1b/d77/f11a [0,4194304] 0 2024-03-17T23:58:41.109 INFO:tasks.workunit.client.0.smithi196.stdout:1/913: dread d1/d13/d23/d47/d48/d7e/f87 [0,4194304] 0 2024-03-17T23:58:41.111 INFO:tasks.workunit.client.0.smithi196.stdout:4/919: link d1/d11/l37 d1/d61/l13c 0 2024-03-17T23:58:41.112 INFO:tasks.workunit.client.0.smithi196.stdout:4/920: stat d1/d1b/f5f 0 2024-03-17T23:58:41.115 INFO:tasks.workunit.client.0.smithi196.stdout:1/914: link d1/d13/d91/de9/df5/f126 d1/d13/d23/d47/d48/d11e/f130 0 2024-03-17T23:58:41.115 INFO:tasks.workunit.client.0.smithi196.stdout:1/915: chown d1/db/dd/d43/l95 11090 1 2024-03-17T23:58:41.118 INFO:tasks.workunit.client.0.smithi196.stdout:1/916: unlink d1/d13/d23/l115 0 2024-03-17T23:58:41.122 INFO:tasks.workunit.client.0.smithi196.stdout:1/917: getdents d1/d13 0 2024-03-17T23:58:41.122 INFO:tasks.workunit.client.0.smithi196.stdout:4/921: dwrite d1/f12a [0,4194304] 0 2024-03-17T23:58:41.126 INFO:tasks.workunit.client.0.smithi196.stdout:1/918: truncate d1/f4 338113 0 2024-03-17T23:58:41.127 INFO:tasks.workunit.client.0.smithi196.stdout:1/919: fdatasync d1/d13/d4c/dcd/f107 0 2024-03-17T23:58:41.127 INFO:tasks.workunit.client.0.smithi196.stdout:4/922: creat d1/de/d50/d55/d4a/d121/d123/f13d x:0 0 0 2024-03-17T23:58:41.127 INFO:tasks.workunit.client.0.smithi196.stdout:1/920: stat d1/db/dd/f113 0 2024-03-17T23:58:41.129 INFO:tasks.workunit.client.0.smithi196.stdout:4/923: mknod d1/de/d50/d55/de4/c13e 0 2024-03-17T23:58:41.130 INFO:tasks.workunit.client.0.smithi196.stdout:1/921: getdents d1/d13/d91/de9/d101 0 2024-03-17T23:58:41.131 INFO:tasks.workunit.client.0.smithi196.stdout:1/922: chown d1/d13/d23/d70/cfc 127440688 1 2024-03-17T23:58:41.134 INFO:tasks.workunit.client.0.smithi196.stdout:4/924: rename d1/d61/f13b to d1/d11/d5d/ded/f13f 0 2024-03-17T23:58:41.136 INFO:tasks.workunit.client.0.smithi196.stdout:1/923: symlink d1/d13/d23/d47/d48/dc4/l131 0 2024-03-17T23:58:41.141 INFO:tasks.workunit.client.0.smithi196.stdout:1/924: dread d1/d13/d4c/dcd/fdb [0,4194304] 0 2024-03-17T23:58:41.144 INFO:tasks.workunit.client.0.smithi196.stdout:1/925: chown d1/d13/d23/d62/ca3 6010 1 2024-03-17T23:58:41.147 INFO:tasks.workunit.client.0.smithi196.stdout:1/926: unlink d1/d13/d23/d47/d48/d74/cf6 0 2024-03-17T23:58:41.150 INFO:tasks.workunit.client.0.smithi196.stdout:1/927: creat d1/d13/d2a/d94/f132 x:0 0 0 2024-03-17T23:58:41.150 INFO:tasks.workunit.client.0.smithi196.stdout:4/925: dread d1/d26/f7e [0,4194304] 0 2024-03-17T23:58:41.151 INFO:tasks.workunit.client.0.smithi196.stdout:1/928: chown d1/d13/d91/c9f 9 1 2024-03-17T23:58:41.158 INFO:tasks.workunit.client.0.smithi196.stdout:1/929: dread d1/d13/d23/d47/d48/fcf [0,4194304] 0 2024-03-17T23:58:41.162 INFO:tasks.workunit.client.0.smithi196.stdout:1/930: getdents d1/d13/d23/d62/dab/dca/dd1/dfe/d75 0 2024-03-17T23:58:41.165 INFO:tasks.workunit.client.0.smithi196.stdout:1/931: truncate d1/d13/d2a/f90 1555970 0 2024-03-17T23:58:41.167 INFO:tasks.workunit.client.0.smithi196.stdout:1/932: dread d1/db/dd/d43/fa7 [0,4194304] 0 2024-03-17T23:58:41.175 INFO:tasks.workunit.client.0.smithi196.stdout:1/933: dwrite d1/db/dd/df1/f120 [0,4194304] 0 2024-03-17T23:58:41.176 INFO:tasks.workunit.client.0.smithi196.stdout:1/934: read d1/d13/d4c/fc2 [4034256,33979] 0 2024-03-17T23:58:41.177 INFO:tasks.workunit.client.0.smithi196.stdout:1/935: chown d1/db/dd/df1 513388 1 2024-03-17T23:58:41.187 INFO:tasks.workunit.client.0.smithi196.stdout:8/852: sync 2024-03-17T23:58:41.214 INFO:tasks.workunit.client.0.smithi196.stdout:1/936: symlink d1/d13/d2a/l133 0 2024-03-17T23:58:41.215 INFO:tasks.workunit.client.0.smithi196.stdout:8/853: symlink de/d10/d35/d88/d93/dbf/l109 0 2024-03-17T23:58:41.216 INFO:tasks.workunit.client.0.smithi196.stdout:1/937: symlink d1/d13/d4c/dcd/l134 0 2024-03-17T23:58:41.216 INFO:tasks.workunit.client.0.smithi196.stdout:8/854: chown de/d10/d35/ld7 1574 1 2024-03-17T23:58:41.219 INFO:tasks.workunit.client.0.smithi196.stdout:1/938: dread d1/db/dd/f67 [0,4194304] 0 2024-03-17T23:58:41.220 INFO:tasks.workunit.client.0.smithi196.stdout:8/855: symlink de/d10/d43/d71/l10a 0 2024-03-17T23:58:41.222 INFO:tasks.workunit.client.0.smithi196.stdout:1/939: mkdir d1/d13/d23/d62/d71/d135 0 2024-03-17T23:58:41.225 INFO:tasks.workunit.client.0.smithi196.stdout:8/856: rename de/d2b/d3c to de/d10/d54/d5c/dcc/de6/d10b 0 2024-03-17T23:58:41.226 INFO:tasks.workunit.client.0.smithi196.stdout:8/857: mknod de/d10/d43/d71/c10c 0 2024-03-17T23:58:41.227 INFO:tasks.workunit.client.0.smithi196.stdout:1/940: creat d1/d13/d23/d47/d48/f136 x:0 0 0 2024-03-17T23:58:41.228 INFO:tasks.workunit.client.0.smithi196.stdout:8/858: chown de/d10/d35/ca3 8 1 2024-03-17T23:58:41.229 INFO:tasks.workunit.client.0.smithi196.stdout:1/941: creat d1/d13/d91/de9/df5/f137 x:0 0 0 2024-03-17T23:58:41.238 INFO:tasks.workunit.client.0.smithi196.stdout:1/942: dread d1/f16 [0,4194304] 0 2024-03-17T23:58:41.243 INFO:tasks.workunit.client.0.smithi196.stdout:8/859: dread de/d10/d35/d88/f9b [0,4194304] 0 2024-03-17T23:58:41.245 INFO:tasks.workunit.client.0.smithi196.stdout:8/860: creat de/d10/d35/d88/dc4/f10d x:0 0 0 2024-03-17T23:58:41.247 INFO:tasks.workunit.client.0.smithi196.stdout:8/861: creat de/f10e x:0 0 0 2024-03-17T23:58:41.254 INFO:tasks.workunit.client.0.smithi196.stdout:8/862: dwrite de/d2b/d30/d7c/dc9/fcd [0,4194304] 0 2024-03-17T23:58:41.254 INFO:tasks.workunit.client.0.smithi196.stdout:8/863: chown de/d10/d35/d88/d93 2 1 2024-03-17T23:58:41.256 INFO:tasks.workunit.client.0.smithi196.stdout:8/864: write de/d10/d35/d88/dd1/fd5 [353243,104113] 0 2024-03-17T23:58:41.260 INFO:tasks.workunit.client.0.smithi196.stdout:8/865: link de/d10/d35/d88/cd4 de/d2b/d30/d7c/dd6/c10f 0 2024-03-17T23:58:41.260 INFO:tasks.workunit.client.0.smithi196.stdout:8/866: read - de/d10/d54/dbe/fc0 zero size 2024-03-17T23:58:41.267 INFO:tasks.workunit.client.0.smithi196.stdout:8/867: dwrite de/f15 [0,4194304] 0 2024-03-17T23:58:41.274 INFO:tasks.workunit.client.0.smithi196.stdout:8/868: unlink de/d2b/d30/fa8 0 2024-03-17T23:58:41.276 INFO:tasks.workunit.client.0.smithi196.stdout:8/869: mknod de/d10/d35/d88/dd1/c110 0 2024-03-17T23:58:41.277 INFO:tasks.workunit.client.0.smithi196.stdout:8/870: dread - de/d10/d35/d88/d93/ff7 zero size 2024-03-17T23:58:41.279 INFO:tasks.workunit.client.0.smithi196.stdout:8/871: mkdir de/d10/d35/d88/d93/d111 0 2024-03-17T23:58:41.282 INFO:tasks.workunit.client.0.smithi196.stdout:8/872: write de/d10/d54/d5c/d81/f94 [628637,24921] 0 2024-03-17T23:58:41.290 INFO:tasks.workunit.client.0.smithi196.stdout:8/873: dread de/d10/d35/d3e/f4c [0,4194304] 0 2024-03-17T23:58:41.291 INFO:tasks.workunit.client.0.smithi196.stdout:8/874: write de/f31 [3071373,61646] 0 2024-03-17T23:58:41.292 INFO:tasks.workunit.client.0.smithi196.stdout:8/875: dread de/d10/ff5 [0,4194304] 0 2024-03-17T23:58:41.295 INFO:tasks.workunit.client.0.smithi196.stdout:8/876: mknod de/d2b/d30/d7c/dc9/c112 0 2024-03-17T23:58:41.314 INFO:tasks.workunit.client.0.smithi196.stdout:8/877: write de/d10/f2e [3791314,96896] 0 2024-03-17T23:58:41.317 INFO:tasks.workunit.client.0.smithi196.stdout:8/878: read de/d10/d35/d3e/f8d [2465768,114669] 0 2024-03-17T23:58:41.318 INFO:tasks.workunit.client.0.smithi196.stdout:8/879: fdatasync de/f10e 0 2024-03-17T23:58:41.318 INFO:tasks.workunit.client.0.smithi196.stdout:8/880: fsync de/d2b/f47 0 2024-03-17T23:58:41.328 INFO:tasks.workunit.client.0.smithi196.stdout:8/881: dwrite de/d2b/faf [0,4194304] 0 2024-03-17T23:58:41.330 INFO:tasks.workunit.client.0.smithi196.stdout:8/882: chown de/d10/d43/d71/c10c 71921987 1 2024-03-17T23:58:41.339 INFO:tasks.workunit.client.0.smithi196.stdout:8/883: dwrite de/d10/d35/d3e/f9c [0,4194304] 0 2024-03-17T23:58:41.344 INFO:tasks.workunit.client.0.smithi196.stdout:8/884: unlink de/d10/d54/d5c/dcc/de6/d10b/d5d/lf1 0 2024-03-17T23:58:41.346 INFO:tasks.workunit.client.0.smithi196.stdout:8/885: symlink de/d10/l113 0 2024-03-17T23:58:41.357 INFO:tasks.workunit.client.0.smithi196.stdout:9/997: sync 2024-03-17T23:58:41.357 INFO:tasks.workunit.client.0.smithi196.stdout:9/998: fdatasync d9/f11 0 2024-03-17T23:58:41.361 INFO:tasks.workunit.client.0.smithi196.stdout:9/999: getdents d9/df/d4a/d5b/d6d/da8/def/d146 0 2024-03-17T23:58:41.367 INFO:tasks.workunit.client.0.smithi196.stdout:8/886: dread de/d2b/d30/f51 [0,4194304] 0 2024-03-17T23:58:41.378 INFO:tasks.workunit.client.0.smithi196.stdout:8/887: dwrite de/d10/d54/d5c/daa/fb2 [4194304,4194304] 0 2024-03-17T23:58:41.380 INFO:tasks.workunit.client.0.smithi196.stdout:8/888: fsync de/d10/d35/d88/ffe 0 2024-03-17T23:58:41.382 INFO:tasks.workunit.client.0.smithi196.stdout:8/889: symlink de/d10/d35/d88/dc4/l114 0 2024-03-17T23:58:41.388 INFO:tasks.workunit.client.0.smithi196.stdout:8/890: write de/d2b/f47 [2156925,25125] 0 2024-03-17T23:58:41.388 INFO:tasks.workunit.client.0.smithi196.stdout:4/926: sync 2024-03-17T23:58:41.391 INFO:tasks.workunit.client.0.smithi196.stdout:4/927: rename d1/d68/c84 to d1/c140 0 2024-03-17T23:58:41.399 INFO:tasks.workunit.client.0.smithi196.stdout:8/891: truncate de/d10/d35/d88/f9b 3643830 0 2024-03-17T23:58:41.407 INFO:tasks.workunit.client.0.smithi196.stdout:8/892: write de/d10/d54/d5c/dcc/de6/d10b/fae [419892,98948] 0 2024-03-17T23:58:41.407 INFO:tasks.workunit.client.0.smithi196.stdout:4/928: dread d1/d26/d33/f88 [0,4194304] 0 2024-03-17T23:58:41.410 INFO:tasks.workunit.client.0.smithi196.stdout:8/893: creat de/d10/d54/f115 x:0 0 0 2024-03-17T23:58:41.412 INFO:tasks.workunit.client.0.smithi196.stdout:4/929: getdents d1/d11/d5d/ded 0 2024-03-17T23:58:41.413 INFO:tasks.workunit.client.0.smithi196.stdout:4/930: chown d1/de/d50/d55/d4a/f8d 3080189 1 2024-03-17T23:58:41.413 INFO:tasks.workunit.client.0.smithi196.stdout:8/894: creat de/d10/d35/f116 x:0 0 0 2024-03-17T23:58:41.417 INFO:tasks.workunit.client.0.smithi196.stdout:4/931: link d1/de/d50/d55/fb3 d1/d11/f141 0 2024-03-17T23:58:41.419 INFO:tasks.workunit.client.0.smithi196.stdout:4/932: mknod d1/de/d50/d55/d131/d134/c142 0 2024-03-17T23:58:41.422 INFO:tasks.workunit.client.0.smithi196.stdout:4/933: mkdir d1/de/d50/d55/de4/d143 0 2024-03-17T23:58:41.422 INFO:tasks.workunit.client.0.smithi196.stdout:4/934: stat d1/d11/d5d/ded/ff0 0 2024-03-17T23:58:41.424 INFO:tasks.workunit.client.0.smithi196.stdout:4/935: write d1/d26/d57/d8c/d97/fa8 [2556997,15600] 0 2024-03-17T23:58:41.425 INFO:tasks.workunit.client.0.smithi196.stdout:4/936: chown d1/d11/d5d/f11f 19987 1 2024-03-17T23:58:41.447 INFO:tasks.workunit.client.0.smithi196.stdout:4/937: dread d1/d26/d8b/de9/f136 [0,4194304] 0 2024-03-17T23:58:41.449 INFO:tasks.workunit.client.0.smithi196.stdout:4/938: creat d1/d26/f144 x:0 0 0 2024-03-17T23:58:41.453 INFO:tasks.workunit.client.0.smithi196.stdout:4/939: dread d1/d1b/d77/f101 [0,4194304] 0 2024-03-17T23:58:41.454 INFO:tasks.workunit.client.0.smithi196.stdout:4/940: fsync d1/d11/d5d/f11f 0 2024-03-17T23:58:41.455 INFO:tasks.workunit.client.0.smithi196.stdout:4/941: truncate d1/d1b/ff6 228919 0 2024-03-17T23:58:41.458 INFO:tasks.workunit.client.0.smithi196.stdout:4/942: rename d1/d1b/l6c to d1/d26/d57/dac/db2/l145 0 2024-03-17T23:58:41.460 INFO:tasks.workunit.client.0.smithi196.stdout:4/943: creat d1/de/d50/d55/de4/f146 x:0 0 0 2024-03-17T23:58:41.462 INFO:tasks.workunit.client.0.smithi196.stdout:4/944: unlink d1/d26/d33/d40/ca0 0 2024-03-17T23:58:41.464 INFO:tasks.workunit.client.0.smithi196.stdout:4/945: mknod d1/d1b/c147 0 2024-03-17T23:58:41.467 INFO:tasks.workunit.client.0.smithi196.stdout:4/946: getdents d1/de 0 2024-03-17T23:58:41.469 INFO:tasks.workunit.client.0.smithi196.stdout:4/947: mknod d1/d1b/d77/c148 0 2024-03-17T23:58:41.471 INFO:tasks.workunit.client.0.smithi196.stdout:4/948: truncate d1/d26/d33/fd8 732262 0 2024-03-17T23:58:41.472 INFO:tasks.workunit.client.0.smithi196.stdout:4/949: write d1/d11/d5d/ded/ff0 [4791070,35379] 0 2024-03-17T23:58:41.474 INFO:tasks.workunit.client.0.smithi196.stdout:4/950: fsync d1/d1b/d77/df1/fa5 0 2024-03-17T23:58:41.475 INFO:tasks.workunit.client.0.smithi196.stdout:4/951: chown d1/de/d50/d55/de4/f146 653484 1 2024-03-17T23:58:41.478 INFO:tasks.workunit.client.0.smithi196.stdout:4/952: rename d1/f12a to d1/de/d50/d55/d4a/f149 0 2024-03-17T23:58:41.494 INFO:tasks.workunit.client.0.smithi196.stdout:4/953: dwrite d1/de/d50/f9e [0,4194304] 0 2024-03-17T23:58:41.497 INFO:tasks.workunit.client.0.smithi196.stdout:4/954: creat d1/de/d50/d55/f14a x:0 0 0 2024-03-17T23:58:41.499 INFO:tasks.workunit.client.0.smithi196.stdout:4/955: symlink d1/d26/d57/de6/l14b 0 2024-03-17T23:58:41.499 INFO:tasks.workunit.client.0.smithi196.stdout:4/956: fdatasync d1/d26/f144 0 2024-03-17T23:58:41.507 INFO:tasks.workunit.client.0.smithi196.stdout:4/957: dwrite d1/d68/f12b [0,4194304] 0 2024-03-17T23:58:41.510 INFO:tasks.workunit.client.0.smithi196.stdout:1/943: sync 2024-03-17T23:58:41.511 INFO:tasks.workunit.client.0.smithi196.stdout:4/958: mkdir d1/de/d50/d14c 0 2024-03-17T23:58:41.513 INFO:tasks.workunit.client.0.smithi196.stdout:1/944: dread d1/d13/d23/d47/d48/d74/f84 [0,4194304] 0 2024-03-17T23:58:41.515 INFO:tasks.workunit.client.0.smithi196.stdout:1/945: mknod d1/c138 0 2024-03-17T23:58:41.523 INFO:tasks.workunit.client.0.smithi196.stdout:1/946: dwrite d1/db/ff0 [0,4194304] 0 2024-03-17T23:58:41.534 INFO:tasks.workunit.client.0.smithi196.stdout:1/947: dwrite d1/d13/d23/d47/d48/f7b [0,4194304] 0 2024-03-17T23:58:41.654 INFO:tasks.workunit.client.0.smithi196.stdout:8/895: sync 2024-03-17T23:58:41.666 INFO:tasks.workunit.client.0.smithi196.stdout:8/896: dwrite de/d10/d54/d5c/dcc/fef [0,4194304] 0 2024-03-17T23:58:41.674 INFO:tasks.workunit.client.0.smithi196.stdout:8/897: dwrite de/d5e/f60 [0,4194304] 0 2024-03-17T23:58:41.675 INFO:tasks.workunit.client.0.smithi196.stdout:8/898: chown de/d10/f1a 7580 1 2024-03-17T23:58:41.687 INFO:tasks.workunit.client.0.smithi196.stdout:8/899: dwrite de/f1f [0,4194304] 0 2024-03-17T23:58:41.688 INFO:tasks.workunit.client.0.smithi196.stdout:8/900: read de/f85 [2649178,41272] 0 2024-03-17T23:58:41.690 INFO:tasks.workunit.client.0.smithi196.stdout:8/901: chown de/d2b/d30/f90 0 1 2024-03-17T23:58:41.691 INFO:tasks.workunit.client.0.smithi196.stdout:8/902: stat de/d10/d35/d88/d93 0 2024-03-17T23:58:41.693 INFO:tasks.workunit.client.0.smithi196.stdout:8/903: mkdir de/d10/d35/d88/d117 0 2024-03-17T23:58:41.697 INFO:tasks.workunit.client.0.smithi196.stdout:8/904: creat de/d10/d35/d3e/f118 x:0 0 0 2024-03-17T23:58:41.740 INFO:tasks.workunit.client.0.smithi196.stdout:8/905: creat de/d10/d35/d3e/d6c/f119 x:0 0 0 2024-03-17T23:58:41.740 INFO:tasks.workunit.client.0.smithi196.stdout:8/906: symlink de/d10/d54/d5c/daa/dde/l11a 0 2024-03-17T23:58:41.740 INFO:tasks.workunit.client.0.smithi196.stdout:8/907: read - de/d2b/d30/d33/f77 zero size 2024-03-17T23:58:41.740 INFO:tasks.workunit.client.0.smithi196.stdout:4/959: sync 2024-03-17T23:58:41.740 INFO:tasks.workunit.client.0.smithi196.stdout:1/948: sync 2024-03-17T23:58:41.740 INFO:tasks.workunit.client.0.smithi196.stdout:8/908: rename de/d10/d35/d3e/ld2 to de/d10/d35/d88/dd1/l11b 0 2024-03-17T23:58:41.740 INFO:tasks.workunit.client.0.smithi196.stdout:1/949: write d1/db/dd/d43/fda [566583,47550] 0 2024-03-17T23:58:41.740 INFO:tasks.workunit.client.0.smithi196.stdout:1/950: dread d1/db/dd/f5d [0,4194304] 0 2024-03-17T23:58:41.740 INFO:tasks.workunit.client.0.smithi196.stdout:8/909: dwrite de/d10/d54/dbe/fc0 [0,4194304] 0 2024-03-17T23:58:41.740 INFO:tasks.workunit.client.0.smithi196.stdout:4/960: dwrite d1/d11/fbb [0,4194304] 0 2024-03-17T23:58:41.741 INFO:tasks.workunit.client.0.smithi196.stdout:4/961: write d1/d1b/d77/fb4 [8933018,89934] 0 2024-03-17T23:58:41.741 INFO:tasks.workunit.client.0.smithi196.stdout:1/951: dwrite d1/d13/d23/d62/dab/dca/fd7 [0,4194304] 0 2024-03-17T23:58:41.741 INFO:tasks.workunit.client.0.smithi196.stdout:1/952: rmdir d1/d13/d23/d47/d48/dc4 39 2024-03-17T23:58:41.741 INFO:tasks.workunit.client.0.smithi196.stdout:1/953: fdatasync d1/d13/d91/de9/f112 0 2024-03-17T23:58:41.741 INFO:tasks.workunit.client.0.smithi196.stdout:4/962: dread d1/d11/fbb [0,4194304] 0 2024-03-17T23:58:41.741 INFO:tasks.workunit.client.0.smithi196.stdout:4/963: mkdir d1/de/d50/d55/d4a/d121/d137/d14d 0 2024-03-17T23:58:41.746 INFO:tasks.workunit.client.0.smithi196.stdout:1/954: dwrite d1/db/dd/d43/f98 [0,4194304] 0 2024-03-17T23:58:41.746 INFO:tasks.workunit.client.0.smithi196.stdout:4/964: getdents d1/de/d50/d55/de4 0 2024-03-17T23:58:41.747 INFO:tasks.workunit.client.0.smithi196.stdout:8/910: dread de/d10/d54/d5c/dcc/de6/d10b/d5d/f64 [0,4194304] 0 2024-03-17T23:58:41.749 INFO:tasks.workunit.client.0.smithi196.stdout:1/955: write d1/db/f73 [1403704,31661] 0 2024-03-17T23:58:41.752 INFO:tasks.workunit.client.0.smithi196.stdout:1/956: write d1/db/dd/f93 [9414390,51476] 0 2024-03-17T23:58:41.753 INFO:tasks.workunit.client.0.smithi196.stdout:1/957: stat d1/d13/d2a/l30 0 2024-03-17T23:58:41.754 INFO:tasks.workunit.client.0.smithi196.stdout:4/965: dread d1/d1b/f75 [0,4194304] 0 2024-03-17T23:58:41.755 INFO:tasks.workunit.client.0.smithi196.stdout:1/958: dread d1/db/dd/d43/fa7 [0,4194304] 0 2024-03-17T23:58:41.757 INFO:tasks.workunit.client.0.smithi196.stdout:8/911: dread de/d10/d35/d88/dd1/fd5 [0,4194304] 0 2024-03-17T23:58:41.758 INFO:tasks.workunit.client.0.smithi196.stdout:1/959: write d1/db/dd/fc9 [1515847,102642] 0 2024-03-17T23:58:41.758 INFO:tasks.workunit.client.0.smithi196.stdout:4/966: fsync d1/de/d50/fc9 0 2024-03-17T23:58:41.760 INFO:tasks.workunit.client.0.smithi196.stdout:1/960: write d1/f11b [808847,48072] 0 2024-03-17T23:58:41.760 INFO:tasks.workunit.client.0.smithi196.stdout:8/912: chown de/d2b/d30/d33/f48 125 1 2024-03-17T23:58:41.761 INFO:tasks.workunit.client.0.smithi196.stdout:4/967: write d1/d11/d5d/ded/ff0 [4770722,61425] 0 2024-03-17T23:58:41.762 INFO:tasks.workunit.client.0.smithi196.stdout:8/913: chown de/d10/d35/d88/d93/dbf 59224 1 2024-03-17T23:58:41.764 INFO:tasks.workunit.client.0.smithi196.stdout:1/961: symlink d1/d13/d91/de9/df5/l139 0 2024-03-17T23:58:41.767 INFO:tasks.workunit.client.0.smithi196.stdout:4/968: creat d1/d1b/f14e x:0 0 0 2024-03-17T23:58:41.769 INFO:tasks.workunit.client.0.smithi196.stdout:4/969: rmdir d1/d68 39 2024-03-17T23:58:41.771 INFO:tasks.workunit.client.0.smithi196.stdout:1/962: rename d1/d13/d23/d62/dab/dca/dd1/dfe/c76 to d1/db/c13a 0 2024-03-17T23:58:41.772 INFO:tasks.workunit.client.0.smithi196.stdout:8/914: dwrite de/d10/d54/d5c/d81/f94 [0,4194304] 0 2024-03-17T23:58:41.775 INFO:tasks.workunit.client.0.smithi196.stdout:4/970: dread - d1/d68/fce zero size 2024-03-17T23:58:41.776 INFO:tasks.workunit.client.0.smithi196.stdout:4/971: truncate d1/f8a 4760332 0 2024-03-17T23:58:41.785 INFO:tasks.workunit.client.0.smithi196.stdout:4/972: dwrite d1/d26/fcc [0,4194304] 0 2024-03-17T23:58:41.791 INFO:tasks.workunit.client.0.smithi196.stdout:4/973: rmdir d1/de/d50/d55/de4/df2 39 2024-03-17T23:58:41.797 INFO:tasks.workunit.client.0.smithi196.stdout:8/915: dwrite de/d10/d35/d88/dd1/dea/ffb [0,4194304] 0 2024-03-17T23:58:41.799 INFO:tasks.workunit.client.0.smithi196.stdout:4/974: rmdir d1/de/d50/d55/d4a/d121/d137/d14d 0 2024-03-17T23:58:41.800 INFO:tasks.workunit.client.0.smithi196.stdout:4/975: chown d1/d26/d57/d8c/f110 1359 1 2024-03-17T23:58:41.800 INFO:tasks.workunit.client.0.smithi196.stdout:4/976: chown d1/dd2 2729396 1 2024-03-17T23:58:41.801 INFO:tasks.workunit.client.0.smithi196.stdout:8/916: mkdir de/d2b/d9f/d11c 0 2024-03-17T23:58:41.804 INFO:tasks.workunit.client.0.smithi196.stdout:4/977: rmdir d1/dd2/dcb 39 2024-03-17T23:58:41.805 INFO:tasks.workunit.client.0.smithi196.stdout:8/917: creat de/d10/d35/d88/d93/f11d x:0 0 0 2024-03-17T23:58:41.807 INFO:tasks.workunit.client.0.smithi196.stdout:8/918: symlink de/d10/d54/d5c/d81/l11e 0 2024-03-17T23:58:41.808 INFO:tasks.workunit.client.0.smithi196.stdout:4/978: getdents d1/d11/d5d/ded 0 2024-03-17T23:58:41.809 INFO:tasks.workunit.client.0.smithi196.stdout:4/979: chown d1/d26/d33/d40/da1/c106 164334018 1 2024-03-17T23:58:41.811 INFO:tasks.workunit.client.0.smithi196.stdout:4/980: chown d1/d11/l37 1 1 2024-03-17T23:58:41.813 INFO:tasks.workunit.client.0.smithi196.stdout:4/981: mkdir d1/d26/d33/d3f/d14f 0 2024-03-17T23:58:41.819 INFO:tasks.workunit.client.0.smithi196.stdout:4/982: creat d1/d26/d33/d3f/d14f/f150 x:0 0 0 2024-03-17T23:58:41.823 INFO:tasks.workunit.client.0.smithi196.stdout:8/919: write de/d10/f3b [1436051,72051] 0 2024-03-17T23:58:41.826 INFO:tasks.workunit.client.0.smithi196.stdout:8/920: creat de/d10/d35/d3e/f11f x:0 0 0 2024-03-17T23:58:41.828 INFO:tasks.workunit.client.0.smithi196.stdout:8/921: symlink de/d10/d35/d88/d93/dbf/l120 0 2024-03-17T23:58:41.830 INFO:tasks.workunit.client.0.smithi196.stdout:8/922: mkdir de/d2b/d30/d7c/d121 0 2024-03-17T23:58:41.835 INFO:tasks.workunit.client.0.smithi196.stdout:8/923: rmdir de/d10/d35/d88/d93/d111 0 2024-03-17T23:58:41.837 INFO:tasks.workunit.client.0.smithi196.stdout:8/924: truncate de/d10/d35/d3e/f11f 356088 0 2024-03-17T23:58:41.837 INFO:tasks.workunit.client.0.smithi196.stdout:8/925: stat de/d5e/f8f 0 2024-03-17T23:58:41.838 INFO:tasks.workunit.client.0.smithi196.stdout:8/926: readlink de/d10/d43/l4d 0 2024-03-17T23:58:41.843 INFO:tasks.workunit.client.0.smithi196.stdout:8/927: link de/d10/d54/d5c/daa/cc8 de/d10/d54/dbe/c122 0 2024-03-17T23:58:41.844 INFO:tasks.workunit.client.0.smithi196.stdout:8/928: chown de/d10/d35/d88/dd1/l11b 208655258 1 2024-03-17T23:58:41.851 INFO:tasks.workunit.client.0.smithi196.stdout:8/929: dwrite de/d10/d54/d5c/dcc/de6/d10b/fae [0,4194304] 0 2024-03-17T23:58:41.853 INFO:tasks.workunit.client.0.smithi196.stdout:8/930: rmdir de/d10/d35/d3e 39 2024-03-17T23:58:41.859 INFO:tasks.workunit.client.0.smithi196.stdout:8/931: link de/c25 de/d10/d35/d88/dd1/dea/c123 0 2024-03-17T23:58:41.859 INFO:tasks.workunit.client.0.smithi196.stdout:8/932: stat de/d2b/f47 0 2024-03-17T23:58:41.862 INFO:tasks.workunit.client.0.smithi196.stdout:8/933: truncate de/f23 1825440 0 2024-03-17T23:58:41.863 INFO:tasks.workunit.client.0.smithi196.stdout:8/934: chown de/d10/d35/d88/dd1/fd5 473 1 2024-03-17T23:58:41.863 INFO:tasks.workunit.client.0.smithi196.stdout:8/935: stat de/d2b/d30/d33/f5a 0 2024-03-17T23:58:41.875 INFO:tasks.workunit.client.0.smithi196.stdout:8/936: truncate de/d10/d54/d5c/dcc/de6/d10b/fae 3280113 0 2024-03-17T23:58:41.878 INFO:tasks.workunit.client.0.smithi196.stdout:8/937: symlink de/d10/d54/d5c/dcc/de6/d10b/d5d/l124 0 2024-03-17T23:58:41.878 INFO:tasks.workunit.client.0.smithi196.stdout:8/938: dread - de/d10/fec zero size 2024-03-17T23:58:41.880 INFO:tasks.workunit.client.0.smithi196.stdout:8/939: write de/d10/d54/d5c/daa/fb2 [5462280,38872] 0 2024-03-17T23:58:41.881 INFO:tasks.workunit.client.0.smithi196.stdout:8/940: readlink de/d10/d35/lb5 0 2024-03-17T23:58:41.888 INFO:tasks.workunit.client.0.smithi196.stdout:8/941: dwrite de/d10/f2e [0,4194304] 0 2024-03-17T23:58:41.890 INFO:tasks.workunit.client.0.smithi196.stdout:8/942: unlink lc 0 2024-03-17T23:58:41.892 INFO:tasks.workunit.client.0.smithi196.stdout:8/943: getdents de/d10/d54/d5c/dcc/de6/d10b/d5d/de1 0 2024-03-17T23:58:41.894 INFO:tasks.workunit.client.0.smithi196.stdout:8/944: symlink de/d10/d43/l125 0 2024-03-17T23:58:41.895 INFO:tasks.workunit.client.0.smithi196.stdout:8/945: chown de/d10/d43/l4d 25272 1 2024-03-17T23:58:41.896 INFO:tasks.workunit.client.0.smithi196.stdout:8/946: fdatasync de/d2b/d30/d33/f3d 0 2024-03-17T23:58:41.898 INFO:tasks.workunit.client.0.smithi196.stdout:8/947: fdatasync de/d10/d54/d5c/dcc/de6/d10b/f55 0 2024-03-17T23:58:41.899 INFO:tasks.workunit.client.0.smithi196.stdout:8/948: dread - de/d10/d35/d88/dd1/fd9 zero size 2024-03-17T23:58:41.908 INFO:tasks.workunit.client.0.smithi196.stdout:8/949: dwrite de/d2b/d30/f3a [0,4194304] 0 2024-03-17T23:58:41.910 INFO:tasks.workunit.client.0.smithi196.stdout:8/950: fdatasync de/d5e/fd8 0 2024-03-17T23:58:41.915 INFO:tasks.workunit.client.0.smithi196.stdout:8/951: dread - de/d10/d43/f6e zero size 2024-03-17T23:58:41.916 INFO:tasks.workunit.client.0.smithi196.stdout:8/952: dread - de/d10/d35/d88/dd1/fd9 zero size 2024-03-17T23:58:41.920 INFO:tasks.workunit.client.0.smithi196.stdout:8/953: creat de/d10/d35/d88/d93/db9/f126 x:0 0 0 2024-03-17T23:58:41.923 INFO:tasks.workunit.client.0.smithi196.stdout:8/954: mknod de/d10/d54/d5c/daa/dde/c127 0 2024-03-17T23:58:41.923 INFO:tasks.workunit.client.0.smithi196.stdout:8/955: stat de/d10/d54 0 2024-03-17T23:58:41.928 INFO:tasks.workunit.client.0.smithi196.stdout:8/956: write de/d10/d54/f67 [106636,112932] 0 2024-03-17T23:58:41.929 INFO:tasks.workunit.client.0.smithi196.stdout:8/957: chown de/d10/d35/d88/d93 33280242 1 2024-03-17T23:58:41.930 INFO:tasks.workunit.client.0.smithi196.stdout:8/958: chown de/d10/d35/d88/d93/dbf/l120 234804 1 2024-03-17T23:58:41.934 INFO:tasks.workunit.client.0.smithi196.stdout:8/959: rmdir de/d2b/d9f/d11c 0 2024-03-17T23:58:41.936 INFO:tasks.workunit.client.0.smithi196.stdout:8/960: symlink de/d10/d54/d5c/daa/l128 0 2024-03-17T23:58:41.937 INFO:tasks.workunit.client.0.smithi196.stdout:8/961: fsync de/d10/f2e 0 2024-03-17T23:58:41.941 INFO:tasks.workunit.client.0.smithi196.stdout:8/962: getdents de/d10/d54 0 2024-03-17T23:58:41.942 INFO:tasks.workunit.client.0.smithi196.stdout:8/963: truncate de/d10/d35/d88/dd1/fd9 828287 0 2024-03-17T23:58:41.946 INFO:tasks.workunit.client.0.smithi196.stdout:8/964: getdents de/d10/d35/d88/dc4/dfc 0 2024-03-17T23:58:41.948 INFO:tasks.workunit.client.0.smithi196.stdout:1/963: sync 2024-03-17T23:58:41.948 INFO:tasks.workunit.client.0.smithi196.stdout:4/983: sync 2024-03-17T23:58:41.949 INFO:tasks.workunit.client.0.smithi196.stdout:4/984: read d1/d26/d8b/de9/f136 [375521,79691] 0 2024-03-17T23:58:41.950 INFO:tasks.workunit.client.0.smithi196.stdout:1/964: mkdir d1/db/d13b 0 2024-03-17T23:58:41.951 INFO:tasks.workunit.client.0.smithi196.stdout:4/985: chown d1/d26/d8b/de9/fa3 2669721 1 2024-03-17T23:58:41.953 INFO:tasks.workunit.client.0.smithi196.stdout:1/965: write d1/d13/d23/d62/dab/ded/fe7 [5050409,60702] 0 2024-03-17T23:58:41.953 INFO:tasks.workunit.client.0.smithi196.stdout:4/986: mknod d1/d1b/d77/df1/c151 0 2024-03-17T23:58:41.955 INFO:tasks.workunit.client.0.smithi196.stdout:8/965: dwrite de/f19 [0,4194304] 0 2024-03-17T23:58:41.957 INFO:tasks.workunit.client.0.smithi196.stdout:8/966: fsync de/d10/f14 0 2024-03-17T23:58:41.963 INFO:tasks.workunit.client.0.smithi196.stdout:8/967: creat de/d10/d35/d88/dc4/f129 x:0 0 0 2024-03-17T23:58:41.964 INFO:tasks.workunit.client.0.smithi196.stdout:8/968: read - de/d5e/ff8 zero size 2024-03-17T23:58:41.964 INFO:tasks.workunit.client.0.smithi196.stdout:4/987: link d1/d26/d8b/de9/fa3 d1/d26/d33/d40/da1/f152 0 2024-03-17T23:58:41.965 INFO:tasks.workunit.client.0.smithi196.stdout:4/988: fdatasync d1/d26/d57/de6/f10c 0 2024-03-17T23:58:41.966 INFO:tasks.workunit.client.0.smithi196.stdout:1/966: truncate d1/db/ff0 1996005 0 2024-03-17T23:58:41.968 INFO:tasks.workunit.client.0.smithi196.stdout:4/989: rmdir d1/d11 39 2024-03-17T23:58:41.969 INFO:tasks.workunit.client.0.smithi196.stdout:8/969: rename de/d10/d35/d3e/d6c/la5 to de/d10/d54/dbe/l12a 0 2024-03-17T23:58:41.971 INFO:tasks.workunit.client.0.smithi196.stdout:8/970: write de/d10/d35/d3e/d6c/f119 [822612,97853] 0 2024-03-17T23:58:41.971 INFO:tasks.workunit.client.0.smithi196.stdout:1/967: mknod d1/d13/d23/d62/dab/dca/dd1/dfe/d75/d118/c13c 0 2024-03-17T23:58:41.972 INFO:tasks.workunit.client.0.smithi196.stdout:4/990: mknod d1/d11/d5d/dfa/c153 0 2024-03-17T23:58:41.974 INFO:tasks.workunit.client.0.smithi196.stdout:1/968: creat d1/d13/d23/d62/dab/f13d x:0 0 0 2024-03-17T23:58:41.974 INFO:tasks.workunit.client.0.smithi196.stdout:4/991: chown d1/c118 374 1 2024-03-17T23:58:41.976 INFO:tasks.workunit.client.0.smithi196.stdout:1/969: symlink d1/db/l13e 0 2024-03-17T23:58:41.977 INFO:tasks.workunit.client.0.smithi196.stdout:4/992: fsync d1/d1b/f75 0 2024-03-17T23:58:41.978 INFO:tasks.workunit.client.0.smithi196.stdout:1/970: mkdir d1/d13/d91/d13f 0 2024-03-17T23:58:41.979 INFO:tasks.workunit.client.0.smithi196.stdout:4/993: unlink d1/d11/c6d 0 2024-03-17T23:58:41.982 INFO:tasks.workunit.client.0.smithi196.stdout:4/994: symlink d1/d26/d8b/l154 0 2024-03-17T23:58:41.983 INFO:tasks.workunit.client.0.smithi196.stdout:1/971: link d1/d13/d4c/dcd/c122 d1/d13/d23/d47/d48/d11e/c140 0 2024-03-17T23:58:41.984 INFO:tasks.workunit.client.0.smithi196.stdout:4/995: chown d1/d1b/c22 1034795152 1 2024-03-17T23:58:41.984 INFO:tasks.workunit.client.0.smithi196.stdout:1/972: write d1/d13/d91/de9/f112 [305738,62733] 0 2024-03-17T23:58:41.986 INFO:tasks.workunit.client.0.smithi196.stdout:4/996: mkdir d1/de/d50/d55/d4a/d121/d137/d155 0 2024-03-17T23:58:41.986 INFO:tasks.workunit.client.0.smithi196.stdout:4/997: readlink d1/d1b/le5 0 2024-03-17T23:58:41.990 INFO:tasks.workunit.client.0.smithi196.stdout:4/998: symlink d1/d26/l156 0 2024-03-17T23:58:42.003 INFO:tasks.workunit.client.0.smithi196.stdout:1/973: dwrite d1/db/dd/f67 [0,4194304] 0 2024-03-17T23:58:42.012 INFO:tasks.workunit.client.0.smithi196.stdout:1/974: creat d1/d13/d23/d62/dab/dca/dd1/f141 x:0 0 0 2024-03-17T23:58:42.012 INFO:tasks.workunit.client.0.smithi196.stdout:1/975: mknod d1/db/dd/d43/c142 0 2024-03-17T23:58:42.012 INFO:tasks.workunit.client.0.smithi196.stdout:1/976: chown d1/d13/d2a/l133 5327595 1 2024-03-17T23:58:42.013 INFO:tasks.workunit.client.0.smithi196.stdout:1/977: readlink d1/d13/d4c/dcd/lce 0 2024-03-17T23:58:42.014 INFO:tasks.workunit.client.0.smithi196.stdout:4/999: dread d1/d11/d5d/ded/f12d [0,4194304] 0 2024-03-17T23:58:42.018 INFO:tasks.workunit.client.0.smithi196.stdout:1/978: write d1/f7c [603505,58985] 0 2024-03-17T23:58:42.020 INFO:tasks.workunit.client.0.smithi196.stdout:1/979: fsync d1/d13/d23/d47/d48/d7e/f87 0 2024-03-17T23:58:42.021 INFO:tasks.workunit.client.0.smithi196.stdout:1/980: dread - d1/d13/d91/de9/d10c/f12f zero size 2024-03-17T23:58:42.023 INFO:tasks.workunit.client.0.smithi196.stdout:1/981: unlink d1/d13/d23/d47/d48/c9d 0 2024-03-17T23:58:42.026 INFO:tasks.workunit.client.0.smithi196.stdout:1/982: mknod d1/d13/d23/d62/d71/d135/c143 0 2024-03-17T23:58:42.032 INFO:tasks.workunit.client.0.smithi196.stdout:1/983: dwrite d1/f7c [0,4194304] 0 2024-03-17T23:58:42.035 INFO:tasks.workunit.client.0.smithi196.stdout:1/984: rename d1/db/dd/faa to d1/d13/d91/de9/df5/f144 0 2024-03-17T23:58:42.037 INFO:tasks.workunit.client.0.smithi196.stdout:1/985: mkdir d1/d13/d91/de9/df5/d145 0 2024-03-17T23:58:42.052 INFO:tasks.workunit.client.0.smithi196.stdout:1/986: dwrite d1/f4 [0,4194304] 0 2024-03-17T23:58:42.054 INFO:tasks.workunit.client.0.smithi196.stdout:1/987: fsync d1/d13/d91/de9/df5/f137 0 2024-03-17T23:58:42.055 INFO:tasks.workunit.client.0.smithi196.stdout:1/988: chown d1/d13/d23/d47/d48/d7e/f87 55584927 1 2024-03-17T23:58:42.056 INFO:tasks.workunit.client.0.smithi196.stdout:1/989: getdents d1/db/d13b 0 2024-03-17T23:58:42.061 INFO:tasks.workunit.client.0.smithi196.stdout:1/990: write d1/d13/d2a/f90 [554580,28174] 0 2024-03-17T23:58:42.063 INFO:tasks.workunit.client.0.smithi196.stdout:1/991: mkdir d1/db/d104/d146 0 2024-03-17T23:58:42.064 INFO:tasks.workunit.client.0.smithi196.stdout:1/992: mknod d1/d13/d91/c147 0 2024-03-17T23:58:42.066 INFO:tasks.workunit.client.0.smithi196.stdout:1/993: fdatasync d1/db/dd/f5d 0 2024-03-17T23:58:42.068 INFO:tasks.workunit.client.0.smithi196.stdout:1/994: dread - d1/d13/d91/de9/df5/f137 zero size 2024-03-17T23:58:42.071 INFO:tasks.workunit.client.0.smithi196.stdout:1/995: rename d1/d13/d23/d62/dab/ded/f123 to d1/d13/d91/f148 0 2024-03-17T23:58:42.074 INFO:tasks.workunit.client.0.smithi196.stdout:1/996: creat d1/d13/d4c/f149 x:0 0 0 2024-03-17T23:58:42.077 INFO:tasks.workunit.client.0.smithi196.stdout:1/997: dread d1/d13/d23/d70/f12b [0,4194304] 0 2024-03-17T23:58:42.079 INFO:tasks.workunit.client.0.smithi196.stdout:1/998: symlink d1/d13/d23/l14a 0 2024-03-17T23:58:42.212 INFO:tasks.workunit.client.0.smithi196.stdout:8/971: sync 2024-03-17T23:58:42.222 INFO:tasks.workunit.client.0.smithi196.stdout:8/972: dwrite de/d10/f2e [0,4194304] 0 2024-03-17T23:58:42.223 INFO:tasks.workunit.client.0.smithi196.stdout:8/973: stat de/d10/d54/d5c/daa/fb2 0 2024-03-17T23:58:42.242 INFO:tasks.workunit.client.0.smithi196.stdout:8/974: mkdir de/d10/d35/d88/d93/dbf/d101/d12b 0 2024-03-17T23:58:42.246 INFO:tasks.workunit.client.0.smithi196.stdout:1/999: sync 2024-03-17T23:58:42.255 INFO:tasks.workunit.client.0.smithi196.stdout:8/975: dread de/d10/d35/d88/d93/db9/fe2 [0,4194304] 0 2024-03-17T23:58:42.257 INFO:tasks.workunit.client.0.smithi196.stdout:8/976: read de/d2b/d30/d33/f37 [820350,116353] 0 2024-03-17T23:58:42.258 INFO:tasks.workunit.client.0.smithi196.stdout:8/977: mknod de/d2b/d9f/c12c 0 2024-03-17T23:58:42.259 INFO:tasks.workunit.client.0.smithi196.stdout:8/978: fsync de/d10/d54/d5c/d81/f94 0 2024-03-17T23:58:42.261 INFO:tasks.workunit.client.0.smithi196.stdout:8/979: symlink de/d10/d35/d88/dc4/l12d 0 2024-03-17T23:58:42.264 INFO:tasks.workunit.client.0.smithi196.stdout:8/980: unlink de/d2b/d30/d33/c44 0 2024-03-17T23:58:42.268 INFO:tasks.workunit.client.0.smithi196.stdout:8/981: rename de/d10/d35/d88/dc4/dfc to de/d2b/d30/d7c/d121/d12e 0 2024-03-17T23:58:42.269 INFO:tasks.workunit.client.0.smithi196.stdout:8/982: chown de/d10/l2f 247330573 1 2024-03-17T23:58:42.271 INFO:tasks.workunit.client.0.smithi196.stdout:8/983: mknod de/d10/d35/d88/d93/dbf/c12f 0 2024-03-17T23:58:42.273 INFO:tasks.workunit.client.0.smithi196.stdout:8/984: creat de/d10/d43/d71/f130 x:0 0 0 2024-03-17T23:58:42.296 INFO:tasks.workunit.client.0.smithi196.stdout:8/985: dwrite de/d10/d35/d88/f9b [0,4194304] 0 2024-03-17T23:58:42.297 INFO:tasks.workunit.client.0.smithi196.stdout:8/986: chown de/d5e/lb7 858508746 1 2024-03-17T23:58:42.298 INFO:tasks.workunit.client.0.smithi196.stdout:8/987: chown de/d10/d35/d3e/f56 18 1 2024-03-17T23:58:42.299 INFO:tasks.workunit.client.0.smithi196.stdout:8/988: readlink de/d10/l2f 0 2024-03-17T23:58:42.311 INFO:tasks.workunit.client.0.smithi196.stdout:8/989: dread de/d10/d43/d71/f82 [0,4194304] 0 2024-03-17T23:58:42.313 INFO:tasks.workunit.client.0.smithi196.stdout:8/990: write de/d10/d54/f115 [43843,104661] 0 2024-03-17T23:58:42.320 INFO:tasks.workunit.client.0.smithi196.stdout:8/991: dwrite de/d10/d54/d5c/fc5 [0,4194304] 0 2024-03-17T23:58:42.322 INFO:tasks.workunit.client.0.smithi196.stdout:8/992: write de/d10/d54/d5c/fa0 [4377518,126880] 0 2024-03-17T23:58:42.324 INFO:tasks.workunit.client.0.smithi196.stdout:8/993: readlink de/d2b/l4a 0 2024-03-17T23:58:42.331 INFO:tasks.workunit.client.0.smithi196.stdout:8/994: dwrite de/d2b/d30/feb [0,4194304] 0 2024-03-17T23:58:42.336 INFO:tasks.workunit.client.0.smithi196.stdout:8/995: write de/d5e/f8f [2521183,32021] 0 2024-03-17T23:58:42.338 INFO:tasks.workunit.client.0.smithi196.stdout:8/996: rmdir de/d10/d54/d5c/dcc 39 2024-03-17T23:58:42.339 INFO:tasks.workunit.client.0.smithi196.stdout:8/997: chown de/d2b/d30/d7c/ldb 202859840 1 2024-03-17T23:58:42.342 INFO:tasks.workunit.client.0.smithi196.stdout:8/998: rename de/d10/f14 to de/d10/d35/d88/dd1/f131 0 2024-03-17T23:58:42.342 INFO:tasks.workunit.client.0.smithi196.stdout:8/999: stat de/f2d 0 2024-03-17T23:58:42.345 INFO:tasks.workunit.client.0.smithi196.stderr:+ rm -rf -- ./tmp.6KLhVFM3Bq 2024-03-17T23:58:53.524 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-03-17T23:58:53.525 DEBUG:teuthology.orchestra.run.smithi196:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-03-17T23:59:07.351 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T23:59:07.354 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T23:59:37.403 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T23:59:37.406 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T23:59:38.606 INFO:tasks.workunit:Stopping ['suites/fsstress.sh'] on client.0... 2024-03-17T23:59:38.606 DEBUG:teuthology.orchestra.run.smithi196:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-03-17T23:59:38.886 DEBUG:teuthology.parallel:result is None 2024-03-17T23:59:38.887 DEBUG:teuthology.orchestra.run.smithi196:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-03-17T23:59:38.905 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-03-17T23:59:38.905 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2024-03-17T23:59:38.918 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2024-03-17T23:59:38.919 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2024-03-17T23:59:38.919 DEBUG:teuthology.orchestra.run.smithi196:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-17T23:59:38.958 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2024-03-17T23:59:38.958 DEBUG:teuthology.orchestra.run.smithi196:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-17T23:59:39.004 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-17T23:59:39.148 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:39.143+0000 7f21b4f74640 1 Processor -- start 2024-03-17T23:59:39.148 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:39.143+0000 7f21b4f74640 1 -- start start 2024-03-17T23:59:39.149 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:39.147+0000 7f21b4f74640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f21b00ca230 0x7f21b0165820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:59:39.149 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:39.147+0000 7f21b4f74640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f21b006fea0 con 0x7f21b00c8240 2024-03-17T23:59:39.149 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:39.147+0000 7f21b4f74640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f21b0070180 con 0x7f21b00b0150 2024-03-17T23:59:39.150 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:39.147+0000 7f21b4f74640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7f21b00b0530 con 0x7f21b00ca230 2024-03-17T23:59:39.150 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:39.147+0000 7f21aed9d640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f21b00ca230 0x7f21b0165820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:59:39.150 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:39.147+0000 7f21add9b640 1 --1- >> v1:172.21.15.196:6789/0 conn(0x7f21b00c8240 0x7f21b00c9b20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.196:6789/0 says I am v1:172.21.15.196:52904/0 (socket says 172.21.15.196:52904) 2024-03-17T23:59:39.150 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:39.147+0000 7f21add9b640 1 -- 172.21.15.196:0/2454673749 learned_addr learned my addr 172.21.15.196:0/2454673749 (peer_addr_for_me v1:172.21.15.196:0/0) 2024-03-17T23:59:39.150 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:39.147+0000 7f21aed9d640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f21b00ca230 0x7f21b0165820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.196:44540/0 (socket says 172.21.15.196:44540) 2024-03-17T23:59:39.150 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:39.147+0000 7f21aed9d640 1 -- 172.21.15.196:0/2454673749 >> v1:172.21.15.204:6789/0 conn(0x7f21b00b0150 legacy=0x7f21b006c3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:59:39.150 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:39.147+0000 7f21aed9d640 1 -- 172.21.15.196:0/2454673749 >> v1:172.21.15.196:6789/0 conn(0x7f21b00c8240 legacy=0x7f21b00c9b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:59:39.150 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:39.147+0000 7f21aed9d640 1 -- 172.21.15.196:0/2454673749 --> v2:172.21.15.196:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21b00c8cb0 con 0x7f21b00ca230 2024-03-17T23:59:39.151 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:39.147+0000 7f21aed9d640 1 --2- 172.21.15.196:0/2454673749 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f21b00ca230 0x7f21b0165820 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f21a8009d90 tx=0x7f21a801c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64cf7cbad0cf2d0f server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:59:39.152 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:39.147+0000 7f21ad59a640 1 -- 172.21.15.196:0/2454673749 <== mon.0 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21a80b2070 con 0x7f21b00ca230 2024-03-17T23:59:39.152 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:39.147+0000 7f21ad59a640 1 -- 172.21.15.196:0/2454673749 <== mon.0 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f21a80a5830 con 0x7f21b00ca230 2024-03-17T23:59:39.152 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:39.147+0000 7f21ad59a640 1 -- 172.21.15.196:0/2454673749 <== mon.0 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21a80a5c00 con 0x7f21b00ca230 2024-03-17T23:59:39.152 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:39.147+0000 7f21b4f74640 1 -- 172.21.15.196:0/2454673749 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f21b00ca230 msgr2=0x7f21b0165820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:59:39.153 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:39.147+0000 7f21b4f74640 1 --2- 172.21.15.196:0/2454673749 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f21b00ca230 0x7f21b0165820 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f21a8009d90 tx=0x7f21a801c970 comp rx=0 tx=0).stop 2024-03-17T23:59:39.153 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:39.151+0000 7f21b4f74640 1 -- 172.21.15.196:0/2454673749 shutdown_connections 2024-03-17T23:59:39.153 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:39.151+0000 7f21b4f74640 1 --2- 172.21.15.196:0/2454673749 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f21b00ca230 0x7f21b0165820 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:59:39.153 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:39.151+0000 7f21b4f74640 1 -- 172.21.15.196:0/2454673749 >> 172.21.15.196:0/2454673749 conn(0x7f21b006b2b0 msgr2=0x7f21b006b6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-17T23:59:39.153 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:39.151+0000 7f21b4f74640 1 -- 172.21.15.196:0/2454673749 shutdown_connections 2024-03-17T23:59:39.153 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:39.151+0000 7f21b4f74640 1 -- 172.21.15.196:0/2454673749 wait complete. 2024-03-17T23:59:39.153 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:39.151+0000 7f21b4f74640 1 Processor -- start 2024-03-17T23:59:39.154 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:39.151+0000 7f21b4f74640 1 -- start start 2024-03-17T23:59:39.156 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:39.151+0000 7f21b4f74640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f21b00b0150 0x7f21b00c61d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:59:39.156 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:39.151+0000 7f21b4f74640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f21b00c8240 0x7f21b01f4180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:59:39.156 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:39.151+0000 7f21b4f74640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f21b00ca230 0x7f21b0152630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:59:39.156 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:39.151+0000 7f21b4f74640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f21b006cc50 con 0x7f21b00c8240 2024-03-17T23:59:39.156 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:39.151+0000 7f21b4f74640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f21b006cad0 con 0x7f21b00b0150 2024-03-17T23:59:39.156 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:39.151+0000 7f21b4f74640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f21b0168580 con 0x7f21b00ca230 2024-03-17T23:59:39.156 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:39.151+0000 7f21add9b640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f21b00c8240 0x7f21b01f4180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:59:39.156 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:39.151+0000 7f21add9b640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f21b00c8240 0x7f21b01f4180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.196:44548/0 (socket says 172.21.15.196:44548) 2024-03-17T23:59:39.156 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:39.151+0000 7f21add9b640 1 -- 172.21.15.196:0/2171951905 learned_addr learned my addr 172.21.15.196:0/2171951905 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-03-17T23:59:39.157 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:39.151+0000 7f21ae59c640 1 --2- 172.21.15.196:0/2171951905 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f21b00b0150 0x7f21b00c61d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:59:39.157 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:39.151+0000 7f21aed9d640 1 --2- 172.21.15.196:0/2171951905 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f21b00ca230 0x7f21b0152630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:59:39.157 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:39.151+0000 7f21add9b640 1 -- 172.21.15.196:0/2171951905 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f21b00ca230 msgr2=0x7f21b0152630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:59:39.157 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:39.151+0000 7f21add9b640 1 --2- 172.21.15.196:0/2171951905 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f21b00ca230 0x7f21b0152630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:59:39.157 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:39.151+0000 7f21add9b640 1 -- 172.21.15.196:0/2171951905 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f21b00b0150 msgr2=0x7f21b00c61d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:59:39.157 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:39.151+0000 7f21add9b640 1 --2- 172.21.15.196:0/2171951905 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f21b00b0150 0x7f21b00c61d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:59:39.157 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:39.151+0000 7f21add9b640 1 -- 172.21.15.196:0/2171951905 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21b0152b70 con 0x7f21b00c8240 2024-03-17T23:59:39.157 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:39.151+0000 7f21aed9d640 1 --2- 172.21.15.196:0/2171951905 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f21b00ca230 0x7f21b0152630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-17T23:59:39.157 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:39.151+0000 7f21ae59c640 1 --2- 172.21.15.196:0/2171951905 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f21b00b0150 0x7f21b00c61d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-17T23:59:39.157 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:39.151+0000 7f21add9b640 1 --2- 172.21.15.196:0/2171951905 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f21b00c8240 0x7f21b01f4180 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f21a400c530 tx=0x7f21a400c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:59:39.157 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:39.151+0000 7f219effd640 1 -- 172.21.15.196:0/2171951905 <== mon.0 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21a4017070 con 0x7f21b00c8240 2024-03-17T23:59:39.157 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:39.151+0000 7f219effd640 1 -- 172.21.15.196:0/2171951905 <== mon.0 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f21a4005cf0 con 0x7f21b00c8240 2024-03-17T23:59:39.157 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:39.151+0000 7f21b4f74640 1 -- 172.21.15.196:0/2171951905 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f21b00c5150 con 0x7f21b00c8240 2024-03-17T23:59:39.157 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:39.151+0000 7f219effd640 1 -- 172.21.15.196:0/2171951905 <== mon.0 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21a4007270 con 0x7f21b00c8240 2024-03-17T23:59:39.158 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:39.151+0000 7f21b4f74640 1 -- 172.21.15.196:0/2171951905 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f21b00c5410 con 0x7f21b00c8240 2024-03-17T23:59:39.159 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:39.155+0000 7f21b4f74640 1 -- 172.21.15.196:0/2171951905 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f21b00689a0 con 0x7f21b00c8240 2024-03-17T23:59:39.159 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:39.155+0000 7f219effd640 1 -- 172.21.15.196:0/2171951905 <== mon.0 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 5) ==== 87083+0+0 (secure 0 0 0) 0x7f21a401a070 con 0x7f21b00c8240 2024-03-17T23:59:39.159 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:39.155+0000 7f219effd640 1 --2- 172.21.15.196:0/2171951905 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f2190067660 0x7f2190069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:59:39.159 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:39.155+0000 7f219effd640 1 -- 172.21.15.196:0/2171951905 <== mon.0 v2:172.21.15.196:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7f21a4084b70 con 0x7f21b00c8240 2024-03-17T23:59:39.159 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:39.155+0000 7f21ae59c640 1 --2- 172.21.15.196:0/2171951905 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f2190067660 0x7f2190069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:59:39.159 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:39.155+0000 7f21ae59c640 1 --2- 172.21.15.196:0/2171951905 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f2190067660 0x7f2190069b20 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f21a0000f70 tx=0x7f21a0009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:59:39.161 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:39.159+0000 7f219effd640 1 -- 172.21.15.196:0/2171951905 <== mon.0 v2:172.21.15.196:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177849 (secure 0 0 0) 0x7f21a4055090 con 0x7f21b00c8240 2024-03-17T23:59:39.462 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:39.459+0000 7f21b4f74640 1 -- 172.21.15.196:0/2171951905 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f21b0165840 con 0x7f21b00c8240 2024-03-17T23:59:39.464 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:39.459+0000 7f219effd640 1 -- 172.21.15.196:0/2171951905 <== mon.0 v2:172.21.15.196:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) ==== 74+0+16891 (secure 0 0 0) 0x7f21a4059130 con 0x7f21b00c8240 2024-03-17T23:59:39.465 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-03-17T23:59:39.465 INFO:teuthology.orchestra.run.smithi196.stdout:{"epoch":23,"fsid":"b80f9c80-17ad-4126-8957-4c0c46f5b803","created":"2024-03-17T23:55:43.368838+0000","modified":"2024-03-17T23:56:49.062022+0000","last_up_change":"2024-03-17T23:55:54.132187+0000","last_in_change":"2024-03-17T23:55:46.016435+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-17T23:55:56.030640+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-17T23:55:58.658234+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-17T23:56:00.003208+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"224d699f-bc10-4661-a8b5-6ca73290ffa0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6806","nonce":1194547591},{"type":"v1","addr":"172.21.15.196:6807","nonce":1194547591}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6809","nonce":1194547591},{"type":"v1","addr":"172.21.15.196:6811","nonce":1194547591}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6814","nonce":1194547591},{"type":"v1","addr":"172.21.15.196:6815","nonce":1194547591}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6812","nonce":1194547591},{"type":"v1","addr":"172.21.15.196:6813","nonce":1194547591}]},"public_addr":"172.21.15.196:6807/1194547591","cluster_addr":"172.21.15.196:6811/1194547591","heartbeat_back_addr":"172.21.15.196:6815/1194547591","heartbeat_front_addr":"172.21.15.196:6813/1194547591","state":["exists","up"]},{"osd":1,"uuid":"d8d6a0b0-450b-4ab5-b143-d4f36286e81e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6800","nonce":1901246986},{"type":"v1","addr":"172.21.15.196:6801","nonce":1901246986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6802","nonce":1901246986},{"type":"v1","addr":"172.21.15.196:6803","nonce":1901246986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6808","nonce":1901246986},{"type":"v1","addr":"172.21.15.196:6810","nonce":1901246986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6804","nonce":1901246986},{"type":"v1","addr":"172.21.15.196:6805","nonce":1901246986}]},"public_addr":"172.21.15.196:6801/1901246986","cluster_addr":"172.21.15.196:6803/1901246986","heartbeat_back_addr":"172.21.15.196:6810/1901246986","heartbeat_front_addr":"172.21.15.196:6805/1901246986","state":["exists","up"]},{"osd":2,"uuid":"d732ba94-1db0-41ed-930a-5abb6188980a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6824","nonce":673819559},{"type":"v1","addr":"172.21.15.196:6825","nonce":673819559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6826","nonce":673819559},{"type":"v1","addr":"172.21.15.196:6827","nonce":673819559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6830","nonce":673819559},{"type":"v1","addr":"172.21.15.196:6831","nonce":673819559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6828","nonce":673819559},{"type":"v1","addr":"172.21.15.196:6829","nonce":673819559}]},"public_addr":"172.21.15.196:6825/673819559","cluster_addr":"172.21.15.196:6827/673819559","heartbeat_back_addr":"172.21.15.196:6831/673819559","heartbeat_front_addr":"172.21.15.196:6829/673819559","state":["exists","up"]},{"osd":3,"uuid":"b79cab98-a49f-4544-b6b0-546dcfbd47a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6816","nonce":1104340623},{"type":"v1","addr":"172.21.15.196:6817","nonce":1104340623}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6818","nonce":1104340623},{"type":"v1","addr":"172.21.15.196:6819","nonce":1104340623}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6822","nonce":1104340623},{"type":"v1","addr":"172.21.15.196:6823","nonce":1104340623}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6820","nonce":1104340623},{"type":"v1","addr":"172.21.15.196:6821","nonce":1104340623}]},"public_addr":"172.21.15.196:6817/1104340623","cluster_addr":"172.21.15.196:6819/1104340623","heartbeat_back_addr":"172.21.15.196:6823/1104340623","heartbeat_front_addr":"172.21.15.196:6821/1104340623","state":["exists","up"]},{"osd":4,"uuid":"d5892856-6eb4-4188-beb0-368f64169af1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6816","nonce":658561863},{"type":"v1","addr":"172.21.15.204:6818","nonce":658561863}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6819","nonce":658561863},{"type":"v1","addr":"172.21.15.204:6821","nonce":658561863}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6826","nonce":658561863},{"type":"v1","addr":"172.21.15.204:6828","nonce":658561863}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6823","nonce":658561863},{"type":"v1","addr":"172.21.15.204:6825","nonce":658561863}]},"public_addr":"172.21.15.204:6818/658561863","cluster_addr":"172.21.15.204:6821/658561863","heartbeat_back_addr":"172.21.15.204:6828/658561863","heartbeat_front_addr":"172.21.15.204:6825/658561863","state":["exists","up"]},{"osd":5,"uuid":"89d6b48d-aa8a-4cb8-aa2e-e0aae04928b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6817","nonce":3367327749},{"type":"v1","addr":"172.21.15.204:6820","nonce":3367327749}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6822","nonce":3367327749},{"type":"v1","addr":"172.21.15.204:6824","nonce":3367327749}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6830","nonce":3367327749},{"type":"v1","addr":"172.21.15.204:6831","nonce":3367327749}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6827","nonce":3367327749},{"type":"v1","addr":"172.21.15.204:6829","nonce":3367327749}]},"public_addr":"172.21.15.204:6820/3367327749","cluster_addr":"172.21.15.204:6824/3367327749","heartbeat_back_addr":"172.21.15.204:6831/3367327749","heartbeat_front_addr":"172.21.15.204:6829/3367327749","state":["exists","up"]},{"osd":6,"uuid":"ff7d0949-2836-42a6-a63d-bc5a4269e080","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6805","nonce":2586742078},{"type":"v1","addr":"172.21.15.204:6807","nonce":2586742078}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6809","nonce":2586742078},{"type":"v1","addr":"172.21.15.204:6811","nonce":2586742078}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6814","nonce":2586742078},{"type":"v1","addr":"172.21.15.204:6815","nonce":2586742078}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6812","nonce":2586742078},{"type":"v1","addr":"172.21.15.204:6813","nonce":2586742078}]},"public_addr":"172.21.15.204:6807/2586742078","cluster_addr":"172.21.15.204:6811/2586742078","heartbeat_back_addr":"172.21.15.204:6815/2586742078","heartbeat_front_addr":"172.21.15.204:6813/2586742078","state":["exists","up"]},{"osd":7,"uuid":"42bcc14b-70b3-4c59-bf81-41436e4eb272","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6800","nonce":3361860686},{"type":"v1","addr":"172.21.15.204:6801","nonce":3361860686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6802","nonce":3361860686},{"type":"v1","addr":"172.21.15.204:6803","nonce":3361860686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6808","nonce":3361860686},{"type":"v1","addr":"172.21.15.204:6810","nonce":3361860686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6804","nonce":3361860686},{"type":"v1","addr":"172.21.15.204:6806","nonce":3361860686}]},"public_addr":"172.21.15.204:6801/3361860686","cluster_addr":"172.21.15.204:6803/3361860686","heartbeat_back_addr":"172.21.15.204:6810/3361860686","heartbeat_front_addr":"172.21.15.204:6806/3361860686","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-17T23:55:51.372683+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-17T23:55:51.466291+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-17T23:55:51.608084+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-17T23:55:51.680819+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-17T23:55:51.528198+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-17T23:55:51.537065+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-17T23:55:51.558146+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-17T23:55:51.382540+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.17","mappings":[{"from":5,"to":1}]},{"pgid":"3.19","mappings":[{"from":3,"to":2}]},{"pgid":"3.2a","mappings":[{"from":5,"to":2}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-17T23:59:39.469 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:39.467+0000 7f21b4f74640 1 -- 172.21.15.196:0/2171951905 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f2190067660 msgr2=0x7f2190069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:59:39.469 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:39.467+0000 7f21b4f74640 1 --2- 172.21.15.196:0/2171951905 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f2190067660 0x7f2190069b20 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f21a0000f70 tx=0x7f21a0009040 comp rx=0 tx=0).stop 2024-03-17T23:59:39.469 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:39.467+0000 7f21b4f74640 1 -- 172.21.15.196:0/2171951905 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f21b00c8240 msgr2=0x7f21b01f4180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:59:39.469 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:39.467+0000 7f21b4f74640 1 --2- 172.21.15.196:0/2171951905 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f21b00c8240 0x7f21b01f4180 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f21a400c530 tx=0x7f21a400c9f0 comp rx=0 tx=0).stop 2024-03-17T23:59:39.470 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:39.467+0000 7f21b4f74640 1 -- 172.21.15.196:0/2171951905 shutdown_connections 2024-03-17T23:59:39.470 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:39.467+0000 7f21b4f74640 1 --2- 172.21.15.196:0/2171951905 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f2190067660 0x7f2190069b20 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:59:39.470 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:39.467+0000 7f21b4f74640 1 --2- 172.21.15.196:0/2171951905 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f21b00ca230 0x7f21b0152630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:59:39.470 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:39.467+0000 7f21b4f74640 1 --2- 172.21.15.196:0/2171951905 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f21b00c8240 0x7f21b01f4180 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:59:39.470 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:39.467+0000 7f21b4f74640 1 --2- 172.21.15.196:0/2171951905 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f21b00b0150 0x7f21b00c61d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:59:39.470 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:39.467+0000 7f21b4f74640 1 -- 172.21.15.196:0/2171951905 >> 172.21.15.196:0/2171951905 conn(0x7f21b006b2b0 msgr2=0x7f21b00ccea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-17T23:59:39.470 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:39.467+0000 7f21b4f74640 1 -- 172.21.15.196:0/2171951905 shutdown_connections 2024-03-17T23:59:39.470 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:39.467+0000 7f21b4f74640 1 -- 172.21.15.196:0/2171951905 wait complete. 2024-03-17T23:59:39.496 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-17T23:55:56.030640+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-17T23:55:58.658234+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-17T23:56:00.003208+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-17T23:59:39.496 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-17T23:59:39.614 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:39.611+0000 7fdc638fc640 1 Processor -- start 2024-03-17T23:59:39.614 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:39.611+0000 7fdc638fc640 1 -- start start 2024-03-17T23:59:39.616 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:39.611+0000 7fdc638fc640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fdc5c157630 0x7fdc5c0c9ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:59:39.616 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:39.611+0000 7fdc638fc640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fdc5c06c3c0 0x7fdc5c15a050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:59:39.616 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:39.611+0000 7fdc638fc640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdc5c0ca000 con 0x7fdc5c06c7e0 2024-03-17T23:59:39.616 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:39.611+0000 7fdc638fc640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7fdc5c15e500 con 0x7fdc5c06c3c0 2024-03-17T23:59:39.616 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:39.611+0000 7fdc638fc640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7fdc5c15e070 con 0x7fdc5c157630 2024-03-17T23:59:39.616 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:39.611+0000 7fdc60e97640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fdc5c06c3c0 0x7fdc5c15a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:59:39.616 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:39.611+0000 7fdc60e97640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fdc5c06c3c0 0x7fdc5c15a050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.196:44564/0 (socket says 172.21.15.196:44564) 2024-03-17T23:59:39.616 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:39.611+0000 7fdc60e97640 1 -- 172.21.15.196:0/2571688238 learned_addr learned my addr 172.21.15.196:0/2571688238 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-03-17T23:59:39.616 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:39.611+0000 7fdc61698640 1 --2- 172.21.15.196:0/2571688238 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fdc5c157630 0x7fdc5c0c9ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:59:39.616 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:39.611+0000 7fdc60e97640 1 -- 172.21.15.196:0/2571688238 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fdc5c157630 msgr2=0x7fdc5c0c9ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-17T23:59:39.616 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:39.611+0000 7fdc60e97640 1 --2- 172.21.15.196:0/2571688238 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fdc5c157630 0x7fdc5c0c9ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:59:39.616 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:39.611+0000 7fdc60e97640 1 -- 172.21.15.196:0/2571688238 >> v1:172.21.15.204:6789/0 conn(0x7fdc5c06c7e0 legacy=0x7fdc5c06f140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:59:39.617 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:39.611+0000 7fdc60e97640 1 -- 172.21.15.196:0/2571688238 --> v2:172.21.15.196:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc5c06cc70 con 0x7fdc5c06c3c0 2024-03-17T23:59:39.618 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:39.615+0000 7fdc60e97640 1 --2- 172.21.15.196:0/2571688238 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fdc5c06c3c0 0x7fdc5c15a050 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fdc4c009870 tx=0x7fdc4c01ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6545d3e981a16e1f server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:59:39.618 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:39.615+0000 7fdc53fff640 1 -- 172.21.15.196:0/2571688238 <== mon.0 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc4c0b5070 con 0x7fdc5c06c3c0 2024-03-17T23:59:39.619 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:39.615+0000 7fdc53fff640 1 -- 172.21.15.196:0/2571688238 <== mon.0 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc4c0a8a50 con 0x7fdc5c06c3c0 2024-03-17T23:59:39.619 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:39.615+0000 7fdc53fff640 1 -- 172.21.15.196:0/2571688238 <== mon.0 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc4c0a8e20 con 0x7fdc5c06c3c0 2024-03-17T23:59:39.619 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:39.615+0000 7fdc638fc640 1 -- 172.21.15.196:0/2571688238 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fdc5c06c3c0 msgr2=0x7fdc5c15a050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:59:39.619 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:39.615+0000 7fdc638fc640 1 --2- 172.21.15.196:0/2571688238 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fdc5c06c3c0 0x7fdc5c15a050 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fdc4c009870 tx=0x7fdc4c01ed50 comp rx=0 tx=0).stop 2024-03-17T23:59:39.619 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:39.615+0000 7fdc638fc640 1 -- 172.21.15.196:0/2571688238 shutdown_connections 2024-03-17T23:59:39.619 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:39.615+0000 7fdc638fc640 1 --2- 172.21.15.196:0/2571688238 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fdc5c06c3c0 0x7fdc5c15a050 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:59:39.619 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:39.615+0000 7fdc638fc640 1 --2- 172.21.15.196:0/2571688238 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fdc5c157630 0x7fdc5c0c9ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:59:39.619 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:39.615+0000 7fdc638fc640 1 -- 172.21.15.196:0/2571688238 >> 172.21.15.196:0/2571688238 conn(0x7fdc5c0703f0 msgr2=0x7fdc5c06b2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-17T23:59:39.619 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:39.615+0000 7fdc638fc640 1 -- 172.21.15.196:0/2571688238 shutdown_connections 2024-03-17T23:59:39.619 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:39.615+0000 7fdc638fc640 1 -- 172.21.15.196:0/2571688238 wait complete. 2024-03-17T23:59:39.620 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:39.615+0000 7fdc638fc640 1 Processor -- start 2024-03-17T23:59:39.620 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:39.615+0000 7fdc638fc640 1 -- start start 2024-03-17T23:59:39.621 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:39.619+0000 7fdc638fc640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fdc5c157630 0x7fdc5c0ae9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:59:39.622 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:39.619+0000 7fdc638fc640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fdc5c153fe0 0x7fdc5c154440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:59:39.622 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:39.619+0000 7fdc638fc640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fdc5c158f30 0x7fdc5c1593b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:59:39.622 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:39.619+0000 7fdc638fc640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fdc5c15da20 con 0x7fdc5c153fe0 2024-03-17T23:59:39.622 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:39.619+0000 7fdc638fc640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7fdc5c06cf50 con 0x7fdc5c157630 2024-03-17T23:59:39.622 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:39.619+0000 7fdc638fc640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7fdc5c15dd00 con 0x7fdc5c158f30 2024-03-17T23:59:39.622 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:39.619+0000 7fdc60e97640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fdc5c153fe0 0x7fdc5c154440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:59:39.622 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:39.619+0000 7fdc60e97640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fdc5c153fe0 0x7fdc5c154440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.196:44566/0 (socket says 172.21.15.196:44566) 2024-03-17T23:59:39.622 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:39.619+0000 7fdc60e97640 1 -- 172.21.15.196:0/3418586578 learned_addr learned my addr 172.21.15.196:0/3418586578 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-03-17T23:59:39.622 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:39.619+0000 7fdc61698640 1 --2- 172.21.15.196:0/3418586578 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fdc5c157630 0x7fdc5c0ae9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:59:39.622 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:39.619+0000 7fdc61e99640 1 --2- 172.21.15.196:0/3418586578 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fdc5c158f30 0x7fdc5c1593b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:59:39.622 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:39.619+0000 7fdc60e97640 1 -- 172.21.15.196:0/3418586578 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fdc5c158f30 msgr2=0x7fdc5c1593b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:59:39.622 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:39.619+0000 7fdc60e97640 1 --2- 172.21.15.196:0/3418586578 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fdc5c158f30 0x7fdc5c1593b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:59:39.622 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:39.619+0000 7fdc60e97640 1 -- 172.21.15.196:0/3418586578 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fdc5c157630 msgr2=0x7fdc5c0ae9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:59:39.623 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:39.619+0000 7fdc60e97640 1 --2- 172.21.15.196:0/3418586578 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fdc5c157630 0x7fdc5c0ae9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:59:39.623 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:39.619+0000 7fdc60e97640 1 -- 172.21.15.196:0/3418586578 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc5c1f01a0 con 0x7fdc5c153fe0 2024-03-17T23:59:39.623 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:39.619+0000 7fdc61e99640 1 --2- 172.21.15.196:0/3418586578 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fdc5c158f30 0x7fdc5c1593b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-17T23:59:39.623 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:39.619+0000 7fdc60e97640 1 --2- 172.21.15.196:0/3418586578 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fdc5c153fe0 0x7fdc5c154440 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fdc4c01d400 tx=0x7fdc4c01baf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:59:39.623 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:39.619+0000 7fdc51ffb640 1 -- 172.21.15.196:0/3418586578 <== mon.0 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc4c0c0070 con 0x7fdc5c153fe0 2024-03-17T23:59:39.623 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:39.619+0000 7fdc51ffb640 1 -- 172.21.15.196:0/3418586578 <== mon.0 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc4c0ae550 con 0x7fdc5c153fe0 2024-03-17T23:59:39.623 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:39.619+0000 7fdc638fc640 1 -- 172.21.15.196:0/3418586578 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdc5c0ad980 con 0x7fdc5c153fe0 2024-03-17T23:59:39.623 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:39.619+0000 7fdc51ffb640 1 -- 172.21.15.196:0/3418586578 <== mon.0 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc4c0b5070 con 0x7fdc5c153fe0 2024-03-17T23:59:39.624 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:39.619+0000 7fdc638fc640 1 -- 172.21.15.196:0/3418586578 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdc5c0adf00 con 0x7fdc5c153fe0 2024-03-17T23:59:39.624 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:39.619+0000 7fdc638fc640 1 -- 172.21.15.196:0/3418586578 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdc5c0689a0 con 0x7fdc5c153fe0 2024-03-17T23:59:39.624 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:39.619+0000 7fdc51ffb640 1 -- 172.21.15.196:0/3418586578 <== mon.0 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 5) ==== 87083+0+0 (secure 0 0 0) 0x7fdc4c0c3070 con 0x7fdc5c153fe0 2024-03-17T23:59:39.624 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:39.619+0000 7fdc51ffb640 1 --2- 172.21.15.196:0/3418586578 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7fdc40067660 0x7fdc40069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:59:39.624 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:39.619+0000 7fdc51ffb640 1 -- 172.21.15.196:0/3418586578 <== mon.0 v2:172.21.15.196:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7fdc4c123940 con 0x7fdc5c153fe0 2024-03-17T23:59:39.624 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:39.623+0000 7fdc61698640 1 --2- 172.21.15.196:0/3418586578 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7fdc40067660 0x7fdc40069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:59:39.625 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:39.623+0000 7fdc61698640 1 --2- 172.21.15.196:0/3418586578 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7fdc40067660 0x7fdc40069b20 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fdc580079c0 tx=0x7fdc58008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:59:39.632 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:39.627+0000 7fdc51ffb640 1 -- 172.21.15.196:0/3418586578 <== mon.0 v2:172.21.15.196:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177849 (secure 0 0 0) 0x7fdc4c0ca070 con 0x7fdc5c153fe0 2024-03-17T23:59:39.926 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:39.923+0000 7fdc638fc640 1 -- 172.21.15.196:0/3418586578 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fdc5c0b0d10 con 0x7fdc5c153fe0 2024-03-17T23:59:39.926 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:39.923+0000 7fdc51ffb640 1 -- 172.21.15.196:0/3418586578 <== mon.0 v2:172.21.15.196:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) ==== 93+0+10 (secure 0 0 0) 0x7fdc4c0188b0 con 0x7fdc5c153fe0 2024-03-17T23:59:39.927 INFO:teuthology.orchestra.run.smithi196.stdout:pg_num: 1 2024-03-17T23:59:39.929 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:39.927+0000 7fdc638fc640 1 -- 172.21.15.196:0/3418586578 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7fdc40067660 msgr2=0x7fdc40069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:59:39.929 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:39.927+0000 7fdc638fc640 1 --2- 172.21.15.196:0/3418586578 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7fdc40067660 0x7fdc40069b20 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fdc580079c0 tx=0x7fdc58008040 comp rx=0 tx=0).stop 2024-03-17T23:59:39.929 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:39.927+0000 7fdc638fc640 1 -- 172.21.15.196:0/3418586578 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fdc5c153fe0 msgr2=0x7fdc5c154440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:59:39.929 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:39.927+0000 7fdc638fc640 1 --2- 172.21.15.196:0/3418586578 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fdc5c153fe0 0x7fdc5c154440 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fdc4c01d400 tx=0x7fdc4c01baf0 comp rx=0 tx=0).stop 2024-03-17T23:59:39.930 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:39.927+0000 7fdc638fc640 1 -- 172.21.15.196:0/3418586578 shutdown_connections 2024-03-17T23:59:39.930 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:39.927+0000 7fdc638fc640 1 --2- 172.21.15.196:0/3418586578 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7fdc40067660 0x7fdc40069b20 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:59:39.930 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:39.927+0000 7fdc638fc640 1 --2- 172.21.15.196:0/3418586578 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fdc5c158f30 0x7fdc5c1593b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:59:39.930 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:39.927+0000 7fdc638fc640 1 --2- 172.21.15.196:0/3418586578 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fdc5c153fe0 0x7fdc5c154440 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:59:39.930 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:39.927+0000 7fdc638fc640 1 --2- 172.21.15.196:0/3418586578 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fdc5c157630 0x7fdc5c0ae9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:59:39.930 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:39.927+0000 7fdc638fc640 1 -- 172.21.15.196:0/3418586578 >> 172.21.15.196:0/3418586578 conn(0x7fdc5c0703f0 msgr2=0x7fdc5c06b2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-17T23:59:39.930 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:39.927+0000 7fdc638fc640 1 -- 172.21.15.196:0/3418586578 shutdown_connections 2024-03-17T23:59:39.930 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:39.927+0000 7fdc638fc640 1 -- 172.21.15.196:0/3418586578 wait complete. 2024-03-17T23:59:39.948 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-17T23:59:40.060 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:40.055+0000 7fb0832b3640 1 Processor -- start 2024-03-17T23:59:40.060 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:40.055+0000 7fb0832b3640 1 -- start start 2024-03-17T23:59:40.061 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:40.059+0000 7fb0832b3640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb07c0c4730 0x7fb07c06fde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:59:40.061 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:40.059+0000 7fb0832b3640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fb07c0ca1d0 0x7fb07c0cd6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:59:40.061 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:40.059+0000 7fb0832b3640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb07c0c82e0 con 0x7fb07c152000 2024-03-17T23:59:40.061 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:40.059+0000 7fb0832b3640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7fb07c070420 con 0x7fb07c0ca1d0 2024-03-17T23:59:40.061 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:40.059+0000 7fb0832b3640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7fb07c070790 con 0x7fb07c0c4730 2024-03-17T23:59:40.061 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:40.059+0000 7fb081850640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fb07c0ca1d0 0x7fb07c0cd6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:59:40.061 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:40.059+0000 7fb081850640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fb07c0ca1d0 0x7fb07c0cd6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.196:44576/0 (socket says 172.21.15.196:44576) 2024-03-17T23:59:40.061 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:40.059+0000 7fb081850640 1 -- 172.21.15.196:0/1400269720 learned_addr learned my addr 172.21.15.196:0/1400269720 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-03-17T23:59:40.062 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:40.059+0000 7fb08084e640 1 --2- 172.21.15.196:0/1400269720 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb07c0c4730 0x7fb07c06fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:59:40.062 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:40.059+0000 7fb081850640 1 -- 172.21.15.196:0/1400269720 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb07c0c4730 msgr2=0x7fb07c06fde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-17T23:59:40.062 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:40.059+0000 7fb081850640 1 --2- 172.21.15.196:0/1400269720 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb07c0c4730 0x7fb07c06fde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:59:40.062 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:40.059+0000 7fb081850640 1 -- 172.21.15.196:0/1400269720 >> v1:172.21.15.204:6789/0 conn(0x7fb07c152000 legacy=0x7fb07c15ba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:59:40.062 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:40.059+0000 7fb081850640 1 -- 172.21.15.196:0/1400269720 --> v2:172.21.15.196:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb07c0c85c0 con 0x7fb07c0ca1d0 2024-03-17T23:59:40.064 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:40.063+0000 7fb081850640 1 --2- 172.21.15.196:0/1400269720 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb07c0ca1d0 0x7fb07c0cd6b0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fb07c070910 tx=0x7fb07401f200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27632c0222306a47 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:59:40.064 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:40.063+0000 7fb073fff640 1 -- 172.21.15.196:0/1400269720 <== mon.0 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0740b4070 con 0x7fb07c0ca1d0 2024-03-17T23:59:40.065 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:40.063+0000 7fb073fff640 1 -- 172.21.15.196:0/1400269720 <== mon.0 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb0740af400 con 0x7fb07c0ca1d0 2024-03-17T23:59:40.065 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:40.063+0000 7fb073fff640 1 -- 172.21.15.196:0/1400269720 <== mon.0 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0740af7d0 con 0x7fb07c0ca1d0 2024-03-17T23:59:40.065 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:40.063+0000 7fb0832b3640 1 -- 172.21.15.196:0/1400269720 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb07c0ca1d0 msgr2=0x7fb07c0cd6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:59:40.065 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:40.063+0000 7fb0832b3640 1 --2- 172.21.15.196:0/1400269720 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb07c0ca1d0 0x7fb07c0cd6b0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fb07c070910 tx=0x7fb07401f200 comp rx=0 tx=0).stop 2024-03-17T23:59:40.066 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:40.063+0000 7fb0832b3640 1 -- 172.21.15.196:0/1400269720 shutdown_connections 2024-03-17T23:59:40.066 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:40.063+0000 7fb0832b3640 1 --2- 172.21.15.196:0/1400269720 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb07c0ca1d0 0x7fb07c0cd6b0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:59:40.066 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:40.063+0000 7fb0832b3640 1 --2- 172.21.15.196:0/1400269720 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb07c0c4730 0x7fb07c06fde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:59:40.066 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:40.063+0000 7fb0832b3640 1 -- 172.21.15.196:0/1400269720 >> 172.21.15.196:0/1400269720 conn(0x7fb07c06b2b0 msgr2=0x7fb07c06b6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-17T23:59:40.066 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:40.063+0000 7fb0832b3640 1 -- 172.21.15.196:0/1400269720 shutdown_connections 2024-03-17T23:59:40.066 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:40.063+0000 7fb0832b3640 1 -- 172.21.15.196:0/1400269720 wait complete. 2024-03-17T23:59:40.067 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:40.063+0000 7fb0832b3640 1 Processor -- start 2024-03-17T23:59:40.067 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:40.063+0000 7fb0832b3640 1 -- start start 2024-03-17T23:59:40.069 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:40.067+0000 7fb0832b3640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb07c0c4730 0x7fb07c14fd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:59:40.069 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:40.067+0000 7fb0832b3640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb07c0ca1d0 0x7fb07c147fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:59:40.069 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:40.067+0000 7fb0832b3640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb07c152000 0x7fb07c1484f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:59:40.069 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:40.067+0000 7fb0832b3640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fb07c15b560 con 0x7fb07c0ca1d0 2024-03-17T23:59:40.069 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:40.067+0000 7fb0832b3640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7fb07c15b280 con 0x7fb07c0c4730 2024-03-17T23:59:40.070 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:40.067+0000 7fb0832b3640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7fb07c0b29a0 con 0x7fb07c152000 2024-03-17T23:59:40.070 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:40.067+0000 7fb08084e640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb07c0ca1d0 0x7fb07c147fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:59:40.070 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:40.067+0000 7fb08084e640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb07c0ca1d0 0x7fb07c147fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.196:44590/0 (socket says 172.21.15.196:44590) 2024-03-17T23:59:40.070 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:40.067+0000 7fb08084e640 1 -- 172.21.15.196:0/3069480667 learned_addr learned my addr 172.21.15.196:0/3069480667 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-03-17T23:59:40.070 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:40.067+0000 7fb08104f640 1 --2- 172.21.15.196:0/3069480667 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb07c0c4730 0x7fb07c14fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:59:40.070 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:40.067+0000 7fb08084e640 1 -- 172.21.15.196:0/3069480667 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb07c152000 msgr2=0x7fb07c1484f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:59:40.070 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:40.067+0000 7fb08084e640 1 --2- 172.21.15.196:0/3069480667 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb07c152000 0x7fb07c1484f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:59:40.070 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:40.067+0000 7fb08084e640 1 -- 172.21.15.196:0/3069480667 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb07c0c4730 msgr2=0x7fb07c14fd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:59:40.070 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:40.067+0000 7fb08084e640 1 --2- 172.21.15.196:0/3069480667 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb07c0c4730 0x7fb07c14fd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:59:40.070 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:40.067+0000 7fb08084e640 1 -- 172.21.15.196:0/3069480667 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb07c06f900 con 0x7fb07c0ca1d0 2024-03-17T23:59:40.070 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:40.067+0000 7fb08084e640 1 --2- 172.21.15.196:0/3069480667 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb07c0ca1d0 0x7fb07c147fb0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fb06c00d800 tx=0x7fb06c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:59:40.070 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:40.067+0000 7fb071ffb640 1 -- 172.21.15.196:0/3069480667 <== mon.0 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb06c00b6c0 con 0x7fb07c0ca1d0 2024-03-17T23:59:40.071 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:40.067+0000 7fb071ffb640 1 -- 172.21.15.196:0/3069480667 <== mon.0 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb06c019070 con 0x7fb07c0ca1d0 2024-03-17T23:59:40.071 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:40.067+0000 7fb071ffb640 1 -- 172.21.15.196:0/3069480667 <== mon.0 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb06c00baa0 con 0x7fb07c0ca1d0 2024-03-17T23:59:40.071 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:40.067+0000 7fb0832b3640 1 -- 172.21.15.196:0/3069480667 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb07c159d30 con 0x7fb07c0ca1d0 2024-03-17T23:59:40.071 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:40.067+0000 7fb0832b3640 1 -- 172.21.15.196:0/3069480667 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb07c15a280 con 0x7fb07c0ca1d0 2024-03-17T23:59:40.071 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:40.067+0000 7fb0832b3640 1 -- 172.21.15.196:0/3069480667 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb07c0689a0 con 0x7fb07c0ca1d0 2024-03-17T23:59:40.072 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:40.067+0000 7fb071ffb640 1 -- 172.21.15.196:0/3069480667 <== mon.0 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 5) ==== 87083+0+0 (secure 0 0 0) 0x7fb06c00bc40 con 0x7fb07c0ca1d0 2024-03-17T23:59:40.072 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:40.067+0000 7fb071ffb640 1 --2- 172.21.15.196:0/3069480667 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7fb060067690 0x7fb060069b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:59:40.072 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:40.067+0000 7fb071ffb640 1 -- 172.21.15.196:0/3069480667 <== mon.0 v2:172.21.15.196:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7fb06c085d30 con 0x7fb07c0ca1d0 2024-03-17T23:59:40.072 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:40.071+0000 7fb08104f640 1 --2- 172.21.15.196:0/3069480667 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7fb060067690 0x7fb060069b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:59:40.073 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:40.071+0000 7fb08104f640 1 --2- 172.21.15.196:0/3069480667 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7fb060067690 0x7fb060069b50 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fb078001770 tx=0x7fb078009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:59:40.076 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:40.071+0000 7fb071ffb640 1 -- 172.21.15.196:0/3069480667 <== mon.0 v2:172.21.15.196:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177849 (secure 0 0 0) 0x7fb06c0568a0 con 0x7fb07c0ca1d0 2024-03-17T23:59:40.231 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:40.227+0000 7fb0832b3640 1 -- 172.21.15.196:0/3069480667 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fb07c0b2570 con 0x7fb07c0ca1d0 2024-03-17T23:59:40.231 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:40.227+0000 7fb071ffb640 1 -- 172.21.15.196:0/3069480667 <== mon.0 v2:172.21.15.196:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) ==== 104+0+11 (secure 0 0 0) 0x7fb06c0561a0 con 0x7fb07c0ca1d0 2024-03-17T23:59:40.231 INFO:teuthology.orchestra.run.smithi196.stdout:pg_num: 32 2024-03-17T23:59:40.233 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:40.231+0000 7fb0832b3640 1 -- 172.21.15.196:0/3069480667 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7fb060067690 msgr2=0x7fb060069b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:59:40.234 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:40.231+0000 7fb0832b3640 1 --2- 172.21.15.196:0/3069480667 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7fb060067690 0x7fb060069b50 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fb078001770 tx=0x7fb078009040 comp rx=0 tx=0).stop 2024-03-17T23:59:40.234 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:40.231+0000 7fb0832b3640 1 -- 172.21.15.196:0/3069480667 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb07c0ca1d0 msgr2=0x7fb07c147fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:59:40.234 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:40.231+0000 7fb0832b3640 1 --2- 172.21.15.196:0/3069480667 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb07c0ca1d0 0x7fb07c147fb0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fb06c00d800 tx=0x7fb06c00dcc0 comp rx=0 tx=0).stop 2024-03-17T23:59:40.234 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:40.231+0000 7fb0832b3640 1 -- 172.21.15.196:0/3069480667 shutdown_connections 2024-03-17T23:59:40.234 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:40.231+0000 7fb0832b3640 1 --2- 172.21.15.196:0/3069480667 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7fb060067690 0x7fb060069b50 secure :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fb078001770 tx=0x7fb078009040 comp rx=0 tx=0).stop 2024-03-17T23:59:40.234 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:40.231+0000 7fb0832b3640 1 --2- 172.21.15.196:0/3069480667 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb07c152000 0x7fb07c1484f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:59:40.234 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:40.231+0000 7fb0832b3640 1 --2- 172.21.15.196:0/3069480667 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb07c0ca1d0 0x7fb07c147fb0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:59:40.234 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:40.231+0000 7fb0832b3640 1 --2- 172.21.15.196:0/3069480667 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb07c0c4730 0x7fb07c14fd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:59:40.234 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:40.231+0000 7fb0832b3640 1 -- 172.21.15.196:0/3069480667 >> 172.21.15.196:0/3069480667 conn(0x7fb07c06b2b0 msgr2=0x7fb07c0c8b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-17T23:59:40.234 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:40.231+0000 7fb0832b3640 1 -- 172.21.15.196:0/3069480667 shutdown_connections 2024-03-17T23:59:40.234 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:40.231+0000 7fb0832b3640 1 -- 172.21.15.196:0/3069480667 wait complete. 2024-03-17T23:59:40.255 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-17T23:59:40.423 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:40.419+0000 7f5af4356640 1 Processor -- start 2024-03-17T23:59:40.424 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:40.419+0000 7f5af4356640 1 -- start start 2024-03-17T23:59:40.424 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:40.423+0000 7f5af4356640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f5aec0b1c80 0x7f5aec0c7c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:59:40.424 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:40.423+0000 7f5af4356640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5aec071cb0 0x7f5aec0c1b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:59:40.425 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:40.423+0000 7f5af4356640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f5aec0c2040 0x7f5aec072e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:59:40.425 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:40.423+0000 7f5af4356640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7f5aec15f350 con 0x7f5aec0b1c80 2024-03-17T23:59:40.425 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:40.423+0000 7f5af4356640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 -- 0x7f5aec0b2060 con 0x7f5aec0c2040 2024-03-17T23:59:40.425 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:40.423+0000 7f5af4356640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f5aec0c6ca0 con 0x7f5aec071cb0 2024-03-17T23:59:40.425 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:40.423+0000 7f5af18f1640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5aec071cb0 0x7f5aec0c1b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:59:40.425 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:40.423+0000 7f5af18f1640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5aec071cb0 0x7f5aec0c1b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3301/0 says I am v2:172.21.15.196:45570/0 (socket says 172.21.15.196:45570) 2024-03-17T23:59:40.426 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:40.423+0000 7f5af18f1640 1 -- 172.21.15.196:0/3410857772 learned_addr learned my addr 172.21.15.196:0/3410857772 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-03-17T23:59:40.426 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:40.423+0000 7f5af20f2640 1 --2- 172.21.15.196:0/3410857772 >> v2:172.21.15.196:3300/0 conn(0x7f5aec0b1c80 0x7f5aec0c7c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:59:40.426 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:40.423+0000 7f5af28f3640 1 --2- 172.21.15.196:0/3410857772 >> v2:172.21.15.204:3300/0 conn(0x7f5aec0c2040 0x7f5aec072e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:59:40.426 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:40.423+0000 7f5af20f2640 1 -- 172.21.15.196:0/3410857772 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5aec071cb0 msgr2=0x7f5aec0c1b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-17T23:59:40.427 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:40.423+0000 7f5af20f2640 1 --2- 172.21.15.196:0/3410857772 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5aec071cb0 0x7f5aec0c1b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:59:40.427 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:40.423+0000 7f5af20f2640 1 -- 172.21.15.196:0/3410857772 >> v2:172.21.15.204:3300/0 conn(0x7f5aec0c2040 msgr2=0x7f5aec072e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-17T23:59:40.427 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:40.423+0000 7f5af20f2640 1 --2- 172.21.15.196:0/3410857772 >> v2:172.21.15.204:3300/0 conn(0x7f5aec0c2040 0x7f5aec072e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:59:40.427 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:40.423+0000 7f5af20f2640 1 -- 172.21.15.196:0/3410857772 --> v2:172.21.15.196:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5aec15e590 con 0x7f5aec0b1c80 2024-03-17T23:59:40.427 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:40.423+0000 7f5af28f3640 1 --2- 172.21.15.196:0/3410857772 >> v2:172.21.15.204:3300/0 conn(0x7f5aec0c2040 0x7f5aec072e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-17T23:59:40.430 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:40.427+0000 7f5af20f2640 1 --2- 172.21.15.196:0/3410857772 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5aec0b1c80 0x7f5aec0c7c50 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f5aec06d2b0 tx=0x7f5ae801c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3056cb62632d35c server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:59:40.431 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:40.427+0000 7f5af10f0640 1 -- 172.21.15.196:0/3410857772 <== mon.0 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ae80b0070 con 0x7f5aec0b1c80 2024-03-17T23:59:40.431 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:40.427+0000 7f5af10f0640 1 -- 172.21.15.196:0/3410857772 <== mon.0 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ae80ab600 con 0x7f5aec0b1c80 2024-03-17T23:59:40.431 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:40.427+0000 7f5af10f0640 1 -- 172.21.15.196:0/3410857772 <== mon.0 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ae80ab9d0 con 0x7f5aec0b1c80 2024-03-17T23:59:40.432 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:40.427+0000 7f5af4356640 1 -- 172.21.15.196:0/3410857772 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5aec0b1c80 msgr2=0x7f5aec0c7c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:59:40.432 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:40.427+0000 7f5af4356640 1 --2- 172.21.15.196:0/3410857772 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5aec0b1c80 0x7f5aec0c7c50 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f5aec06d2b0 tx=0x7f5ae801c480 comp rx=0 tx=0).stop 2024-03-17T23:59:40.432 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:40.427+0000 7f5af4356640 1 -- 172.21.15.196:0/3410857772 shutdown_connections 2024-03-17T23:59:40.432 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:40.427+0000 7f5af4356640 1 --2- 172.21.15.196:0/3410857772 >> v2:172.21.15.204:3300/0 conn(0x7f5aec0c2040 0x7f5aec072e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:59:40.432 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:40.427+0000 7f5af4356640 1 --2- 172.21.15.196:0/3410857772 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5aec071cb0 0x7f5aec0c1b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:59:40.432 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:40.427+0000 7f5af4356640 1 --2- 172.21.15.196:0/3410857772 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5aec0b1c80 0x7f5aec0c7c50 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:59:40.432 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:40.427+0000 7f5af4356640 1 -- 172.21.15.196:0/3410857772 >> 172.21.15.196:0/3410857772 conn(0x7f5aec06f5e0 msgr2=0x7f5aec06f9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-17T23:59:40.432 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:40.427+0000 7f5af4356640 1 -- 172.21.15.196:0/3410857772 shutdown_connections 2024-03-17T23:59:40.432 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:40.427+0000 7f5af4356640 1 -- 172.21.15.196:0/3410857772 wait complete. 2024-03-17T23:59:40.433 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:40.431+0000 7f5af4356640 1 Processor -- start 2024-03-17T23:59:40.433 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:40.431+0000 7f5af4356640 1 -- start start 2024-03-17T23:59:40.435 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:40.431+0000 7f5af4356640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5aec071cb0 0x7f5aec0c5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:59:40.435 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:40.431+0000 7f5af4356640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5aec0b1c80 0x7f5aec168060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:59:40.436 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:40.431+0000 7f5af18f1640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5aec0b1c80 0x7f5aec168060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:59:40.436 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:40.431+0000 7f5af18f1640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5aec0b1c80 0x7f5aec168060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.196:44600/0 (socket says 172.21.15.196:44600) 2024-03-17T23:59:40.436 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:40.431+0000 7f5af4356640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5aec0c2040 0x7f5aec1685a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:59:40.436 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:40.431+0000 7f5af18f1640 1 -- 172.21.15.196:0/3235564699 learned_addr learned my addr 172.21.15.196:0/3235564699 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-03-17T23:59:40.436 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:40.431+0000 7f5af4356640 1 -- 172.21.15.196:0/3235564699 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f5aec0c68a0 con 0x7f5aec0b1c80 2024-03-17T23:59:40.436 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:40.431+0000 7f5af4356640 1 -- 172.21.15.196:0/3235564699 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f5aec0676d0 con 0x7f5aec071cb0 2024-03-17T23:59:40.436 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:40.431+0000 7f5af4356640 1 -- 172.21.15.196:0/3235564699 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f5aec0c6a20 con 0x7f5aec0c2040 2024-03-17T23:59:40.436 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:40.431+0000 7f5af20f2640 1 --2- 172.21.15.196:0/3235564699 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5aec071cb0 0x7f5aec0c5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:59:40.436 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:40.431+0000 7f5af28f3640 1 --2- 172.21.15.196:0/3235564699 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5aec0c2040 0x7f5aec1685a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:59:40.436 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:40.431+0000 7f5af18f1640 1 -- 172.21.15.196:0/3235564699 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5aec0c2040 msgr2=0x7f5aec1685a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:59:40.436 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:40.431+0000 7f5af18f1640 1 --2- 172.21.15.196:0/3235564699 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5aec0c2040 0x7f5aec1685a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:59:40.436 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:40.431+0000 7f5af18f1640 1 -- 172.21.15.196:0/3235564699 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5aec071cb0 msgr2=0x7f5aec0c5790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:59:40.436 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:40.431+0000 7f5af18f1640 1 --2- 172.21.15.196:0/3235564699 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5aec071cb0 0x7f5aec0c5790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:59:40.436 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:40.431+0000 7f5af18f1640 1 -- 172.21.15.196:0/3235564699 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5aec158e20 con 0x7f5aec0b1c80 2024-03-17T23:59:40.437 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:40.431+0000 7f5af18f1640 1 --2- 172.21.15.196:0/3235564699 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5aec0b1c80 0x7f5aec168060 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f5adc00e870 tx=0x7f5adc00ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:59:40.456 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:40.455+0000 7f5ae2ffd640 1 -- 172.21.15.196:0/3235564699 <== mon.0 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5adc017070 con 0x7f5aec0b1c80 2024-03-17T23:59:40.456 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:40.455+0000 7f5af4356640 1 -- 172.21.15.196:0/3235564699 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5aec159100 con 0x7f5aec0b1c80 2024-03-17T23:59:40.459 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:40.455+0000 7f5af4356640 1 -- 172.21.15.196:0/3235564699 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5aec0c5270 con 0x7f5aec0b1c80 2024-03-17T23:59:40.460 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:40.455+0000 7f5ae2ffd640 1 -- 172.21.15.196:0/3235564699 <== mon.0 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5adc00c940 con 0x7f5aec0b1c80 2024-03-17T23:59:40.460 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:40.455+0000 7f5ae2ffd640 1 -- 172.21.15.196:0/3235564699 <== mon.0 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5adc00ccf0 con 0x7f5aec0b1c80 2024-03-17T23:59:40.460 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:40.455+0000 7f5ae2ffd640 1 -- 172.21.15.196:0/3235564699 <== mon.0 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 5) ==== 87083+0+0 (secure 0 0 0) 0x7f5adc01a070 con 0x7f5aec0b1c80 2024-03-17T23:59:40.460 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:40.459+0000 7f5ae2ffd640 1 --2- 172.21.15.196:0/3235564699 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f5ad0067790 0x7f5ad0069c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:59:40.461 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:40.459+0000 7f5af4356640 1 -- 172.21.15.196:0/3235564699 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5ad40052a0 con 0x7f5aec0b1c80 2024-03-17T23:59:40.461 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:40.459+0000 7f5ae2ffd640 1 -- 172.21.15.196:0/3235564699 <== mon.0 v2:172.21.15.196:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7f5adc084f80 con 0x7f5aec0b1c80 2024-03-17T23:59:40.464 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:40.463+0000 7f5af20f2640 1 --2- 172.21.15.196:0/3235564699 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f5ad0067790 0x7f5ad0069c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:59:40.466 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:40.463+0000 7f5af20f2640 1 --2- 172.21.15.196:0/3235564699 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f5ad0067790 0x7f5ad0069c50 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f5ae80ad000 tx=0x7f5ae80a6000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:59:40.468 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:40.467+0000 7f5ae2ffd640 1 -- 172.21.15.196:0/3235564699 <== mon.0 v2:172.21.15.196:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177849 (secure 0 0 0) 0x7f5adc055570 con 0x7f5aec0b1c80 2024-03-17T23:59:40.660 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:40.659+0000 7f5af4356640 1 -- 172.21.15.196:0/3235564699 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f5ad4005860 con 0x7f5aec0b1c80 2024-03-17T23:59:40.661 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:40.659+0000 7f5ae2ffd640 1 -- 172.21.15.196:0/3235564699 <== mon.0 v2:172.21.15.196:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) ==== 100+0+11 (secure 0 0 0) 0x7f5adc059610 con 0x7f5aec0b1c80 2024-03-17T23:59:40.661 INFO:teuthology.orchestra.run.smithi196.stdout:pg_num: 64 2024-03-17T23:59:40.663 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:40.659+0000 7f5af4356640 1 -- 172.21.15.196:0/3235564699 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f5ad0067790 msgr2=0x7f5ad0069c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:59:40.664 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:40.659+0000 7f5af4356640 1 --2- 172.21.15.196:0/3235564699 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f5ad0067790 0x7f5ad0069c50 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f5ae80ad000 tx=0x7f5ae80a6000 comp rx=0 tx=0).stop 2024-03-17T23:59:40.664 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:40.659+0000 7f5af4356640 1 -- 172.21.15.196:0/3235564699 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5aec0b1c80 msgr2=0x7f5aec168060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:59:40.664 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:40.659+0000 7f5af4356640 1 --2- 172.21.15.196:0/3235564699 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5aec0b1c80 0x7f5aec168060 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f5adc00e870 tx=0x7f5adc00ed30 comp rx=0 tx=0).stop 2024-03-17T23:59:40.664 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:40.659+0000 7f5af4356640 1 -- 172.21.15.196:0/3235564699 shutdown_connections 2024-03-17T23:59:40.664 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:40.659+0000 7f5af4356640 1 --2- 172.21.15.196:0/3235564699 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f5ad0067790 0x7f5ad0069c50 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:59:40.664 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:40.659+0000 7f5af4356640 1 --2- 172.21.15.196:0/3235564699 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5aec0c2040 0x7f5aec1685a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:59:40.664 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:40.659+0000 7f5af4356640 1 --2- 172.21.15.196:0/3235564699 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5aec0b1c80 0x7f5aec168060 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:59:40.664 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:40.659+0000 7f5af4356640 1 --2- 172.21.15.196:0/3235564699 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5aec071cb0 0x7f5aec0c5790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:59:40.664 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:40.659+0000 7f5af4356640 1 -- 172.21.15.196:0/3235564699 >> 172.21.15.196:0/3235564699 conn(0x7f5aec06f5e0 msgr2=0x7f5aec06bbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-17T23:59:40.664 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:40.659+0000 7f5af4356640 1 -- 172.21.15.196:0/3235564699 shutdown_connections 2024-03-17T23:59:40.664 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:40.659+0000 7f5af4356640 1 -- 172.21.15.196:0/3235564699 wait complete. 2024-03-17T23:59:40.680 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-03-17T23:59:40.788 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:40.783+0000 7f256fee4640 1 Processor -- start 2024-03-17T23:59:40.788 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:40.783+0000 7f256fee4640 1 -- start start 2024-03-17T23:59:40.789 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:40.787+0000 7f256fee4640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f2568154340 0x7f25680c8d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:59:40.789 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:40.787+0000 7f256fee4640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f256815d5d0 con 0x7f256815aa70 2024-03-17T23:59:40.789 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:40.787+0000 7f256fee4640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f256815d8b0 con 0x7f2568153f60 2024-03-17T23:59:40.789 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:40.787+0000 7f256fee4640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7f2568072770 con 0x7f2568154340 2024-03-17T23:59:40.789 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:40.787+0000 7f256d47f640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f2568154340 0x7f25680c8d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:59:40.789 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:40.787+0000 7f256e481640 1 --1- >> v1:172.21.15.196:6789/0 conn(0x7f256815aa70 0x7f2568072c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.196:6789/0 says I am v1:172.21.15.196:52918/0 (socket says 172.21.15.196:52918) 2024-03-17T23:59:40.789 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:40.787+0000 7f256e481640 1 -- 172.21.15.196:0/899495424 learned_addr learned my addr 172.21.15.196:0/899495424 (peer_addr_for_me v1:172.21.15.196:0/0) 2024-03-17T23:59:40.790 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:40.787+0000 7f256d47f640 1 -- 172.21.15.196:0/899495424 >> v1:172.21.15.204:6789/0 conn(0x7f2568153f60 legacy=0x7f25680705f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:59:40.790 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:40.787+0000 7f256d47f640 1 -- 172.21.15.196:0/899495424 >> v1:172.21.15.196:6789/0 conn(0x7f256815aa70 legacy=0x7f2568072c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:59:40.790 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:40.787+0000 7f256d47f640 1 -- 172.21.15.196:0/899495424 --> v2:172.21.15.196:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f256815db90 con 0x7f2568154340 2024-03-17T23:59:40.792 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:40.791+0000 7f256d47f640 1 --2- 172.21.15.196:0/899495424 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2568154340 0x7f25680c8d60 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f25580097c0 tx=0x7f255801ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae59b324cc9c77ba server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:59:40.793 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:40.791+0000 7f256cc7e640 1 -- 172.21.15.196:0/899495424 <== mon.0 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25580b5070 con 0x7f2568154340 2024-03-17T23:59:40.793 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:40.791+0000 7f256cc7e640 1 -- 172.21.15.196:0/899495424 <== mon.0 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f25580a8990 con 0x7f2568154340 2024-03-17T23:59:40.793 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:40.791+0000 7f256cc7e640 1 -- 172.21.15.196:0/899495424 <== mon.0 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25580a8d60 con 0x7f2568154340 2024-03-17T23:59:40.794 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:40.791+0000 7f256fee4640 1 -- 172.21.15.196:0/899495424 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2568154340 msgr2=0x7f25680c8d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:59:40.794 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:40.791+0000 7f256fee4640 1 --2- 172.21.15.196:0/899495424 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2568154340 0x7f25680c8d60 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f25580097c0 tx=0x7f255801ec90 comp rx=0 tx=0).stop 2024-03-17T23:59:40.794 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:40.791+0000 7f256fee4640 1 -- 172.21.15.196:0/899495424 shutdown_connections 2024-03-17T23:59:40.794 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:40.791+0000 7f256fee4640 1 --2- 172.21.15.196:0/899495424 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2568154340 0x7f25680c8d60 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:59:40.794 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:40.791+0000 7f256fee4640 1 -- 172.21.15.196:0/899495424 >> 172.21.15.196:0/899495424 conn(0x7f256806c3c0 msgr2=0x7f256806c7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-17T23:59:40.794 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:40.791+0000 7f256fee4640 1 -- 172.21.15.196:0/899495424 shutdown_connections 2024-03-17T23:59:40.794 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:40.791+0000 7f256fee4640 1 -- 172.21.15.196:0/899495424 wait complete. 2024-03-17T23:59:40.795 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:40.791+0000 7f256fee4640 1 Processor -- start 2024-03-17T23:59:40.795 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:40.791+0000 7f256fee4640 1 -- start start 2024-03-17T23:59:40.796 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:40.791+0000 7f256fee4640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2568153f60 0x7f25680ccd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:59:40.796 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:40.791+0000 7f256fee4640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2568154340 0x7f25680cad10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:59:40.797 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:40.791+0000 7f256fee4640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f256815aa70 0x7f256814b580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:59:40.797 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:40.791+0000 7f256fee4640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f256815e150 con 0x7f2568154340 2024-03-17T23:59:40.797 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:40.791+0000 7f256fee4640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f256815d380 con 0x7f256815aa70 2024-03-17T23:59:40.797 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:40.791+0000 7f256fee4640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f2568070d00 con 0x7f2568153f60 2024-03-17T23:59:40.797 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:40.791+0000 7f256d47f640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2568154340 0x7f25680cad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:59:40.797 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:40.791+0000 7f256d47f640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2568154340 0x7f25680cad10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.196:44620/0 (socket says 172.21.15.196:44620) 2024-03-17T23:59:40.797 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:40.791+0000 7f256d47f640 1 -- 172.21.15.196:0/4051123566 learned_addr learned my addr 172.21.15.196:0/4051123566 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-03-17T23:59:40.797 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:40.791+0000 7f256dc80640 1 --2- 172.21.15.196:0/4051123566 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2568153f60 0x7f25680ccd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:59:40.797 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:40.791+0000 7f256e481640 1 --2- 172.21.15.196:0/4051123566 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f256815aa70 0x7f256814b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:59:40.797 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:40.791+0000 7f256d47f640 1 -- 172.21.15.196:0/4051123566 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2568153f60 msgr2=0x7f25680ccd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:59:40.797 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:40.791+0000 7f256d47f640 1 --2- 172.21.15.196:0/4051123566 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2568153f60 0x7f25680ccd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:59:40.797 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:40.791+0000 7f256d47f640 1 -- 172.21.15.196:0/4051123566 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f256815aa70 msgr2=0x7f256814b580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:59:40.797 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:40.791+0000 7f256d47f640 1 --2- 172.21.15.196:0/4051123566 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f256815aa70 0x7f256814b580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:59:40.797 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:40.791+0000 7f256d47f640 1 -- 172.21.15.196:0/4051123566 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2568158480 con 0x7f2568154340 2024-03-17T23:59:40.798 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:40.791+0000 7f256dc80640 1 --2- 172.21.15.196:0/4051123566 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2568153f60 0x7f25680ccd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-17T23:59:40.798 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:40.791+0000 7f256d47f640 1 --2- 172.21.15.196:0/4051123566 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2568154340 0x7f25680cad10 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f25580b3040 tx=0x7f255801ba30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:59:40.798 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:40.795+0000 7f255e7fc640 1 -- 172.21.15.196:0/4051123566 <== mon.0 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25580bf070 con 0x7f2568154340 2024-03-17T23:59:40.798 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:40.795+0000 7f255e7fc640 1 -- 172.21.15.196:0/4051123566 <== mon.0 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f25580b0900 con 0x7f2568154340 2024-03-17T23:59:40.798 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:40.795+0000 7f256fee4640 1 -- 172.21.15.196:0/4051123566 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f256815b590 con 0x7f2568154340 2024-03-17T23:59:40.798 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:40.795+0000 7f255e7fc640 1 -- 172.21.15.196:0/4051123566 <== mon.0 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25580b5040 con 0x7f2568154340 2024-03-17T23:59:40.798 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:40.795+0000 7f256fee4640 1 -- 172.21.15.196:0/4051123566 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25681efd30 con 0x7f2568154340 2024-03-17T23:59:40.799 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:40.795+0000 7f254bfff640 1 -- 172.21.15.196:0/4051123566 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f25440052a0 con 0x7f2568154340 2024-03-17T23:59:40.799 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:40.795+0000 7f255e7fc640 1 -- 172.21.15.196:0/4051123566 <== mon.0 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 5) ==== 87083+0+0 (secure 0 0 0) 0x7f25580c2070 con 0x7f2568154340 2024-03-17T23:59:40.799 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:40.795+0000 7f255e7fc640 1 --2- 172.21.15.196:0/4051123566 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f254c067660 0x7f254c069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:59:40.799 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:40.795+0000 7f255e7fc640 1 -- 172.21.15.196:0/4051123566 <== mon.0 v2:172.21.15.196:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7f2558122260 con 0x7f2568154340 2024-03-17T23:59:40.799 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:40.795+0000 7f256dc80640 1 --2- 172.21.15.196:0/4051123566 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f254c067660 0x7f254c069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:59:40.799 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:40.795+0000 7f256dc80640 1 --2- 172.21.15.196:0/4051123566 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f254c067660 0x7f254c069b20 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f2564001710 tx=0x7f2564009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:59:40.802 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:40.799+0000 7f255e7fc640 1 -- 172.21.15.196:0/4051123566 <== mon.0 v2:172.21.15.196:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177849 (secure 0 0 0) 0x7f25580187f0 con 0x7f2568154340 2024-03-17T23:59:40.985 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:40.983+0000 7f254bfff640 1 -- 172.21.15.196:0/4051123566 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f2544005860 con 0x7f2568154340 2024-03-17T23:59:40.986 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:40.983+0000 7f255e7fc640 1 -- 172.21.15.196:0/4051123566 <== mon.0 v2:172.21.15.196:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v23) ==== 80+0+0 (secure 0 0 0) 0x7f25580f2dd0 con 0x7f2568154340 2024-03-17T23:59:40.986 INFO:teuthology.orchestra.run.smithi196.stderr:listed 0 entries 2024-03-17T23:59:40.988 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:40.983+0000 7f254bfff640 1 -- 172.21.15.196:0/4051123566 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f254c067660 msgr2=0x7f254c069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:59:40.988 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:40.983+0000 7f254bfff640 1 --2- 172.21.15.196:0/4051123566 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f254c067660 0x7f254c069b20 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f2564001710 tx=0x7f2564009040 comp rx=0 tx=0).stop 2024-03-17T23:59:40.988 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:40.983+0000 7f254bfff640 1 -- 172.21.15.196:0/4051123566 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2568154340 msgr2=0x7f25680cad10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:59:40.988 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:40.983+0000 7f254bfff640 1 --2- 172.21.15.196:0/4051123566 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2568154340 0x7f25680cad10 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f25580b3040 tx=0x7f255801ba30 comp rx=0 tx=0).stop 2024-03-17T23:59:40.988 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:40.983+0000 7f254bfff640 1 -- 172.21.15.196:0/4051123566 shutdown_connections 2024-03-17T23:59:40.988 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:40.983+0000 7f254bfff640 1 --2- 172.21.15.196:0/4051123566 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f254c067660 0x7f254c069b20 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:59:40.988 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:40.983+0000 7f254bfff640 1 --2- 172.21.15.196:0/4051123566 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f256815aa70 0x7f256814b580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:59:40.988 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:40.983+0000 7f254bfff640 1 --2- 172.21.15.196:0/4051123566 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2568154340 0x7f25680cad10 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:59:40.988 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:40.983+0000 7f254bfff640 1 --2- 172.21.15.196:0/4051123566 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2568153f60 0x7f25680ccd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:59:40.988 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:40.983+0000 7f254bfff640 1 -- 172.21.15.196:0/4051123566 >> 172.21.15.196:0/4051123566 conn(0x7f256806c3c0 msgr2=0x7f25680c8200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-17T23:59:40.988 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:40.983+0000 7f254bfff640 1 -- 172.21.15.196:0/4051123566 shutdown_connections 2024-03-17T23:59:40.989 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:40.983+0000 7f254bfff640 1 -- 172.21.15.196:0/4051123566 wait complete. 2024-03-17T23:59:41.007 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2024-03-17T23:59:41.007 DEBUG:teuthology.orchestra.run.smithi196:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-17T23:59:41.012 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-17T23:59:41.194 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:41.191+0000 7fae899b6640 1 Processor -- start 2024-03-17T23:59:41.194 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:41.191+0000 7fae899b6640 1 -- start start 2024-03-17T23:59:41.196 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:41.191+0000 7fae899b6640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fae84150f60 0x7fae8415a0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:59:41.196 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:41.191+0000 7fae899b6640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fae840b1d30 0x7fae840c1130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:59:41.196 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:41.191+0000 7fae899b6640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fae8406d030 con 0x7fae840735a0 2024-03-17T23:59:41.196 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:41.191+0000 7fae899b6640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7fae84151340 con 0x7fae84150f60 2024-03-17T23:59:41.196 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:41.191+0000 7fae899b6640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 -- 0x7fae840c8250 con 0x7fae840b1d30 2024-03-17T23:59:41.196 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:41.191+0000 7fae82ffd640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fae84150f60 0x7fae8415a0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:59:41.196 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:41.191+0000 7fae82ffd640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fae84150f60 0x7fae8415a0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.196:44630/0 (socket says 172.21.15.196:44630) 2024-03-17T23:59:41.196 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:41.191+0000 7fae82ffd640 1 -- 172.21.15.196:0/4238200741 learned_addr learned my addr 172.21.15.196:0/4238200741 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-03-17T23:59:41.196 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:41.191+0000 7fae837fe640 1 --2- 172.21.15.196:0/4238200741 >> v2:172.21.15.204:3300/0 conn(0x7fae840b1d30 0x7fae840c1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:59:41.196 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:41.191+0000 7fae82ffd640 1 -- 172.21.15.196:0/4238200741 >> v2:172.21.15.204:3300/0 conn(0x7fae840b1d30 msgr2=0x7fae840c1130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-17T23:59:41.196 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:41.191+0000 7fae82ffd640 1 --2- 172.21.15.196:0/4238200741 >> v2:172.21.15.204:3300/0 conn(0x7fae840b1d30 0x7fae840c1130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:59:41.196 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:41.191+0000 7fae82ffd640 1 -- 172.21.15.196:0/4238200741 >> v1:172.21.15.204:6789/0 conn(0x7fae840735a0 legacy=0x7fae8406e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:59:41.196 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:41.191+0000 7fae82ffd640 1 -- 172.21.15.196:0/4238200741 --> v2:172.21.15.196:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae840c2ba0 con 0x7fae84150f60 2024-03-17T23:59:41.198 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:41.195+0000 7fae82ffd640 1 --2- 172.21.15.196:0/4238200741 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fae84150f60 0x7fae8415a0f0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fae8406f500 tx=0x7fae7401e830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a245fb20b7e18b2 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:59:41.198 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:41.195+0000 7fae81ffb640 1 -- 172.21.15.196:0/4238200741 <== mon.0 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae740b4070 con 0x7fae84150f60 2024-03-17T23:59:41.198 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:41.195+0000 7fae81ffb640 1 -- 172.21.15.196:0/4238200741 <== mon.0 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fae740a75f0 con 0x7fae84150f60 2024-03-17T23:59:41.198 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:41.195+0000 7fae81ffb640 1 -- 172.21.15.196:0/4238200741 <== mon.0 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae740a79c0 con 0x7fae84150f60 2024-03-17T23:59:41.199 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:41.195+0000 7fae899b6640 1 -- 172.21.15.196:0/4238200741 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fae84150f60 msgr2=0x7fae8415a0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:59:41.199 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:41.195+0000 7fae899b6640 1 --2- 172.21.15.196:0/4238200741 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fae84150f60 0x7fae8415a0f0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fae8406f500 tx=0x7fae7401e830 comp rx=0 tx=0).stop 2024-03-17T23:59:41.199 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:41.195+0000 7fae899b6640 1 -- 172.21.15.196:0/4238200741 shutdown_connections 2024-03-17T23:59:41.199 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:41.195+0000 7fae899b6640 1 --2- 172.21.15.196:0/4238200741 >> v2:172.21.15.204:3300/0 conn(0x7fae840b1d30 0x7fae840c1130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:59:41.199 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:41.195+0000 7fae899b6640 1 --2- 172.21.15.196:0/4238200741 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fae84150f60 0x7fae8415a0f0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:59:41.199 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:41.195+0000 7fae899b6640 1 -- 172.21.15.196:0/4238200741 >> 172.21.15.196:0/4238200741 conn(0x7fae8406b2b0 msgr2=0x7fae8406b6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-17T23:59:41.199 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:41.195+0000 7fae899b6640 1 -- 172.21.15.196:0/4238200741 shutdown_connections 2024-03-17T23:59:41.200 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:41.195+0000 7fae899b6640 1 -- 172.21.15.196:0/4238200741 wait complete. 2024-03-17T23:59:41.201 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:41.199+0000 7fae899b6640 1 Processor -- start 2024-03-17T23:59:41.201 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:41.199+0000 7fae899b6640 1 -- start start 2024-03-17T23:59:41.203 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:41.199+0000 7fae899b6640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fae840735a0 0x7fae841528f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:59:41.203 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:41.199+0000 7fae899b6640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fae840b1d30 0x7fae841f2840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:59:41.203 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:41.199+0000 7fae899b6640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fae84150f60 0x7fae84146c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:59:41.203 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:41.199+0000 7fae899b6640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fae8406ea40 con 0x7fae840735a0 2024-03-17T23:59:41.204 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:41.199+0000 7fae899b6640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7fae8406c7e0 con 0x7fae840b1d30 2024-03-17T23:59:41.204 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:41.199+0000 7fae899b6640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7fae8406ebc0 con 0x7fae84150f60 2024-03-17T23:59:41.204 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:41.199+0000 7fae82ffd640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fae840735a0 0x7fae841528f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:59:41.204 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:41.199+0000 7fae82ffd640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fae840735a0 0x7fae841528f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.196:44642/0 (socket says 172.21.15.196:44642) 2024-03-17T23:59:41.204 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:41.199+0000 7fae82ffd640 1 -- 172.21.15.196:0/255282187 learned_addr learned my addr 172.21.15.196:0/255282187 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-03-17T23:59:41.204 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:41.199+0000 7fae827fc640 1 --2- 172.21.15.196:0/255282187 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fae840b1d30 0x7fae841f2840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:59:41.204 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:41.199+0000 7fae837fe640 1 --2- 172.21.15.196:0/255282187 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fae84150f60 0x7fae84146c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:59:41.204 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:41.199+0000 7fae82ffd640 1 -- 172.21.15.196:0/255282187 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fae84150f60 msgr2=0x7fae84146c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:59:41.204 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:41.199+0000 7fae82ffd640 1 --2- 172.21.15.196:0/255282187 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fae84150f60 0x7fae84146c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:59:41.204 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:41.199+0000 7fae82ffd640 1 -- 172.21.15.196:0/255282187 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fae840b1d30 msgr2=0x7fae841f2840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:59:41.204 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:41.199+0000 7fae82ffd640 1 --2- 172.21.15.196:0/255282187 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fae840b1d30 0x7fae841f2840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:59:41.204 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:41.199+0000 7fae82ffd640 1 -- 172.21.15.196:0/255282187 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae84151e70 con 0x7fae840735a0 2024-03-17T23:59:41.204 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:41.199+0000 7fae82ffd640 1 --2- 172.21.15.196:0/255282187 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fae840735a0 0x7fae841528f0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fae7401b440 tx=0x7fae7401b5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:59:41.205 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:41.199+0000 7fae6bfff640 1 -- 172.21.15.196:0/255282187 <== mon.0 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae740b4070 con 0x7fae840735a0 2024-03-17T23:59:41.205 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:41.199+0000 7fae6bfff640 1 -- 172.21.15.196:0/255282187 <== mon.0 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fae740af9d0 con 0x7fae840735a0 2024-03-17T23:59:41.205 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:41.199+0000 7fae899b6640 1 -- 172.21.15.196:0/255282187 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fae84152150 con 0x7fae840735a0 2024-03-17T23:59:41.205 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:41.199+0000 7fae6bfff640 1 -- 172.21.15.196:0/255282187 <== mon.0 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae740afdc0 con 0x7fae840735a0 2024-03-17T23:59:41.205 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:41.199+0000 7fae899b6640 1 -- 172.21.15.196:0/255282187 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fae841f2040 con 0x7fae840735a0 2024-03-17T23:59:41.206 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:41.199+0000 7fae69ffb640 1 -- 172.21.15.196:0/255282187 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fae5c0052a0 con 0x7fae840735a0 2024-03-17T23:59:41.206 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:41.203+0000 7fae6bfff640 1 -- 172.21.15.196:0/255282187 <== mon.0 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 5) ==== 87083+0+0 (secure 0 0 0) 0x7fae740c1060 con 0x7fae840735a0 2024-03-17T23:59:41.206 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:41.203+0000 7fae6bfff640 1 --2- 172.21.15.196:0/255282187 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7fae70067690 0x7fae70069b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:59:41.206 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:41.203+0000 7fae6bfff640 1 -- 172.21.15.196:0/255282187 <== mon.0 v2:172.21.15.196:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7fae74121d00 con 0x7fae840735a0 2024-03-17T23:59:41.206 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:41.203+0000 7fae827fc640 1 --2- 172.21.15.196:0/255282187 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7fae70067690 0x7fae70069b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:59:41.206 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:41.203+0000 7fae827fc640 1 --2- 172.21.15.196:0/255282187 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7fae70067690 0x7fae70069b50 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fae841546a0 tx=0x7fae78009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:59:41.209 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:41.207+0000 7fae6bfff640 1 -- 172.21.15.196:0/255282187 <== mon.0 v2:172.21.15.196:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177849 (secure 0 0 0) 0x7fae74018540 con 0x7fae840735a0 2024-03-17T23:59:41.442 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:41.439+0000 7fae69ffb640 1 -- 172.21.15.196:0/255282187 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fae5c005860 con 0x7fae840735a0 2024-03-17T23:59:41.443 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:41.439+0000 7fae6bfff640 1 -- 172.21.15.196:0/255282187 <== mon.0 v2:172.21.15.196:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) ==== 74+0+16891 (secure 0 0 0) 0x7fae740c02c0 con 0x7fae840735a0 2024-03-17T23:59:41.443 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-03-17T23:59:41.443 INFO:teuthology.orchestra.run.smithi196.stdout:{"epoch":23,"fsid":"b80f9c80-17ad-4126-8957-4c0c46f5b803","created":"2024-03-17T23:55:43.368838+0000","modified":"2024-03-17T23:56:49.062022+0000","last_up_change":"2024-03-17T23:55:54.132187+0000","last_in_change":"2024-03-17T23:55:46.016435+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-17T23:55:56.030640+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-17T23:55:58.658234+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-17T23:56:00.003208+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"224d699f-bc10-4661-a8b5-6ca73290ffa0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6806","nonce":1194547591},{"type":"v1","addr":"172.21.15.196:6807","nonce":1194547591}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6809","nonce":1194547591},{"type":"v1","addr":"172.21.15.196:6811","nonce":1194547591}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6814","nonce":1194547591},{"type":"v1","addr":"172.21.15.196:6815","nonce":1194547591}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6812","nonce":1194547591},{"type":"v1","addr":"172.21.15.196:6813","nonce":1194547591}]},"public_addr":"172.21.15.196:6807/1194547591","cluster_addr":"172.21.15.196:6811/1194547591","heartbeat_back_addr":"172.21.15.196:6815/1194547591","heartbeat_front_addr":"172.21.15.196:6813/1194547591","state":["exists","up"]},{"osd":1,"uuid":"d8d6a0b0-450b-4ab5-b143-d4f36286e81e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6800","nonce":1901246986},{"type":"v1","addr":"172.21.15.196:6801","nonce":1901246986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6802","nonce":1901246986},{"type":"v1","addr":"172.21.15.196:6803","nonce":1901246986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6808","nonce":1901246986},{"type":"v1","addr":"172.21.15.196:6810","nonce":1901246986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6804","nonce":1901246986},{"type":"v1","addr":"172.21.15.196:6805","nonce":1901246986}]},"public_addr":"172.21.15.196:6801/1901246986","cluster_addr":"172.21.15.196:6803/1901246986","heartbeat_back_addr":"172.21.15.196:6810/1901246986","heartbeat_front_addr":"172.21.15.196:6805/1901246986","state":["exists","up"]},{"osd":2,"uuid":"d732ba94-1db0-41ed-930a-5abb6188980a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6824","nonce":673819559},{"type":"v1","addr":"172.21.15.196:6825","nonce":673819559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6826","nonce":673819559},{"type":"v1","addr":"172.21.15.196:6827","nonce":673819559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6830","nonce":673819559},{"type":"v1","addr":"172.21.15.196:6831","nonce":673819559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6828","nonce":673819559},{"type":"v1","addr":"172.21.15.196:6829","nonce":673819559}]},"public_addr":"172.21.15.196:6825/673819559","cluster_addr":"172.21.15.196:6827/673819559","heartbeat_back_addr":"172.21.15.196:6831/673819559","heartbeat_front_addr":"172.21.15.196:6829/673819559","state":["exists","up"]},{"osd":3,"uuid":"b79cab98-a49f-4544-b6b0-546dcfbd47a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6816","nonce":1104340623},{"type":"v1","addr":"172.21.15.196:6817","nonce":1104340623}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6818","nonce":1104340623},{"type":"v1","addr":"172.21.15.196:6819","nonce":1104340623}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6822","nonce":1104340623},{"type":"v1","addr":"172.21.15.196:6823","nonce":1104340623}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6820","nonce":1104340623},{"type":"v1","addr":"172.21.15.196:6821","nonce":1104340623}]},"public_addr":"172.21.15.196:6817/1104340623","cluster_addr":"172.21.15.196:6819/1104340623","heartbeat_back_addr":"172.21.15.196:6823/1104340623","heartbeat_front_addr":"172.21.15.196:6821/1104340623","state":["exists","up"]},{"osd":4,"uuid":"d5892856-6eb4-4188-beb0-368f64169af1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6816","nonce":658561863},{"type":"v1","addr":"172.21.15.204:6818","nonce":658561863}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6819","nonce":658561863},{"type":"v1","addr":"172.21.15.204:6821","nonce":658561863}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6826","nonce":658561863},{"type":"v1","addr":"172.21.15.204:6828","nonce":658561863}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6823","nonce":658561863},{"type":"v1","addr":"172.21.15.204:6825","nonce":658561863}]},"public_addr":"172.21.15.204:6818/658561863","cluster_addr":"172.21.15.204:6821/658561863","heartbeat_back_addr":"172.21.15.204:6828/658561863","heartbeat_front_addr":"172.21.15.204:6825/658561863","state":["exists","up"]},{"osd":5,"uuid":"89d6b48d-aa8a-4cb8-aa2e-e0aae04928b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6817","nonce":3367327749},{"type":"v1","addr":"172.21.15.204:6820","nonce":3367327749}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6822","nonce":3367327749},{"type":"v1","addr":"172.21.15.204:6824","nonce":3367327749}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6830","nonce":3367327749},{"type":"v1","addr":"172.21.15.204:6831","nonce":3367327749}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6827","nonce":3367327749},{"type":"v1","addr":"172.21.15.204:6829","nonce":3367327749}]},"public_addr":"172.21.15.204:6820/3367327749","cluster_addr":"172.21.15.204:6824/3367327749","heartbeat_back_addr":"172.21.15.204:6831/3367327749","heartbeat_front_addr":"172.21.15.204:6829/3367327749","state":["exists","up"]},{"osd":6,"uuid":"ff7d0949-2836-42a6-a63d-bc5a4269e080","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6805","nonce":2586742078},{"type":"v1","addr":"172.21.15.204:6807","nonce":2586742078}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6809","nonce":2586742078},{"type":"v1","addr":"172.21.15.204:6811","nonce":2586742078}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6814","nonce":2586742078},{"type":"v1","addr":"172.21.15.204:6815","nonce":2586742078}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6812","nonce":2586742078},{"type":"v1","addr":"172.21.15.204:6813","nonce":2586742078}]},"public_addr":"172.21.15.204:6807/2586742078","cluster_addr":"172.21.15.204:6811/2586742078","heartbeat_back_addr":"172.21.15.204:6815/2586742078","heartbeat_front_addr":"172.21.15.204:6813/2586742078","state":["exists","up"]},{"osd":7,"uuid":"42bcc14b-70b3-4c59-bf81-41436e4eb272","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6800","nonce":3361860686},{"type":"v1","addr":"172.21.15.204:6801","nonce":3361860686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6802","nonce":3361860686},{"type":"v1","addr":"172.21.15.204:6803","nonce":3361860686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6808","nonce":3361860686},{"type":"v1","addr":"172.21.15.204:6810","nonce":3361860686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6804","nonce":3361860686},{"type":"v1","addr":"172.21.15.204:6806","nonce":3361860686}]},"public_addr":"172.21.15.204:6801/3361860686","cluster_addr":"172.21.15.204:6803/3361860686","heartbeat_back_addr":"172.21.15.204:6810/3361860686","heartbeat_front_addr":"172.21.15.204:6806/3361860686","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-17T23:55:51.372683+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-17T23:55:51.466291+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-17T23:55:51.608084+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-17T23:55:51.680819+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-17T23:55:51.528198+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-17T23:55:51.537065+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-17T23:55:51.558146+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-17T23:55:51.382540+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.17","mappings":[{"from":5,"to":1}]},{"pgid":"3.19","mappings":[{"from":3,"to":2}]},{"pgid":"3.2a","mappings":[{"from":5,"to":2}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-17T23:59:41.446 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:41.443+0000 7fae69ffb640 1 -- 172.21.15.196:0/255282187 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7fae70067690 msgr2=0x7fae70069b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:59:41.446 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:41.443+0000 7fae69ffb640 1 --2- 172.21.15.196:0/255282187 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7fae70067690 0x7fae70069b50 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fae841546a0 tx=0x7fae78009040 comp rx=0 tx=0).stop 2024-03-17T23:59:41.446 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:41.443+0000 7fae69ffb640 1 -- 172.21.15.196:0/255282187 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fae840735a0 msgr2=0x7fae841528f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:59:41.446 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:41.443+0000 7fae69ffb640 1 --2- 172.21.15.196:0/255282187 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fae840735a0 0x7fae841528f0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fae7401b440 tx=0x7fae7401b5d0 comp rx=0 tx=0).stop 2024-03-17T23:59:41.446 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:41.443+0000 7fae69ffb640 1 -- 172.21.15.196:0/255282187 shutdown_connections 2024-03-17T23:59:41.446 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:41.443+0000 7fae69ffb640 1 --2- 172.21.15.196:0/255282187 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7fae70067690 0x7fae70069b50 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:59:41.447 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:41.443+0000 7fae69ffb640 1 --2- 172.21.15.196:0/255282187 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fae84150f60 0x7fae84146c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:59:41.447 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:41.443+0000 7fae69ffb640 1 --2- 172.21.15.196:0/255282187 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fae840b1d30 0x7fae841f2840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:59:41.447 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:41.443+0000 7fae69ffb640 1 --2- 172.21.15.196:0/255282187 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fae840735a0 0x7fae841528f0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:59:41.447 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:41.443+0000 7fae69ffb640 1 -- 172.21.15.196:0/255282187 >> 172.21.15.196:0/255282187 conn(0x7fae8406b2b0 msgr2=0x7fae8414fc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-17T23:59:41.447 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:41.443+0000 7fae69ffb640 1 -- 172.21.15.196:0/255282187 shutdown_connections 2024-03-17T23:59:41.447 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:41.443+0000 7fae69ffb640 1 -- 172.21.15.196:0/255282187 wait complete. 2024-03-17T23:59:41.468 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-17T23:55:56.030640+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-17T23:55:58.658234+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-17T23:56:00.003208+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-17T23:59:41.468 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-17T23:59:41.577 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:41.575+0000 7fed67bb2640 1 Processor -- start 2024-03-17T23:59:41.578 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:41.575+0000 7fed67bb2640 1 -- start start 2024-03-17T23:59:41.579 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:41.575+0000 7fed67bb2640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fed600c4730 0x7fed6006fde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:59:41.579 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:41.575+0000 7fed67bb2640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fed600ca1d0 0x7fed600cd6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:59:41.579 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:41.575+0000 7fed67bb2640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fed600c82e0 con 0x7fed60152000 2024-03-17T23:59:41.579 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:41.575+0000 7fed67bb2640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7fed60070420 con 0x7fed600c4730 2024-03-17T23:59:41.579 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:41.575+0000 7fed67bb2640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 -- 0x7fed60070790 con 0x7fed600ca1d0 2024-03-17T23:59:41.579 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:41.575+0000 7fed6514d640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fed600c4730 0x7fed6006fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:59:41.579 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:41.575+0000 7fed6514d640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fed600c4730 0x7fed6006fde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.196:44652/0 (socket says 172.21.15.196:44652) 2024-03-17T23:59:41.579 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:41.575+0000 7fed6594e640 1 --1- >> v1:172.21.15.196:6789/0 conn(0x7fed60152000 0x7fed6015ba80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.196:6789/0 says I am v1:172.21.15.196:52926/0 (socket says 172.21.15.196:52926) 2024-03-17T23:59:41.580 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:41.575+0000 7fed6514d640 1 -- 172.21.15.196:0/3570568788 learned_addr learned my addr 172.21.15.196:0/3570568788 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-03-17T23:59:41.580 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:41.575+0000 7fed6614f640 1 --2- 172.21.15.196:0/3570568788 >> v2:172.21.15.204:3300/0 conn(0x7fed600ca1d0 0x7fed600cd6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:59:41.580 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:41.575+0000 7fed6514d640 1 -- 172.21.15.196:0/3570568788 >> v2:172.21.15.204:3300/0 conn(0x7fed600ca1d0 msgr2=0x7fed600cd6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-17T23:59:41.580 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:41.575+0000 7fed6514d640 1 --2- 172.21.15.196:0/3570568788 >> v2:172.21.15.204:3300/0 conn(0x7fed600ca1d0 0x7fed600cd6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:59:41.580 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:41.575+0000 7fed6514d640 1 -- 172.21.15.196:0/3570568788 >> v1:172.21.15.196:6789/0 conn(0x7fed60152000 legacy=0x7fed6015ba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:59:41.580 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:41.575+0000 7fed6494c640 1 -- 172.21.15.196:0/3570568788 <== mon.0 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3371414858 0 0) 0x7fed600c82e0 con 0x7fed60152000 2024-03-17T23:59:41.580 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:41.575+0000 7fed6514d640 1 -- 172.21.15.196:0/3570568788 --> v2:172.21.15.196:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed600c85c0 con 0x7fed600c4730 2024-03-17T23:59:41.581 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:41.579+0000 7fed6514d640 1 --2- 172.21.15.196:0/3570568788 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fed600c4730 0x7fed6006fde0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fed60071040 tx=0x7fed5001ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2f6312df6582a2e server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:59:41.581 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:41.579+0000 7fed6494c640 1 -- 172.21.15.196:0/3570568788 <== mon.0 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed500b5070 con 0x7fed600c4730 2024-03-17T23:59:41.581 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:41.579+0000 7fed6494c640 1 -- 172.21.15.196:0/3570568788 <== mon.0 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed500a8a10 con 0x7fed600c4730 2024-03-17T23:59:41.581 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:41.579+0000 7fed6494c640 1 -- 172.21.15.196:0/3570568788 <== mon.0 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed500a8de0 con 0x7fed600c4730 2024-03-17T23:59:41.582 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:41.579+0000 7fed67bb2640 1 -- 172.21.15.196:0/3570568788 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fed600c4730 msgr2=0x7fed6006fde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:59:41.582 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:41.579+0000 7fed67bb2640 1 --2- 172.21.15.196:0/3570568788 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fed600c4730 0x7fed6006fde0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fed60071040 tx=0x7fed5001ed10 comp rx=0 tx=0).stop 2024-03-17T23:59:41.582 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:41.579+0000 7fed67bb2640 1 -- 172.21.15.196:0/3570568788 shutdown_connections 2024-03-17T23:59:41.582 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:41.579+0000 7fed67bb2640 1 --2- 172.21.15.196:0/3570568788 >> v2:172.21.15.204:3300/0 conn(0x7fed600ca1d0 0x7fed600cd6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:59:41.583 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:41.579+0000 7fed67bb2640 1 --2- 172.21.15.196:0/3570568788 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fed600c4730 0x7fed6006fde0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:59:41.583 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:41.579+0000 7fed67bb2640 1 -- 172.21.15.196:0/3570568788 >> 172.21.15.196:0/3570568788 conn(0x7fed6006b2b0 msgr2=0x7fed6006b6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-17T23:59:41.583 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:41.579+0000 7fed67bb2640 1 -- 172.21.15.196:0/3570568788 shutdown_connections 2024-03-17T23:59:41.583 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:41.579+0000 7fed67bb2640 1 -- 172.21.15.196:0/3570568788 wait complete. 2024-03-17T23:59:41.583 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:41.579+0000 7fed67bb2640 1 Processor -- start 2024-03-17T23:59:41.583 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:41.579+0000 7fed67bb2640 1 -- start start 2024-03-17T23:59:41.586 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:41.583+0000 7fed67bb2640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fed600c4730 0x7fed600b1270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:59:41.586 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:41.583+0000 7fed67bb2640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fed600ca1d0 0x7fed601f2c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:59:41.586 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:41.583+0000 7fed67bb2640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fed60152000 0x7fed601f31b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:59:41.586 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:41.583+0000 7fed67bb2640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fed6015b560 con 0x7fed600ca1d0 2024-03-17T23:59:41.586 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:41.583+0000 7fed67bb2640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7fed6015b280 con 0x7fed600c4730 2024-03-17T23:59:41.586 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:41.583+0000 7fed67bb2640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7fed600b29a0 con 0x7fed60152000 2024-03-17T23:59:41.586 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:41.583+0000 7fed6514d640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fed600ca1d0 0x7fed601f2c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:59:41.587 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:41.583+0000 7fed6514d640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fed600ca1d0 0x7fed601f2c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.196:44664/0 (socket says 172.21.15.196:44664) 2024-03-17T23:59:41.587 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:41.583+0000 7fed6514d640 1 -- 172.21.15.196:0/926481815 learned_addr learned my addr 172.21.15.196:0/926481815 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-03-17T23:59:41.587 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:41.583+0000 7fed6594e640 1 --2- 172.21.15.196:0/926481815 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fed600c4730 0x7fed600b1270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:59:41.587 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:41.583+0000 7fed6614f640 1 --2- 172.21.15.196:0/926481815 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fed60152000 0x7fed601f31b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:59:41.587 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:41.583+0000 7fed6514d640 1 -- 172.21.15.196:0/926481815 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fed60152000 msgr2=0x7fed601f31b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:59:41.587 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:41.583+0000 7fed6514d640 1 --2- 172.21.15.196:0/926481815 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fed60152000 0x7fed601f31b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:59:41.587 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:41.583+0000 7fed6514d640 1 -- 172.21.15.196:0/926481815 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fed600c4730 msgr2=0x7fed600b1270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:59:41.587 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:41.583+0000 7fed6514d640 1 --2- 172.21.15.196:0/926481815 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fed600c4730 0x7fed600b1270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:59:41.587 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:41.583+0000 7fed6514d640 1 -- 172.21.15.196:0/926481815 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed60156c10 con 0x7fed600ca1d0 2024-03-17T23:59:41.587 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:41.583+0000 7fed6614f640 1 --2- 172.21.15.196:0/926481815 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fed60152000 0x7fed601f31b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-17T23:59:41.587 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:41.583+0000 7fed6514d640 1 --2- 172.21.15.196:0/926481815 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fed600ca1d0 0x7fed601f2c70 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fed500b3040 tx=0x7fed5001bab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:59:41.587 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:41.583+0000 7fed567fc640 1 -- 172.21.15.196:0/926481815 <== mon.0 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed500b5070 con 0x7fed600ca1d0 2024-03-17T23:59:41.587 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:41.583+0000 7fed567fc640 1 -- 172.21.15.196:0/926481815 <== mon.0 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed500b0a50 con 0x7fed600ca1d0 2024-03-17T23:59:41.588 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:41.583+0000 7fed67bb2640 1 -- 172.21.15.196:0/926481815 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed60149ef0 con 0x7fed600ca1d0 2024-03-17T23:59:41.588 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:41.583+0000 7fed567fc640 1 -- 172.21.15.196:0/926481815 <== mon.0 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed500b0e40 con 0x7fed600ca1d0 2024-03-17T23:59:41.588 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:41.583+0000 7fed67bb2640 1 -- 172.21.15.196:0/926481815 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed6014e5a0 con 0x7fed600ca1d0 2024-03-17T23:59:41.588 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:41.583+0000 7fed67bb2640 1 -- 172.21.15.196:0/926481815 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fed600689a0 con 0x7fed600ca1d0 2024-03-17T23:59:41.588 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:41.583+0000 7fed567fc640 1 -- 172.21.15.196:0/926481815 <== mon.0 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 5) ==== 87083+0+0 (secure 0 0 0) 0x7fed500c2060 con 0x7fed600ca1d0 2024-03-17T23:59:41.589 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:41.587+0000 7fed567fc640 1 --2- 172.21.15.196:0/926481815 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7fed44067660 0x7fed44069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:59:41.589 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:41.587+0000 7fed567fc640 1 -- 172.21.15.196:0/926481815 <== mon.0 v2:172.21.15.196:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7fed50122a70 con 0x7fed600ca1d0 2024-03-17T23:59:41.589 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:41.587+0000 7fed6594e640 1 --2- 172.21.15.196:0/926481815 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7fed44067660 0x7fed44069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:59:41.589 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:41.587+0000 7fed6594e640 1 --2- 172.21.15.196:0/926481815 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7fed44067660 0x7fed44069b20 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fed5c000f70 tx=0x7fed5c007c10 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:59:41.596 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:41.595+0000 7fed567fc640 1 -- 172.21.15.196:0/926481815 <== mon.0 v2:172.21.15.196:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177849 (secure 0 0 0) 0x7fed50018870 con 0x7fed600ca1d0 2024-03-17T23:59:41.767 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:41.763+0000 7fed67bb2640 1 -- 172.21.15.196:0/926481815 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fed600b2570 con 0x7fed600ca1d0 2024-03-17T23:59:41.767 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:41.763+0000 7fed567fc640 1 -- 172.21.15.196:0/926481815 <== mon.0 v2:172.21.15.196:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) ==== 93+0+10 (secure 0 0 0) 0x7fed500f35e0 con 0x7fed600ca1d0 2024-03-17T23:59:41.767 INFO:teuthology.orchestra.run.smithi196.stdout:pg_num: 1 2024-03-17T23:59:41.769 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:41.767+0000 7fed67bb2640 1 -- 172.21.15.196:0/926481815 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7fed44067660 msgr2=0x7fed44069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:59:41.769 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:41.767+0000 7fed67bb2640 1 --2- 172.21.15.196:0/926481815 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7fed44067660 0x7fed44069b20 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fed5c000f70 tx=0x7fed5c007c10 comp rx=0 tx=0).stop 2024-03-17T23:59:41.769 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:41.767+0000 7fed67bb2640 1 -- 172.21.15.196:0/926481815 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fed600ca1d0 msgr2=0x7fed601f2c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:59:41.769 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:41.767+0000 7fed67bb2640 1 --2- 172.21.15.196:0/926481815 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fed600ca1d0 0x7fed601f2c70 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fed500b3040 tx=0x7fed5001bab0 comp rx=0 tx=0).stop 2024-03-17T23:59:41.769 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:41.767+0000 7fed67bb2640 1 -- 172.21.15.196:0/926481815 shutdown_connections 2024-03-17T23:59:41.769 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:41.767+0000 7fed67bb2640 1 --2- 172.21.15.196:0/926481815 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7fed44067660 0x7fed44069b20 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:59:41.769 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:41.767+0000 7fed67bb2640 1 --2- 172.21.15.196:0/926481815 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fed60152000 0x7fed601f31b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:59:41.769 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:41.767+0000 7fed67bb2640 1 --2- 172.21.15.196:0/926481815 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fed600ca1d0 0x7fed601f2c70 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:59:41.770 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:41.767+0000 7fed67bb2640 1 --2- 172.21.15.196:0/926481815 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fed600c4730 0x7fed600b1270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:59:41.770 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:41.767+0000 7fed67bb2640 1 -- 172.21.15.196:0/926481815 >> 172.21.15.196:0/926481815 conn(0x7fed6006b2b0 msgr2=0x7fed600b1e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-17T23:59:41.770 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:41.767+0000 7fed67bb2640 1 -- 172.21.15.196:0/926481815 shutdown_connections 2024-03-17T23:59:41.770 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:41.767+0000 7fed67bb2640 1 -- 172.21.15.196:0/926481815 wait complete. 2024-03-17T23:59:41.784 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-17T23:59:41.888 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:41.883+0000 7f705aaa5640 1 Processor -- start 2024-03-17T23:59:41.888 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:41.883+0000 7f705aaa5640 1 -- start start 2024-03-17T23:59:41.890 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:41.887+0000 7f705aaa5640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7054151c10 0x7f70540c90b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:59:41.890 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:41.887+0000 7f705aaa5640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f705415bc10 0x7f70540c2ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:59:41.890 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:41.887+0000 7f705aaa5640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7054151ff0 con 0x7f7054071be0 2024-03-17T23:59:41.890 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:41.887+0000 7f705aaa5640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 -- 0x7f70540c95f0 con 0x7f705415bc10 2024-03-17T23:59:41.890 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:41.887+0000 7f705aaa5640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f7054157cb0 con 0x7f7054151c10 2024-03-17T23:59:41.890 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:41.887+0000 7f7058841640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7054151c10 0x7f70540c90b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:59:41.890 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:41.887+0000 7f7059042640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f705415bc10 0x7f70540c2ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:59:41.890 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:41.887+0000 7f7058841640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7054151c10 0x7f70540c90b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3301/0 says I am v2:172.21.15.196:45618/0 (socket says 172.21.15.196:45618) 2024-03-17T23:59:41.890 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:41.887+0000 7f7058841640 1 -- 172.21.15.196:0/536411678 learned_addr learned my addr 172.21.15.196:0/536411678 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-03-17T23:59:41.890 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:41.887+0000 7f7058841640 1 -- 172.21.15.196:0/536411678 >> v2:172.21.15.204:3300/0 conn(0x7f705415bc10 msgr2=0x7f70540c2ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-17T23:59:41.890 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:41.887+0000 7f7058841640 1 --2- 172.21.15.196:0/536411678 >> v2:172.21.15.204:3300/0 conn(0x7f705415bc10 0x7f70540c2ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:59:41.890 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:41.887+0000 7f7058841640 1 -- 172.21.15.196:0/536411678 >> v1:172.21.15.204:6789/0 conn(0x7f7054071be0 legacy=0x7f705415b500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:59:41.891 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:41.887+0000 7f7058841640 1 -- 172.21.15.196:0/536411678 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7054157f50 con 0x7f7054151c10 2024-03-17T23:59:41.891 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:41.887+0000 7f7058841640 1 --2- 172.21.15.196:0/536411678 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7054151c10 0x7f70540c90b0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f70480098a0 tx=0x7f704801c540 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e777d715bbb7ec47 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:59:41.892 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:41.887+0000 7f70537fe640 1 -- 172.21.15.196:0/536411678 <== mon.2 v2:172.21.15.204:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70480a9400 con 0x7f7054151c10 2024-03-17T23:59:41.892 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:41.887+0000 7f70537fe640 1 -- 172.21.15.196:0/536411678 <== mon.2 v2:172.21.15.204:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f70480a95a0 con 0x7f7054151c10 2024-03-17T23:59:41.892 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:41.887+0000 7f70537fe640 1 -- 172.21.15.196:0/536411678 <== mon.2 v2:172.21.15.204:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70480a9970 con 0x7f7054151c10 2024-03-17T23:59:41.893 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:41.891+0000 7f705aaa5640 1 -- 172.21.15.196:0/536411678 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7054151c10 msgr2=0x7f70540c90b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:59:41.893 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:41.891+0000 7f705aaa5640 1 --2- 172.21.15.196:0/536411678 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7054151c10 0x7f70540c90b0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f70480098a0 tx=0x7f704801c540 comp rx=0 tx=0).stop 2024-03-17T23:59:41.893 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:41.891+0000 7f705aaa5640 1 -- 172.21.15.196:0/536411678 shutdown_connections 2024-03-17T23:59:41.893 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:41.891+0000 7f705aaa5640 1 --2- 172.21.15.196:0/536411678 >> v2:172.21.15.204:3300/0 conn(0x7f705415bc10 0x7f70540c2ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:59:41.893 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:41.891+0000 7f705aaa5640 1 --2- 172.21.15.196:0/536411678 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7054151c10 0x7f70540c90b0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:59:41.893 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:41.891+0000 7f705aaa5640 1 -- 172.21.15.196:0/536411678 >> 172.21.15.196:0/536411678 conn(0x7f70540710c0 msgr2=0x7f70540714d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-17T23:59:41.893 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:41.891+0000 7f705aaa5640 1 -- 172.21.15.196:0/536411678 shutdown_connections 2024-03-17T23:59:41.893 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:41.891+0000 7f705aaa5640 1 -- 172.21.15.196:0/536411678 wait complete. 2024-03-17T23:59:41.895 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:41.891+0000 7f705aaa5640 1 Processor -- start 2024-03-17T23:59:41.895 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:41.891+0000 7f705aaa5640 1 -- start start 2024-03-17T23:59:41.895 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:41.891+0000 7f705aaa5640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7054071be0 0x7f705414ec50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:59:41.895 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:41.891+0000 7f705aaa5640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7054151c10 0x7f70540c6ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:59:41.896 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:41.891+0000 7f705aaa5640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f705415bc10 0x7f70540b1540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:59:41.896 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:41.891+0000 7f705aaa5640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f70541646b0 con 0x7f705415bc10 2024-03-17T23:59:41.896 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:41.891+0000 7f705aaa5640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f7054164530 con 0x7f7054071be0 2024-03-17T23:59:41.896 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:41.891+0000 7f705aaa5640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f7054164830 con 0x7f7054151c10 2024-03-17T23:59:41.896 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:41.891+0000 7f7059042640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f705415bc10 0x7f70540b1540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:59:41.896 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:41.891+0000 7f7059042640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f705415bc10 0x7f70540b1540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.196:44676/0 (socket says 172.21.15.196:44676) 2024-03-17T23:59:41.896 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:41.891+0000 7f7059042640 1 -- 172.21.15.196:0/61768277 learned_addr learned my addr 172.21.15.196:0/61768277 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-03-17T23:59:41.896 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:41.891+0000 7f7053fff640 1 --2- 172.21.15.196:0/61768277 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7054151c10 0x7f70540c6ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:59:41.896 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:41.891+0000 7f7058841640 1 --2- 172.21.15.196:0/61768277 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7054071be0 0x7f705414ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:59:41.896 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:41.891+0000 7f7059042640 1 -- 172.21.15.196:0/61768277 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7054151c10 msgr2=0x7f70540c6ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:59:41.896 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:41.891+0000 7f7059042640 1 --2- 172.21.15.196:0/61768277 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7054151c10 0x7f70540c6ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:59:41.896 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:41.891+0000 7f7059042640 1 -- 172.21.15.196:0/61768277 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7054071be0 msgr2=0x7f705414ec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:59:41.896 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:41.891+0000 7f7059042640 1 --2- 172.21.15.196:0/61768277 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7054071be0 0x7f705414ec50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:59:41.897 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:41.891+0000 7f7059042640 1 -- 172.21.15.196:0/61768277 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70541f0e60 con 0x7f705415bc10 2024-03-17T23:59:41.897 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:41.891+0000 7f7053fff640 1 --2- 172.21.15.196:0/61768277 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7054151c10 0x7f70540c6ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-17T23:59:41.897 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:41.891+0000 7f7059042640 1 --2- 172.21.15.196:0/61768277 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f705415bc10 0x7f70540b1540 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f704c00efc0 tx=0x7f704c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:59:41.897 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:41.891+0000 7f70517fa640 1 -- 172.21.15.196:0/61768277 <== mon.0 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f704c018020 con 0x7f705415bc10 2024-03-17T23:59:41.897 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:41.891+0000 7f70517fa640 1 -- 172.21.15.196:0/61768277 <== mon.0 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f704c014480 con 0x7f705415bc10 2024-03-17T23:59:41.897 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:41.891+0000 7f705aaa5640 1 -- 172.21.15.196:0/61768277 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70541f1140 con 0x7f705415bc10 2024-03-17T23:59:41.897 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:41.891+0000 7f70517fa640 1 -- 172.21.15.196:0/61768277 <== mon.0 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f704c009e60 con 0x7f705415bc10 2024-03-17T23:59:41.897 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:41.891+0000 7f705aaa5640 1 -- 172.21.15.196:0/61768277 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70541f1700 con 0x7f705415bc10 2024-03-17T23:59:41.898 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:41.895+0000 7f705aaa5640 1 -- 172.21.15.196:0/61768277 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f70540689a0 con 0x7f705415bc10 2024-03-17T23:59:41.898 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:41.895+0000 7f70517fa640 1 -- 172.21.15.196:0/61768277 <== mon.0 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 5) ==== 87083+0+0 (secure 0 0 0) 0x7f704c01b020 con 0x7f705415bc10 2024-03-17T23:59:41.898 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:41.895+0000 7f70517fa640 1 --2- 172.21.15.196:0/61768277 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f7038067690 0x7f7038069b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:59:41.898 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:41.895+0000 7f70517fa640 1 -- 172.21.15.196:0/61768277 <== mon.0 v2:172.21.15.196:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7f704c0864b0 con 0x7f705415bc10 2024-03-17T23:59:41.898 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:41.895+0000 7f7058841640 1 --2- 172.21.15.196:0/61768277 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f7038067690 0x7f7038069b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:59:41.898 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:41.895+0000 7f7058841640 1 --2- 172.21.15.196:0/61768277 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f7038067690 0x7f7038069b50 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f70480ae000 tx=0x7f70480b3040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:59:41.901 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:41.899+0000 7f70517fa640 1 -- 172.21.15.196:0/61768277 <== mon.0 v2:172.21.15.196:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177849 (secure 0 0 0) 0x7f704c022030 con 0x7f705415bc10 2024-03-17T23:59:42.055 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:42.051+0000 7f705aaa5640 1 -- 172.21.15.196:0/61768277 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f70541512a0 con 0x7f705415bc10 2024-03-17T23:59:42.056 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:42.051+0000 7f70517fa640 1 -- 172.21.15.196:0/61768277 <== mon.0 v2:172.21.15.196:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) ==== 104+0+11 (secure 0 0 0) 0x7f704c010040 con 0x7f705415bc10 2024-03-17T23:59:42.056 INFO:teuthology.orchestra.run.smithi196.stdout:pg_num: 32 2024-03-17T23:59:42.057 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:42.055+0000 7f705aaa5640 1 -- 172.21.15.196:0/61768277 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f7038067690 msgr2=0x7f7038069b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:59:42.057 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:42.055+0000 7f705aaa5640 1 --2- 172.21.15.196:0/61768277 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f7038067690 0x7f7038069b50 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f70480ae000 tx=0x7f70480b3040 comp rx=0 tx=0).stop 2024-03-17T23:59:42.057 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:42.055+0000 7f705aaa5640 1 -- 172.21.15.196:0/61768277 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f705415bc10 msgr2=0x7f70540b1540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:59:42.057 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:42.055+0000 7f705aaa5640 1 --2- 172.21.15.196:0/61768277 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f705415bc10 0x7f70540b1540 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f704c00efc0 tx=0x7f704c00c490 comp rx=0 tx=0).stop 2024-03-17T23:59:42.057 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:42.055+0000 7f705aaa5640 1 -- 172.21.15.196:0/61768277 shutdown_connections 2024-03-17T23:59:42.057 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:42.055+0000 7f705aaa5640 1 --2- 172.21.15.196:0/61768277 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f7038067690 0x7f7038069b50 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:59:42.058 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:42.055+0000 7f705aaa5640 1 --2- 172.21.15.196:0/61768277 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7054151c10 0x7f70540c6ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:59:42.058 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:42.055+0000 7f705aaa5640 1 --2- 172.21.15.196:0/61768277 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f705415bc10 0x7f70540b1540 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:59:42.058 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:42.055+0000 7f705aaa5640 1 --2- 172.21.15.196:0/61768277 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7054071be0 0x7f705414ec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:59:42.058 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:42.055+0000 7f705aaa5640 1 -- 172.21.15.196:0/61768277 >> 172.21.15.196:0/61768277 conn(0x7f70540710c0 msgr2=0x7f70540c7d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-17T23:59:42.058 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:42.055+0000 7f705aaa5640 1 -- 172.21.15.196:0/61768277 shutdown_connections 2024-03-17T23:59:42.058 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:42.055+0000 7f705aaa5640 1 -- 172.21.15.196:0/61768277 wait complete. 2024-03-17T23:59:42.072 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-17T23:59:42.186 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:42.183+0000 7f99ec1f5640 1 Processor -- start 2024-03-17T23:59:42.186 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:42.183+0000 7f99ec1f5640 1 -- start start 2024-03-17T23:59:42.187 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:42.183+0000 7f99ec1f5640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f99e406fb80 0x7f99e4070530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:59:42.187 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:42.183+0000 7f99ec1f5640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f99e4070a70 0x7f99e4157d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:59:42.188 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:42.183+0000 7f99ec1f5640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f99e40c7900 con 0x7f99e4152140 2024-03-17T23:59:42.188 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:42.183+0000 7f99ec1f5640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 -- 0x7f99e4152520 con 0x7f99e4070a70 2024-03-17T23:59:42.188 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:42.183+0000 7f99ec1f5640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f99e415c020 con 0x7f99e406fb80 2024-03-17T23:59:42.188 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:42.183+0000 7f99e9790640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f99e406fb80 0x7f99e4070530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:59:42.188 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:42.183+0000 7f99e9790640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f99e406fb80 0x7f99e4070530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3301/0 says I am v2:172.21.15.196:45634/0 (socket says 172.21.15.196:45634) 2024-03-17T23:59:42.188 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:42.183+0000 7f99e9790640 1 -- 172.21.15.196:0/603698421 learned_addr learned my addr 172.21.15.196:0/603698421 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-03-17T23:59:42.188 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:42.183+0000 7f99ea792640 1 --2- 172.21.15.196:0/603698421 >> v2:172.21.15.204:3300/0 conn(0x7f99e4070a70 0x7f99e4157d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:59:42.189 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:42.183+0000 7f99e9790640 1 -- 172.21.15.196:0/603698421 >> v2:172.21.15.204:3300/0 conn(0x7f99e4070a70 msgr2=0x7f99e4157d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-17T23:59:42.189 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:42.183+0000 7f99e9790640 1 --2- 172.21.15.196:0/603698421 >> v2:172.21.15.204:3300/0 conn(0x7f99e4070a70 0x7f99e4157d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:59:42.189 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:42.183+0000 7f99e9790640 1 -- 172.21.15.196:0/603698421 >> v1:172.21.15.204:6789/0 conn(0x7f99e4152140 legacy=0x7f99e40c6fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:59:42.189 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:42.183+0000 7f99e9790640 1 -- 172.21.15.196:0/603698421 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99e415b410 con 0x7f99e406fb80 2024-03-17T23:59:42.191 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:42.187+0000 7f99e9790640 1 --2- 172.21.15.196:0/603698421 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f99e406fb80 0x7f99e4070530 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f99d4009870 tx=0x7f99d401ed50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2272f182c6d28cc server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:59:42.191 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:42.187+0000 7f99e8f8f640 1 -- 172.21.15.196:0/603698421 <== mon.2 v2:172.21.15.204:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99d40b5070 con 0x7f99e406fb80 2024-03-17T23:59:42.191 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:42.187+0000 7f99e8f8f640 1 -- 172.21.15.196:0/603698421 <== mon.2 v2:172.21.15.204:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f99d40a8a50 con 0x7f99e406fb80 2024-03-17T23:59:42.191 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:42.187+0000 7f99e8f8f640 1 -- 172.21.15.196:0/603698421 <== mon.2 v2:172.21.15.204:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99d40a8e20 con 0x7f99e406fb80 2024-03-17T23:59:42.191 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:42.187+0000 7f99ec1f5640 1 -- 172.21.15.196:0/603698421 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f99e406fb80 msgr2=0x7f99e4070530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:59:42.191 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:42.187+0000 7f99ec1f5640 1 --2- 172.21.15.196:0/603698421 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f99e406fb80 0x7f99e4070530 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f99d4009870 tx=0x7f99d401ed50 comp rx=0 tx=0).stop 2024-03-17T23:59:42.191 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:42.187+0000 7f99ec1f5640 1 -- 172.21.15.196:0/603698421 shutdown_connections 2024-03-17T23:59:42.191 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:42.187+0000 7f99ec1f5640 1 --2- 172.21.15.196:0/603698421 >> v2:172.21.15.204:3300/0 conn(0x7f99e4070a70 0x7f99e4157d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:59:42.191 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:42.187+0000 7f99ec1f5640 1 --2- 172.21.15.196:0/603698421 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f99e406fb80 0x7f99e4070530 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:59:42.192 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:42.187+0000 7f99ec1f5640 1 -- 172.21.15.196:0/603698421 >> 172.21.15.196:0/603698421 conn(0x7f99e40cc5e0 msgr2=0x7f99e40cc9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-17T23:59:42.192 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:42.187+0000 7f99ec1f5640 1 -- 172.21.15.196:0/603698421 shutdown_connections 2024-03-17T23:59:42.192 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:42.187+0000 7f99ec1f5640 1 -- 172.21.15.196:0/603698421 wait complete. 2024-03-17T23:59:42.192 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:42.191+0000 7f99ec1f5640 1 Processor -- start 2024-03-17T23:59:42.193 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:42.191+0000 7f99ec1f5640 1 -- start start 2024-03-17T23:59:42.195 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:42.191+0000 7f99ec1f5640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f99e406fb80 0x7f99e4158f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:59:42.195 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:42.191+0000 7f99ec1f5640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f99e4070a70 0x7f99e40c9320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:59:42.196 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:42.191+0000 7f99ec1f5640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f99e4152140 0x7f99e4159e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:59:42.196 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:42.191+0000 7f99ec1f5640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f99e415bcb0 con 0x7f99e4152140 2024-03-17T23:59:42.196 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:42.191+0000 7f99ec1f5640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f99e415b9d0 con 0x7f99e406fb80 2024-03-17T23:59:42.196 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:42.191+0000 7f99ec1f5640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f99e40cd2f0 con 0x7f99e4070a70 2024-03-17T23:59:42.196 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:42.191+0000 7f99ea792640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f99e4152140 0x7f99e4159e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:59:42.196 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:42.191+0000 7f99ea792640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f99e4152140 0x7f99e4159e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.196:44690/0 (socket says 172.21.15.196:44690) 2024-03-17T23:59:42.196 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:42.191+0000 7f99ea792640 1 -- 172.21.15.196:0/231691835 learned_addr learned my addr 172.21.15.196:0/231691835 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-03-17T23:59:42.196 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:42.191+0000 7f99e9f91640 1 --2- 172.21.15.196:0/231691835 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f99e406fb80 0x7f99e4158f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:59:42.197 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:42.191+0000 7f99e9790640 1 --2- 172.21.15.196:0/231691835 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f99e4070a70 0x7f99e40c9320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:59:42.197 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:42.191+0000 7f99ea792640 1 -- 172.21.15.196:0/231691835 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f99e4070a70 msgr2=0x7f99e40c9320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:59:42.197 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:42.191+0000 7f99ea792640 1 --2- 172.21.15.196:0/231691835 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f99e4070a70 0x7f99e40c9320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:59:42.197 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:42.191+0000 7f99ea792640 1 -- 172.21.15.196:0/231691835 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f99e406fb80 msgr2=0x7f99e4158f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:59:42.197 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:42.191+0000 7f99ea792640 1 --2- 172.21.15.196:0/231691835 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f99e406fb80 0x7f99e4158f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:59:42.197 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:42.191+0000 7f99ea792640 1 -- 172.21.15.196:0/231691835 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99e4159580 con 0x7f99e4152140 2024-03-17T23:59:42.197 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:42.191+0000 7f99e9790640 1 --2- 172.21.15.196:0/231691835 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f99e4070a70 0x7f99e40c9320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-17T23:59:42.197 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:42.191+0000 7f99ea792640 1 --2- 172.21.15.196:0/231691835 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f99e4152140 0x7f99e4159e70 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f99dc00efc0 tx=0x7f99dc00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:59:42.197 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:42.191+0000 7f99da7fc640 1 -- 172.21.15.196:0/231691835 <== mon.0 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99dc018020 con 0x7f99e4152140 2024-03-17T23:59:42.197 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:42.191+0000 7f99ec1f5640 1 -- 172.21.15.196:0/231691835 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99e40c3ae0 con 0x7f99e4152140 2024-03-17T23:59:42.197 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:42.191+0000 7f99da7fc640 1 -- 172.21.15.196:0/231691835 <== mon.0 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f99dc014480 con 0x7f99e4152140 2024-03-17T23:59:42.197 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:42.191+0000 7f99da7fc640 1 -- 172.21.15.196:0/231691835 <== mon.0 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99dc014870 con 0x7f99e4152140 2024-03-17T23:59:42.197 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:42.191+0000 7f99ec1f5640 1 -- 172.21.15.196:0/231691835 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99e40c40a0 con 0x7f99e4152140 2024-03-17T23:59:42.197 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:42.191+0000 7f99ec1f5640 1 -- 172.21.15.196:0/231691835 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f99e40689a0 con 0x7f99e4152140 2024-03-17T23:59:42.198 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:42.195+0000 7f99da7fc640 1 -- 172.21.15.196:0/231691835 <== mon.0 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 5) ==== 87083+0+0 (secure 0 0 0) 0x7f99dc01b020 con 0x7f99e4152140 2024-03-17T23:59:42.198 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:42.195+0000 7f99da7fc640 1 --2- 172.21.15.196:0/231691835 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f99c8067690 0x7f99c8069b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:59:42.199 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:42.195+0000 7f99da7fc640 1 -- 172.21.15.196:0/231691835 <== mon.0 v2:172.21.15.196:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7f99dc086360 con 0x7f99e4152140 2024-03-17T23:59:42.199 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:42.195+0000 7f99e9f91640 1 --2- 172.21.15.196:0/231691835 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f99c8067690 0x7f99c8069b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:59:42.199 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:42.195+0000 7f99e9f91640 1 --2- 172.21.15.196:0/231691835 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f99c8067690 0x7f99c8069b50 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f99e0001770 tx=0x7f99e0009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:59:42.201 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:42.199+0000 7f99da7fc640 1 -- 172.21.15.196:0/231691835 <== mon.0 v2:172.21.15.196:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177849 (secure 0 0 0) 0x7f99dc022070 con 0x7f99e4152140 2024-03-17T23:59:42.353 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:42.351+0000 7f99ec1f5640 1 -- 172.21.15.196:0/231691835 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f99e4070310 con 0x7f99e4152140 2024-03-17T23:59:42.353 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:42.351+0000 7f99da7fc640 1 -- 172.21.15.196:0/231691835 <== mon.0 v2:172.21.15.196:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) ==== 100+0+11 (secure 0 0 0) 0x7f99dc010040 con 0x7f99e4152140 2024-03-17T23:59:42.354 INFO:teuthology.orchestra.run.smithi196.stdout:pg_num: 64 2024-03-17T23:59:42.356 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:42.351+0000 7f99ec1f5640 1 -- 172.21.15.196:0/231691835 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f99c8067690 msgr2=0x7f99c8069b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:59:42.356 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:42.351+0000 7f99ec1f5640 1 --2- 172.21.15.196:0/231691835 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f99c8067690 0x7f99c8069b50 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f99e0001770 tx=0x7f99e0009040 comp rx=0 tx=0).stop 2024-03-17T23:59:42.356 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:42.351+0000 7f99ec1f5640 1 -- 172.21.15.196:0/231691835 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f99e4152140 msgr2=0x7f99e4159e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:59:42.356 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:42.351+0000 7f99ec1f5640 1 --2- 172.21.15.196:0/231691835 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f99e4152140 0x7f99e4159e70 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f99dc00efc0 tx=0x7f99dc00c490 comp rx=0 tx=0).stop 2024-03-17T23:59:42.356 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:42.351+0000 7f99ec1f5640 1 -- 172.21.15.196:0/231691835 shutdown_connections 2024-03-17T23:59:42.356 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:42.351+0000 7f99ec1f5640 1 --2- 172.21.15.196:0/231691835 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f99c8067690 0x7f99c8069b50 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:59:42.356 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:42.351+0000 7f99ec1f5640 1 --2- 172.21.15.196:0/231691835 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f99e4070a70 0x7f99e40c9320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:59:42.356 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:42.351+0000 7f99ec1f5640 1 --2- 172.21.15.196:0/231691835 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f99e4152140 0x7f99e4159e70 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:59:42.356 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:42.351+0000 7f99ec1f5640 1 --2- 172.21.15.196:0/231691835 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f99e406fb80 0x7f99e4158f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:59:42.356 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:42.351+0000 7f99ec1f5640 1 -- 172.21.15.196:0/231691835 >> 172.21.15.196:0/231691835 conn(0x7f99e40cc5e0 msgr2=0x7f99e414f6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-17T23:59:42.357 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:42.351+0000 7f99ec1f5640 1 -- 172.21.15.196:0/231691835 shutdown_connections 2024-03-17T23:59:42.357 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:42.351+0000 7f99ec1f5640 1 -- 172.21.15.196:0/231691835 wait complete. 2024-03-17T23:59:42.377 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-03-17T23:59:42.485 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:42.483+0000 7f875cf39640 1 Processor -- start 2024-03-17T23:59:42.485 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:42.483+0000 7f875cf39640 1 -- start start 2024-03-17T23:59:42.486 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:42.483+0000 7f875cf39640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8758151e40 0x7f8758070de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:59:42.486 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:42.483+0000 7f875cf39640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f875806fe70 0x7f87580702c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:59:42.486 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:42.483+0000 7f875cf39640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8758157c50 con 0x7f87581589f0 2024-03-17T23:59:42.486 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:42.483+0000 7f875cf39640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7f87580c2c30 con 0x7f875806fe70 2024-03-17T23:59:42.486 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:42.483+0000 7f875cf39640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f87580c2f10 con 0x7f8758151e40 2024-03-17T23:59:42.487 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:42.483+0000 7f8756d9d640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f875806fe70 0x7f87580702c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:59:42.487 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:42.483+0000 7f8756d9d640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f875806fe70 0x7f87580702c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.196:34192/0 (socket says 172.21.15.196:34192) 2024-03-17T23:59:42.487 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:42.483+0000 7f8756d9d640 1 -- 172.21.15.196:0/1856501665 learned_addr learned my addr 172.21.15.196:0/1856501665 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-03-17T23:59:42.487 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:42.483+0000 7f875659c640 1 --2- 172.21.15.196:0/1856501665 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8758151e40 0x7f8758070de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:59:42.487 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:42.483+0000 7f8756d9d640 1 -- 172.21.15.196:0/1856501665 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8758151e40 msgr2=0x7f8758070de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-17T23:59:42.487 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:42.483+0000 7f8756d9d640 1 --2- 172.21.15.196:0/1856501665 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8758151e40 0x7f8758070de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:59:42.487 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:42.483+0000 7f8756d9d640 1 -- 172.21.15.196:0/1856501665 >> v1:172.21.15.204:6789/0 conn(0x7f87581589f0 legacy=0x7f87580c8240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:59:42.487 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:42.483+0000 7f8756d9d640 1 -- 172.21.15.196:0/1856501665 --> v2:172.21.15.196:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8758157f10 con 0x7f875806fe70 2024-03-17T23:59:42.487 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:42.483+0000 7f875559a640 1 -- 172.21.15.196:0/1856501665 <== mon.1 v1:172.21.15.204:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4163530168 0 0) 0x7f8758157c50 con 0x7f87581589f0 2024-03-17T23:59:42.488 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:42.483+0000 7f8756d9d640 1 --2- 172.21.15.196:0/1856501665 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f875806fe70 0x7f87580702c0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f8750009e50 tx=0x7f875001ca00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f18f4d1827fc3ac server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:59:42.488 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:42.483+0000 7f875559a640 1 -- 172.21.15.196:0/1856501665 <== mon.0 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87500a58d0 con 0x7f875806fe70 2024-03-17T23:59:42.488 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:42.487+0000 7f875559a640 1 -- 172.21.15.196:0/1856501665 <== mon.0 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f87500a5a70 con 0x7f875806fe70 2024-03-17T23:59:42.488 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:42.487+0000 7f875559a640 1 -- 172.21.15.196:0/1856501665 <== mon.0 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87500a5e40 con 0x7f875806fe70 2024-03-17T23:59:42.489 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:42.487+0000 7f875cf39640 1 -- 172.21.15.196:0/1856501665 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f875806fe70 msgr2=0x7f87580702c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:59:42.489 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:42.487+0000 7f875cf39640 1 --2- 172.21.15.196:0/1856501665 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f875806fe70 0x7f87580702c0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f8750009e50 tx=0x7f875001ca00 comp rx=0 tx=0).stop 2024-03-17T23:59:42.489 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:42.487+0000 7f875cf39640 1 -- 172.21.15.196:0/1856501665 shutdown_connections 2024-03-17T23:59:42.489 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:42.487+0000 7f875cf39640 1 --2- 172.21.15.196:0/1856501665 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f875806fe70 0x7f87580702c0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:59:42.489 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:42.487+0000 7f875cf39640 1 --2- 172.21.15.196:0/1856501665 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8758151e40 0x7f8758070de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:59:42.489 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:42.487+0000 7f875cf39640 1 -- 172.21.15.196:0/1856501665 >> 172.21.15.196:0/1856501665 conn(0x7f875806b2b0 msgr2=0x7f875806b6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-17T23:59:42.489 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:42.487+0000 7f875cf39640 1 -- 172.21.15.196:0/1856501665 shutdown_connections 2024-03-17T23:59:42.490 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:42.487+0000 7f875cf39640 1 -- 172.21.15.196:0/1856501665 wait complete. 2024-03-17T23:59:42.490 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:42.487+0000 7f875cf39640 1 Processor -- start 2024-03-17T23:59:42.491 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:42.487+0000 7f875cf39640 1 -- start start 2024-03-17T23:59:42.493 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:42.487+0000 7f875cf39640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f875806fe70 0x7f8758148680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:59:42.493 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:42.487+0000 7f875cf39640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8758151e40 0x7f87580ca500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:59:42.493 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:42.487+0000 7f875cf39640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f87581589f0 0x7f875813bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:59:42.493 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:42.487+0000 7f875cf39640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f87580c2860 con 0x7f875806fe70 2024-03-17T23:59:42.493 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:42.487+0000 7f875cf39640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f87580c8950 con 0x7f87581589f0 2024-03-17T23:59:42.493 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:42.487+0000 7f875cf39640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f87580c29e0 con 0x7f8758151e40 2024-03-17T23:59:42.494 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:42.487+0000 7f875659c640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f875806fe70 0x7f8758148680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:59:42.494 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:42.487+0000 7f875659c640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f875806fe70 0x7f8758148680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.196:34202/0 (socket says 172.21.15.196:34202) 2024-03-17T23:59:42.494 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:42.487+0000 7f875659c640 1 -- 172.21.15.196:0/3119655599 learned_addr learned my addr 172.21.15.196:0/3119655599 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-03-17T23:59:42.494 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:42.491+0000 7f8756d9d640 1 --2- 172.21.15.196:0/3119655599 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f87581589f0 0x7f875813bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:59:42.494 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:42.491+0000 7f8755d9b640 1 --2- 172.21.15.196:0/3119655599 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8758151e40 0x7f87580ca500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:59:42.494 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:42.491+0000 7f875659c640 1 -- 172.21.15.196:0/3119655599 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8758151e40 msgr2=0x7f87580ca500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:59:42.494 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:42.491+0000 7f875659c640 1 --2- 172.21.15.196:0/3119655599 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8758151e40 0x7f87580ca500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:59:42.494 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:42.491+0000 7f875659c640 1 -- 172.21.15.196:0/3119655599 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f87581589f0 msgr2=0x7f875813bfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:59:42.494 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:42.491+0000 7f875659c640 1 --2- 172.21.15.196:0/3119655599 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f87581589f0 0x7f875813bfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:59:42.494 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:42.491+0000 7f875659c640 1 -- 172.21.15.196:0/3119655599 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f875814b5a0 con 0x7f875806fe70 2024-03-17T23:59:42.494 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:42.491+0000 7f875659c640 1 --2- 172.21.15.196:0/3119655599 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f875806fe70 0x7f8758148680 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f874800e9b0 tx=0x7f874800ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:59:42.494 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:42.491+0000 7f8746ffd640 1 -- 172.21.15.196:0/3119655599 <== mon.0 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8748017070 con 0x7f875806fe70 2024-03-17T23:59:42.494 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:42.491+0000 7f8746ffd640 1 -- 172.21.15.196:0/3119655599 <== mon.0 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f874800c9a0 con 0x7f875806fe70 2024-03-17T23:59:42.495 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:42.491+0000 7f875cf39640 1 -- 172.21.15.196:0/3119655599 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f875814b840 con 0x7f875806fe70 2024-03-17T23:59:42.495 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:42.491+0000 7f8746ffd640 1 -- 172.21.15.196:0/3119655599 <== mon.0 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f874800cd70 con 0x7f875806fe70 2024-03-17T23:59:42.495 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:42.491+0000 7f875cf39640 1 -- 172.21.15.196:0/3119655599 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f875813d590 con 0x7f875806fe70 2024-03-17T23:59:42.495 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:42.491+0000 7f8744ff9640 1 -- 172.21.15.196:0/3119655599 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f87300052a0 con 0x7f875806fe70 2024-03-17T23:59:42.496 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:42.491+0000 7f8746ffd640 1 -- 172.21.15.196:0/3119655599 <== mon.0 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 5) ==== 87083+0+0 (secure 0 0 0) 0x7f874801a070 con 0x7f875806fe70 2024-03-17T23:59:42.496 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:42.491+0000 7f8746ffd640 1 --2- 172.21.15.196:0/3119655599 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f8738067660 0x7f8738069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:59:42.496 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:42.491+0000 7f8746ffd640 1 -- 172.21.15.196:0/3119655599 <== mon.0 v2:172.21.15.196:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7f8748085880 con 0x7f875806fe70 2024-03-17T23:59:42.496 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:42.491+0000 7f8755d9b640 1 --2- 172.21.15.196:0/3119655599 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f8738067660 0x7f8738069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:59:42.496 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:42.491+0000 7f8755d9b640 1 --2- 172.21.15.196:0/3119655599 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f8738067660 0x7f8738069b20 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f875814acf0 tx=0x7f874c007be0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:59:42.499 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:42.495+0000 7f8746ffd640 1 -- 172.21.15.196:0/3119655599 <== mon.0 v2:172.21.15.196:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177849 (secure 0 0 0) 0x7f8748055ec0 con 0x7f875806fe70 2024-03-17T23:59:42.664 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:42.659+0000 7f8744ff9640 1 -- 172.21.15.196:0/3119655599 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f8730005860 con 0x7f875806fe70 2024-03-17T23:59:42.664 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:42.659+0000 7f8746ffd640 1 -- 172.21.15.196:0/3119655599 <== mon.0 v2:172.21.15.196:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v23) ==== 80+0+0 (secure 0 0 0) 0x7f8748059f60 con 0x7f875806fe70 2024-03-17T23:59:42.664 INFO:teuthology.orchestra.run.smithi196.stderr:listed 0 entries 2024-03-17T23:59:42.666 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:42.663+0000 7f8744ff9640 1 -- 172.21.15.196:0/3119655599 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f8738067660 msgr2=0x7f8738069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:59:42.666 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:42.663+0000 7f8744ff9640 1 --2- 172.21.15.196:0/3119655599 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f8738067660 0x7f8738069b20 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f875814acf0 tx=0x7f874c007be0 comp rx=0 tx=0).stop 2024-03-17T23:59:42.666 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:42.663+0000 7f8744ff9640 1 -- 172.21.15.196:0/3119655599 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f875806fe70 msgr2=0x7f8758148680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:59:42.666 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:42.663+0000 7f8744ff9640 1 --2- 172.21.15.196:0/3119655599 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f875806fe70 0x7f8758148680 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f874800e9b0 tx=0x7f874800ee70 comp rx=0 tx=0).stop 2024-03-17T23:59:42.666 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:42.663+0000 7f8744ff9640 1 -- 172.21.15.196:0/3119655599 shutdown_connections 2024-03-17T23:59:42.666 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:42.663+0000 7f8744ff9640 1 --2- 172.21.15.196:0/3119655599 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f8738067660 0x7f8738069b20 secure :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f875814acf0 tx=0x7f874c007be0 comp rx=0 tx=0).stop 2024-03-17T23:59:42.666 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:42.663+0000 7f8744ff9640 1 --2- 172.21.15.196:0/3119655599 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8758151e40 0x7f87580ca500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:59:42.666 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:42.663+0000 7f8744ff9640 1 --2- 172.21.15.196:0/3119655599 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f87581589f0 0x7f875813bfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:59:42.666 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:42.663+0000 7f8744ff9640 1 --2- 172.21.15.196:0/3119655599 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f875806fe70 0x7f8758148680 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:59:42.666 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:42.663+0000 7f8744ff9640 1 -- 172.21.15.196:0/3119655599 >> 172.21.15.196:0/3119655599 conn(0x7f875806b2b0 msgr2=0x7f8758155ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-17T23:59:42.667 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:42.663+0000 7f8744ff9640 1 -- 172.21.15.196:0/3119655599 shutdown_connections 2024-03-17T23:59:42.667 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:42.663+0000 7f8744ff9640 1 -- 172.21.15.196:0/3119655599 wait complete. 2024-03-17T23:59:42.681 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi196.front.sepia.ceph.com... 2024-03-17T23:59:42.681 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-17T23:59:42.681 DEBUG:teuthology.orchestra.run.smithi196:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-03-17T23:59:42.700 INFO:teuthology.orchestra.run:waiting for 300 2024-03-17T23:59:42.700 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi196.stderr:ceph-fuse[33383]: fuse finished with error 0 and tester_r 0 2024-03-17T23:59:48.802 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi196.front.sepia.ceph.com 2024-03-17T23:59:48.802 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-17T23:59:48.802 DEBUG:teuthology.orchestra.run.smithi196:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-03-17T23:59:48.813 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-17T23:59:48.813 DEBUG:teuthology.orchestra.run.smithi196:> ip netns list 2024-03-17T23:59:48.861 INFO:teuthology.orchestra.run.smithi196.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-03-17T23:59:48.861 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-17T23:59:48.861 DEBUG:teuthology.orchestra.run.smithi196:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-17T23:59:48.915 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-17T23:59:48.915 DEBUG:teuthology.orchestra.run.smithi196:> sudo ip link delete ceph-brx 2024-03-17T23:59:49.081 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-03-17T23:59:49.096 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-03-17T23:59:49.096 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-17T23:59:49.201 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:49.199+0000 7f78ed205640 1 Processor -- start 2024-03-17T23:59:49.201 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:49.199+0000 7f78ed205640 1 -- start start 2024-03-17T23:59:49.204 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:49.199+0000 7f78ed205640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f78e80ca230 0x7f78e8165820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:59:49.204 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:49.199+0000 7f78ed205640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f78e806fea0 con 0x7f78e80b0150 2024-03-17T23:59:49.204 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:49.199+0000 7f78ed205640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f78e8070180 con 0x7f78e80c8240 2024-03-17T23:59:49.205 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:49.199+0000 7f78ed205640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 -- 0x7f78e80b0530 con 0x7f78e80ca230 2024-03-17T23:59:49.205 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:49.199+0000 7f78e6d9d640 1 --1- >> v1:172.21.15.196:6789/0 conn(0x7f78e80b0150 0x7f78e806c3c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.196:6789/0 says I am v1:172.21.15.196:59248/0 (socket says 172.21.15.196:59248) 2024-03-17T23:59:49.205 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:49.199+0000 7f78e6d9d640 1 -- 172.21.15.196:0/1937846934 learned_addr learned my addr 172.21.15.196:0/1937846934 (peer_addr_for_me v1:172.21.15.196:0/0) 2024-03-17T23:59:49.205 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:49.199+0000 7f78e759e640 1 --2- 172.21.15.196:0/1937846934 >> v2:172.21.15.204:3300/0 conn(0x7f78e80ca230 0x7f78e8165820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:59:49.205 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:49.199+0000 7f78e5d9b640 1 -- 172.21.15.196:0/1937846934 <== mon.0 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 657893167 0 0) 0x7f78e806fea0 con 0x7f78e80b0150 2024-03-17T23:59:49.205 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:49.199+0000 7f78e5d9b640 1 -- 172.21.15.196:0/1937846934 --> v1:172.21.15.196:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f78d0003530 con 0x7f78e80b0150 2024-03-17T23:59:49.205 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:49.199+0000 7f78e5d9b640 1 -- 172.21.15.196:0/1937846934 <== mon.0 v1:172.21.15.196:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2459152542 0 0) 0x7f78d0003530 con 0x7f78e80b0150 2024-03-17T23:59:49.205 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:49.199+0000 7f78e5d9b640 1 -- 172.21.15.196:0/1937846934 >> v2:172.21.15.204:3300/0 conn(0x7f78e80ca230 msgr2=0x7f78e8165820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-17T23:59:49.205 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:49.199+0000 7f78e5d9b640 1 --2- 172.21.15.196:0/1937846934 >> v2:172.21.15.204:3300/0 conn(0x7f78e80ca230 0x7f78e8165820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:59:49.205 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:49.199+0000 7f78e5d9b640 1 -- 172.21.15.196:0/1937846934 >> v1:172.21.15.204:6789/0 conn(0x7f78e80c8240 legacy=0x7f78e80c9b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:59:49.205 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:49.199+0000 7f78e5d9b640 1 -- 172.21.15.196:0/1937846934 --> v1:172.21.15.196:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78e80c8cb0 con 0x7f78e80b0150 2024-03-17T23:59:49.206 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:49.199+0000 7f78e5d9b640 1 -- 172.21.15.196:0/1937846934 <== mon.0 v1:172.21.15.196:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 981458915 0 0) 0x7f78d8001680 con 0x7f78e80b0150 2024-03-17T23:59:49.206 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:49.199+0000 7f78e5d9b640 1 -- 172.21.15.196:0/1937846934 >> v1:172.21.15.196:6789/0 conn(0x7f78e80b0150 legacy=0x7f78e806c3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:59:49.206 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:49.199+0000 7f78e5d9b640 1 --2- 172.21.15.196:0/1937846934 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f78d00039c0 0x7f78d0003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:59:49.206 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:49.199+0000 7f78e5d9b640 1 --2- 172.21.15.196:0/1937846934 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f78d0004810 0x7f78d0004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:59:49.206 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:49.199+0000 7f78e5d9b640 1 --2- 172.21.15.196:0/1937846934 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f78d00051d0 0x7f78d000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:59:49.206 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:49.199+0000 7f78e5d9b640 1 -- 172.21.15.196:0/1937846934 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f78e80b0530 con 0x7f78d00039c0 2024-03-17T23:59:49.206 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:49.199+0000 7f78e5d9b640 1 -- 172.21.15.196:0/1937846934 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f78d000c070 con 0x7f78d0004810 2024-03-17T23:59:49.206 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:49.199+0000 7f78e5d9b640 1 -- 172.21.15.196:0/1937846934 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f78d000c270 con 0x7f78d00051d0 2024-03-17T23:59:49.206 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:49.199+0000 7f78e6d9d640 1 --2- 172.21.15.196:0/1937846934 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f78d00039c0 0x7f78d0003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:59:49.206 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:49.199+0000 7f78e659c640 1 --2- 172.21.15.196:0/1937846934 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f78d0004810 0x7f78d0004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:59:49.206 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:49.199+0000 7f78e759e640 1 --2- 172.21.15.196:0/1937846934 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f78d00051d0 0x7f78d000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:59:49.206 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:49.199+0000 7f78e6d9d640 1 -- 172.21.15.196:0/1937846934 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f78d00051d0 msgr2=0x7f78d000b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-17T23:59:49.207 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:49.199+0000 7f78e6d9d640 1 --2- 172.21.15.196:0/1937846934 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f78d00051d0 0x7f78d000b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:59:49.207 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:49.199+0000 7f78e6d9d640 1 -- 172.21.15.196:0/1937846934 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f78d0004810 msgr2=0x7f78d0004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-17T23:59:49.207 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:49.199+0000 7f78e6d9d640 1 --2- 172.21.15.196:0/1937846934 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f78d0004810 0x7f78d0004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:59:49.207 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:49.199+0000 7f78e6d9d640 1 -- 172.21.15.196:0/1937846934 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78d0003530 con 0x7f78d00039c0 2024-03-17T23:59:49.207 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:49.199+0000 7f78e759e640 1 --2- 172.21.15.196:0/1937846934 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f78d00051d0 0x7f78d000b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-17T23:59:49.207 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:49.199+0000 7f78e759e640 1 -- 172.21.15.196:0/1937846934 reap_dead start 2024-03-17T23:59:49.208 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:49.203+0000 7f78e6d9d640 1 --2- 172.21.15.196:0/1937846934 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f78d00039c0 0x7f78d0003de0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f78d800c210 tx=0x7f78d801cbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30f4ce3bec4d06dc server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:59:49.208 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:49.203+0000 7f78e5d9b640 1 -- 172.21.15.196:0/1937846934 <== mon.0 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78d8007d40 con 0x7f78d00039c0 2024-03-17T23:59:49.208 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:49.203+0000 7f78e5d9b640 1 -- 172.21.15.196:0/1937846934 <== mon.0 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f78d80a9070 con 0x7f78d00039c0 2024-03-17T23:59:49.208 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:49.203+0000 7f78e5d9b640 1 -- 172.21.15.196:0/1937846934 <== mon.0 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78d8005d80 con 0x7f78d00039c0 2024-03-17T23:59:49.209 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:49.203+0000 7f78ed205640 1 -- 172.21.15.196:0/1937846934 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f78d00039c0 msgr2=0x7f78d0003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:59:49.209 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:49.203+0000 7f78ed205640 1 --2- 172.21.15.196:0/1937846934 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f78d00039c0 0x7f78d0003de0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f78d800c210 tx=0x7f78d801cbe0 comp rx=0 tx=0).stop 2024-03-17T23:59:49.209 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:49.203+0000 7f78ed205640 1 -- 172.21.15.196:0/1937846934 shutdown_connections 2024-03-17T23:59:49.209 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:49.203+0000 7f78ed205640 1 --2- 172.21.15.196:0/1937846934 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f78d00039c0 0x7f78d0003de0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:59:49.209 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:49.203+0000 7f78ed205640 1 -- 172.21.15.196:0/1937846934 >> 172.21.15.196:0/1937846934 conn(0x7f78e806b2b0 msgr2=0x7f78e806b6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-17T23:59:49.209 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:49.203+0000 7f78ed205640 1 -- 172.21.15.196:0/1937846934 shutdown_connections 2024-03-17T23:59:49.209 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:49.203+0000 7f78ed205640 1 -- 172.21.15.196:0/1937846934 wait complete. 2024-03-17T23:59:49.209 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:49.203+0000 7f78ed205640 1 Processor -- start 2024-03-17T23:59:49.209 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:49.207+0000 7f78ed205640 1 -- start start 2024-03-17T23:59:49.211 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:49.207+0000 7f78ed205640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f78d00039c0 0x7f78e81e88d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:59:49.212 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:49.207+0000 7f78ed205640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f78e81e9290 0x7f78e80c6490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:59:49.212 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:49.207+0000 7f78ed205640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f78e80c69d0 0x7f78e8158810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:59:49.212 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:49.207+0000 7f78ed205640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f78e80ca0b0 con 0x7f78e80c69d0 2024-03-17T23:59:49.212 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:49.207+0000 7f78ed205640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f78e80c9f30 con 0x7f78e81e9290 2024-03-17T23:59:49.212 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:49.207+0000 7f78ed205640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f78e815a9f0 con 0x7f78d00039c0 2024-03-17T23:59:49.212 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:49.207+0000 7f78e759e640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f78e80c69d0 0x7f78e8158810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:59:49.212 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:49.207+0000 7f78e759e640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f78e80c69d0 0x7f78e8158810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.196:34230/0 (socket says 172.21.15.196:34230) 2024-03-17T23:59:49.212 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:49.207+0000 7f78e759e640 1 -- 172.21.15.196:0/898757658 learned_addr learned my addr 172.21.15.196:0/898757658 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-03-17T23:59:49.212 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:49.207+0000 7f78e6d9d640 1 --2- 172.21.15.196:0/898757658 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f78d00039c0 0x7f78e81e88d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:59:49.212 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:49.207+0000 7f78e659c640 1 --2- 172.21.15.196:0/898757658 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f78e81e9290 0x7f78e80c6490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:59:49.212 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:49.207+0000 7f78e759e640 1 -- 172.21.15.196:0/898757658 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f78d00039c0 msgr2=0x7f78e81e88d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:59:49.212 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:49.207+0000 7f78e759e640 1 --2- 172.21.15.196:0/898757658 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f78d00039c0 0x7f78e81e88d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:59:49.213 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:49.207+0000 7f78e759e640 1 -- 172.21.15.196:0/898757658 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f78e81e9290 msgr2=0x7f78e80c6490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:59:49.213 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:49.207+0000 7f78e759e640 1 --2- 172.21.15.196:0/898757658 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f78e81e9290 0x7f78e80c6490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:59:49.213 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:49.207+0000 7f78e759e640 1 -- 172.21.15.196:0/898757658 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78e80c5a20 con 0x7f78e80c69d0 2024-03-17T23:59:49.213 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:49.207+0000 7f78e759e640 1 --2- 172.21.15.196:0/898757658 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f78e80c69d0 0x7f78e8158810 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f78e80cb0d0 tx=0x7f78e000f520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:59:49.213 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:49.207+0000 7f78cf7fe640 1 -- 172.21.15.196:0/898757658 <== mon.0 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78e0016620 con 0x7f78e80c69d0 2024-03-17T23:59:49.213 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:49.207+0000 7f78cf7fe640 1 -- 172.21.15.196:0/898757658 <== mon.0 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f78e001b070 con 0x7f78e80c69d0 2024-03-17T23:59:49.213 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:49.207+0000 7f78ed205640 1 -- 172.21.15.196:0/898757658 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78e80c6e60 con 0x7f78e80c69d0 2024-03-17T23:59:49.213 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:49.207+0000 7f78cf7fe640 1 -- 172.21.15.196:0/898757658 <== mon.0 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78e00169c0 con 0x7f78e80c69d0 2024-03-17T23:59:49.213 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:49.207+0000 7f78ed205640 1 -- 172.21.15.196:0/898757658 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78e80c7dc0 con 0x7f78e80c69d0 2024-03-17T23:59:49.213 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:49.207+0000 7f78ed205640 1 -- 172.21.15.196:0/898757658 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f78e80689a0 con 0x7f78e80c69d0 2024-03-17T23:59:49.214 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:49.211+0000 7f78cf7fe640 1 -- 172.21.15.196:0/898757658 <== mon.0 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 5) ==== 87083+0+0 (secure 0 0 0) 0x7f78e0016b60 con 0x7f78e80c69d0 2024-03-17T23:59:49.214 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:49.211+0000 7f78cf7fe640 1 --2- 172.21.15.196:0/898757658 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f78d4067660 0x7f78d4069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:59:49.214 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:49.211+0000 7f78cf7fe640 1 -- 172.21.15.196:0/898757658 <== mon.0 v2:172.21.15.196:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7f78e00863a0 con 0x7f78e80c69d0 2024-03-17T23:59:49.214 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:49.211+0000 7f78e6d9d640 1 --2- 172.21.15.196:0/898757658 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f78d4067660 0x7f78d4069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:59:49.214 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:49.211+0000 7f78e6d9d640 1 --2- 172.21.15.196:0/898757658 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f78d4067660 0x7f78d4069b20 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f78d80ab000 tx=0x7f78d80a7070 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:59:49.222 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:49.219+0000 7f78cf7fe640 1 -- 172.21.15.196:0/898757658 <== mon.0 v2:172.21.15.196:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177849 (secure 0 0 0) 0x7f78e0009b10 con 0x7f78e80c69d0 2024-03-17T23:59:49.377 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:49.375+0000 7f78ed205640 1 -- 172.21.15.196:0/898757658 --> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f78e81f3550 con 0x7f78d4067660 2024-03-17T23:59:49.397 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:49.395+0000 7f78cf7fe640 1 -- 172.21.15.196:0/898757658 <== mgr.4099 v2:172.21.15.204:6832/2505201055 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+254275 (secure 0 0 0) 0x7f78e81f3550 con 0x7f78d4067660 2024-03-17T23:59:49.400 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-03-17T23:59:49.402 INFO:teuthology.orchestra.run.smithi196.stderr:dumped all 2024-03-17T23:59:49.403 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:49.399+0000 7f78ed205640 1 -- 172.21.15.196:0/898757658 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f78d4067660 msgr2=0x7f78d4069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:59:49.403 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:49.399+0000 7f78ed205640 1 --2- 172.21.15.196:0/898757658 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f78d4067660 0x7f78d4069b20 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f78d80ab000 tx=0x7f78d80a7070 comp rx=0 tx=0).stop 2024-03-17T23:59:49.403 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:49.399+0000 7f78ed205640 1 -- 172.21.15.196:0/898757658 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f78e80c69d0 msgr2=0x7f78e8158810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:59:49.404 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:49.399+0000 7f78ed205640 1 --2- 172.21.15.196:0/898757658 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f78e80c69d0 0x7f78e8158810 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f78e80cb0d0 tx=0x7f78e000f520 comp rx=0 tx=0).stop 2024-03-17T23:59:49.404 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:49.399+0000 7f78ed205640 1 -- 172.21.15.196:0/898757658 shutdown_connections 2024-03-17T23:59:49.404 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:49.399+0000 7f78ed205640 1 --2- 172.21.15.196:0/898757658 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f78d4067660 0x7f78d4069b20 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:59:49.404 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:49.399+0000 7f78ed205640 1 --2- 172.21.15.196:0/898757658 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f78e80c69d0 0x7f78e8158810 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:59:49.404 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:49.399+0000 7f78ed205640 1 --2- 172.21.15.196:0/898757658 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f78e81e9290 0x7f78e80c6490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:59:49.404 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:49.399+0000 7f78ed205640 1 --2- 172.21.15.196:0/898757658 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f78d00039c0 0x7f78e81e88d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:59:49.404 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:49.399+0000 7f78ed205640 1 -- 172.21.15.196:0/898757658 >> 172.21.15.196:0/898757658 conn(0x7f78e806b2b0 msgr2=0x7f78e815d9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-17T23:59:49.404 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:49.399+0000 7f78ed205640 1 -- 172.21.15.196:0/898757658 shutdown_connections 2024-03-17T23:59:49.404 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:49.399+0000 7f78ed205640 1 -- 172.21.15.196:0/898757658 wait complete. 2024-03-17T23:59:49.417 INFO:teuthology.orchestra.run.smithi196.stdout:{"pg_ready":true,"pg_map":{"version":133,"stamp":"2024-03-17T23:59:48.028164+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":131409282,"num_objects":131,"num_object_clones":0,"num_object_copies":262,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":131,"num_whiteouts":0,"num_read":3164,"num_read_kb":1535472,"num_write":30477,"num_write_kb":4409625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":34009,"ondisk_log_size":34009,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":451864,"kb_used_data":91416,"kb_used_omap":12,"kb_used_meta":360371,"kb_avail":754522856,"statfs":{"total":773094113280,"available":772631404544,"internally_reserved":0,"allocated":93609984,"data_stored":263520924,"data_compressed":38669382,"data_compressed_allocated":50274304,"data_compressed_original":221667328,"omap_allocated":12748,"internal_metadata":369020468},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,7],"upper_bound":128},"perf_stat":{"commit_latency_ms":68,"apply_latency_ms":68,"commit_latency_ns":68000000,"apply_latency_ns":68000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-6303676,"num_objects":-1292,"num_object_clones":0,"num_object_copies":-2584,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-1292,"num_whiteouts":0,"num_read":19,"num_read_kb":164,"num_write":1475,"num_write_kb":4172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004271"},"pg_stats":[{"pgid":"3.3f","version":"23'416","reported_seq":466,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:42.798627+0000","last_change":"2024-03-17T23:56:01.208245+0000","last_active":"2024-03-17T23:59:42.798627+0000","last_peered":"2024-03-17T23:59:42.798627+0000","last_clean":"2024-03-17T23:59:42.798627+0000","last_became_active":"2024-03-17T23:56:01.207533+0000","last_became_peered":"2024-03-17T23:56:01.207533+0000","last_unstale":"2024-03-17T23:59:42.798627+0000","last_undegraded":"2024-03-17T23:59:42.798627+0000","last_fullsized":"2024-03-17T23:59:42.798627+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":416,"log_dups_size":0,"ondisk_log_size":416,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T09:33:28.935701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":22799,"num_write":382,"num_write_kb":63271,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"23'451","reported_seq":558,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:42.769225+0000","last_change":"2024-03-17T23:56:01.193546+0000","last_active":"2024-03-17T23:59:42.769225+0000","last_peered":"2024-03-17T23:59:42.769225+0000","last_clean":"2024-03-17T23:59:42.769225+0000","last_became_active":"2024-03-17T23:56:01.192736+0000","last_became_peered":"2024-03-17T23:56:01.192736+0000","last_unstale":"2024-03-17T23:59:42.769225+0000","last_undegraded":"2024-03-17T23:59:42.769225+0000","last_fullsized":"2024-03-17T23:59:42.769225+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":451,"log_dups_size":0,"ondisk_log_size":451,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T07:03:18.208772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":90,"num_read_kb":44601,"num_write":422,"num_write_kb":92038,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"23'361","reported_seq":395,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:42.770813+0000","last_change":"2024-03-17T23:56:01.188859+0000","last_active":"2024-03-17T23:59:42.770813+0000","last_peered":"2024-03-17T23:59:42.770813+0000","last_clean":"2024-03-17T23:59:42.770813+0000","last_became_active":"2024-03-17T23:56:01.188339+0000","last_became_peered":"2024-03-17T23:56:01.188339+0000","last_unstale":"2024-03-17T23:59:42.770813+0000","last_undegraded":"2024-03-17T23:59:42.770813+0000","last_fullsized":"2024-03-17T23:59:42.770813+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":361,"log_dups_size":0,"ondisk_log_size":361,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T05:26:03.654839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":9522,"num_write":340,"num_write_kb":42370,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"23'375","reported_seq":429,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:42.797389+0000","last_change":"2024-03-17T23:56:01.204810+0000","last_active":"2024-03-17T23:59:42.797389+0000","last_peered":"2024-03-17T23:59:42.797389+0000","last_clean":"2024-03-17T23:59:42.797389+0000","last_became_active":"2024-03-17T23:56:01.196978+0000","last_became_peered":"2024-03-17T23:56:01.196978+0000","last_unstale":"2024-03-17T23:59:42.797389+0000","last_undegraded":"2024-03-17T23:59:42.797389+0000","last_fullsized":"2024-03-17T23:59:42.797389+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":375,"log_dups_size":0,"ondisk_log_size":375,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T06:25:58.489959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":11889,"num_write":341,"num_write_kb":42361,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"23'410","reported_seq":465,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:42.776537+0000","last_change":"2024-03-17T23:56:01.195423+0000","last_active":"2024-03-17T23:59:42.776537+0000","last_peered":"2024-03-17T23:59:42.776537+0000","last_clean":"2024-03-17T23:59:42.776537+0000","last_became_active":"2024-03-17T23:56:01.194710+0000","last_became_peered":"2024-03-17T23:56:01.194710+0000","last_unstale":"2024-03-17T23:59:42.776537+0000","last_undegraded":"2024-03-17T23:59:42.776537+0000","last_fullsized":"2024-03-17T23:59:42.776537+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":410,"log_dups_size":0,"ondisk_log_size":410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T06:25:58.489959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":20292,"num_write":376,"num_write_kb":22112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"23'379","reported_seq":420,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:42.791477+0000","last_change":"2024-03-17T23:56:01.204633+0000","last_active":"2024-03-17T23:59:42.791477+0000","last_peered":"2024-03-17T23:59:42.791477+0000","last_clean":"2024-03-17T23:59:42.791477+0000","last_became_active":"2024-03-17T23:56:01.192908+0000","last_became_peered":"2024-03-17T23:56:01.192908+0000","last_unstale":"2024-03-17T23:59:42.791477+0000","last_undegraded":"2024-03-17T23:59:42.791477+0000","last_fullsized":"2024-03-17T23:59:42.791477+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":379,"log_dups_size":0,"ondisk_log_size":379,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T03:49:46.522282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":17487,"num_write":350,"num_write_kb":34234,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"23'439","reported_seq":524,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:42.780782+0000","last_change":"2024-03-17T23:56:01.208861+0000","last_active":"2024-03-17T23:59:42.780782+0000","last_peered":"2024-03-17T23:59:42.780782+0000","last_clean":"2024-03-17T23:59:42.780782+0000","last_became_active":"2024-03-17T23:56:01.199550+0000","last_became_peered":"2024-03-17T23:56:01.199550+0000","last_unstale":"2024-03-17T23:59:42.780782+0000","last_undegraded":"2024-03-17T23:59:42.780782+0000","last_fullsized":"2024-03-17T23:59:42.780782+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T00:21:36.556648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":32233,"num_write":412,"num_write_kb":77021,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"23'355","reported_seq":410,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:42.798751+0000","last_change":"2024-03-17T23:56:01.212574+0000","last_active":"2024-03-17T23:59:42.798751+0000","last_peered":"2024-03-17T23:59:42.798751+0000","last_clean":"2024-03-17T23:59:42.798751+0000","last_became_active":"2024-03-17T23:56:01.211860+0000","last_became_peered":"2024-03-17T23:56:01.211860+0000","last_unstale":"2024-03-17T23:59:42.798751+0000","last_undegraded":"2024-03-17T23:59:42.798751+0000","last_fullsized":"2024-03-17T23:59:42.798751+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":355,"log_dups_size":0,"ondisk_log_size":355,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T02:15:18.353466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":19734,"num_write":322,"num_write_kb":51043,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"23'422","reported_seq":471,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:42.803353+0000","last_change":"2024-03-17T23:56:01.214731+0000","last_active":"2024-03-17T23:59:42.803353+0000","last_peered":"2024-03-17T23:59:42.803353+0000","last_clean":"2024-03-17T23:59:42.803353+0000","last_became_active":"2024-03-17T23:56:01.213795+0000","last_became_peered":"2024-03-17T23:56:01.213795+0000","last_unstale":"2024-03-17T23:59:42.803353+0000","last_undegraded":"2024-03-17T23:59:42.803353+0000","last_fullsized":"2024-03-17T23:59:42.803353+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":422,"log_dups_size":0,"ondisk_log_size":422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T11:32:23.716236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":22221,"num_write":389,"num_write_kb":59485,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"23'402","reported_seq":455,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:42.803564+0000","last_change":"2024-03-17T23:56:01.212409+0000","last_active":"2024-03-17T23:59:42.803564+0000","last_peered":"2024-03-17T23:59:42.803564+0000","last_clean":"2024-03-17T23:59:42.803564+0000","last_became_active":"2024-03-17T23:56:01.211620+0000","last_became_peered":"2024-03-17T23:56:01.211620+0000","last_unstale":"2024-03-17T23:59:42.803564+0000","last_undegraded":"2024-03-17T23:59:42.803564+0000","last_fullsized":"2024-03-17T23:59:42.803564+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T11:40:55.653472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":18482,"num_write":357,"num_write_kb":55072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"23'371","reported_seq":425,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:42.800374+0000","last_change":"2024-03-17T23:56:01.212568+0000","last_active":"2024-03-17T23:59:42.800374+0000","last_peered":"2024-03-17T23:59:42.800374+0000","last_clean":"2024-03-17T23:59:42.800374+0000","last_became_active":"2024-03-17T23:56:01.211561+0000","last_became_peered":"2024-03-17T23:56:01.211561+0000","last_unstale":"2024-03-17T23:59:42.800374+0000","last_undegraded":"2024-03-17T23:59:42.800374+0000","last_fullsized":"2024-03-17T23:59:42.800374+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":371,"log_dups_size":0,"ondisk_log_size":371,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T02:46:13.650384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":21281,"num_write":349,"num_write_kb":38541,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"23'389","reported_seq":431,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:42.785259+0000","last_change":"2024-03-17T23:56:01.186811+0000","last_active":"2024-03-17T23:59:42.785259+0000","last_peered":"2024-03-17T23:59:42.785259+0000","last_clean":"2024-03-17T23:59:42.785259+0000","last_became_active":"2024-03-17T23:56:01.186012+0000","last_became_peered":"2024-03-17T23:56:01.186012+0000","last_unstale":"2024-03-17T23:59:42.785259+0000","last_undegraded":"2024-03-17T23:59:42.785259+0000","last_fullsized":"2024-03-17T23:59:42.785259+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":389,"log_dups_size":0,"ondisk_log_size":389,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T10:35:20.142750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":10579,"num_write":363,"num_write_kb":91649,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"23'398","reported_seq":463,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:42.784930+0000","last_change":"2024-03-17T23:56:01.213648+0000","last_active":"2024-03-17T23:59:42.784930+0000","last_peered":"2024-03-17T23:59:42.784930+0000","last_clean":"2024-03-17T23:59:42.784930+0000","last_became_active":"2024-03-17T23:56:01.205058+0000","last_became_peered":"2024-03-17T23:56:01.205058+0000","last_unstale":"2024-03-17T23:59:42.784930+0000","last_undegraded":"2024-03-17T23:59:42.784930+0000","last_fullsized":"2024-03-17T23:59:42.784930+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T03:49:46.522282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":19128,"num_write":366,"num_write_kb":47322,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"23'424","reported_seq":494,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:42.778219+0000","last_change":"2024-03-17T23:56:01.196817+0000","last_active":"2024-03-17T23:59:42.778219+0000","last_peered":"2024-03-17T23:59:42.778219+0000","last_clean":"2024-03-17T23:59:42.778219+0000","last_became_active":"2024-03-17T23:56:01.195960+0000","last_became_peered":"2024-03-17T23:56:01.195960+0000","last_unstale":"2024-03-17T23:59:42.778219+0000","last_undegraded":"2024-03-17T23:59:42.778219+0000","last_fullsized":"2024-03-17T23:59:42.778219+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T10:13:51.662432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":28789,"num_write":400,"num_write_kb":133401,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"23'431","reported_seq":488,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:42.790618+0000","last_change":"2024-03-17T23:56:01.182140+0000","last_active":"2024-03-17T23:59:42.790618+0000","last_peered":"2024-03-17T23:59:42.790618+0000","last_clean":"2024-03-17T23:59:42.790618+0000","last_became_active":"2024-03-17T23:56:01.181405+0000","last_became_peered":"2024-03-17T23:56:01.181405+0000","last_unstale":"2024-03-17T23:59:42.790618+0000","last_undegraded":"2024-03-17T23:59:42.790618+0000","last_fullsized":"2024-03-17T23:59:42.790618+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":431,"log_dups_size":0,"ondisk_log_size":431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T02:46:13.650384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":18708,"num_write":399,"num_write_kb":108829,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"23'444","reported_seq":492,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:42.794403+0000","last_change":"2024-03-17T23:56:01.194871+0000","last_active":"2024-03-17T23:59:42.794403+0000","last_peered":"2024-03-17T23:59:42.794403+0000","last_clean":"2024-03-17T23:59:42.794403+0000","last_became_active":"2024-03-17T23:56:01.193384+0000","last_became_peered":"2024-03-17T23:56:01.193384+0000","last_unstale":"2024-03-17T23:59:42.794403+0000","last_undegraded":"2024-03-17T23:59:42.794403+0000","last_fullsized":"2024-03-17T23:59:42.794403+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":444,"log_dups_size":0,"ondisk_log_size":444,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T11:40:55.653472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":15377,"num_write":410,"num_write_kb":59358,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"23'402","reported_seq":442,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:42.794413+0000","last_change":"2024-03-17T23:56:49.201529+0000","last_active":"2024-03-17T23:59:42.794413+0000","last_peered":"2024-03-17T23:59:42.794413+0000","last_clean":"2024-03-17T23:59:42.794413+0000","last_became_active":"2024-03-17T23:56:49.201243+0000","last_became_peered":"2024-03-17T23:56:49.201243+0000","last_unstale":"2024-03-17T23:59:42.794413+0000","last_undegraded":"2024-03-17T23:59:42.794413+0000","last_fullsized":"2024-03-17T23:59:42.794413+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T11:01:47.143880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":17500,"num_write":362,"num_write_kb":30628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"23'423","reported_seq":524,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:42.790589+0000","last_change":"2024-03-17T23:56:01.186830+0000","last_active":"2024-03-17T23:59:42.790589+0000","last_peered":"2024-03-17T23:59:42.790589+0000","last_clean":"2024-03-17T23:59:42.790589+0000","last_became_active":"2024-03-17T23:56:01.186001+0000","last_became_peered":"2024-03-17T23:56:01.186001+0000","last_unstale":"2024-03-17T23:59:42.790589+0000","last_undegraded":"2024-03-17T23:59:42.790589+0000","last_fullsized":"2024-03-17T23:59:42.790589+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T01:56:02.340062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":84,"num_read_kb":38931,"num_write":386,"num_write_kb":103946,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"23'421","reported_seq":493,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:42.782611+0000","last_change":"2024-03-17T23:56:01.195354+0000","last_active":"2024-03-17T23:59:42.782611+0000","last_peered":"2024-03-17T23:59:42.782611+0000","last_clean":"2024-03-17T23:59:42.782611+0000","last_became_active":"2024-03-17T23:56:01.194579+0000","last_became_peered":"2024-03-17T23:56:01.194579+0000","last_unstale":"2024-03-17T23:59:42.782611+0000","last_undegraded":"2024-03-17T23:59:42.782611+0000","last_fullsized":"2024-03-17T23:59:42.782611+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T07:53:44.598091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":55,"num_read_kb":28885,"num_write":381,"num_write_kb":71633,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"23'457","reported_seq":552,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:42.792052+0000","last_change":"2024-03-17T23:56:01.193429+0000","last_active":"2024-03-17T23:59:42.792052+0000","last_peered":"2024-03-17T23:59:42.792052+0000","last_clean":"2024-03-17T23:59:42.792052+0000","last_became_active":"2024-03-17T23:56:01.192711+0000","last_became_peered":"2024-03-17T23:56:01.192711+0000","last_unstale":"2024-03-17T23:59:42.792052+0000","last_undegraded":"2024-03-17T23:59:42.792052+0000","last_fullsized":"2024-03-17T23:59:42.792052+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":457,"log_dups_size":0,"ondisk_log_size":457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T08:24:06.922044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":48668,"num_write":427,"num_write_kb":117132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"23'407","reported_seq":460,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:42.798540+0000","last_change":"2024-03-17T23:56:01.203203+0000","last_active":"2024-03-17T23:59:42.798540+0000","last_peered":"2024-03-17T23:59:42.798540+0000","last_clean":"2024-03-17T23:59:42.798540+0000","last_became_active":"2024-03-17T23:56:01.202491+0000","last_became_peered":"2024-03-17T23:56:01.202491+0000","last_unstale":"2024-03-17T23:59:42.798540+0000","last_undegraded":"2024-03-17T23:59:42.798540+0000","last_fullsized":"2024-03-17T23:59:42.798540+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T11:35:21.037222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":19175,"num_write":379,"num_write_kb":50742,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"23'423","reported_seq":479,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:42.783044+0000","last_change":"2024-03-17T23:56:49.199752+0000","last_active":"2024-03-17T23:59:42.783044+0000","last_peered":"2024-03-17T23:59:42.783044+0000","last_clean":"2024-03-17T23:59:42.783044+0000","last_became_active":"2024-03-17T23:56:49.199410+0000","last_became_peered":"2024-03-17T23:56:49.199410+0000","last_unstale":"2024-03-17T23:59:42.783044+0000","last_undegraded":"2024-03-17T23:59:42.783044+0000","last_fullsized":"2024-03-17T23:59:42.783044+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T03:18:40.457769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":41103,"num_write":390,"num_write_kb":67292,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.29","version":"23'406","reported_seq":463,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:42.787483+0000","last_change":"2024-03-17T23:56:01.213157+0000","last_active":"2024-03-17T23:59:42.787483+0000","last_peered":"2024-03-17T23:59:42.787483+0000","last_clean":"2024-03-17T23:59:42.787483+0000","last_became_active":"2024-03-17T23:56:01.205601+0000","last_became_peered":"2024-03-17T23:56:01.205601+0000","last_unstale":"2024-03-17T23:59:42.787483+0000","last_undegraded":"2024-03-17T23:59:42.787483+0000","last_fullsized":"2024-03-17T23:59:42.787483+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T00:26:55.287891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":19558,"num_write":374,"num_write_kb":63755,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"23'448","reported_seq":535,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:42.794334+0000","last_change":"2024-03-17T23:56:01.194995+0000","last_active":"2024-03-17T23:59:42.794334+0000","last_peered":"2024-03-17T23:59:42.794334+0000","last_clean":"2024-03-17T23:59:42.794334+0000","last_became_active":"2024-03-17T23:56:01.194290+0000","last_became_peered":"2024-03-17T23:56:01.194290+0000","last_unstale":"2024-03-17T23:59:42.794334+0000","last_undegraded":"2024-03-17T23:59:42.794334+0000","last_fullsized":"2024-03-17T23:59:42.794334+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T07:03:18.208772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":70,"num_read_kb":26782,"num_write":421,"num_write_kb":88405,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"23'403","reported_seq":456,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:42.782500+0000","last_change":"2024-03-17T23:56:01.205233+0000","last_active":"2024-03-17T23:59:42.782500+0000","last_peered":"2024-03-17T23:59:42.782500+0000","last_clean":"2024-03-17T23:59:42.782500+0000","last_became_active":"2024-03-17T23:56:01.204456+0000","last_became_peered":"2024-03-17T23:56:01.204456+0000","last_unstale":"2024-03-17T23:59:42.782500+0000","last_undegraded":"2024-03-17T23:59:42.782500+0000","last_fullsized":"2024-03-17T23:59:42.782500+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":403,"log_dups_size":0,"ondisk_log_size":403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T06:25:58.489959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":21212,"num_write":389,"num_write_kb":62665,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"23'456","reported_seq":517,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:42.800573+0000","last_change":"2024-03-17T23:56:01.210984+0000","last_active":"2024-03-17T23:59:42.800573+0000","last_peered":"2024-03-17T23:59:42.800573+0000","last_clean":"2024-03-17T23:59:42.800573+0000","last_became_active":"2024-03-17T23:56:01.210025+0000","last_became_peered":"2024-03-17T23:56:01.210025+0000","last_unstale":"2024-03-17T23:59:42.800573+0000","last_undegraded":"2024-03-17T23:59:42.800573+0000","last_fullsized":"2024-03-17T23:59:42.800573+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":456,"log_dups_size":0,"ondisk_log_size":456,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T00:26:55.287891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":24179,"num_write":417,"num_write_kb":68058,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"23'406","reported_seq":488,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:42.757304+0000","last_change":"2024-03-17T23:56:01.205461+0000","last_active":"2024-03-17T23:59:42.757304+0000","last_peered":"2024-03-17T23:59:42.757304+0000","last_clean":"2024-03-17T23:59:42.757304+0000","last_became_active":"2024-03-17T23:56:01.204676+0000","last_became_peered":"2024-03-17T23:56:01.204676+0000","last_unstale":"2024-03-17T23:59:42.757304+0000","last_undegraded":"2024-03-17T23:59:42.757304+0000","last_fullsized":"2024-03-17T23:59:42.757304+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T11:40:55.653472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":32120,"num_write":380,"num_write_kb":55330,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"23'390","reported_seq":470,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:42.784777+0000","last_change":"2024-03-17T23:56:01.205530+0000","last_active":"2024-03-17T23:59:42.784777+0000","last_peered":"2024-03-17T23:59:42.784777+0000","last_clean":"2024-03-17T23:59:42.784777+0000","last_became_active":"2024-03-17T23:56:01.204637+0000","last_became_peered":"2024-03-17T23:56:01.204637+0000","last_unstale":"2024-03-17T23:59:42.784777+0000","last_undegraded":"2024-03-17T23:59:42.784777+0000","last_fullsized":"2024-03-17T23:59:42.784777+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T07:03:18.208772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":33745,"num_write":363,"num_write_kb":72094,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"23'405","reported_seq":483,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:42.789252+0000","last_change":"2024-03-17T23:56:01.207143+0000","last_active":"2024-03-17T23:59:42.789252+0000","last_peered":"2024-03-17T23:59:42.789252+0000","last_clean":"2024-03-17T23:59:42.789252+0000","last_became_active":"2024-03-17T23:56:01.206466+0000","last_became_peered":"2024-03-17T23:56:01.206466+0000","last_unstale":"2024-03-17T23:59:42.789252+0000","last_undegraded":"2024-03-17T23:59:42.789252+0000","last_fullsized":"2024-03-17T23:59:42.789252+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T02:46:13.650384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":31525,"num_write":373,"num_write_kb":67528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"23'457","reported_seq":519,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:42.791548+0000","last_change":"2024-03-17T23:56:01.205414+0000","last_active":"2024-03-17T23:59:42.791548+0000","last_peered":"2024-03-17T23:59:42.791548+0000","last_clean":"2024-03-17T23:59:42.791548+0000","last_became_active":"2024-03-17T23:56:01.204418+0000","last_became_peered":"2024-03-17T23:56:01.204418+0000","last_unstale":"2024-03-17T23:59:42.791548+0000","last_undegraded":"2024-03-17T23:59:42.791548+0000","last_fullsized":"2024-03-17T23:59:42.791548+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":457,"log_dups_size":0,"ondisk_log_size":457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T03:59:56.032635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":20620,"num_write":418,"num_write_kb":58690,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"23'455","reported_seq":528,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:42.798202+0000","last_change":"2024-03-17T23:56:01.213242+0000","last_active":"2024-03-17T23:59:42.798202+0000","last_peered":"2024-03-17T23:59:42.798202+0000","last_clean":"2024-03-17T23:59:42.798202+0000","last_became_active":"2024-03-17T23:56:01.212456+0000","last_became_peered":"2024-03-17T23:56:01.212456+0000","last_unstale":"2024-03-17T23:59:42.798202+0000","last_undegraded":"2024-03-17T23:59:42.798202+0000","last_fullsized":"2024-03-17T23:59:42.798202+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":455,"log_dups_size":0,"ondisk_log_size":455,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T11:11:33.525431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":21571,"num_write":428,"num_write_kb":105002,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"23'449","reported_seq":511,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:42.788396+0000","last_change":"2024-03-17T23:56:01.197502+0000","last_active":"2024-03-17T23:59:42.788396+0000","last_peered":"2024-03-17T23:59:42.788396+0000","last_clean":"2024-03-17T23:59:42.788396+0000","last_became_active":"2024-03-17T23:56:01.196672+0000","last_became_peered":"2024-03-17T23:56:01.196672+0000","last_unstale":"2024-03-17T23:59:42.788396+0000","last_undegraded":"2024-03-17T23:59:42.788396+0000","last_fullsized":"2024-03-17T23:59:42.788396+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":449,"log_dups_size":0,"ondisk_log_size":449,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T05:26:03.654839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":29527,"num_write":419,"num_write_kb":89588,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"23'417","reported_seq":480,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:42.782264+0000","last_change":"2024-03-17T23:56:01.169196+0000","last_active":"2024-03-17T23:59:42.782264+0000","last_peered":"2024-03-17T23:59:42.782264+0000","last_clean":"2024-03-17T23:59:42.782264+0000","last_became_active":"2024-03-17T23:56:01.168199+0000","last_became_peered":"2024-03-17T23:56:01.168199+0000","last_unstale":"2024-03-17T23:59:42.782264+0000","last_undegraded":"2024-03-17T23:59:42.782264+0000","last_fullsized":"2024-03-17T23:59:42.782264+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T11:11:33.525431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":34411,"num_write":387,"num_write_kb":91588,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"23'76","reported_seq":95,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:39.379696+0000","last_change":"2024-03-17T23:56:00.675134+0000","last_active":"2024-03-17T23:59:39.379696+0000","last_peered":"2024-03-17T23:59:39.379696+0000","last_clean":"2024-03-17T23:59:39.379696+0000","last_became_active":"2024-03-17T23:56:00.674772+0000","last_became_peered":"2024-03-17T23:56:00.674772+0000","last_unstale":"2024-03-17T23:59:39.379696+0000","last_undegraded":"2024-03-17T23:59:39.379696+0000","last_fullsized":"2024-03-17T23:59:39.379696+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_clean_scrub_stamp":"2024-03-17T23:55:59.626739+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T07:03:16.148691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4195508,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33,"num_write_kb":4113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"23'387","reported_seq":428,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:42.792854+0000","last_change":"2024-03-17T23:56:01.199837+0000","last_active":"2024-03-17T23:59:42.792854+0000","last_peered":"2024-03-17T23:59:42.792854+0000","last_clean":"2024-03-17T23:59:42.792854+0000","last_became_active":"2024-03-17T23:56:01.199084+0000","last_became_peered":"2024-03-17T23:56:01.199084+0000","last_unstale":"2024-03-17T23:59:42.792854+0000","last_undegraded":"2024-03-17T23:59:42.792854+0000","last_fullsized":"2024-03-17T23:59:42.792854+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":387,"log_dups_size":0,"ondisk_log_size":387,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T00:26:55.287891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":13388,"num_write":363,"num_write_kb":66558,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"23'376","reported_seq":395,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:38.393706+0000","last_change":"2024-03-17T23:56:00.683252+0000","last_active":"2024-03-17T23:59:38.393706+0000","last_peered":"2024-03-17T23:59:38.393706+0000","last_clean":"2024-03-17T23:59:38.393706+0000","last_became_active":"2024-03-17T23:56:00.682487+0000","last_became_peered":"2024-03-17T23:56:00.682487+0000","last_unstale":"2024-03-17T23:59:38.393706+0000","last_undegraded":"2024-03-17T23:59:38.393706+0000","last_fullsized":"2024-03-17T23:59:38.393706+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_clean_scrub_stamp":"2024-03-17T23:55:59.626739+0000","objects_scrubbed":0,"log_size":376,"log_dups_size":0,"ondisk_log_size":376,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T04:07:26.256885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":319,"num_write_kb":12441,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"23'246","reported_seq":265,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:38.403114+0000","last_change":"2024-03-17T23:56:00.688353+0000","last_active":"2024-03-17T23:59:38.403114+0000","last_peered":"2024-03-17T23:59:38.403114+0000","last_clean":"2024-03-17T23:59:38.403114+0000","last_became_active":"2024-03-17T23:56:00.688016+0000","last_became_peered":"2024-03-17T23:56:00.688016+0000","last_unstale":"2024-03-17T23:59:38.403114+0000","last_undegraded":"2024-03-17T23:59:38.403114+0000","last_fullsized":"2024-03-17T23:59:38.403114+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_clean_scrub_stamp":"2024-03-17T23:55:59.626739+0000","objects_scrubbed":0,"log_size":246,"log_dups_size":0,"ondisk_log_size":246,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T09:07:52.005791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":201,"num_write_kb":4204,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"23'436","reported_seq":488,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:42.768722+0000","last_change":"2024-03-17T23:56:01.211541+0000","last_active":"2024-03-17T23:59:42.768722+0000","last_peered":"2024-03-17T23:59:42.768722+0000","last_clean":"2024-03-17T23:59:42.768722+0000","last_became_active":"2024-03-17T23:56:01.205709+0000","last_became_peered":"2024-03-17T23:56:01.205709+0000","last_unstale":"2024-03-17T23:59:42.768722+0000","last_undegraded":"2024-03-17T23:59:42.768722+0000","last_fullsized":"2024-03-17T23:59:42.768722+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":436,"log_dups_size":0,"ondisk_log_size":436,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T11:35:21.037222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":21447,"num_write":401,"num_write_kb":58853,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"23'777","reported_seq":796,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:37.491924+0000","last_change":"2024-03-17T23:56:00.690234+0000","last_active":"2024-03-17T23:59:37.491924+0000","last_peered":"2024-03-17T23:59:37.491924+0000","last_clean":"2024-03-17T23:59:37.491924+0000","last_became_active":"2024-03-17T23:56:00.689202+0000","last_became_peered":"2024-03-17T23:56:00.689202+0000","last_unstale":"2024-03-17T23:59:37.491924+0000","last_undegraded":"2024-03-17T23:59:37.491924+0000","last_fullsized":"2024-03-17T23:59:37.491924+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_clean_scrub_stamp":"2024-03-17T23:55:59.626739+0000","objects_scrubbed":0,"log_size":777,"log_dups_size":0,"ondisk_log_size":777,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T05:52:39.451210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389190,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":707,"num_write_kb":8542,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"23'416","reported_seq":458,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:42.763828+0000","last_change":"2024-03-17T23:56:49.077939+0000","last_active":"2024-03-17T23:59:42.763828+0000","last_peered":"2024-03-17T23:59:42.763828+0000","last_clean":"2024-03-17T23:59:42.763828+0000","last_became_active":"2024-03-17T23:56:49.077645+0000","last_became_peered":"2024-03-17T23:56:49.077645+0000","last_unstale":"2024-03-17T23:59:42.763828+0000","last_undegraded":"2024-03-17T23:59:42.763828+0000","last_fullsized":"2024-03-17T23:59:42.763828+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":416,"log_dups_size":0,"ondisk_log_size":416,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T09:27:16.124506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":16384,"num_write":381,"num_write_kb":66829,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"23'56","reported_seq":75,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:42.707701+0000","last_change":"2024-03-17T23:56:00.696649+0000","last_active":"2024-03-17T23:59:42.707701+0000","last_peered":"2024-03-17T23:59:42.707701+0000","last_clean":"2024-03-17T23:59:42.707701+0000","last_became_active":"2024-03-17T23:56:00.696307+0000","last_became_peered":"2024-03-17T23:56:00.696307+0000","last_unstale":"2024-03-17T23:59:42.707701+0000","last_undegraded":"2024-03-17T23:59:42.707701+0000","last_fullsized":"2024-03-17T23:59:42.707701+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_clean_scrub_stamp":"2024-03-17T23:55:59.626739+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T07:28:27.310340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"23'399","reported_seq":426,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:42.797918+0000","last_change":"2024-03-17T23:56:01.194103+0000","last_active":"2024-03-17T23:59:42.797918+0000","last_peered":"2024-03-17T23:59:42.797918+0000","last_clean":"2024-03-17T23:59:42.797918+0000","last_became_active":"2024-03-17T23:56:01.193354+0000","last_became_peered":"2024-03-17T23:56:01.193354+0000","last_unstale":"2024-03-17T23:59:42.797918+0000","last_undegraded":"2024-03-17T23:59:42.797918+0000","last_fullsized":"2024-03-17T23:59:42.797918+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T00:21:36.556648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":5056,"num_write":368,"num_write_kb":26036,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"23'216","reported_seq":235,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:40.404457+0000","last_change":"2024-03-17T23:56:00.689876+0000","last_active":"2024-03-17T23:59:40.404457+0000","last_peered":"2024-03-17T23:59:40.404457+0000","last_clean":"2024-03-17T23:59:40.404457+0000","last_became_active":"2024-03-17T23:56:00.688667+0000","last_became_peered":"2024-03-17T23:56:00.688667+0000","last_unstale":"2024-03-17T23:59:40.404457+0000","last_undegraded":"2024-03-17T23:59:40.404457+0000","last_fullsized":"2024-03-17T23:59:40.404457+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_clean_scrub_stamp":"2024-03-17T23:55:59.626739+0000","objects_scrubbed":0,"log_size":216,"log_dups_size":0,"ondisk_log_size":216,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T09:45:24.650866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":150,"num_write_kb":4172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"23'399","reported_seq":431,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:42.775949+0000","last_change":"2024-03-17T23:56:49.085328+0000","last_active":"2024-03-17T23:59:42.775949+0000","last_peered":"2024-03-17T23:59:42.775949+0000","last_clean":"2024-03-17T23:59:42.775949+0000","last_became_active":"2024-03-17T23:56:49.085029+0000","last_became_peered":"2024-03-17T23:56:49.085029+0000","last_unstale":"2024-03-17T23:59:42.775949+0000","last_undegraded":"2024-03-17T23:59:42.775949+0000","last_fullsized":"2024-03-17T23:59:42.775949+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T06:47:05.968601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":4310,"num_write":367,"num_write_kb":43629,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"23'139","reported_seq":158,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:41.384518+0000","last_change":"2024-03-17T23:56:00.677495+0000","last_active":"2024-03-17T23:59:41.384518+0000","last_peered":"2024-03-17T23:59:41.384518+0000","last_clean":"2024-03-17T23:59:41.384518+0000","last_became_active":"2024-03-17T23:56:00.677165+0000","last_became_peered":"2024-03-17T23:56:00.677165+0000","last_unstale":"2024-03-17T23:59:41.384518+0000","last_undegraded":"2024-03-17T23:59:41.384518+0000","last_fullsized":"2024-03-17T23:59:41.384518+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_clean_scrub_stamp":"2024-03-17T23:55:59.626739+0000","objects_scrubbed":0,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T04:07:26.256885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":91,"num_write_kb":92,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"23'391","reported_seq":452,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:42.786019+0000","last_change":"2024-03-17T23:56:01.190913+0000","last_active":"2024-03-17T23:59:42.786019+0000","last_peered":"2024-03-17T23:59:42.786019+0000","last_clean":"2024-03-17T23:59:42.786019+0000","last_became_active":"2024-03-17T23:56:01.190191+0000","last_became_peered":"2024-03-17T23:56:01.190191+0000","last_unstale":"2024-03-17T23:59:42.786019+0000","last_undegraded":"2024-03-17T23:59:42.786019+0000","last_fullsized":"2024-03-17T23:59:42.786019+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T09:57:50.285832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":22035,"num_write":358,"num_write_kb":71462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"23'261","reported_seq":280,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:42.708202+0000","last_change":"2024-03-17T23:56:00.686597+0000","last_active":"2024-03-17T23:59:42.708202+0000","last_peered":"2024-03-17T23:59:42.708202+0000","last_clean":"2024-03-17T23:59:42.708202+0000","last_became_active":"2024-03-17T23:56:00.685757+0000","last_became_peered":"2024-03-17T23:56:00.685757+0000","last_unstale":"2024-03-17T23:59:42.708202+0000","last_undegraded":"2024-03-17T23:59:42.708202+0000","last_fullsized":"2024-03-17T23:59:42.708202+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_clean_scrub_stamp":"2024-03-17T23:55:59.626739+0000","objects_scrubbed":0,"log_size":261,"log_dups_size":0,"ondisk_log_size":261,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T10:35:19.139554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11902300,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":217,"num_write_kb":11743,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"23'404","reported_seq":469,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:42.794840+0000","last_change":"2024-03-17T23:56:01.216238+0000","last_active":"2024-03-17T23:59:42.794840+0000","last_peered":"2024-03-17T23:59:42.794840+0000","last_clean":"2024-03-17T23:59:42.794840+0000","last_became_active":"2024-03-17T23:56:01.215526+0000","last_became_peered":"2024-03-17T23:56:01.215526+0000","last_unstale":"2024-03-17T23:59:42.794840+0000","last_undegraded":"2024-03-17T23:59:42.794840+0000","last_fullsized":"2024-03-17T23:59:42.794840+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T03:18:40.457769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":29805,"num_write":370,"num_write_kb":75602,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"23'543","reported_seq":562,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:37.441750+0000","last_change":"2024-03-17T23:56:00.682756+0000","last_active":"2024-03-17T23:59:37.441750+0000","last_peered":"2024-03-17T23:59:37.441750+0000","last_clean":"2024-03-17T23:59:37.441750+0000","last_became_active":"2024-03-17T23:56:00.682392+0000","last_became_peered":"2024-03-17T23:56:00.682392+0000","last_unstale":"2024-03-17T23:59:37.441750+0000","last_undegraded":"2024-03-17T23:59:37.441750+0000","last_fullsized":"2024-03-17T23:59:37.441750+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_clean_scrub_stamp":"2024-03-17T23:55:59.626739+0000","objects_scrubbed":0,"log_size":543,"log_dups_size":0,"ondisk_log_size":543,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T04:54:08.515514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388676,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":488,"num_write_kb":8403,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"23'418","reported_seq":480,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:42.795714+0000","last_change":"2024-03-17T23:56:01.218114+0000","last_active":"2024-03-17T23:59:42.795714+0000","last_peered":"2024-03-17T23:59:42.795714+0000","last_clean":"2024-03-17T23:59:42.795714+0000","last_became_active":"2024-03-17T23:56:01.217434+0000","last_became_peered":"2024-03-17T23:56:01.217434+0000","last_unstale":"2024-03-17T23:59:42.795714+0000","last_undegraded":"2024-03-17T23:59:42.795714+0000","last_fullsized":"2024-03-17T23:59:42.795714+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T06:56:40.687109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":24728,"num_write":388,"num_write_kb":63632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"23'69","reported_seq":88,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:40.390514+0000","last_change":"2024-03-17T23:56:00.696766+0000","last_active":"2024-03-17T23:59:40.390514+0000","last_peered":"2024-03-17T23:59:40.390514+0000","last_clean":"2024-03-17T23:59:40.390514+0000","last_became_active":"2024-03-17T23:56:00.695592+0000","last_became_peered":"2024-03-17T23:56:00.695592+0000","last_unstale":"2024-03-17T23:59:40.390514+0000","last_undegraded":"2024-03-17T23:59:40.390514+0000","last_fullsized":"2024-03-17T23:59:40.390514+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_clean_scrub_stamp":"2024-03-17T23:55:59.626739+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T04:07:26.256885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"23'401","reported_seq":467,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:42.795485+0000","last_change":"2024-03-17T23:56:01.208385+0000","last_active":"2024-03-17T23:59:42.795485+0000","last_peered":"2024-03-17T23:59:42.795485+0000","last_clean":"2024-03-17T23:59:42.795485+0000","last_became_active":"2024-03-17T23:56:01.207791+0000","last_became_peered":"2024-03-17T23:56:01.207791+0000","last_unstale":"2024-03-17T23:59:42.795485+0000","last_undegraded":"2024-03-17T23:59:42.795485+0000","last_fullsized":"2024-03-17T23:59:42.795485+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T11:08:21.695552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":27500,"num_write":363,"num_write_kb":68441,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"23'70","reported_seq":89,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:39.432969+0000","last_change":"2024-03-17T23:56:00.686159+0000","last_active":"2024-03-17T23:59:39.432969+0000","last_peered":"2024-03-17T23:59:39.432969+0000","last_clean":"2024-03-17T23:59:39.432969+0000","last_became_active":"2024-03-17T23:56:00.685354+0000","last_became_peered":"2024-03-17T23:56:00.685354+0000","last_unstale":"2024-03-17T23:59:39.432969+0000","last_undegraded":"2024-03-17T23:59:39.432969+0000","last_fullsized":"2024-03-17T23:59:39.432969+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_clean_scrub_stamp":"2024-03-17T23:55:59.626739+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T09:45:24.650866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"23'449","reported_seq":503,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:42.784590+0000","last_change":"2024-03-17T23:56:01.197137+0000","last_active":"2024-03-17T23:59:42.784590+0000","last_peered":"2024-03-17T23:59:42.784590+0000","last_clean":"2024-03-17T23:59:42.784590+0000","last_became_active":"2024-03-17T23:56:01.196356+0000","last_became_peered":"2024-03-17T23:56:01.196356+0000","last_unstale":"2024-03-17T23:59:42.784590+0000","last_undegraded":"2024-03-17T23:59:42.784590+0000","last_fullsized":"2024-03-17T23:59:42.784590+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":449,"log_dups_size":0,"ondisk_log_size":449,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T11:35:21.037222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":24107,"num_write":423,"num_write_kb":92187,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"23'76","reported_seq":95,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:40.420907+0000","last_change":"2024-03-17T23:56:00.682828+0000","last_active":"2024-03-17T23:59:40.420907+0000","last_peered":"2024-03-17T23:59:40.420907+0000","last_clean":"2024-03-17T23:59:40.420907+0000","last_became_active":"2024-03-17T23:56:00.682469+0000","last_became_peered":"2024-03-17T23:56:00.682469+0000","last_unstale":"2024-03-17T23:59:40.420907+0000","last_undegraded":"2024-03-17T23:59:40.420907+0000","last_fullsized":"2024-03-17T23:59:40.420907+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_clean_scrub_stamp":"2024-03-17T23:55:59.626739+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T05:52:39.451210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"23'486","reported_seq":562,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:42.795657+0000","last_change":"2024-03-17T23:56:01.209356+0000","last_active":"2024-03-17T23:59:42.795657+0000","last_peered":"2024-03-17T23:59:42.795657+0000","last_clean":"2024-03-17T23:59:42.795657+0000","last_became_active":"2024-03-17T23:56:01.208381+0000","last_became_peered":"2024-03-17T23:56:01.208381+0000","last_unstale":"2024-03-17T23:59:42.795657+0000","last_undegraded":"2024-03-17T23:59:42.795657+0000","last_fullsized":"2024-03-17T23:59:42.795657+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":486,"log_dups_size":0,"ondisk_log_size":486,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T03:01:01.120023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":26966,"num_write":455,"num_write_kb":93532,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"23'177","reported_seq":196,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:40.454947+0000","last_change":"2024-03-17T23:56:00.683595+0000","last_active":"2024-03-17T23:59:40.454947+0000","last_peered":"2024-03-17T23:59:40.454947+0000","last_clean":"2024-03-17T23:59:40.454947+0000","last_became_active":"2024-03-17T23:56:00.681338+0000","last_became_peered":"2024-03-17T23:56:00.681338+0000","last_unstale":"2024-03-17T23:59:40.454947+0000","last_undegraded":"2024-03-17T23:59:40.454947+0000","last_fullsized":"2024-03-17T23:59:40.454947+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_clean_scrub_stamp":"2024-03-17T23:55:59.626739+0000","objects_scrubbed":0,"log_size":177,"log_dups_size":0,"ondisk_log_size":177,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T08:58:55.725638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":124,"num_write_kb":4160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"23'378","reported_seq":419,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:42.786885+0000","last_change":"2024-03-17T23:56:01.212669+0000","last_active":"2024-03-17T23:59:42.786885+0000","last_peered":"2024-03-17T23:59:42.786885+0000","last_clean":"2024-03-17T23:59:42.786885+0000","last_became_active":"2024-03-17T23:56:01.206691+0000","last_became_peered":"2024-03-17T23:56:01.206691+0000","last_unstale":"2024-03-17T23:59:42.786885+0000","last_undegraded":"2024-03-17T23:59:42.786885+0000","last_fullsized":"2024-03-17T23:59:42.786885+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":378,"log_dups_size":0,"ondisk_log_size":378,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T03:59:56.032635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":10737,"num_write":348,"num_write_kb":63025,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"23'326","reported_seq":345,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:38.421026+0000","last_change":"2024-03-17T23:56:00.690801+0000","last_active":"2024-03-17T23:59:38.421026+0000","last_peered":"2024-03-17T23:59:38.421026+0000","last_clean":"2024-03-17T23:59:38.421026+0000","last_became_active":"2024-03-17T23:56:00.690516+0000","last_became_peered":"2024-03-17T23:56:00.690516+0000","last_unstale":"2024-03-17T23:59:38.421026+0000","last_undegraded":"2024-03-17T23:59:38.421026+0000","last_fullsized":"2024-03-17T23:59:38.421026+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_clean_scrub_stamp":"2024-03-17T23:55:59.626739+0000","objects_scrubbed":0,"log_size":326,"log_dups_size":0,"ondisk_log_size":326,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T09:07:52.005791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":276,"num_write_kb":4244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"23'384","reported_seq":452,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:42.803873+0000","last_change":"2024-03-17T23:56:01.213733+0000","last_active":"2024-03-17T23:59:42.803873+0000","last_peered":"2024-03-17T23:59:42.803873+0000","last_clean":"2024-03-17T23:59:42.803873+0000","last_became_active":"2024-03-17T23:56:01.213095+0000","last_became_peered":"2024-03-17T23:56:01.213095+0000","last_unstale":"2024-03-17T23:59:42.803873+0000","last_undegraded":"2024-03-17T23:59:42.803873+0000","last_fullsized":"2024-03-17T23:59:42.803873+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T08:57:40.944494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":39304,"num_write":347,"num_write_kb":50502,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"23'572","reported_seq":591,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:38.404189+0000","last_change":"2024-03-17T23:56:00.672267+0000","last_active":"2024-03-17T23:59:38.404189+0000","last_peered":"2024-03-17T23:59:38.404189+0000","last_clean":"2024-03-17T23:59:38.404189+0000","last_became_active":"2024-03-17T23:56:00.671655+0000","last_became_peered":"2024-03-17T23:56:00.671655+0000","last_unstale":"2024-03-17T23:59:38.404189+0000","last_undegraded":"2024-03-17T23:59:38.404189+0000","last_fullsized":"2024-03-17T23:59:38.404189+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_clean_scrub_stamp":"2024-03-17T23:55:59.626739+0000","objects_scrubbed":0,"log_size":572,"log_dups_size":0,"ondisk_log_size":572,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T09:45:24.650866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":517,"num_write_kb":4347,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"23'451","reported_seq":497,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:42.794648+0000","last_change":"2024-03-17T23:56:01.204789+0000","last_active":"2024-03-17T23:59:42.794648+0000","last_peered":"2024-03-17T23:59:42.794648+0000","last_clean":"2024-03-17T23:59:42.794648+0000","last_became_active":"2024-03-17T23:56:01.196002+0000","last_became_peered":"2024-03-17T23:56:01.196002+0000","last_unstale":"2024-03-17T23:59:42.794648+0000","last_undegraded":"2024-03-17T23:59:42.794648+0000","last_fullsized":"2024-03-17T23:59:42.794648+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":451,"log_dups_size":0,"ondisk_log_size":451,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T07:53:44.598091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":21931,"num_write":417,"num_write_kb":63333,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"23'70","reported_seq":89,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:40.428715+0000","last_change":"2024-03-17T23:56:00.679054+0000","last_active":"2024-03-17T23:59:40.428715+0000","last_peered":"2024-03-17T23:59:40.428715+0000","last_clean":"2024-03-17T23:59:40.428715+0000","last_became_active":"2024-03-17T23:56:00.677831+0000","last_became_peered":"2024-03-17T23:56:00.677831+0000","last_unstale":"2024-03-17T23:59:40.428715+0000","last_undegraded":"2024-03-17T23:59:40.428715+0000","last_fullsized":"2024-03-17T23:59:40.428715+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_clean_scrub_stamp":"2024-03-17T23:55:59.626739+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T04:07:26.256885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1752,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"23'407","reported_seq":466,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:42.800461+0000","last_change":"2024-03-17T23:56:01.214619+0000","last_active":"2024-03-17T23:59:42.800461+0000","last_peered":"2024-03-17T23:59:42.800461+0000","last_clean":"2024-03-17T23:59:42.800461+0000","last_became_active":"2024-03-17T23:56:01.213960+0000","last_became_peered":"2024-03-17T23:56:01.213960+0000","last_unstale":"2024-03-17T23:59:42.800461+0000","last_undegraded":"2024-03-17T23:59:42.800461+0000","last_fullsized":"2024-03-17T23:59:42.800461+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T11:01:47.143880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":22422,"num_write":380,"num_write_kb":66960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":175,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:56:49.197633+0000","last_change":"2024-03-17T23:55:58.106405+0000","last_active":"2024-03-17T23:56:49.197633+0000","last_peered":"2024-03-17T23:56:49.197633+0000","last_clean":"2024-03-17T23:56:49.197633+0000","last_became_active":"2024-03-17T23:55:58.104493+0000","last_became_peered":"2024-03-17T23:55:58.104493+0000","last_unstale":"2024-03-17T23:56:49.197633+0000","last_undegraded":"2024-03-17T23:56:49.197633+0000","last_fullsized":"2024-03-17T23:56:49.197633+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:55:56.609001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:55:56.609001+0000","last_clean_scrub_stamp":"2024-03-17T23:55:56.609001+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T08:58:52.707900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"23'82","reported_seq":101,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:40.434177+0000","last_change":"2024-03-17T23:56:00.678791+0000","last_active":"2024-03-17T23:59:40.434177+0000","last_peered":"2024-03-17T23:59:40.434177+0000","last_clean":"2024-03-17T23:59:40.434177+0000","last_became_active":"2024-03-17T23:56:00.677660+0000","last_became_peered":"2024-03-17T23:56:00.677660+0000","last_unstale":"2024-03-17T23:59:40.434177+0000","last_undegraded":"2024-03-17T23:59:40.434177+0000","last_fullsized":"2024-03-17T23:59:40.434177+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_clean_scrub_stamp":"2024-03-17T23:55:59.626739+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T07:28:27.310340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"23'360","reported_seq":396,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:42.798746+0000","last_change":"2024-03-17T23:56:01.213073+0000","last_active":"2024-03-17T23:59:42.798746+0000","last_peered":"2024-03-17T23:59:42.798746+0000","last_clean":"2024-03-17T23:59:42.798746+0000","last_became_active":"2024-03-17T23:56:01.212434+0000","last_became_peered":"2024-03-17T23:56:01.212434+0000","last_unstale":"2024-03-17T23:59:42.798746+0000","last_undegraded":"2024-03-17T23:59:42.798746+0000","last_fullsized":"2024-03-17T23:59:42.798746+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":360,"log_dups_size":0,"ondisk_log_size":360,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T08:24:06.922044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":8076,"num_write":326,"num_write_kb":42301,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"23'420","reported_seq":439,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:37.438690+0000","last_change":"2024-03-17T23:56:00.700634+0000","last_active":"2024-03-17T23:59:37.438690+0000","last_peered":"2024-03-17T23:59:37.438690+0000","last_clean":"2024-03-17T23:59:37.438690+0000","last_became_active":"2024-03-17T23:56:00.691617+0000","last_became_peered":"2024-03-17T23:56:00.691617+0000","last_unstale":"2024-03-17T23:59:37.438690+0000","last_undegraded":"2024-03-17T23:59:37.438690+0000","last_fullsized":"2024-03-17T23:59:37.438690+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_clean_scrub_stamp":"2024-03-17T23:55:59.626739+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T11:11:32.522234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":366,"num_write_kb":8360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"23'408","reported_seq":508,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:42.790845+0000","last_change":"2024-03-17T23:56:01.199855+0000","last_active":"2024-03-17T23:59:42.790845+0000","last_peered":"2024-03-17T23:59:42.790845+0000","last_clean":"2024-03-17T23:59:42.790845+0000","last_became_active":"2024-03-17T23:56:01.199121+0000","last_became_peered":"2024-03-17T23:56:01.199121+0000","last_unstale":"2024-03-17T23:59:42.790845+0000","last_undegraded":"2024-03-17T23:59:42.790845+0000","last_fullsized":"2024-03-17T23:59:42.790845+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T09:59:28.908069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":83,"num_read_kb":44834,"num_write":382,"num_write_kb":112569,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"23'288","reported_seq":517,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:42.380720+0000","last_change":"2024-03-17T23:56:00.686560+0000","last_active":"2024-03-17T23:59:42.380720+0000","last_peered":"2024-03-17T23:59:42.380720+0000","last_clean":"2024-03-17T23:59:42.380720+0000","last_became_active":"2024-03-17T23:56:00.686215+0000","last_became_peered":"2024-03-17T23:56:00.686215+0000","last_unstale":"2024-03-17T23:59:42.380720+0000","last_undegraded":"2024-03-17T23:59:42.380720+0000","last_fullsized":"2024-03-17T23:59:42.380720+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_clean_scrub_stamp":"2024-03-17T23:55:59.626739+0000","objects_scrubbed":0,"log_size":288,"log_dups_size":0,"ondisk_log_size":288,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T07:28:27.310340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1468046,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":210,"num_read_kb":1570,"num_write":217,"num_write_kb":1574,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"23'404","reported_seq":435,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:42.740134+0000","last_change":"2024-03-17T23:56:01.193197+0000","last_active":"2024-03-17T23:59:42.740134+0000","last_peered":"2024-03-17T23:59:42.740134+0000","last_clean":"2024-03-17T23:59:42.740134+0000","last_became_active":"2024-03-17T23:56:01.192117+0000","last_became_peered":"2024-03-17T23:56:01.192117+0000","last_unstale":"2024-03-17T23:59:42.740134+0000","last_undegraded":"2024-03-17T23:59:42.740134+0000","last_fullsized":"2024-03-17T23:59:42.740134+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T11:35:21.037222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":8404,"num_write":369,"num_write_kb":38222,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"23'564","reported_seq":583,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:36.422446+0000","last_change":"2024-03-17T23:56:00.696254+0000","last_active":"2024-03-17T23:59:36.422446+0000","last_peered":"2024-03-17T23:59:36.422446+0000","last_clean":"2024-03-17T23:59:36.422446+0000","last_became_active":"2024-03-17T23:56:00.694605+0000","last_became_peered":"2024-03-17T23:56:00.694605+0000","last_unstale":"2024-03-17T23:59:36.422446+0000","last_undegraded":"2024-03-17T23:59:36.422446+0000","last_fullsized":"2024-03-17T23:59:36.422446+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_clean_scrub_stamp":"2024-03-17T23:55:59.626739+0000","objects_scrubbed":0,"log_size":564,"log_dups_size":0,"ondisk_log_size":564,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T10:35:19.139554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389196,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":500,"num_write_kb":8435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"23'401","reported_seq":450,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:42.782955+0000","last_change":"2024-03-17T23:56:01.188278+0000","last_active":"2024-03-17T23:59:42.782955+0000","last_peered":"2024-03-17T23:59:42.782955+0000","last_clean":"2024-03-17T23:59:42.782955+0000","last_became_active":"2024-03-17T23:56:01.187571+0000","last_became_peered":"2024-03-17T23:56:01.187571+0000","last_unstale":"2024-03-17T23:59:42.782955+0000","last_undegraded":"2024-03-17T23:59:42.782955+0000","last_fullsized":"2024-03-17T23:59:42.782955+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T09:45:25.654063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":12494,"num_write":368,"num_write_kb":72170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"23'57","reported_seq":76,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:39.400365+0000","last_change":"2024-03-17T23:56:00.680290+0000","last_active":"2024-03-17T23:59:39.400365+0000","last_peered":"2024-03-17T23:59:39.400365+0000","last_clean":"2024-03-17T23:59:39.400365+0000","last_became_active":"2024-03-17T23:56:00.679981+0000","last_became_peered":"2024-03-17T23:56:00.679981+0000","last_unstale":"2024-03-17T23:59:39.400365+0000","last_undegraded":"2024-03-17T23:59:39.400365+0000","last_fullsized":"2024-03-17T23:59:39.400365+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_clean_scrub_stamp":"2024-03-17T23:55:59.626739+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T10:35:19.139554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"23'455","reported_seq":561,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:42.799702+0000","last_change":"2024-03-17T23:56:01.216640+0000","last_active":"2024-03-17T23:59:42.799702+0000","last_peered":"2024-03-17T23:59:42.799702+0000","last_clean":"2024-03-17T23:59:42.799702+0000","last_became_active":"2024-03-17T23:56:01.216145+0000","last_became_peered":"2024-03-17T23:56:01.216145+0000","last_unstale":"2024-03-17T23:59:42.799702+0000","last_undegraded":"2024-03-17T23:59:42.799702+0000","last_fullsized":"2024-03-17T23:59:42.799702+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":455,"log_dups_size":0,"ondisk_log_size":455,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T11:01:47.143880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":89,"num_read_kb":46763,"num_write":422,"num_write_kb":133395,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"23'223","reported_seq":242,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:39.393925+0000","last_change":"2024-03-17T23:56:00.692896+0000","last_active":"2024-03-17T23:59:39.393925+0000","last_peered":"2024-03-17T23:59:39.393925+0000","last_clean":"2024-03-17T23:59:39.393925+0000","last_became_active":"2024-03-17T23:56:00.692054+0000","last_became_peered":"2024-03-17T23:56:00.692054+0000","last_unstale":"2024-03-17T23:59:39.393925+0000","last_undegraded":"2024-03-17T23:59:39.393925+0000","last_fullsized":"2024-03-17T23:59:39.393925+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_clean_scrub_stamp":"2024-03-17T23:55:59.626739+0000","objects_scrubbed":0,"log_size":223,"log_dups_size":0,"ondisk_log_size":223,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T10:55:17.061099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194416,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":164,"num_write_kb":4176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"23'370","reported_seq":424,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:42.757675+0000","last_change":"2024-03-17T23:56:01.189102+0000","last_active":"2024-03-17T23:59:42.757675+0000","last_peered":"2024-03-17T23:59:42.757675+0000","last_clean":"2024-03-17T23:59:42.757675+0000","last_became_active":"2024-03-17T23:56:01.188353+0000","last_became_peered":"2024-03-17T23:56:01.188353+0000","last_unstale":"2024-03-17T23:59:42.757675+0000","last_undegraded":"2024-03-17T23:59:42.757675+0000","last_fullsized":"2024-03-17T23:59:42.757675+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":370,"log_dups_size":0,"ondisk_log_size":370,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T00:26:55.287891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":24684,"num_write":328,"num_write_kb":42609,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"23'207","reported_seq":226,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:40.794446+0000","last_change":"2024-03-17T23:56:00.689216+0000","last_active":"2024-03-17T23:59:40.794446+0000","last_peered":"2024-03-17T23:59:40.794446+0000","last_clean":"2024-03-17T23:59:40.794446+0000","last_became_active":"2024-03-17T23:56:00.688978+0000","last_became_peered":"2024-03-17T23:56:00.688978+0000","last_unstale":"2024-03-17T23:59:40.794446+0000","last_undegraded":"2024-03-17T23:59:40.794446+0000","last_fullsized":"2024-03-17T23:59:40.794446+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_clean_scrub_stamp":"2024-03-17T23:55:59.626739+0000","objects_scrubbed":0,"log_size":207,"log_dups_size":0,"ondisk_log_size":207,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T09:57:49.282635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":418,"num_write_kb":1562,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"23'361","reported_seq":444,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:42.798955+0000","last_change":"2024-03-17T23:56:01.212041+0000","last_active":"2024-03-17T23:59:42.798955+0000","last_peered":"2024-03-17T23:59:42.798955+0000","last_clean":"2024-03-17T23:59:42.798955+0000","last_became_active":"2024-03-17T23:56:01.211359+0000","last_became_peered":"2024-03-17T23:56:01.211359+0000","last_unstale":"2024-03-17T23:59:42.798955+0000","last_undegraded":"2024-03-17T23:59:42.798955+0000","last_fullsized":"2024-03-17T23:59:42.798955+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":361,"log_dups_size":0,"ondisk_log_size":361,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T11:08:21.695552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":37046,"num_write":339,"num_write_kb":87516,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"23'69","reported_seq":88,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:39.510095+0000","last_change":"2024-03-17T23:56:00.686768+0000","last_active":"2024-03-17T23:59:39.510095+0000","last_peered":"2024-03-17T23:59:39.510095+0000","last_clean":"2024-03-17T23:59:39.510095+0000","last_became_active":"2024-03-17T23:56:00.685461+0000","last_became_peered":"2024-03-17T23:56:00.685461+0000","last_unstale":"2024-03-17T23:59:39.510095+0000","last_undegraded":"2024-03-17T23:59:39.510095+0000","last_fullsized":"2024-03-17T23:59:39.510095+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_clean_scrub_stamp":"2024-03-17T23:55:59.626739+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T05:52:39.451210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"23'472","reported_seq":554,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:42.767925+0000","last_change":"2024-03-17T23:56:01.196364+0000","last_active":"2024-03-17T23:59:42.767925+0000","last_peered":"2024-03-17T23:59:42.767925+0000","last_clean":"2024-03-17T23:59:42.767925+0000","last_became_active":"2024-03-17T23:56:01.191450+0000","last_became_peered":"2024-03-17T23:56:01.191450+0000","last_unstale":"2024-03-17T23:59:42.767925+0000","last_undegraded":"2024-03-17T23:59:42.767925+0000","last_fullsized":"2024-03-17T23:59:42.767925+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":472,"log_dups_size":0,"ondisk_log_size":472,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T02:15:18.353466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":42881,"num_write":439,"num_write_kb":88369,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"23'498","reported_seq":517,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:39.392192+0000","last_change":"2024-03-17T23:56:00.691812+0000","last_active":"2024-03-17T23:59:39.392192+0000","last_peered":"2024-03-17T23:59:39.392192+0000","last_clean":"2024-03-17T23:59:39.392192+0000","last_became_active":"2024-03-17T23:56:00.691381+0000","last_became_peered":"2024-03-17T23:56:00.691381+0000","last_unstale":"2024-03-17T23:59:39.392192+0000","last_undegraded":"2024-03-17T23:59:39.392192+0000","last_fullsized":"2024-03-17T23:59:39.392192+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_clean_scrub_stamp":"2024-03-17T23:55:59.626739+0000","objects_scrubbed":0,"log_size":498,"log_dups_size":0,"ondisk_log_size":498,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T10:35:19.139554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":442,"num_write_kb":4310,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"23'444","reported_seq":509,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:42.745522+0000","last_change":"2024-03-17T23:56:01.195278+0000","last_active":"2024-03-17T23:59:42.745522+0000","last_peered":"2024-03-17T23:59:42.745522+0000","last_clean":"2024-03-17T23:59:42.745522+0000","last_became_active":"2024-03-17T23:56:01.192316+0000","last_became_peered":"2024-03-17T23:56:01.192316+0000","last_unstale":"2024-03-17T23:59:42.745522+0000","last_undegraded":"2024-03-17T23:59:42.745522+0000","last_fullsized":"2024-03-17T23:59:42.745522+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":444,"log_dups_size":0,"ondisk_log_size":444,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T04:07:27.260081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":21819,"num_write":413,"num_write_kb":30190,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"23'60","reported_seq":79,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:38.460611+0000","last_change":"2024-03-17T23:56:00.703680+0000","last_active":"2024-03-17T23:59:38.460611+0000","last_peered":"2024-03-17T23:59:38.460611+0000","last_clean":"2024-03-17T23:59:38.460611+0000","last_became_active":"2024-03-17T23:56:00.703439+0000","last_became_peered":"2024-03-17T23:56:00.703439+0000","last_unstale":"2024-03-17T23:59:38.460611+0000","last_undegraded":"2024-03-17T23:59:38.460611+0000","last_fullsized":"2024-03-17T23:59:38.460611+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_clean_scrub_stamp":"2024-03-17T23:55:59.626739+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T11:11:32.522234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"23'411","reported_seq":446,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:42.761413+0000","last_change":"2024-03-17T23:56:01.191678+0000","last_active":"2024-03-17T23:59:42.761413+0000","last_peered":"2024-03-17T23:59:42.761413+0000","last_clean":"2024-03-17T23:59:42.761413+0000","last_became_active":"2024-03-17T23:56:01.190681+0000","last_became_peered":"2024-03-17T23:56:01.190681+0000","last_unstale":"2024-03-17T23:59:42.761413+0000","last_undegraded":"2024-03-17T23:59:42.761413+0000","last_fullsized":"2024-03-17T23:59:42.761413+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T02:46:13.650384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":2591,"num_write":372,"num_write_kb":17971,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"23'151","reported_seq":170,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:38.428986+0000","last_change":"2024-03-17T23:56:00.679281+0000","last_active":"2024-03-17T23:59:38.428986+0000","last_peered":"2024-03-17T23:59:38.428986+0000","last_clean":"2024-03-17T23:59:38.428986+0000","last_became_active":"2024-03-17T23:56:00.678950+0000","last_became_peered":"2024-03-17T23:56:00.678950+0000","last_unstale":"2024-03-17T23:59:38.428986+0000","last_undegraded":"2024-03-17T23:59:38.428986+0000","last_fullsized":"2024-03-17T23:59:38.428986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_clean_scrub_stamp":"2024-03-17T23:55:59.626739+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T05:52:39.451210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":92,"num_write_kb":4145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"23'431","reported_seq":495,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:42.775522+0000","last_change":"2024-03-17T23:56:01.215539+0000","last_active":"2024-03-17T23:59:42.775522+0000","last_peered":"2024-03-17T23:59:42.775522+0000","last_clean":"2024-03-17T23:59:42.775522+0000","last_became_active":"2024-03-17T23:56:01.211163+0000","last_became_peered":"2024-03-17T23:56:01.211163+0000","last_unstale":"2024-03-17T23:59:42.775522+0000","last_undegraded":"2024-03-17T23:59:42.775522+0000","last_fullsized":"2024-03-17T23:59:42.775522+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":431,"log_dups_size":0,"ondisk_log_size":431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T11:40:55.653472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":16100,"num_write":395,"num_write_kb":71500,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"23'122","reported_seq":141,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:38.372796+0000","last_change":"2024-03-17T23:56:00.692384+0000","last_active":"2024-03-17T23:59:38.372796+0000","last_peered":"2024-03-17T23:59:38.372796+0000","last_clean":"2024-03-17T23:59:38.372796+0000","last_became_active":"2024-03-17T23:56:00.684178+0000","last_became_peered":"2024-03-17T23:56:00.684178+0000","last_unstale":"2024-03-17T23:59:38.372796+0000","last_undegraded":"2024-03-17T23:59:38.372796+0000","last_fullsized":"2024-03-17T23:59:38.372796+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_clean_scrub_stamp":"2024-03-17T23:55:59.626739+0000","objects_scrubbed":0,"log_size":122,"log_dups_size":0,"ondisk_log_size":122,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T09:45:24.650866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":65,"num_write_kb":8221,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"23'446","reported_seq":538,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:42.790168+0000","last_change":"2024-03-17T23:56:01.193547+0000","last_active":"2024-03-17T23:59:42.790168+0000","last_peered":"2024-03-17T23:59:42.790168+0000","last_clean":"2024-03-17T23:59:42.790168+0000","last_became_active":"2024-03-17T23:56:01.192775+0000","last_became_peered":"2024-03-17T23:56:01.192775+0000","last_unstale":"2024-03-17T23:59:42.790168+0000","last_undegraded":"2024-03-17T23:59:42.790168+0000","last_fullsized":"2024-03-17T23:59:42.790168+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":446,"log_dups_size":0,"ondisk_log_size":446,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T02:15:18.353466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":28843,"num_write":412,"num_write_kb":84625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"23'388","reported_seq":455,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:42.800309+0000","last_change":"2024-03-17T23:56:01.178436+0000","last_active":"2024-03-17T23:59:42.800309+0000","last_peered":"2024-03-17T23:59:42.800309+0000","last_clean":"2024-03-17T23:59:42.800309+0000","last_became_active":"2024-03-17T23:56:01.177533+0000","last_became_peered":"2024-03-17T23:56:01.177533+0000","last_unstale":"2024-03-17T23:59:42.800309+0000","last_undegraded":"2024-03-17T23:59:42.800309+0000","last_fullsized":"2024-03-17T23:59:42.800309+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":388,"log_dups_size":0,"ondisk_log_size":388,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T03:18:40.457769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":28876,"num_write":348,"num_write_kb":79477,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"23'250","reported_seq":269,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:40.435836+0000","last_change":"2024-03-17T23:56:00.691483+0000","last_active":"2024-03-17T23:59:40.435836+0000","last_peered":"2024-03-17T23:59:40.435836+0000","last_clean":"2024-03-17T23:59:40.435836+0000","last_became_active":"2024-03-17T23:56:00.684714+0000","last_became_peered":"2024-03-17T23:56:00.684714+0000","last_unstale":"2024-03-17T23:59:40.435836+0000","last_undegraded":"2024-03-17T23:59:40.435836+0000","last_fullsized":"2024-03-17T23:59:40.435836+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_clean_scrub_stamp":"2024-03-17T23:55:59.626739+0000","objects_scrubbed":0,"log_size":250,"log_dups_size":0,"ondisk_log_size":250,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T09:57:49.282635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":200,"num_write_kb":4200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"23'366","reported_seq":420,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:42.797532+0000","last_change":"2024-03-17T23:56:01.194350+0000","last_active":"2024-03-17T23:59:42.797532+0000","last_peered":"2024-03-17T23:59:42.797532+0000","last_clean":"2024-03-17T23:59:42.797532+0000","last_became_active":"2024-03-17T23:56:01.193625+0000","last_became_peered":"2024-03-17T23:56:01.193625+0000","last_unstale":"2024-03-17T23:59:42.797532+0000","last_undegraded":"2024-03-17T23:59:42.797532+0000","last_fullsized":"2024-03-17T23:59:42.797532+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T11:08:21.695552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":17870,"num_write":332,"num_write_kb":22223,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"23'265","reported_seq":284,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:40.468483+0000","last_change":"2024-03-17T23:56:00.699785+0000","last_active":"2024-03-17T23:59:40.468483+0000","last_peered":"2024-03-17T23:59:40.468483+0000","last_clean":"2024-03-17T23:59:40.468483+0000","last_became_active":"2024-03-17T23:56:00.699049+0000","last_became_peered":"2024-03-17T23:56:00.699049+0000","last_unstale":"2024-03-17T23:59:40.468483+0000","last_undegraded":"2024-03-17T23:59:40.468483+0000","last_fullsized":"2024-03-17T23:59:40.468483+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_clean_scrub_stamp":"2024-03-17T23:55:59.626739+0000","objects_scrubbed":0,"log_size":265,"log_dups_size":0,"ondisk_log_size":265,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T01:56:01.336865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":190,"num_write_kb":12389,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"23'368","reported_seq":446,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:42.799409+0000","last_change":"2024-03-17T23:56:01.208117+0000","last_active":"2024-03-17T23:59:42.799409+0000","last_peered":"2024-03-17T23:59:42.799409+0000","last_clean":"2024-03-17T23:59:42.799409+0000","last_became_active":"2024-03-17T23:56:01.207342+0000","last_became_peered":"2024-03-17T23:56:01.207342+0000","last_unstale":"2024-03-17T23:59:42.799409+0000","last_undegraded":"2024-03-17T23:59:42.799409+0000","last_fullsized":"2024-03-17T23:59:42.799409+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":368,"log_dups_size":0,"ondisk_log_size":368,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T08:24:06.922044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":38707,"num_write":341,"num_write_kb":47027,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"23'59","reported_seq":78,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:38.432162+0000","last_change":"2024-03-17T23:56:00.691595+0000","last_active":"2024-03-17T23:59:38.432162+0000","last_peered":"2024-03-17T23:59:38.432162+0000","last_clean":"2024-03-17T23:59:38.432162+0000","last_became_active":"2024-03-17T23:56:00.690892+0000","last_became_peered":"2024-03-17T23:56:00.690892+0000","last_unstale":"2024-03-17T23:59:38.432162+0000","last_undegraded":"2024-03-17T23:59:38.432162+0000","last_fullsized":"2024-03-17T23:59:38.432162+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_clean_scrub_stamp":"2024-03-17T23:55:59.626739+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T07:28:27.310340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":4104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"23'416","reported_seq":458,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:42.789760+0000","last_change":"2024-03-17T23:56:01.212430+0000","last_active":"2024-03-17T23:59:42.789760+0000","last_peered":"2024-03-17T23:59:42.789760+0000","last_clean":"2024-03-17T23:59:42.789760+0000","last_became_active":"2024-03-17T23:56:01.204930+0000","last_became_peered":"2024-03-17T23:56:01.204930+0000","last_unstale":"2024-03-17T23:59:42.789760+0000","last_undegraded":"2024-03-17T23:59:42.789760+0000","last_fullsized":"2024-03-17T23:59:42.789760+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":416,"log_dups_size":0,"ondisk_log_size":416,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T04:45:41.506781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":21060,"num_write":382,"num_write_kb":52186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"23'128","reported_seq":147,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:39.504888+0000","last_change":"2024-03-17T23:56:00.682405+0000","last_active":"2024-03-17T23:59:39.504888+0000","last_peered":"2024-03-17T23:59:39.504888+0000","last_clean":"2024-03-17T23:59:39.504888+0000","last_became_active":"2024-03-17T23:56:00.681938+0000","last_became_peered":"2024-03-17T23:56:00.681938+0000","last_unstale":"2024-03-17T23:59:39.504888+0000","last_undegraded":"2024-03-17T23:59:39.504888+0000","last_fullsized":"2024-03-17T23:59:39.504888+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_clean_scrub_stamp":"2024-03-17T23:55:59.626739+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T07:03:16.148691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":81,"num_write_kb":4133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2838,"num_read_kb":1533802,"num_write":24369,"num_write_kb":4275114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26399,"ondisk_log_size":26399,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":130818914,"num_objects":129,"num_object_clones":0,"num_object_copies":258,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":129,"num_whiteouts":0,"num_read":210,"num_read_kb":1570,"num_write":5949,"num_write_kb":132095,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":91545600,"data_stored":261637828,"data_compressed":38603034,"data_compressed_allocated":50184192,"data_compressed_original":220520448,"omap_allocated":0,"internal_metadata":0},"log_size":7493,"ondisk_log_size":7493,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66348,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574897,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":64480,"kb_used_data":15256,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94307360,"statfs":{"total":96636764160,"available":96570736640,"internally_reserved":0,"allocated":15622144,"data_stored":51012493,"data_compressed":7591170,"data_compressed_allocated":9641984,"data_compressed_original":45223936,"omap_allocated":1590,"internal_metadata":50395594},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574897,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":53036,"kb_used_data":13540,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94318804,"statfs":{"total":96636764160,"available":96582455296,"internally_reserved":0,"allocated":13864960,"data_stored":45545899,"data_compressed":7083231,"data_compressed_allocated":9031680,"data_compressed_original":40890368,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574896,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60172,"kb_used_data":10948,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94311668,"statfs":{"total":96636764160,"available":96575148032,"internally_reserved":0,"allocated":11210752,"data_stored":25258133,"data_compressed":3535502,"data_compressed_allocated":4878336,"data_compressed_original":19124224,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":19,"apply_latency_ms":19,"commit_latency_ns":19000000,"apply_latency_ns":19000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574898,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":70952,"kb_used_data":17568,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94300888,"statfs":{"total":96636764160,"available":96564109312,"internally_reserved":0,"allocated":17989632,"data_stored":46227051,"data_compressed":6636651,"data_compressed_allocated":8818688,"data_compressed_original":37232640,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574899,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41684,"kb_used_data":10508,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94330156,"statfs":{"total":96636764160,"available":96594079744,"internally_reserved":0,"allocated":10760192,"data_stored":34430955,"data_compressed":5296110,"data_compressed_allocated":6660096,"data_compressed_original":30515200,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574898,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33936,"kb_used_data":2760,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94337904,"statfs":{"total":96636764160,"available":96602013696,"internally_reserved":0,"allocated":2826240,"data_stored":5752077,"data_compressed":755556,"data_compressed_allocated":1044480,"data_compressed_original":4157440,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574897,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":67656,"kb_used_data":10112,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94304184,"statfs":{"total":96636764160,"available":96567484416,"internally_reserved":0,"allocated":10354688,"data_stored":25255151,"data_compressed":3481816,"data_compressed_allocated":4526080,"data_compressed_original":19607552,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,7],"upper_bound":128},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574896,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59948,"kb_used_data":10724,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94311892,"statfs":{"total":96636764160,"available":96575377408,"internally_reserved":0,"allocated":10981376,"data_stored":30039165,"data_compressed":4289346,"data_compressed_allocated":5672960,"data_compressed_original":24915968,"omap_allocated":1592,"internal_metadata":50395592},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33174,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33174,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":10674176,"data_stored":29361002,"data_compressed":4256172,"data_compressed_allocated":5627904,"data_compressed_original":24342528,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":10113024,"data_stored":25167356,"data_compressed":3481816,"data_compressed_allocated":4526080,"data_compressed_original":19607552,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":2584576,"data_stored":5664282,"data_compressed":755556,"data_compressed_allocated":1044480,"data_compressed_original":4157440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":10518528,"data_stored":34343160,"data_compressed":5296110,"data_compressed_allocated":6660096,"data_compressed_original":30515200,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":17747968,"data_stored":46139256,"data_compressed":6636651,"data_compressed_allocated":8818688,"data_compressed_original":37232640,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":10969088,"data_stored":25170338,"data_compressed":3535502,"data_compressed_allocated":4878336,"data_compressed_original":19124224,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":13623296,"data_stored":45458104,"data_compressed":7083231,"data_compressed_allocated":9031680,"data_compressed_original":40890368,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":15314944,"data_stored":50334330,"data_compressed":7557996,"data_compressed_allocated":9596928,"data_compressed_original":44650496,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-17T23:59:49.421 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-17T23:59:49.570 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:49.567+0000 7fef365b6640 1 Processor -- start 2024-03-17T23:59:49.570 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:49.567+0000 7fef365b6640 1 -- start start 2024-03-17T23:59:49.571 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:49.567+0000 7fef365b6640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fef30151f30 0x7fef30157e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:59:49.571 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:49.567+0000 7fef365b6640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fef3006d240 0x7fef300c68a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:59:49.571 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:49.567+0000 7fef365b6640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fef30152310 con 0x7fef3006e270 2024-03-17T23:59:49.571 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:49.567+0000 7fef365b6640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 -- 0x7fef3015c3e0 con 0x7fef30151f30 2024-03-17T23:59:49.571 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:49.567+0000 7fef365b6640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7fef3015b840 con 0x7fef3006d240 2024-03-17T23:59:49.571 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:49.567+0000 7fef34b53640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fef3006d240 0x7fef300c68a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:59:49.571 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:49.567+0000 7fef2f7fe640 1 --1- >> v1:172.21.15.204:6789/0 conn(0x7fef3006e270 0x7fef3015bcd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.204:6789/0 says I am v1:172.21.15.196:38960/0 (socket says 172.21.15.196:38960) 2024-03-17T23:59:49.571 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:49.567+0000 7fef2f7fe640 1 -- 172.21.15.196:0/15475960 learned_addr learned my addr 172.21.15.196:0/15475960 (peer_addr_for_me v1:172.21.15.196:0/0) 2024-03-17T23:59:49.571 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:49.567+0000 7fef2ffff640 1 --2- 172.21.15.196:0/15475960 >> v2:172.21.15.204:3300/0 conn(0x7fef30151f30 0x7fef30157e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:59:49.572 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:49.567+0000 7fef2effd640 1 -- 172.21.15.196:0/15475960 <== mon.1 v1:172.21.15.204:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1649420978 0 0) 0x7fef30152310 con 0x7fef3006e270 2024-03-17T23:59:49.572 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:49.567+0000 7fef2effd640 1 -- 172.21.15.196:0/15475960 --> v1:172.21.15.204:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fef18003530 con 0x7fef3006e270 2024-03-17T23:59:49.573 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:49.567+0000 7fef34b53640 1 -- 172.21.15.196:0/15475960 >> v2:172.21.15.204:3300/0 conn(0x7fef30151f30 msgr2=0x7fef30157e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-17T23:59:49.573 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:49.567+0000 7fef34b53640 1 --2- 172.21.15.196:0/15475960 >> v2:172.21.15.204:3300/0 conn(0x7fef30151f30 0x7fef30157e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:59:49.573 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:49.567+0000 7fef34b53640 1 -- 172.21.15.196:0/15475960 >> v1:172.21.15.204:6789/0 conn(0x7fef3006e270 legacy=0x7fef3015bcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:59:49.573 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:49.567+0000 7fef34b53640 1 -- 172.21.15.196:0/15475960 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef301584d0 con 0x7fef3006d240 2024-03-17T23:59:49.573 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:49.567+0000 7fef2ffff640 1 --2- 172.21.15.196:0/15475960 >> v2:172.21.15.204:3300/0 conn(0x7fef30151f30 0x7fef30157e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-17T23:59:49.574 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:49.571+0000 7fef34b53640 1 --2- 172.21.15.196:0/15475960 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fef3006d240 0x7fef300c68a0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fef28009d90 tx=0x7fef2801f150 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9d10eefa1131b091 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:59:49.574 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:49.571+0000 7fef2effd640 1 -- 172.21.15.196:0/15475960 <== mon.2 v2:172.21.15.204:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef280b4070 con 0x7fef3006d240 2024-03-17T23:59:49.574 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:49.571+0000 7fef2effd640 1 -- 172.21.15.196:0/15475960 <== mon.2 v2:172.21.15.204:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef280af600 con 0x7fef3006d240 2024-03-17T23:59:49.574 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:49.571+0000 7fef2effd640 1 -- 172.21.15.196:0/15475960 <== mon.2 v2:172.21.15.204:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef280af9b0 con 0x7fef3006d240 2024-03-17T23:59:49.575 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:49.571+0000 7fef365b6640 1 -- 172.21.15.196:0/15475960 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fef3006d240 msgr2=0x7fef300c68a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:59:49.575 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:49.571+0000 7fef365b6640 1 --2- 172.21.15.196:0/15475960 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fef3006d240 0x7fef300c68a0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fef28009d90 tx=0x7fef2801f150 comp rx=0 tx=0).stop 2024-03-17T23:59:49.575 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:49.571+0000 7fef365b6640 1 -- 172.21.15.196:0/15475960 shutdown_connections 2024-03-17T23:59:49.575 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:49.571+0000 7fef365b6640 1 --2- 172.21.15.196:0/15475960 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fef3006d240 0x7fef300c68a0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:59:49.575 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:49.571+0000 7fef365b6640 1 --2- 172.21.15.196:0/15475960 >> v2:172.21.15.204:3300/0 conn(0x7fef30151f30 0x7fef30157e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:59:49.575 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:49.571+0000 7fef365b6640 1 -- 172.21.15.196:0/15475960 >> 172.21.15.196:0/15475960 conn(0x7fef300c89a0 msgr2=0x7fef300c8db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-17T23:59:49.575 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:49.571+0000 7fef365b6640 1 -- 172.21.15.196:0/15475960 shutdown_connections 2024-03-17T23:59:49.575 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:49.571+0000 7fef365b6640 1 -- 172.21.15.196:0/15475960 wait complete. 2024-03-17T23:59:49.578 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:49.571+0000 7fef365b6640 1 Processor -- start 2024-03-17T23:59:49.578 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:49.571+0000 7fef365b6640 1 -- start start 2024-03-17T23:59:49.578 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:49.575+0000 7fef365b6640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fef3006d240 0x7fef30148d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:59:49.578 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:49.575+0000 7fef365b6640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fef3006e270 0x7fef301498e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:59:49.578 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:49.575+0000 7fef365b6640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fef30151f30 0x7fef301574e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:59:49.578 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:49.575+0000 7fef365b6640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fef30158d70 con 0x7fef3006d240 2024-03-17T23:59:49.578 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:49.575+0000 7fef365b6640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7fef30158a90 con 0x7fef3006e270 2024-03-17T23:59:49.578 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:49.575+0000 7fef365b6640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7fef3015b4d0 con 0x7fef30151f30 2024-03-17T23:59:49.578 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:49.575+0000 7fef2ffff640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fef3006d240 0x7fef30148d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:59:49.578 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:49.575+0000 7fef2ffff640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fef3006d240 0x7fef30148d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.196:34244/0 (socket says 172.21.15.196:34244) 2024-03-17T23:59:49.579 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:49.575+0000 7fef2ffff640 1 -- 172.21.15.196:0/2022134063 learned_addr learned my addr 172.21.15.196:0/2022134063 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-03-17T23:59:49.579 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:49.575+0000 7fef34b53640 1 --2- 172.21.15.196:0/2022134063 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fef30151f30 0x7fef301574e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:59:49.579 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:49.575+0000 7fef2f7fe640 1 --2- 172.21.15.196:0/2022134063 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fef3006e270 0x7fef301498e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:59:49.579 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:49.575+0000 7fef2ffff640 1 -- 172.21.15.196:0/2022134063 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fef30151f30 msgr2=0x7fef301574e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:59:49.579 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:49.575+0000 7fef2ffff640 1 --2- 172.21.15.196:0/2022134063 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fef30151f30 0x7fef301574e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:59:49.579 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:49.575+0000 7fef2ffff640 1 -- 172.21.15.196:0/2022134063 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fef3006e270 msgr2=0x7fef301498e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:59:49.579 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:49.575+0000 7fef2ffff640 1 --2- 172.21.15.196:0/2022134063 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fef3006e270 0x7fef301498e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:59:49.579 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:49.575+0000 7fef2ffff640 1 -- 172.21.15.196:0/2022134063 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef300c3df0 con 0x7fef3006d240 2024-03-17T23:59:49.579 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:49.575+0000 7fef2f7fe640 1 --2- 172.21.15.196:0/2022134063 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fef3006e270 0x7fef301498e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-17T23:59:49.579 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:49.575+0000 7fef2ffff640 1 --2- 172.21.15.196:0/2022134063 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fef3006d240 0x7fef30148d80 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fef2000e980 tx=0x7fef2000ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:59:49.579 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:49.575+0000 7fef2cff9640 1 -- 172.21.15.196:0/2022134063 <== mon.0 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef20017070 con 0x7fef3006d240 2024-03-17T23:59:49.579 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:49.575+0000 7fef2cff9640 1 -- 172.21.15.196:0/2022134063 <== mon.0 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef2000ca00 con 0x7fef3006d240 2024-03-17T23:59:49.579 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:49.575+0000 7fef365b6640 1 -- 172.21.15.196:0/2022134063 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef300c3b10 con 0x7fef3006d240 2024-03-17T23:59:49.580 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:49.575+0000 7fef2cff9640 1 -- 172.21.15.196:0/2022134063 <== mon.0 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef2000cdd0 con 0x7fef3006d240 2024-03-17T23:59:49.580 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:49.575+0000 7fef365b6640 1 -- 172.21.15.196:0/2022134063 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef300c4e20 con 0x7fef3006d240 2024-03-17T23:59:49.580 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:49.575+0000 7fef365b6640 1 -- 172.21.15.196:0/2022134063 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fef100052a0 con 0x7fef3006d240 2024-03-17T23:59:49.581 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:49.575+0000 7fef2cff9640 1 -- 172.21.15.196:0/2022134063 <== mon.0 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 5) ==== 87083+0+0 (secure 0 0 0) 0x7fef2001a070 con 0x7fef3006d240 2024-03-17T23:59:49.581 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:49.575+0000 7fef2cff9640 1 --2- 172.21.15.196:0/2022134063 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7fef1c067660 0x7fef1c069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:59:49.581 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:49.575+0000 7fef2cff9640 1 -- 172.21.15.196:0/2022134063 <== mon.0 v2:172.21.15.196:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7fef20085770 con 0x7fef3006d240 2024-03-17T23:59:49.581 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:49.575+0000 7fef2f7fe640 1 --2- 172.21.15.196:0/2022134063 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7fef1c067660 0x7fef1c069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:59:49.581 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:49.575+0000 7fef2f7fe640 1 --2- 172.21.15.196:0/2022134063 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7fef1c067660 0x7fef1c069b20 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fef30149520 tx=0x7fef24009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:59:49.587 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:49.583+0000 7fef2cff9640 1 -- 172.21.15.196:0/2022134063 <== mon.0 v2:172.21.15.196:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177849 (secure 0 0 0) 0x7fef20055d20 con 0x7fef3006d240 2024-03-17T23:59:49.784 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:49.779+0000 7fef365b6640 1 -- 172.21.15.196:0/2022134063 --> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fef10000bd0 con 0x7fef1c067660 2024-03-17T23:59:49.801 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:49.799+0000 7fef2cff9640 1 -- 172.21.15.196:0/2022134063 <== mgr.4099 v2:172.21.15.204:6832/2505201055 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+254275 (secure 0 0 0) 0x7fef10000bd0 con 0x7fef1c067660 2024-03-17T23:59:49.803 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-03-17T23:59:49.805 INFO:teuthology.orchestra.run.smithi196.stderr:dumped all 2024-03-17T23:59:49.806 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:49.803+0000 7fef365b6640 1 -- 172.21.15.196:0/2022134063 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7fef1c067660 msgr2=0x7fef1c069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:59:49.806 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:49.803+0000 7fef365b6640 1 --2- 172.21.15.196:0/2022134063 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7fef1c067660 0x7fef1c069b20 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fef30149520 tx=0x7fef24009040 comp rx=0 tx=0).stop 2024-03-17T23:59:49.806 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:49.803+0000 7fef365b6640 1 -- 172.21.15.196:0/2022134063 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fef3006d240 msgr2=0x7fef30148d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:59:49.806 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:49.803+0000 7fef365b6640 1 --2- 172.21.15.196:0/2022134063 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fef3006d240 0x7fef30148d80 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fef2000e980 tx=0x7fef2000ee40 comp rx=0 tx=0).stop 2024-03-17T23:59:49.806 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:49.803+0000 7fef365b6640 1 -- 172.21.15.196:0/2022134063 shutdown_connections 2024-03-17T23:59:49.806 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:49.803+0000 7fef365b6640 1 --2- 172.21.15.196:0/2022134063 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7fef1c067660 0x7fef1c069b20 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:59:49.806 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:49.803+0000 7fef365b6640 1 --2- 172.21.15.196:0/2022134063 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fef30151f30 0x7fef301574e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:59:49.806 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:49.803+0000 7fef365b6640 1 --2- 172.21.15.196:0/2022134063 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fef3006e270 0x7fef301498e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:59:49.807 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:49.803+0000 7fef365b6640 1 --2- 172.21.15.196:0/2022134063 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fef3006d240 0x7fef30148d80 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:59:49.807 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:49.803+0000 7fef365b6640 1 -- 172.21.15.196:0/2022134063 >> 172.21.15.196:0/2022134063 conn(0x7fef300c89a0 msgr2=0x7fef30150960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-17T23:59:49.807 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:49.803+0000 7fef365b6640 1 -- 172.21.15.196:0/2022134063 shutdown_connections 2024-03-17T23:59:49.807 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:49.803+0000 7fef365b6640 1 -- 172.21.15.196:0/2022134063 wait complete. 2024-03-17T23:59:49.821 INFO:teuthology.orchestra.run.smithi196.stdout:{"pg_ready":true,"pg_map":{"version":133,"stamp":"2024-03-17T23:59:48.028164+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":131409282,"num_objects":131,"num_object_clones":0,"num_object_copies":262,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":131,"num_whiteouts":0,"num_read":3164,"num_read_kb":1535472,"num_write":30477,"num_write_kb":4409625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":34009,"ondisk_log_size":34009,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":451864,"kb_used_data":91416,"kb_used_omap":12,"kb_used_meta":360371,"kb_avail":754522856,"statfs":{"total":773094113280,"available":772631404544,"internally_reserved":0,"allocated":93609984,"data_stored":263520924,"data_compressed":38669382,"data_compressed_allocated":50274304,"data_compressed_original":221667328,"omap_allocated":12748,"internal_metadata":369020468},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,7],"upper_bound":128},"perf_stat":{"commit_latency_ms":68,"apply_latency_ms":68,"commit_latency_ns":68000000,"apply_latency_ns":68000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-6303676,"num_objects":-1292,"num_object_clones":0,"num_object_copies":-2584,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-1292,"num_whiteouts":0,"num_read":19,"num_read_kb":164,"num_write":1475,"num_write_kb":4172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004271"},"pg_stats":[{"pgid":"3.3f","version":"23'416","reported_seq":466,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:42.798627+0000","last_change":"2024-03-17T23:56:01.208245+0000","last_active":"2024-03-17T23:59:42.798627+0000","last_peered":"2024-03-17T23:59:42.798627+0000","last_clean":"2024-03-17T23:59:42.798627+0000","last_became_active":"2024-03-17T23:56:01.207533+0000","last_became_peered":"2024-03-17T23:56:01.207533+0000","last_unstale":"2024-03-17T23:59:42.798627+0000","last_undegraded":"2024-03-17T23:59:42.798627+0000","last_fullsized":"2024-03-17T23:59:42.798627+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":416,"log_dups_size":0,"ondisk_log_size":416,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T09:33:28.935701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":22799,"num_write":382,"num_write_kb":63271,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"23'451","reported_seq":558,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:42.769225+0000","last_change":"2024-03-17T23:56:01.193546+0000","last_active":"2024-03-17T23:59:42.769225+0000","last_peered":"2024-03-17T23:59:42.769225+0000","last_clean":"2024-03-17T23:59:42.769225+0000","last_became_active":"2024-03-17T23:56:01.192736+0000","last_became_peered":"2024-03-17T23:56:01.192736+0000","last_unstale":"2024-03-17T23:59:42.769225+0000","last_undegraded":"2024-03-17T23:59:42.769225+0000","last_fullsized":"2024-03-17T23:59:42.769225+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":451,"log_dups_size":0,"ondisk_log_size":451,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T07:03:18.208772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":90,"num_read_kb":44601,"num_write":422,"num_write_kb":92038,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"23'361","reported_seq":395,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:42.770813+0000","last_change":"2024-03-17T23:56:01.188859+0000","last_active":"2024-03-17T23:59:42.770813+0000","last_peered":"2024-03-17T23:59:42.770813+0000","last_clean":"2024-03-17T23:59:42.770813+0000","last_became_active":"2024-03-17T23:56:01.188339+0000","last_became_peered":"2024-03-17T23:56:01.188339+0000","last_unstale":"2024-03-17T23:59:42.770813+0000","last_undegraded":"2024-03-17T23:59:42.770813+0000","last_fullsized":"2024-03-17T23:59:42.770813+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":361,"log_dups_size":0,"ondisk_log_size":361,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T05:26:03.654839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":9522,"num_write":340,"num_write_kb":42370,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"23'375","reported_seq":429,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:42.797389+0000","last_change":"2024-03-17T23:56:01.204810+0000","last_active":"2024-03-17T23:59:42.797389+0000","last_peered":"2024-03-17T23:59:42.797389+0000","last_clean":"2024-03-17T23:59:42.797389+0000","last_became_active":"2024-03-17T23:56:01.196978+0000","last_became_peered":"2024-03-17T23:56:01.196978+0000","last_unstale":"2024-03-17T23:59:42.797389+0000","last_undegraded":"2024-03-17T23:59:42.797389+0000","last_fullsized":"2024-03-17T23:59:42.797389+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":375,"log_dups_size":0,"ondisk_log_size":375,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T06:25:58.489959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":11889,"num_write":341,"num_write_kb":42361,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"23'410","reported_seq":465,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:42.776537+0000","last_change":"2024-03-17T23:56:01.195423+0000","last_active":"2024-03-17T23:59:42.776537+0000","last_peered":"2024-03-17T23:59:42.776537+0000","last_clean":"2024-03-17T23:59:42.776537+0000","last_became_active":"2024-03-17T23:56:01.194710+0000","last_became_peered":"2024-03-17T23:56:01.194710+0000","last_unstale":"2024-03-17T23:59:42.776537+0000","last_undegraded":"2024-03-17T23:59:42.776537+0000","last_fullsized":"2024-03-17T23:59:42.776537+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":410,"log_dups_size":0,"ondisk_log_size":410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T06:25:58.489959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":20292,"num_write":376,"num_write_kb":22112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"23'379","reported_seq":420,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:42.791477+0000","last_change":"2024-03-17T23:56:01.204633+0000","last_active":"2024-03-17T23:59:42.791477+0000","last_peered":"2024-03-17T23:59:42.791477+0000","last_clean":"2024-03-17T23:59:42.791477+0000","last_became_active":"2024-03-17T23:56:01.192908+0000","last_became_peered":"2024-03-17T23:56:01.192908+0000","last_unstale":"2024-03-17T23:59:42.791477+0000","last_undegraded":"2024-03-17T23:59:42.791477+0000","last_fullsized":"2024-03-17T23:59:42.791477+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":379,"log_dups_size":0,"ondisk_log_size":379,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T03:49:46.522282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":17487,"num_write":350,"num_write_kb":34234,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"23'439","reported_seq":524,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:42.780782+0000","last_change":"2024-03-17T23:56:01.208861+0000","last_active":"2024-03-17T23:59:42.780782+0000","last_peered":"2024-03-17T23:59:42.780782+0000","last_clean":"2024-03-17T23:59:42.780782+0000","last_became_active":"2024-03-17T23:56:01.199550+0000","last_became_peered":"2024-03-17T23:56:01.199550+0000","last_unstale":"2024-03-17T23:59:42.780782+0000","last_undegraded":"2024-03-17T23:59:42.780782+0000","last_fullsized":"2024-03-17T23:59:42.780782+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T00:21:36.556648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":32233,"num_write":412,"num_write_kb":77021,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"23'355","reported_seq":410,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:42.798751+0000","last_change":"2024-03-17T23:56:01.212574+0000","last_active":"2024-03-17T23:59:42.798751+0000","last_peered":"2024-03-17T23:59:42.798751+0000","last_clean":"2024-03-17T23:59:42.798751+0000","last_became_active":"2024-03-17T23:56:01.211860+0000","last_became_peered":"2024-03-17T23:56:01.211860+0000","last_unstale":"2024-03-17T23:59:42.798751+0000","last_undegraded":"2024-03-17T23:59:42.798751+0000","last_fullsized":"2024-03-17T23:59:42.798751+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":355,"log_dups_size":0,"ondisk_log_size":355,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T02:15:18.353466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":19734,"num_write":322,"num_write_kb":51043,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"23'422","reported_seq":471,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:42.803353+0000","last_change":"2024-03-17T23:56:01.214731+0000","last_active":"2024-03-17T23:59:42.803353+0000","last_peered":"2024-03-17T23:59:42.803353+0000","last_clean":"2024-03-17T23:59:42.803353+0000","last_became_active":"2024-03-17T23:56:01.213795+0000","last_became_peered":"2024-03-17T23:56:01.213795+0000","last_unstale":"2024-03-17T23:59:42.803353+0000","last_undegraded":"2024-03-17T23:59:42.803353+0000","last_fullsized":"2024-03-17T23:59:42.803353+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":422,"log_dups_size":0,"ondisk_log_size":422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T11:32:23.716236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":22221,"num_write":389,"num_write_kb":59485,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"23'402","reported_seq":455,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:42.803564+0000","last_change":"2024-03-17T23:56:01.212409+0000","last_active":"2024-03-17T23:59:42.803564+0000","last_peered":"2024-03-17T23:59:42.803564+0000","last_clean":"2024-03-17T23:59:42.803564+0000","last_became_active":"2024-03-17T23:56:01.211620+0000","last_became_peered":"2024-03-17T23:56:01.211620+0000","last_unstale":"2024-03-17T23:59:42.803564+0000","last_undegraded":"2024-03-17T23:59:42.803564+0000","last_fullsized":"2024-03-17T23:59:42.803564+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T11:40:55.653472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":18482,"num_write":357,"num_write_kb":55072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"23'371","reported_seq":425,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:42.800374+0000","last_change":"2024-03-17T23:56:01.212568+0000","last_active":"2024-03-17T23:59:42.800374+0000","last_peered":"2024-03-17T23:59:42.800374+0000","last_clean":"2024-03-17T23:59:42.800374+0000","last_became_active":"2024-03-17T23:56:01.211561+0000","last_became_peered":"2024-03-17T23:56:01.211561+0000","last_unstale":"2024-03-17T23:59:42.800374+0000","last_undegraded":"2024-03-17T23:59:42.800374+0000","last_fullsized":"2024-03-17T23:59:42.800374+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":371,"log_dups_size":0,"ondisk_log_size":371,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T02:46:13.650384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":21281,"num_write":349,"num_write_kb":38541,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"23'389","reported_seq":431,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:42.785259+0000","last_change":"2024-03-17T23:56:01.186811+0000","last_active":"2024-03-17T23:59:42.785259+0000","last_peered":"2024-03-17T23:59:42.785259+0000","last_clean":"2024-03-17T23:59:42.785259+0000","last_became_active":"2024-03-17T23:56:01.186012+0000","last_became_peered":"2024-03-17T23:56:01.186012+0000","last_unstale":"2024-03-17T23:59:42.785259+0000","last_undegraded":"2024-03-17T23:59:42.785259+0000","last_fullsized":"2024-03-17T23:59:42.785259+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":389,"log_dups_size":0,"ondisk_log_size":389,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T10:35:20.142750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":10579,"num_write":363,"num_write_kb":91649,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"23'398","reported_seq":463,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:42.784930+0000","last_change":"2024-03-17T23:56:01.213648+0000","last_active":"2024-03-17T23:59:42.784930+0000","last_peered":"2024-03-17T23:59:42.784930+0000","last_clean":"2024-03-17T23:59:42.784930+0000","last_became_active":"2024-03-17T23:56:01.205058+0000","last_became_peered":"2024-03-17T23:56:01.205058+0000","last_unstale":"2024-03-17T23:59:42.784930+0000","last_undegraded":"2024-03-17T23:59:42.784930+0000","last_fullsized":"2024-03-17T23:59:42.784930+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T03:49:46.522282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":19128,"num_write":366,"num_write_kb":47322,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"23'424","reported_seq":494,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:42.778219+0000","last_change":"2024-03-17T23:56:01.196817+0000","last_active":"2024-03-17T23:59:42.778219+0000","last_peered":"2024-03-17T23:59:42.778219+0000","last_clean":"2024-03-17T23:59:42.778219+0000","last_became_active":"2024-03-17T23:56:01.195960+0000","last_became_peered":"2024-03-17T23:56:01.195960+0000","last_unstale":"2024-03-17T23:59:42.778219+0000","last_undegraded":"2024-03-17T23:59:42.778219+0000","last_fullsized":"2024-03-17T23:59:42.778219+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T10:13:51.662432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":28789,"num_write":400,"num_write_kb":133401,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"23'431","reported_seq":488,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:42.790618+0000","last_change":"2024-03-17T23:56:01.182140+0000","last_active":"2024-03-17T23:59:42.790618+0000","last_peered":"2024-03-17T23:59:42.790618+0000","last_clean":"2024-03-17T23:59:42.790618+0000","last_became_active":"2024-03-17T23:56:01.181405+0000","last_became_peered":"2024-03-17T23:56:01.181405+0000","last_unstale":"2024-03-17T23:59:42.790618+0000","last_undegraded":"2024-03-17T23:59:42.790618+0000","last_fullsized":"2024-03-17T23:59:42.790618+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":431,"log_dups_size":0,"ondisk_log_size":431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T02:46:13.650384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":18708,"num_write":399,"num_write_kb":108829,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"23'444","reported_seq":492,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:42.794403+0000","last_change":"2024-03-17T23:56:01.194871+0000","last_active":"2024-03-17T23:59:42.794403+0000","last_peered":"2024-03-17T23:59:42.794403+0000","last_clean":"2024-03-17T23:59:42.794403+0000","last_became_active":"2024-03-17T23:56:01.193384+0000","last_became_peered":"2024-03-17T23:56:01.193384+0000","last_unstale":"2024-03-17T23:59:42.794403+0000","last_undegraded":"2024-03-17T23:59:42.794403+0000","last_fullsized":"2024-03-17T23:59:42.794403+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":444,"log_dups_size":0,"ondisk_log_size":444,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T11:40:55.653472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":15377,"num_write":410,"num_write_kb":59358,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"23'402","reported_seq":442,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:42.794413+0000","last_change":"2024-03-17T23:56:49.201529+0000","last_active":"2024-03-17T23:59:42.794413+0000","last_peered":"2024-03-17T23:59:42.794413+0000","last_clean":"2024-03-17T23:59:42.794413+0000","last_became_active":"2024-03-17T23:56:49.201243+0000","last_became_peered":"2024-03-17T23:56:49.201243+0000","last_unstale":"2024-03-17T23:59:42.794413+0000","last_undegraded":"2024-03-17T23:59:42.794413+0000","last_fullsized":"2024-03-17T23:59:42.794413+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T11:01:47.143880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":17500,"num_write":362,"num_write_kb":30628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"23'423","reported_seq":524,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:42.790589+0000","last_change":"2024-03-17T23:56:01.186830+0000","last_active":"2024-03-17T23:59:42.790589+0000","last_peered":"2024-03-17T23:59:42.790589+0000","last_clean":"2024-03-17T23:59:42.790589+0000","last_became_active":"2024-03-17T23:56:01.186001+0000","last_became_peered":"2024-03-17T23:56:01.186001+0000","last_unstale":"2024-03-17T23:59:42.790589+0000","last_undegraded":"2024-03-17T23:59:42.790589+0000","last_fullsized":"2024-03-17T23:59:42.790589+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T01:56:02.340062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":84,"num_read_kb":38931,"num_write":386,"num_write_kb":103946,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"23'421","reported_seq":493,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:42.782611+0000","last_change":"2024-03-17T23:56:01.195354+0000","last_active":"2024-03-17T23:59:42.782611+0000","last_peered":"2024-03-17T23:59:42.782611+0000","last_clean":"2024-03-17T23:59:42.782611+0000","last_became_active":"2024-03-17T23:56:01.194579+0000","last_became_peered":"2024-03-17T23:56:01.194579+0000","last_unstale":"2024-03-17T23:59:42.782611+0000","last_undegraded":"2024-03-17T23:59:42.782611+0000","last_fullsized":"2024-03-17T23:59:42.782611+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T07:53:44.598091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":55,"num_read_kb":28885,"num_write":381,"num_write_kb":71633,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"23'457","reported_seq":552,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:42.792052+0000","last_change":"2024-03-17T23:56:01.193429+0000","last_active":"2024-03-17T23:59:42.792052+0000","last_peered":"2024-03-17T23:59:42.792052+0000","last_clean":"2024-03-17T23:59:42.792052+0000","last_became_active":"2024-03-17T23:56:01.192711+0000","last_became_peered":"2024-03-17T23:56:01.192711+0000","last_unstale":"2024-03-17T23:59:42.792052+0000","last_undegraded":"2024-03-17T23:59:42.792052+0000","last_fullsized":"2024-03-17T23:59:42.792052+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":457,"log_dups_size":0,"ondisk_log_size":457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T08:24:06.922044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":48668,"num_write":427,"num_write_kb":117132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"23'407","reported_seq":460,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:42.798540+0000","last_change":"2024-03-17T23:56:01.203203+0000","last_active":"2024-03-17T23:59:42.798540+0000","last_peered":"2024-03-17T23:59:42.798540+0000","last_clean":"2024-03-17T23:59:42.798540+0000","last_became_active":"2024-03-17T23:56:01.202491+0000","last_became_peered":"2024-03-17T23:56:01.202491+0000","last_unstale":"2024-03-17T23:59:42.798540+0000","last_undegraded":"2024-03-17T23:59:42.798540+0000","last_fullsized":"2024-03-17T23:59:42.798540+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T11:35:21.037222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":19175,"num_write":379,"num_write_kb":50742,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"23'423","reported_seq":479,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:42.783044+0000","last_change":"2024-03-17T23:56:49.199752+0000","last_active":"2024-03-17T23:59:42.783044+0000","last_peered":"2024-03-17T23:59:42.783044+0000","last_clean":"2024-03-17T23:59:42.783044+0000","last_became_active":"2024-03-17T23:56:49.199410+0000","last_became_peered":"2024-03-17T23:56:49.199410+0000","last_unstale":"2024-03-17T23:59:42.783044+0000","last_undegraded":"2024-03-17T23:59:42.783044+0000","last_fullsized":"2024-03-17T23:59:42.783044+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T03:18:40.457769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":41103,"num_write":390,"num_write_kb":67292,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.29","version":"23'406","reported_seq":463,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:42.787483+0000","last_change":"2024-03-17T23:56:01.213157+0000","last_active":"2024-03-17T23:59:42.787483+0000","last_peered":"2024-03-17T23:59:42.787483+0000","last_clean":"2024-03-17T23:59:42.787483+0000","last_became_active":"2024-03-17T23:56:01.205601+0000","last_became_peered":"2024-03-17T23:56:01.205601+0000","last_unstale":"2024-03-17T23:59:42.787483+0000","last_undegraded":"2024-03-17T23:59:42.787483+0000","last_fullsized":"2024-03-17T23:59:42.787483+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T00:26:55.287891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":19558,"num_write":374,"num_write_kb":63755,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"23'448","reported_seq":535,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:42.794334+0000","last_change":"2024-03-17T23:56:01.194995+0000","last_active":"2024-03-17T23:59:42.794334+0000","last_peered":"2024-03-17T23:59:42.794334+0000","last_clean":"2024-03-17T23:59:42.794334+0000","last_became_active":"2024-03-17T23:56:01.194290+0000","last_became_peered":"2024-03-17T23:56:01.194290+0000","last_unstale":"2024-03-17T23:59:42.794334+0000","last_undegraded":"2024-03-17T23:59:42.794334+0000","last_fullsized":"2024-03-17T23:59:42.794334+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T07:03:18.208772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":70,"num_read_kb":26782,"num_write":421,"num_write_kb":88405,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"23'403","reported_seq":456,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:42.782500+0000","last_change":"2024-03-17T23:56:01.205233+0000","last_active":"2024-03-17T23:59:42.782500+0000","last_peered":"2024-03-17T23:59:42.782500+0000","last_clean":"2024-03-17T23:59:42.782500+0000","last_became_active":"2024-03-17T23:56:01.204456+0000","last_became_peered":"2024-03-17T23:56:01.204456+0000","last_unstale":"2024-03-17T23:59:42.782500+0000","last_undegraded":"2024-03-17T23:59:42.782500+0000","last_fullsized":"2024-03-17T23:59:42.782500+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":403,"log_dups_size":0,"ondisk_log_size":403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T06:25:58.489959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":21212,"num_write":389,"num_write_kb":62665,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"23'456","reported_seq":517,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:42.800573+0000","last_change":"2024-03-17T23:56:01.210984+0000","last_active":"2024-03-17T23:59:42.800573+0000","last_peered":"2024-03-17T23:59:42.800573+0000","last_clean":"2024-03-17T23:59:42.800573+0000","last_became_active":"2024-03-17T23:56:01.210025+0000","last_became_peered":"2024-03-17T23:56:01.210025+0000","last_unstale":"2024-03-17T23:59:42.800573+0000","last_undegraded":"2024-03-17T23:59:42.800573+0000","last_fullsized":"2024-03-17T23:59:42.800573+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":456,"log_dups_size":0,"ondisk_log_size":456,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T00:26:55.287891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":24179,"num_write":417,"num_write_kb":68058,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"23'406","reported_seq":488,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:42.757304+0000","last_change":"2024-03-17T23:56:01.205461+0000","last_active":"2024-03-17T23:59:42.757304+0000","last_peered":"2024-03-17T23:59:42.757304+0000","last_clean":"2024-03-17T23:59:42.757304+0000","last_became_active":"2024-03-17T23:56:01.204676+0000","last_became_peered":"2024-03-17T23:56:01.204676+0000","last_unstale":"2024-03-17T23:59:42.757304+0000","last_undegraded":"2024-03-17T23:59:42.757304+0000","last_fullsized":"2024-03-17T23:59:42.757304+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T11:40:55.653472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":32120,"num_write":380,"num_write_kb":55330,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"23'390","reported_seq":470,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:42.784777+0000","last_change":"2024-03-17T23:56:01.205530+0000","last_active":"2024-03-17T23:59:42.784777+0000","last_peered":"2024-03-17T23:59:42.784777+0000","last_clean":"2024-03-17T23:59:42.784777+0000","last_became_active":"2024-03-17T23:56:01.204637+0000","last_became_peered":"2024-03-17T23:56:01.204637+0000","last_unstale":"2024-03-17T23:59:42.784777+0000","last_undegraded":"2024-03-17T23:59:42.784777+0000","last_fullsized":"2024-03-17T23:59:42.784777+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T07:03:18.208772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":33745,"num_write":363,"num_write_kb":72094,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"23'405","reported_seq":483,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:42.789252+0000","last_change":"2024-03-17T23:56:01.207143+0000","last_active":"2024-03-17T23:59:42.789252+0000","last_peered":"2024-03-17T23:59:42.789252+0000","last_clean":"2024-03-17T23:59:42.789252+0000","last_became_active":"2024-03-17T23:56:01.206466+0000","last_became_peered":"2024-03-17T23:56:01.206466+0000","last_unstale":"2024-03-17T23:59:42.789252+0000","last_undegraded":"2024-03-17T23:59:42.789252+0000","last_fullsized":"2024-03-17T23:59:42.789252+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T02:46:13.650384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":31525,"num_write":373,"num_write_kb":67528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"23'457","reported_seq":519,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:42.791548+0000","last_change":"2024-03-17T23:56:01.205414+0000","last_active":"2024-03-17T23:59:42.791548+0000","last_peered":"2024-03-17T23:59:42.791548+0000","last_clean":"2024-03-17T23:59:42.791548+0000","last_became_active":"2024-03-17T23:56:01.204418+0000","last_became_peered":"2024-03-17T23:56:01.204418+0000","last_unstale":"2024-03-17T23:59:42.791548+0000","last_undegraded":"2024-03-17T23:59:42.791548+0000","last_fullsized":"2024-03-17T23:59:42.791548+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":457,"log_dups_size":0,"ondisk_log_size":457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T03:59:56.032635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":20620,"num_write":418,"num_write_kb":58690,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"23'455","reported_seq":528,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:42.798202+0000","last_change":"2024-03-17T23:56:01.213242+0000","last_active":"2024-03-17T23:59:42.798202+0000","last_peered":"2024-03-17T23:59:42.798202+0000","last_clean":"2024-03-17T23:59:42.798202+0000","last_became_active":"2024-03-17T23:56:01.212456+0000","last_became_peered":"2024-03-17T23:56:01.212456+0000","last_unstale":"2024-03-17T23:59:42.798202+0000","last_undegraded":"2024-03-17T23:59:42.798202+0000","last_fullsized":"2024-03-17T23:59:42.798202+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":455,"log_dups_size":0,"ondisk_log_size":455,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T11:11:33.525431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":21571,"num_write":428,"num_write_kb":105002,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"23'449","reported_seq":511,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:42.788396+0000","last_change":"2024-03-17T23:56:01.197502+0000","last_active":"2024-03-17T23:59:42.788396+0000","last_peered":"2024-03-17T23:59:42.788396+0000","last_clean":"2024-03-17T23:59:42.788396+0000","last_became_active":"2024-03-17T23:56:01.196672+0000","last_became_peered":"2024-03-17T23:56:01.196672+0000","last_unstale":"2024-03-17T23:59:42.788396+0000","last_undegraded":"2024-03-17T23:59:42.788396+0000","last_fullsized":"2024-03-17T23:59:42.788396+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":449,"log_dups_size":0,"ondisk_log_size":449,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T05:26:03.654839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":29527,"num_write":419,"num_write_kb":89588,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"23'417","reported_seq":480,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:42.782264+0000","last_change":"2024-03-17T23:56:01.169196+0000","last_active":"2024-03-17T23:59:42.782264+0000","last_peered":"2024-03-17T23:59:42.782264+0000","last_clean":"2024-03-17T23:59:42.782264+0000","last_became_active":"2024-03-17T23:56:01.168199+0000","last_became_peered":"2024-03-17T23:56:01.168199+0000","last_unstale":"2024-03-17T23:59:42.782264+0000","last_undegraded":"2024-03-17T23:59:42.782264+0000","last_fullsized":"2024-03-17T23:59:42.782264+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T11:11:33.525431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":34411,"num_write":387,"num_write_kb":91588,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"23'76","reported_seq":95,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:39.379696+0000","last_change":"2024-03-17T23:56:00.675134+0000","last_active":"2024-03-17T23:59:39.379696+0000","last_peered":"2024-03-17T23:59:39.379696+0000","last_clean":"2024-03-17T23:59:39.379696+0000","last_became_active":"2024-03-17T23:56:00.674772+0000","last_became_peered":"2024-03-17T23:56:00.674772+0000","last_unstale":"2024-03-17T23:59:39.379696+0000","last_undegraded":"2024-03-17T23:59:39.379696+0000","last_fullsized":"2024-03-17T23:59:39.379696+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_clean_scrub_stamp":"2024-03-17T23:55:59.626739+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T07:03:16.148691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4195508,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33,"num_write_kb":4113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"23'387","reported_seq":428,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:42.792854+0000","last_change":"2024-03-17T23:56:01.199837+0000","last_active":"2024-03-17T23:59:42.792854+0000","last_peered":"2024-03-17T23:59:42.792854+0000","last_clean":"2024-03-17T23:59:42.792854+0000","last_became_active":"2024-03-17T23:56:01.199084+0000","last_became_peered":"2024-03-17T23:56:01.199084+0000","last_unstale":"2024-03-17T23:59:42.792854+0000","last_undegraded":"2024-03-17T23:59:42.792854+0000","last_fullsized":"2024-03-17T23:59:42.792854+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":387,"log_dups_size":0,"ondisk_log_size":387,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T00:26:55.287891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":13388,"num_write":363,"num_write_kb":66558,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"23'376","reported_seq":395,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:38.393706+0000","last_change":"2024-03-17T23:56:00.683252+0000","last_active":"2024-03-17T23:59:38.393706+0000","last_peered":"2024-03-17T23:59:38.393706+0000","last_clean":"2024-03-17T23:59:38.393706+0000","last_became_active":"2024-03-17T23:56:00.682487+0000","last_became_peered":"2024-03-17T23:56:00.682487+0000","last_unstale":"2024-03-17T23:59:38.393706+0000","last_undegraded":"2024-03-17T23:59:38.393706+0000","last_fullsized":"2024-03-17T23:59:38.393706+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_clean_scrub_stamp":"2024-03-17T23:55:59.626739+0000","objects_scrubbed":0,"log_size":376,"log_dups_size":0,"ondisk_log_size":376,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T04:07:26.256885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":319,"num_write_kb":12441,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"23'246","reported_seq":265,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:38.403114+0000","last_change":"2024-03-17T23:56:00.688353+0000","last_active":"2024-03-17T23:59:38.403114+0000","last_peered":"2024-03-17T23:59:38.403114+0000","last_clean":"2024-03-17T23:59:38.403114+0000","last_became_active":"2024-03-17T23:56:00.688016+0000","last_became_peered":"2024-03-17T23:56:00.688016+0000","last_unstale":"2024-03-17T23:59:38.403114+0000","last_undegraded":"2024-03-17T23:59:38.403114+0000","last_fullsized":"2024-03-17T23:59:38.403114+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_clean_scrub_stamp":"2024-03-17T23:55:59.626739+0000","objects_scrubbed":0,"log_size":246,"log_dups_size":0,"ondisk_log_size":246,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T09:07:52.005791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":201,"num_write_kb":4204,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"23'436","reported_seq":488,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:42.768722+0000","last_change":"2024-03-17T23:56:01.211541+0000","last_active":"2024-03-17T23:59:42.768722+0000","last_peered":"2024-03-17T23:59:42.768722+0000","last_clean":"2024-03-17T23:59:42.768722+0000","last_became_active":"2024-03-17T23:56:01.205709+0000","last_became_peered":"2024-03-17T23:56:01.205709+0000","last_unstale":"2024-03-17T23:59:42.768722+0000","last_undegraded":"2024-03-17T23:59:42.768722+0000","last_fullsized":"2024-03-17T23:59:42.768722+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":436,"log_dups_size":0,"ondisk_log_size":436,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T11:35:21.037222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":21447,"num_write":401,"num_write_kb":58853,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"23'777","reported_seq":796,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:37.491924+0000","last_change":"2024-03-17T23:56:00.690234+0000","last_active":"2024-03-17T23:59:37.491924+0000","last_peered":"2024-03-17T23:59:37.491924+0000","last_clean":"2024-03-17T23:59:37.491924+0000","last_became_active":"2024-03-17T23:56:00.689202+0000","last_became_peered":"2024-03-17T23:56:00.689202+0000","last_unstale":"2024-03-17T23:59:37.491924+0000","last_undegraded":"2024-03-17T23:59:37.491924+0000","last_fullsized":"2024-03-17T23:59:37.491924+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_clean_scrub_stamp":"2024-03-17T23:55:59.626739+0000","objects_scrubbed":0,"log_size":777,"log_dups_size":0,"ondisk_log_size":777,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T05:52:39.451210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389190,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":707,"num_write_kb":8542,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"23'416","reported_seq":458,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:42.763828+0000","last_change":"2024-03-17T23:56:49.077939+0000","last_active":"2024-03-17T23:59:42.763828+0000","last_peered":"2024-03-17T23:59:42.763828+0000","last_clean":"2024-03-17T23:59:42.763828+0000","last_became_active":"2024-03-17T23:56:49.077645+0000","last_became_peered":"2024-03-17T23:56:49.077645+0000","last_unstale":"2024-03-17T23:59:42.763828+0000","last_undegraded":"2024-03-17T23:59:42.763828+0000","last_fullsized":"2024-03-17T23:59:42.763828+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":416,"log_dups_size":0,"ondisk_log_size":416,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T09:27:16.124506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":16384,"num_write":381,"num_write_kb":66829,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"23'56","reported_seq":75,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:42.707701+0000","last_change":"2024-03-17T23:56:00.696649+0000","last_active":"2024-03-17T23:59:42.707701+0000","last_peered":"2024-03-17T23:59:42.707701+0000","last_clean":"2024-03-17T23:59:42.707701+0000","last_became_active":"2024-03-17T23:56:00.696307+0000","last_became_peered":"2024-03-17T23:56:00.696307+0000","last_unstale":"2024-03-17T23:59:42.707701+0000","last_undegraded":"2024-03-17T23:59:42.707701+0000","last_fullsized":"2024-03-17T23:59:42.707701+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_clean_scrub_stamp":"2024-03-17T23:55:59.626739+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T07:28:27.310340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"23'399","reported_seq":426,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:42.797918+0000","last_change":"2024-03-17T23:56:01.194103+0000","last_active":"2024-03-17T23:59:42.797918+0000","last_peered":"2024-03-17T23:59:42.797918+0000","last_clean":"2024-03-17T23:59:42.797918+0000","last_became_active":"2024-03-17T23:56:01.193354+0000","last_became_peered":"2024-03-17T23:56:01.193354+0000","last_unstale":"2024-03-17T23:59:42.797918+0000","last_undegraded":"2024-03-17T23:59:42.797918+0000","last_fullsized":"2024-03-17T23:59:42.797918+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T00:21:36.556648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":5056,"num_write":368,"num_write_kb":26036,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"23'216","reported_seq":235,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:40.404457+0000","last_change":"2024-03-17T23:56:00.689876+0000","last_active":"2024-03-17T23:59:40.404457+0000","last_peered":"2024-03-17T23:59:40.404457+0000","last_clean":"2024-03-17T23:59:40.404457+0000","last_became_active":"2024-03-17T23:56:00.688667+0000","last_became_peered":"2024-03-17T23:56:00.688667+0000","last_unstale":"2024-03-17T23:59:40.404457+0000","last_undegraded":"2024-03-17T23:59:40.404457+0000","last_fullsized":"2024-03-17T23:59:40.404457+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_clean_scrub_stamp":"2024-03-17T23:55:59.626739+0000","objects_scrubbed":0,"log_size":216,"log_dups_size":0,"ondisk_log_size":216,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T09:45:24.650866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":150,"num_write_kb":4172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"23'399","reported_seq":431,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:42.775949+0000","last_change":"2024-03-17T23:56:49.085328+0000","last_active":"2024-03-17T23:59:42.775949+0000","last_peered":"2024-03-17T23:59:42.775949+0000","last_clean":"2024-03-17T23:59:42.775949+0000","last_became_active":"2024-03-17T23:56:49.085029+0000","last_became_peered":"2024-03-17T23:56:49.085029+0000","last_unstale":"2024-03-17T23:59:42.775949+0000","last_undegraded":"2024-03-17T23:59:42.775949+0000","last_fullsized":"2024-03-17T23:59:42.775949+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T06:47:05.968601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":4310,"num_write":367,"num_write_kb":43629,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"23'139","reported_seq":158,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:41.384518+0000","last_change":"2024-03-17T23:56:00.677495+0000","last_active":"2024-03-17T23:59:41.384518+0000","last_peered":"2024-03-17T23:59:41.384518+0000","last_clean":"2024-03-17T23:59:41.384518+0000","last_became_active":"2024-03-17T23:56:00.677165+0000","last_became_peered":"2024-03-17T23:56:00.677165+0000","last_unstale":"2024-03-17T23:59:41.384518+0000","last_undegraded":"2024-03-17T23:59:41.384518+0000","last_fullsized":"2024-03-17T23:59:41.384518+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_clean_scrub_stamp":"2024-03-17T23:55:59.626739+0000","objects_scrubbed":0,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T04:07:26.256885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":91,"num_write_kb":92,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"23'391","reported_seq":452,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:42.786019+0000","last_change":"2024-03-17T23:56:01.190913+0000","last_active":"2024-03-17T23:59:42.786019+0000","last_peered":"2024-03-17T23:59:42.786019+0000","last_clean":"2024-03-17T23:59:42.786019+0000","last_became_active":"2024-03-17T23:56:01.190191+0000","last_became_peered":"2024-03-17T23:56:01.190191+0000","last_unstale":"2024-03-17T23:59:42.786019+0000","last_undegraded":"2024-03-17T23:59:42.786019+0000","last_fullsized":"2024-03-17T23:59:42.786019+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T09:57:50.285832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":22035,"num_write":358,"num_write_kb":71462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"23'261","reported_seq":280,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:42.708202+0000","last_change":"2024-03-17T23:56:00.686597+0000","last_active":"2024-03-17T23:59:42.708202+0000","last_peered":"2024-03-17T23:59:42.708202+0000","last_clean":"2024-03-17T23:59:42.708202+0000","last_became_active":"2024-03-17T23:56:00.685757+0000","last_became_peered":"2024-03-17T23:56:00.685757+0000","last_unstale":"2024-03-17T23:59:42.708202+0000","last_undegraded":"2024-03-17T23:59:42.708202+0000","last_fullsized":"2024-03-17T23:59:42.708202+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_clean_scrub_stamp":"2024-03-17T23:55:59.626739+0000","objects_scrubbed":0,"log_size":261,"log_dups_size":0,"ondisk_log_size":261,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T10:35:19.139554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11902300,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":217,"num_write_kb":11743,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"23'404","reported_seq":469,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:42.794840+0000","last_change":"2024-03-17T23:56:01.216238+0000","last_active":"2024-03-17T23:59:42.794840+0000","last_peered":"2024-03-17T23:59:42.794840+0000","last_clean":"2024-03-17T23:59:42.794840+0000","last_became_active":"2024-03-17T23:56:01.215526+0000","last_became_peered":"2024-03-17T23:56:01.215526+0000","last_unstale":"2024-03-17T23:59:42.794840+0000","last_undegraded":"2024-03-17T23:59:42.794840+0000","last_fullsized":"2024-03-17T23:59:42.794840+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T03:18:40.457769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":29805,"num_write":370,"num_write_kb":75602,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"23'543","reported_seq":562,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:37.441750+0000","last_change":"2024-03-17T23:56:00.682756+0000","last_active":"2024-03-17T23:59:37.441750+0000","last_peered":"2024-03-17T23:59:37.441750+0000","last_clean":"2024-03-17T23:59:37.441750+0000","last_became_active":"2024-03-17T23:56:00.682392+0000","last_became_peered":"2024-03-17T23:56:00.682392+0000","last_unstale":"2024-03-17T23:59:37.441750+0000","last_undegraded":"2024-03-17T23:59:37.441750+0000","last_fullsized":"2024-03-17T23:59:37.441750+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_clean_scrub_stamp":"2024-03-17T23:55:59.626739+0000","objects_scrubbed":0,"log_size":543,"log_dups_size":0,"ondisk_log_size":543,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T04:54:08.515514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388676,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":488,"num_write_kb":8403,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"23'418","reported_seq":480,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:42.795714+0000","last_change":"2024-03-17T23:56:01.218114+0000","last_active":"2024-03-17T23:59:42.795714+0000","last_peered":"2024-03-17T23:59:42.795714+0000","last_clean":"2024-03-17T23:59:42.795714+0000","last_became_active":"2024-03-17T23:56:01.217434+0000","last_became_peered":"2024-03-17T23:56:01.217434+0000","last_unstale":"2024-03-17T23:59:42.795714+0000","last_undegraded":"2024-03-17T23:59:42.795714+0000","last_fullsized":"2024-03-17T23:59:42.795714+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T06:56:40.687109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":24728,"num_write":388,"num_write_kb":63632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"23'69","reported_seq":88,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:40.390514+0000","last_change":"2024-03-17T23:56:00.696766+0000","last_active":"2024-03-17T23:59:40.390514+0000","last_peered":"2024-03-17T23:59:40.390514+0000","last_clean":"2024-03-17T23:59:40.390514+0000","last_became_active":"2024-03-17T23:56:00.695592+0000","last_became_peered":"2024-03-17T23:56:00.695592+0000","last_unstale":"2024-03-17T23:59:40.390514+0000","last_undegraded":"2024-03-17T23:59:40.390514+0000","last_fullsized":"2024-03-17T23:59:40.390514+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_clean_scrub_stamp":"2024-03-17T23:55:59.626739+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T04:07:26.256885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"23'401","reported_seq":467,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:42.795485+0000","last_change":"2024-03-17T23:56:01.208385+0000","last_active":"2024-03-17T23:59:42.795485+0000","last_peered":"2024-03-17T23:59:42.795485+0000","last_clean":"2024-03-17T23:59:42.795485+0000","last_became_active":"2024-03-17T23:56:01.207791+0000","last_became_peered":"2024-03-17T23:56:01.207791+0000","last_unstale":"2024-03-17T23:59:42.795485+0000","last_undegraded":"2024-03-17T23:59:42.795485+0000","last_fullsized":"2024-03-17T23:59:42.795485+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T11:08:21.695552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":27500,"num_write":363,"num_write_kb":68441,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"23'70","reported_seq":89,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:39.432969+0000","last_change":"2024-03-17T23:56:00.686159+0000","last_active":"2024-03-17T23:59:39.432969+0000","last_peered":"2024-03-17T23:59:39.432969+0000","last_clean":"2024-03-17T23:59:39.432969+0000","last_became_active":"2024-03-17T23:56:00.685354+0000","last_became_peered":"2024-03-17T23:56:00.685354+0000","last_unstale":"2024-03-17T23:59:39.432969+0000","last_undegraded":"2024-03-17T23:59:39.432969+0000","last_fullsized":"2024-03-17T23:59:39.432969+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_clean_scrub_stamp":"2024-03-17T23:55:59.626739+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T09:45:24.650866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"23'449","reported_seq":503,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:42.784590+0000","last_change":"2024-03-17T23:56:01.197137+0000","last_active":"2024-03-17T23:59:42.784590+0000","last_peered":"2024-03-17T23:59:42.784590+0000","last_clean":"2024-03-17T23:59:42.784590+0000","last_became_active":"2024-03-17T23:56:01.196356+0000","last_became_peered":"2024-03-17T23:56:01.196356+0000","last_unstale":"2024-03-17T23:59:42.784590+0000","last_undegraded":"2024-03-17T23:59:42.784590+0000","last_fullsized":"2024-03-17T23:59:42.784590+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":449,"log_dups_size":0,"ondisk_log_size":449,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T11:35:21.037222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":24107,"num_write":423,"num_write_kb":92187,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"23'76","reported_seq":95,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:40.420907+0000","last_change":"2024-03-17T23:56:00.682828+0000","last_active":"2024-03-17T23:59:40.420907+0000","last_peered":"2024-03-17T23:59:40.420907+0000","last_clean":"2024-03-17T23:59:40.420907+0000","last_became_active":"2024-03-17T23:56:00.682469+0000","last_became_peered":"2024-03-17T23:56:00.682469+0000","last_unstale":"2024-03-17T23:59:40.420907+0000","last_undegraded":"2024-03-17T23:59:40.420907+0000","last_fullsized":"2024-03-17T23:59:40.420907+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_clean_scrub_stamp":"2024-03-17T23:55:59.626739+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T05:52:39.451210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"23'486","reported_seq":562,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:42.795657+0000","last_change":"2024-03-17T23:56:01.209356+0000","last_active":"2024-03-17T23:59:42.795657+0000","last_peered":"2024-03-17T23:59:42.795657+0000","last_clean":"2024-03-17T23:59:42.795657+0000","last_became_active":"2024-03-17T23:56:01.208381+0000","last_became_peered":"2024-03-17T23:56:01.208381+0000","last_unstale":"2024-03-17T23:59:42.795657+0000","last_undegraded":"2024-03-17T23:59:42.795657+0000","last_fullsized":"2024-03-17T23:59:42.795657+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":486,"log_dups_size":0,"ondisk_log_size":486,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T03:01:01.120023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":26966,"num_write":455,"num_write_kb":93532,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"23'177","reported_seq":196,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:40.454947+0000","last_change":"2024-03-17T23:56:00.683595+0000","last_active":"2024-03-17T23:59:40.454947+0000","last_peered":"2024-03-17T23:59:40.454947+0000","last_clean":"2024-03-17T23:59:40.454947+0000","last_became_active":"2024-03-17T23:56:00.681338+0000","last_became_peered":"2024-03-17T23:56:00.681338+0000","last_unstale":"2024-03-17T23:59:40.454947+0000","last_undegraded":"2024-03-17T23:59:40.454947+0000","last_fullsized":"2024-03-17T23:59:40.454947+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_clean_scrub_stamp":"2024-03-17T23:55:59.626739+0000","objects_scrubbed":0,"log_size":177,"log_dups_size":0,"ondisk_log_size":177,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T08:58:55.725638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":124,"num_write_kb":4160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"23'378","reported_seq":419,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:42.786885+0000","last_change":"2024-03-17T23:56:01.212669+0000","last_active":"2024-03-17T23:59:42.786885+0000","last_peered":"2024-03-17T23:59:42.786885+0000","last_clean":"2024-03-17T23:59:42.786885+0000","last_became_active":"2024-03-17T23:56:01.206691+0000","last_became_peered":"2024-03-17T23:56:01.206691+0000","last_unstale":"2024-03-17T23:59:42.786885+0000","last_undegraded":"2024-03-17T23:59:42.786885+0000","last_fullsized":"2024-03-17T23:59:42.786885+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":378,"log_dups_size":0,"ondisk_log_size":378,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T03:59:56.032635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":10737,"num_write":348,"num_write_kb":63025,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"23'326","reported_seq":345,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:38.421026+0000","last_change":"2024-03-17T23:56:00.690801+0000","last_active":"2024-03-17T23:59:38.421026+0000","last_peered":"2024-03-17T23:59:38.421026+0000","last_clean":"2024-03-17T23:59:38.421026+0000","last_became_active":"2024-03-17T23:56:00.690516+0000","last_became_peered":"2024-03-17T23:56:00.690516+0000","last_unstale":"2024-03-17T23:59:38.421026+0000","last_undegraded":"2024-03-17T23:59:38.421026+0000","last_fullsized":"2024-03-17T23:59:38.421026+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_clean_scrub_stamp":"2024-03-17T23:55:59.626739+0000","objects_scrubbed":0,"log_size":326,"log_dups_size":0,"ondisk_log_size":326,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T09:07:52.005791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":276,"num_write_kb":4244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"23'384","reported_seq":452,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:42.803873+0000","last_change":"2024-03-17T23:56:01.213733+0000","last_active":"2024-03-17T23:59:42.803873+0000","last_peered":"2024-03-17T23:59:42.803873+0000","last_clean":"2024-03-17T23:59:42.803873+0000","last_became_active":"2024-03-17T23:56:01.213095+0000","last_became_peered":"2024-03-17T23:56:01.213095+0000","last_unstale":"2024-03-17T23:59:42.803873+0000","last_undegraded":"2024-03-17T23:59:42.803873+0000","last_fullsized":"2024-03-17T23:59:42.803873+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T08:57:40.944494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":39304,"num_write":347,"num_write_kb":50502,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"23'572","reported_seq":591,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:38.404189+0000","last_change":"2024-03-17T23:56:00.672267+0000","last_active":"2024-03-17T23:59:38.404189+0000","last_peered":"2024-03-17T23:59:38.404189+0000","last_clean":"2024-03-17T23:59:38.404189+0000","last_became_active":"2024-03-17T23:56:00.671655+0000","last_became_peered":"2024-03-17T23:56:00.671655+0000","last_unstale":"2024-03-17T23:59:38.404189+0000","last_undegraded":"2024-03-17T23:59:38.404189+0000","last_fullsized":"2024-03-17T23:59:38.404189+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_clean_scrub_stamp":"2024-03-17T23:55:59.626739+0000","objects_scrubbed":0,"log_size":572,"log_dups_size":0,"ondisk_log_size":572,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T09:45:24.650866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":517,"num_write_kb":4347,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"23'451","reported_seq":497,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:42.794648+0000","last_change":"2024-03-17T23:56:01.204789+0000","last_active":"2024-03-17T23:59:42.794648+0000","last_peered":"2024-03-17T23:59:42.794648+0000","last_clean":"2024-03-17T23:59:42.794648+0000","last_became_active":"2024-03-17T23:56:01.196002+0000","last_became_peered":"2024-03-17T23:56:01.196002+0000","last_unstale":"2024-03-17T23:59:42.794648+0000","last_undegraded":"2024-03-17T23:59:42.794648+0000","last_fullsized":"2024-03-17T23:59:42.794648+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":451,"log_dups_size":0,"ondisk_log_size":451,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T07:53:44.598091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":21931,"num_write":417,"num_write_kb":63333,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"23'70","reported_seq":89,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:40.428715+0000","last_change":"2024-03-17T23:56:00.679054+0000","last_active":"2024-03-17T23:59:40.428715+0000","last_peered":"2024-03-17T23:59:40.428715+0000","last_clean":"2024-03-17T23:59:40.428715+0000","last_became_active":"2024-03-17T23:56:00.677831+0000","last_became_peered":"2024-03-17T23:56:00.677831+0000","last_unstale":"2024-03-17T23:59:40.428715+0000","last_undegraded":"2024-03-17T23:59:40.428715+0000","last_fullsized":"2024-03-17T23:59:40.428715+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_clean_scrub_stamp":"2024-03-17T23:55:59.626739+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T04:07:26.256885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1752,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"23'407","reported_seq":466,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:42.800461+0000","last_change":"2024-03-17T23:56:01.214619+0000","last_active":"2024-03-17T23:59:42.800461+0000","last_peered":"2024-03-17T23:59:42.800461+0000","last_clean":"2024-03-17T23:59:42.800461+0000","last_became_active":"2024-03-17T23:56:01.213960+0000","last_became_peered":"2024-03-17T23:56:01.213960+0000","last_unstale":"2024-03-17T23:59:42.800461+0000","last_undegraded":"2024-03-17T23:59:42.800461+0000","last_fullsized":"2024-03-17T23:59:42.800461+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T11:01:47.143880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":22422,"num_write":380,"num_write_kb":66960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":175,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:56:49.197633+0000","last_change":"2024-03-17T23:55:58.106405+0000","last_active":"2024-03-17T23:56:49.197633+0000","last_peered":"2024-03-17T23:56:49.197633+0000","last_clean":"2024-03-17T23:56:49.197633+0000","last_became_active":"2024-03-17T23:55:58.104493+0000","last_became_peered":"2024-03-17T23:55:58.104493+0000","last_unstale":"2024-03-17T23:56:49.197633+0000","last_undegraded":"2024-03-17T23:56:49.197633+0000","last_fullsized":"2024-03-17T23:56:49.197633+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:55:56.609001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:55:56.609001+0000","last_clean_scrub_stamp":"2024-03-17T23:55:56.609001+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T08:58:52.707900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"23'82","reported_seq":101,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:40.434177+0000","last_change":"2024-03-17T23:56:00.678791+0000","last_active":"2024-03-17T23:59:40.434177+0000","last_peered":"2024-03-17T23:59:40.434177+0000","last_clean":"2024-03-17T23:59:40.434177+0000","last_became_active":"2024-03-17T23:56:00.677660+0000","last_became_peered":"2024-03-17T23:56:00.677660+0000","last_unstale":"2024-03-17T23:59:40.434177+0000","last_undegraded":"2024-03-17T23:59:40.434177+0000","last_fullsized":"2024-03-17T23:59:40.434177+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_clean_scrub_stamp":"2024-03-17T23:55:59.626739+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T07:28:27.310340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"23'360","reported_seq":396,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:42.798746+0000","last_change":"2024-03-17T23:56:01.213073+0000","last_active":"2024-03-17T23:59:42.798746+0000","last_peered":"2024-03-17T23:59:42.798746+0000","last_clean":"2024-03-17T23:59:42.798746+0000","last_became_active":"2024-03-17T23:56:01.212434+0000","last_became_peered":"2024-03-17T23:56:01.212434+0000","last_unstale":"2024-03-17T23:59:42.798746+0000","last_undegraded":"2024-03-17T23:59:42.798746+0000","last_fullsized":"2024-03-17T23:59:42.798746+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":360,"log_dups_size":0,"ondisk_log_size":360,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T08:24:06.922044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":8076,"num_write":326,"num_write_kb":42301,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"23'420","reported_seq":439,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:37.438690+0000","last_change":"2024-03-17T23:56:00.700634+0000","last_active":"2024-03-17T23:59:37.438690+0000","last_peered":"2024-03-17T23:59:37.438690+0000","last_clean":"2024-03-17T23:59:37.438690+0000","last_became_active":"2024-03-17T23:56:00.691617+0000","last_became_peered":"2024-03-17T23:56:00.691617+0000","last_unstale":"2024-03-17T23:59:37.438690+0000","last_undegraded":"2024-03-17T23:59:37.438690+0000","last_fullsized":"2024-03-17T23:59:37.438690+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_clean_scrub_stamp":"2024-03-17T23:55:59.626739+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T11:11:32.522234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":366,"num_write_kb":8360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"23'408","reported_seq":508,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:42.790845+0000","last_change":"2024-03-17T23:56:01.199855+0000","last_active":"2024-03-17T23:59:42.790845+0000","last_peered":"2024-03-17T23:59:42.790845+0000","last_clean":"2024-03-17T23:59:42.790845+0000","last_became_active":"2024-03-17T23:56:01.199121+0000","last_became_peered":"2024-03-17T23:56:01.199121+0000","last_unstale":"2024-03-17T23:59:42.790845+0000","last_undegraded":"2024-03-17T23:59:42.790845+0000","last_fullsized":"2024-03-17T23:59:42.790845+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T09:59:28.908069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":83,"num_read_kb":44834,"num_write":382,"num_write_kb":112569,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"23'288","reported_seq":517,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:42.380720+0000","last_change":"2024-03-17T23:56:00.686560+0000","last_active":"2024-03-17T23:59:42.380720+0000","last_peered":"2024-03-17T23:59:42.380720+0000","last_clean":"2024-03-17T23:59:42.380720+0000","last_became_active":"2024-03-17T23:56:00.686215+0000","last_became_peered":"2024-03-17T23:56:00.686215+0000","last_unstale":"2024-03-17T23:59:42.380720+0000","last_undegraded":"2024-03-17T23:59:42.380720+0000","last_fullsized":"2024-03-17T23:59:42.380720+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_clean_scrub_stamp":"2024-03-17T23:55:59.626739+0000","objects_scrubbed":0,"log_size":288,"log_dups_size":0,"ondisk_log_size":288,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T07:28:27.310340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1468046,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":210,"num_read_kb":1570,"num_write":217,"num_write_kb":1574,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"23'404","reported_seq":435,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:42.740134+0000","last_change":"2024-03-17T23:56:01.193197+0000","last_active":"2024-03-17T23:59:42.740134+0000","last_peered":"2024-03-17T23:59:42.740134+0000","last_clean":"2024-03-17T23:59:42.740134+0000","last_became_active":"2024-03-17T23:56:01.192117+0000","last_became_peered":"2024-03-17T23:56:01.192117+0000","last_unstale":"2024-03-17T23:59:42.740134+0000","last_undegraded":"2024-03-17T23:59:42.740134+0000","last_fullsized":"2024-03-17T23:59:42.740134+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T11:35:21.037222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":8404,"num_write":369,"num_write_kb":38222,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"23'564","reported_seq":583,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:36.422446+0000","last_change":"2024-03-17T23:56:00.696254+0000","last_active":"2024-03-17T23:59:36.422446+0000","last_peered":"2024-03-17T23:59:36.422446+0000","last_clean":"2024-03-17T23:59:36.422446+0000","last_became_active":"2024-03-17T23:56:00.694605+0000","last_became_peered":"2024-03-17T23:56:00.694605+0000","last_unstale":"2024-03-17T23:59:36.422446+0000","last_undegraded":"2024-03-17T23:59:36.422446+0000","last_fullsized":"2024-03-17T23:59:36.422446+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_clean_scrub_stamp":"2024-03-17T23:55:59.626739+0000","objects_scrubbed":0,"log_size":564,"log_dups_size":0,"ondisk_log_size":564,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T10:35:19.139554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389196,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":500,"num_write_kb":8435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"23'401","reported_seq":450,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:42.782955+0000","last_change":"2024-03-17T23:56:01.188278+0000","last_active":"2024-03-17T23:59:42.782955+0000","last_peered":"2024-03-17T23:59:42.782955+0000","last_clean":"2024-03-17T23:59:42.782955+0000","last_became_active":"2024-03-17T23:56:01.187571+0000","last_became_peered":"2024-03-17T23:56:01.187571+0000","last_unstale":"2024-03-17T23:59:42.782955+0000","last_undegraded":"2024-03-17T23:59:42.782955+0000","last_fullsized":"2024-03-17T23:59:42.782955+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T09:45:25.654063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":12494,"num_write":368,"num_write_kb":72170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"23'57","reported_seq":76,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:39.400365+0000","last_change":"2024-03-17T23:56:00.680290+0000","last_active":"2024-03-17T23:59:39.400365+0000","last_peered":"2024-03-17T23:59:39.400365+0000","last_clean":"2024-03-17T23:59:39.400365+0000","last_became_active":"2024-03-17T23:56:00.679981+0000","last_became_peered":"2024-03-17T23:56:00.679981+0000","last_unstale":"2024-03-17T23:59:39.400365+0000","last_undegraded":"2024-03-17T23:59:39.400365+0000","last_fullsized":"2024-03-17T23:59:39.400365+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_clean_scrub_stamp":"2024-03-17T23:55:59.626739+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T10:35:19.139554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"23'455","reported_seq":561,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:42.799702+0000","last_change":"2024-03-17T23:56:01.216640+0000","last_active":"2024-03-17T23:59:42.799702+0000","last_peered":"2024-03-17T23:59:42.799702+0000","last_clean":"2024-03-17T23:59:42.799702+0000","last_became_active":"2024-03-17T23:56:01.216145+0000","last_became_peered":"2024-03-17T23:56:01.216145+0000","last_unstale":"2024-03-17T23:59:42.799702+0000","last_undegraded":"2024-03-17T23:59:42.799702+0000","last_fullsized":"2024-03-17T23:59:42.799702+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":455,"log_dups_size":0,"ondisk_log_size":455,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T11:01:47.143880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":89,"num_read_kb":46763,"num_write":422,"num_write_kb":133395,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"23'223","reported_seq":242,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:39.393925+0000","last_change":"2024-03-17T23:56:00.692896+0000","last_active":"2024-03-17T23:59:39.393925+0000","last_peered":"2024-03-17T23:59:39.393925+0000","last_clean":"2024-03-17T23:59:39.393925+0000","last_became_active":"2024-03-17T23:56:00.692054+0000","last_became_peered":"2024-03-17T23:56:00.692054+0000","last_unstale":"2024-03-17T23:59:39.393925+0000","last_undegraded":"2024-03-17T23:59:39.393925+0000","last_fullsized":"2024-03-17T23:59:39.393925+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_clean_scrub_stamp":"2024-03-17T23:55:59.626739+0000","objects_scrubbed":0,"log_size":223,"log_dups_size":0,"ondisk_log_size":223,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T10:55:17.061099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194416,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":164,"num_write_kb":4176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"23'370","reported_seq":424,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:42.757675+0000","last_change":"2024-03-17T23:56:01.189102+0000","last_active":"2024-03-17T23:59:42.757675+0000","last_peered":"2024-03-17T23:59:42.757675+0000","last_clean":"2024-03-17T23:59:42.757675+0000","last_became_active":"2024-03-17T23:56:01.188353+0000","last_became_peered":"2024-03-17T23:56:01.188353+0000","last_unstale":"2024-03-17T23:59:42.757675+0000","last_undegraded":"2024-03-17T23:59:42.757675+0000","last_fullsized":"2024-03-17T23:59:42.757675+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":370,"log_dups_size":0,"ondisk_log_size":370,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T00:26:55.287891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":24684,"num_write":328,"num_write_kb":42609,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"23'207","reported_seq":226,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:40.794446+0000","last_change":"2024-03-17T23:56:00.689216+0000","last_active":"2024-03-17T23:59:40.794446+0000","last_peered":"2024-03-17T23:59:40.794446+0000","last_clean":"2024-03-17T23:59:40.794446+0000","last_became_active":"2024-03-17T23:56:00.688978+0000","last_became_peered":"2024-03-17T23:56:00.688978+0000","last_unstale":"2024-03-17T23:59:40.794446+0000","last_undegraded":"2024-03-17T23:59:40.794446+0000","last_fullsized":"2024-03-17T23:59:40.794446+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_clean_scrub_stamp":"2024-03-17T23:55:59.626739+0000","objects_scrubbed":0,"log_size":207,"log_dups_size":0,"ondisk_log_size":207,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T09:57:49.282635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":418,"num_write_kb":1562,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"23'361","reported_seq":444,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:42.798955+0000","last_change":"2024-03-17T23:56:01.212041+0000","last_active":"2024-03-17T23:59:42.798955+0000","last_peered":"2024-03-17T23:59:42.798955+0000","last_clean":"2024-03-17T23:59:42.798955+0000","last_became_active":"2024-03-17T23:56:01.211359+0000","last_became_peered":"2024-03-17T23:56:01.211359+0000","last_unstale":"2024-03-17T23:59:42.798955+0000","last_undegraded":"2024-03-17T23:59:42.798955+0000","last_fullsized":"2024-03-17T23:59:42.798955+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":361,"log_dups_size":0,"ondisk_log_size":361,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T11:08:21.695552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":37046,"num_write":339,"num_write_kb":87516,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"23'69","reported_seq":88,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:39.510095+0000","last_change":"2024-03-17T23:56:00.686768+0000","last_active":"2024-03-17T23:59:39.510095+0000","last_peered":"2024-03-17T23:59:39.510095+0000","last_clean":"2024-03-17T23:59:39.510095+0000","last_became_active":"2024-03-17T23:56:00.685461+0000","last_became_peered":"2024-03-17T23:56:00.685461+0000","last_unstale":"2024-03-17T23:59:39.510095+0000","last_undegraded":"2024-03-17T23:59:39.510095+0000","last_fullsized":"2024-03-17T23:59:39.510095+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_clean_scrub_stamp":"2024-03-17T23:55:59.626739+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T05:52:39.451210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"23'472","reported_seq":554,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:42.767925+0000","last_change":"2024-03-17T23:56:01.196364+0000","last_active":"2024-03-17T23:59:42.767925+0000","last_peered":"2024-03-17T23:59:42.767925+0000","last_clean":"2024-03-17T23:59:42.767925+0000","last_became_active":"2024-03-17T23:56:01.191450+0000","last_became_peered":"2024-03-17T23:56:01.191450+0000","last_unstale":"2024-03-17T23:59:42.767925+0000","last_undegraded":"2024-03-17T23:59:42.767925+0000","last_fullsized":"2024-03-17T23:59:42.767925+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":472,"log_dups_size":0,"ondisk_log_size":472,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T02:15:18.353466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":42881,"num_write":439,"num_write_kb":88369,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"23'498","reported_seq":517,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:39.392192+0000","last_change":"2024-03-17T23:56:00.691812+0000","last_active":"2024-03-17T23:59:39.392192+0000","last_peered":"2024-03-17T23:59:39.392192+0000","last_clean":"2024-03-17T23:59:39.392192+0000","last_became_active":"2024-03-17T23:56:00.691381+0000","last_became_peered":"2024-03-17T23:56:00.691381+0000","last_unstale":"2024-03-17T23:59:39.392192+0000","last_undegraded":"2024-03-17T23:59:39.392192+0000","last_fullsized":"2024-03-17T23:59:39.392192+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_clean_scrub_stamp":"2024-03-17T23:55:59.626739+0000","objects_scrubbed":0,"log_size":498,"log_dups_size":0,"ondisk_log_size":498,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T10:35:19.139554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":442,"num_write_kb":4310,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"23'444","reported_seq":509,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:42.745522+0000","last_change":"2024-03-17T23:56:01.195278+0000","last_active":"2024-03-17T23:59:42.745522+0000","last_peered":"2024-03-17T23:59:42.745522+0000","last_clean":"2024-03-17T23:59:42.745522+0000","last_became_active":"2024-03-17T23:56:01.192316+0000","last_became_peered":"2024-03-17T23:56:01.192316+0000","last_unstale":"2024-03-17T23:59:42.745522+0000","last_undegraded":"2024-03-17T23:59:42.745522+0000","last_fullsized":"2024-03-17T23:59:42.745522+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":444,"log_dups_size":0,"ondisk_log_size":444,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T04:07:27.260081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":21819,"num_write":413,"num_write_kb":30190,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"23'60","reported_seq":79,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:38.460611+0000","last_change":"2024-03-17T23:56:00.703680+0000","last_active":"2024-03-17T23:59:38.460611+0000","last_peered":"2024-03-17T23:59:38.460611+0000","last_clean":"2024-03-17T23:59:38.460611+0000","last_became_active":"2024-03-17T23:56:00.703439+0000","last_became_peered":"2024-03-17T23:56:00.703439+0000","last_unstale":"2024-03-17T23:59:38.460611+0000","last_undegraded":"2024-03-17T23:59:38.460611+0000","last_fullsized":"2024-03-17T23:59:38.460611+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_clean_scrub_stamp":"2024-03-17T23:55:59.626739+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T11:11:32.522234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"23'411","reported_seq":446,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:42.761413+0000","last_change":"2024-03-17T23:56:01.191678+0000","last_active":"2024-03-17T23:59:42.761413+0000","last_peered":"2024-03-17T23:59:42.761413+0000","last_clean":"2024-03-17T23:59:42.761413+0000","last_became_active":"2024-03-17T23:56:01.190681+0000","last_became_peered":"2024-03-17T23:56:01.190681+0000","last_unstale":"2024-03-17T23:59:42.761413+0000","last_undegraded":"2024-03-17T23:59:42.761413+0000","last_fullsized":"2024-03-17T23:59:42.761413+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T02:46:13.650384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":2591,"num_write":372,"num_write_kb":17971,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"23'151","reported_seq":170,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:38.428986+0000","last_change":"2024-03-17T23:56:00.679281+0000","last_active":"2024-03-17T23:59:38.428986+0000","last_peered":"2024-03-17T23:59:38.428986+0000","last_clean":"2024-03-17T23:59:38.428986+0000","last_became_active":"2024-03-17T23:56:00.678950+0000","last_became_peered":"2024-03-17T23:56:00.678950+0000","last_unstale":"2024-03-17T23:59:38.428986+0000","last_undegraded":"2024-03-17T23:59:38.428986+0000","last_fullsized":"2024-03-17T23:59:38.428986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_clean_scrub_stamp":"2024-03-17T23:55:59.626739+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T05:52:39.451210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":92,"num_write_kb":4145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"23'431","reported_seq":495,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:42.775522+0000","last_change":"2024-03-17T23:56:01.215539+0000","last_active":"2024-03-17T23:59:42.775522+0000","last_peered":"2024-03-17T23:59:42.775522+0000","last_clean":"2024-03-17T23:59:42.775522+0000","last_became_active":"2024-03-17T23:56:01.211163+0000","last_became_peered":"2024-03-17T23:56:01.211163+0000","last_unstale":"2024-03-17T23:59:42.775522+0000","last_undegraded":"2024-03-17T23:59:42.775522+0000","last_fullsized":"2024-03-17T23:59:42.775522+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":431,"log_dups_size":0,"ondisk_log_size":431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T11:40:55.653472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":16100,"num_write":395,"num_write_kb":71500,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"23'122","reported_seq":141,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:38.372796+0000","last_change":"2024-03-17T23:56:00.692384+0000","last_active":"2024-03-17T23:59:38.372796+0000","last_peered":"2024-03-17T23:59:38.372796+0000","last_clean":"2024-03-17T23:59:38.372796+0000","last_became_active":"2024-03-17T23:56:00.684178+0000","last_became_peered":"2024-03-17T23:56:00.684178+0000","last_unstale":"2024-03-17T23:59:38.372796+0000","last_undegraded":"2024-03-17T23:59:38.372796+0000","last_fullsized":"2024-03-17T23:59:38.372796+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_clean_scrub_stamp":"2024-03-17T23:55:59.626739+0000","objects_scrubbed":0,"log_size":122,"log_dups_size":0,"ondisk_log_size":122,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T09:45:24.650866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":65,"num_write_kb":8221,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"23'446","reported_seq":538,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:42.790168+0000","last_change":"2024-03-17T23:56:01.193547+0000","last_active":"2024-03-17T23:59:42.790168+0000","last_peered":"2024-03-17T23:59:42.790168+0000","last_clean":"2024-03-17T23:59:42.790168+0000","last_became_active":"2024-03-17T23:56:01.192775+0000","last_became_peered":"2024-03-17T23:56:01.192775+0000","last_unstale":"2024-03-17T23:59:42.790168+0000","last_undegraded":"2024-03-17T23:59:42.790168+0000","last_fullsized":"2024-03-17T23:59:42.790168+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":446,"log_dups_size":0,"ondisk_log_size":446,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T02:15:18.353466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":28843,"num_write":412,"num_write_kb":84625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"23'388","reported_seq":455,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:42.800309+0000","last_change":"2024-03-17T23:56:01.178436+0000","last_active":"2024-03-17T23:59:42.800309+0000","last_peered":"2024-03-17T23:59:42.800309+0000","last_clean":"2024-03-17T23:59:42.800309+0000","last_became_active":"2024-03-17T23:56:01.177533+0000","last_became_peered":"2024-03-17T23:56:01.177533+0000","last_unstale":"2024-03-17T23:59:42.800309+0000","last_undegraded":"2024-03-17T23:59:42.800309+0000","last_fullsized":"2024-03-17T23:59:42.800309+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":388,"log_dups_size":0,"ondisk_log_size":388,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T03:18:40.457769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":28876,"num_write":348,"num_write_kb":79477,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"23'250","reported_seq":269,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:40.435836+0000","last_change":"2024-03-17T23:56:00.691483+0000","last_active":"2024-03-17T23:59:40.435836+0000","last_peered":"2024-03-17T23:59:40.435836+0000","last_clean":"2024-03-17T23:59:40.435836+0000","last_became_active":"2024-03-17T23:56:00.684714+0000","last_became_peered":"2024-03-17T23:56:00.684714+0000","last_unstale":"2024-03-17T23:59:40.435836+0000","last_undegraded":"2024-03-17T23:59:40.435836+0000","last_fullsized":"2024-03-17T23:59:40.435836+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_clean_scrub_stamp":"2024-03-17T23:55:59.626739+0000","objects_scrubbed":0,"log_size":250,"log_dups_size":0,"ondisk_log_size":250,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T09:57:49.282635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":200,"num_write_kb":4200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"23'366","reported_seq":420,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:42.797532+0000","last_change":"2024-03-17T23:56:01.194350+0000","last_active":"2024-03-17T23:59:42.797532+0000","last_peered":"2024-03-17T23:59:42.797532+0000","last_clean":"2024-03-17T23:59:42.797532+0000","last_became_active":"2024-03-17T23:56:01.193625+0000","last_became_peered":"2024-03-17T23:56:01.193625+0000","last_unstale":"2024-03-17T23:59:42.797532+0000","last_undegraded":"2024-03-17T23:59:42.797532+0000","last_fullsized":"2024-03-17T23:59:42.797532+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T11:08:21.695552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":17870,"num_write":332,"num_write_kb":22223,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"23'265","reported_seq":284,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:40.468483+0000","last_change":"2024-03-17T23:56:00.699785+0000","last_active":"2024-03-17T23:59:40.468483+0000","last_peered":"2024-03-17T23:59:40.468483+0000","last_clean":"2024-03-17T23:59:40.468483+0000","last_became_active":"2024-03-17T23:56:00.699049+0000","last_became_peered":"2024-03-17T23:56:00.699049+0000","last_unstale":"2024-03-17T23:59:40.468483+0000","last_undegraded":"2024-03-17T23:59:40.468483+0000","last_fullsized":"2024-03-17T23:59:40.468483+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_clean_scrub_stamp":"2024-03-17T23:55:59.626739+0000","objects_scrubbed":0,"log_size":265,"log_dups_size":0,"ondisk_log_size":265,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T01:56:01.336865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":190,"num_write_kb":12389,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"23'368","reported_seq":446,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:42.799409+0000","last_change":"2024-03-17T23:56:01.208117+0000","last_active":"2024-03-17T23:59:42.799409+0000","last_peered":"2024-03-17T23:59:42.799409+0000","last_clean":"2024-03-17T23:59:42.799409+0000","last_became_active":"2024-03-17T23:56:01.207342+0000","last_became_peered":"2024-03-17T23:56:01.207342+0000","last_unstale":"2024-03-17T23:59:42.799409+0000","last_undegraded":"2024-03-17T23:59:42.799409+0000","last_fullsized":"2024-03-17T23:59:42.799409+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":368,"log_dups_size":0,"ondisk_log_size":368,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T08:24:06.922044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":38707,"num_write":341,"num_write_kb":47027,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"23'59","reported_seq":78,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:38.432162+0000","last_change":"2024-03-17T23:56:00.691595+0000","last_active":"2024-03-17T23:59:38.432162+0000","last_peered":"2024-03-17T23:59:38.432162+0000","last_clean":"2024-03-17T23:59:38.432162+0000","last_became_active":"2024-03-17T23:56:00.690892+0000","last_became_peered":"2024-03-17T23:56:00.690892+0000","last_unstale":"2024-03-17T23:59:38.432162+0000","last_undegraded":"2024-03-17T23:59:38.432162+0000","last_fullsized":"2024-03-17T23:59:38.432162+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_clean_scrub_stamp":"2024-03-17T23:55:59.626739+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T07:28:27.310340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":4104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"23'416","reported_seq":458,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:42.789760+0000","last_change":"2024-03-17T23:56:01.212430+0000","last_active":"2024-03-17T23:59:42.789760+0000","last_peered":"2024-03-17T23:59:42.789760+0000","last_clean":"2024-03-17T23:59:42.789760+0000","last_became_active":"2024-03-17T23:56:01.204930+0000","last_became_peered":"2024-03-17T23:56:01.204930+0000","last_unstale":"2024-03-17T23:59:42.789760+0000","last_undegraded":"2024-03-17T23:59:42.789760+0000","last_fullsized":"2024-03-17T23:59:42.789760+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":416,"log_dups_size":0,"ondisk_log_size":416,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T04:45:41.506781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":21060,"num_write":382,"num_write_kb":52186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"23'128","reported_seq":147,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:39.504888+0000","last_change":"2024-03-17T23:56:00.682405+0000","last_active":"2024-03-17T23:59:39.504888+0000","last_peered":"2024-03-17T23:59:39.504888+0000","last_clean":"2024-03-17T23:59:39.504888+0000","last_became_active":"2024-03-17T23:56:00.681938+0000","last_became_peered":"2024-03-17T23:56:00.681938+0000","last_unstale":"2024-03-17T23:59:39.504888+0000","last_undegraded":"2024-03-17T23:59:39.504888+0000","last_fullsized":"2024-03-17T23:59:39.504888+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_clean_scrub_stamp":"2024-03-17T23:55:59.626739+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T07:03:16.148691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":81,"num_write_kb":4133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2838,"num_read_kb":1533802,"num_write":24369,"num_write_kb":4275114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26399,"ondisk_log_size":26399,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":130818914,"num_objects":129,"num_object_clones":0,"num_object_copies":258,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":129,"num_whiteouts":0,"num_read":210,"num_read_kb":1570,"num_write":5949,"num_write_kb":132095,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":91545600,"data_stored":261637828,"data_compressed":38603034,"data_compressed_allocated":50184192,"data_compressed_original":220520448,"omap_allocated":0,"internal_metadata":0},"log_size":7493,"ondisk_log_size":7493,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66348,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574897,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":64480,"kb_used_data":15256,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94307360,"statfs":{"total":96636764160,"available":96570736640,"internally_reserved":0,"allocated":15622144,"data_stored":51012493,"data_compressed":7591170,"data_compressed_allocated":9641984,"data_compressed_original":45223936,"omap_allocated":1590,"internal_metadata":50395594},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574897,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":53036,"kb_used_data":13540,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94318804,"statfs":{"total":96636764160,"available":96582455296,"internally_reserved":0,"allocated":13864960,"data_stored":45545899,"data_compressed":7083231,"data_compressed_allocated":9031680,"data_compressed_original":40890368,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574896,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60172,"kb_used_data":10948,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94311668,"statfs":{"total":96636764160,"available":96575148032,"internally_reserved":0,"allocated":11210752,"data_stored":25258133,"data_compressed":3535502,"data_compressed_allocated":4878336,"data_compressed_original":19124224,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":19,"apply_latency_ms":19,"commit_latency_ns":19000000,"apply_latency_ns":19000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574898,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":70952,"kb_used_data":17568,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94300888,"statfs":{"total":96636764160,"available":96564109312,"internally_reserved":0,"allocated":17989632,"data_stored":46227051,"data_compressed":6636651,"data_compressed_allocated":8818688,"data_compressed_original":37232640,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574899,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41684,"kb_used_data":10508,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94330156,"statfs":{"total":96636764160,"available":96594079744,"internally_reserved":0,"allocated":10760192,"data_stored":34430955,"data_compressed":5296110,"data_compressed_allocated":6660096,"data_compressed_original":30515200,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574898,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33936,"kb_used_data":2760,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94337904,"statfs":{"total":96636764160,"available":96602013696,"internally_reserved":0,"allocated":2826240,"data_stored":5752077,"data_compressed":755556,"data_compressed_allocated":1044480,"data_compressed_original":4157440,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574897,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":67656,"kb_used_data":10112,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94304184,"statfs":{"total":96636764160,"available":96567484416,"internally_reserved":0,"allocated":10354688,"data_stored":25255151,"data_compressed":3481816,"data_compressed_allocated":4526080,"data_compressed_original":19607552,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,7],"upper_bound":128},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574896,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59948,"kb_used_data":10724,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94311892,"statfs":{"total":96636764160,"available":96575377408,"internally_reserved":0,"allocated":10981376,"data_stored":30039165,"data_compressed":4289346,"data_compressed_allocated":5672960,"data_compressed_original":24915968,"omap_allocated":1592,"internal_metadata":50395592},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33174,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33174,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":10674176,"data_stored":29361002,"data_compressed":4256172,"data_compressed_allocated":5627904,"data_compressed_original":24342528,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":10113024,"data_stored":25167356,"data_compressed":3481816,"data_compressed_allocated":4526080,"data_compressed_original":19607552,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":2584576,"data_stored":5664282,"data_compressed":755556,"data_compressed_allocated":1044480,"data_compressed_original":4157440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":10518528,"data_stored":34343160,"data_compressed":5296110,"data_compressed_allocated":6660096,"data_compressed_original":30515200,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":17747968,"data_stored":46139256,"data_compressed":6636651,"data_compressed_allocated":8818688,"data_compressed_original":37232640,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":10969088,"data_stored":25170338,"data_compressed":3535502,"data_compressed_allocated":4878336,"data_compressed_original":19124224,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":13623296,"data_stored":45458104,"data_compressed":7083231,"data_compressed_allocated":9031680,"data_compressed_original":40890368,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":15314944,"data_stored":50334330,"data_compressed":7557996,"data_compressed_allocated":9596928,"data_compressed_original":44650496,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-17T23:59:49.824 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-03-17T23:59:49.825 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-17T23:59:49.982 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:49.979+0000 7fe27384b640 1 Processor -- start 2024-03-17T23:59:49.982 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:49.979+0000 7fe27384b640 1 -- start start 2024-03-17T23:59:49.984 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:49.979+0000 7fe27384b640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe26c0b0150 0x7fe26c06c3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:59:49.984 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:49.979+0000 7fe27384b640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fe26c0c8240 0x7fe26c06c900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:59:49.984 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:49.979+0000 7fe27384b640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe26c06fea0 con 0x7fe26c0c4660 2024-03-17T23:59:49.984 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:49.979+0000 7fe27384b640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 -- 0x7fe26c0b0530 con 0x7fe26c0c8240 2024-03-17T23:59:49.984 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:49.979+0000 7fe27384b640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7fe26c070180 con 0x7fe26c0b0150 2024-03-17T23:59:49.985 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:49.979+0000 7fe271de8640 1 --1- >> v1:172.21.15.196:6789/0 conn(0x7fe26c0c4660 0x7fe26c0c9b20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.196:6789/0 says I am v1:172.21.15.196:59264/0 (socket says 172.21.15.196:59264) 2024-03-17T23:59:49.985 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:49.979+0000 7fe271de8640 1 -- 172.21.15.196:0/2473825679 learned_addr learned my addr 172.21.15.196:0/2473825679 (peer_addr_for_me v1:172.21.15.196:0/0) 2024-03-17T23:59:49.985 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:49.979+0000 7fe2715e7640 1 --2- 172.21.15.196:0/2473825679 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe26c0b0150 0x7fe26c06c3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:59:49.985 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:49.979+0000 7fe270de6640 1 --2- 172.21.15.196:0/2473825679 >> v2:172.21.15.204:3300/0 conn(0x7fe26c0c8240 0x7fe26c06c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:59:49.985 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:49.979+0000 7fe263fff640 1 -- 172.21.15.196:0/2473825679 <== mon.0 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 517670620 0 0) 0x7fe26c06fea0 con 0x7fe26c0c4660 2024-03-17T23:59:49.985 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:49.979+0000 7fe263fff640 1 -- 172.21.15.196:0/2473825679 --> v1:172.21.15.196:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe258003530 con 0x7fe26c0c4660 2024-03-17T23:59:49.985 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:49.979+0000 7fe2715e7640 1 -- 172.21.15.196:0/2473825679 >> v2:172.21.15.204:3300/0 conn(0x7fe26c0c8240 msgr2=0x7fe26c06c900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-17T23:59:49.985 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:49.979+0000 7fe2715e7640 1 --2- 172.21.15.196:0/2473825679 >> v2:172.21.15.204:3300/0 conn(0x7fe26c0c8240 0x7fe26c06c900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:59:49.985 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:49.979+0000 7fe2715e7640 1 -- 172.21.15.196:0/2473825679 >> v1:172.21.15.196:6789/0 conn(0x7fe26c0c4660 legacy=0x7fe26c0c9b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:59:49.985 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:49.979+0000 7fe2715e7640 1 -- 172.21.15.196:0/2473825679 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe26c0c8cb0 con 0x7fe26c0b0150 2024-03-17T23:59:49.986 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:49.983+0000 7fe2715e7640 1 --2- 172.21.15.196:0/2473825679 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe26c0b0150 0x7fe26c06c3c0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fe2680097c0 tx=0x7fe26801c4a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=71f7fb3fd7421da6 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:59:49.986 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:49.983+0000 7fe263fff640 1 -- 172.21.15.196:0/2473825679 <== mon.2 v2:172.21.15.204:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2680b0070 con 0x7fe26c0b0150 2024-03-17T23:59:49.986 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:49.983+0000 7fe263fff640 1 -- 172.21.15.196:0/2473825679 <== mon.2 v2:172.21.15.204:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2680ab600 con 0x7fe26c0b0150 2024-03-17T23:59:49.986 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:49.983+0000 7fe263fff640 1 -- 172.21.15.196:0/2473825679 <== mon.2 v2:172.21.15.204:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2680ab9b0 con 0x7fe26c0b0150 2024-03-17T23:59:49.987 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:49.983+0000 7fe27384b640 1 -- 172.21.15.196:0/2473825679 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe26c0b0150 msgr2=0x7fe26c06c3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:59:49.987 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:49.983+0000 7fe27384b640 1 --2- 172.21.15.196:0/2473825679 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe26c0b0150 0x7fe26c06c3c0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fe2680097c0 tx=0x7fe26801c4a0 comp rx=0 tx=0).stop 2024-03-17T23:59:49.987 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:49.983+0000 7fe27384b640 1 -- 172.21.15.196:0/2473825679 shutdown_connections 2024-03-17T23:59:49.987 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:49.983+0000 7fe27384b640 1 --2- 172.21.15.196:0/2473825679 >> v2:172.21.15.204:3300/0 conn(0x7fe26c0c8240 0x7fe26c06c900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:59:49.988 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:49.983+0000 7fe27384b640 1 --2- 172.21.15.196:0/2473825679 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe26c0b0150 0x7fe26c06c3c0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:59:49.988 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:49.983+0000 7fe27384b640 1 -- 172.21.15.196:0/2473825679 >> 172.21.15.196:0/2473825679 conn(0x7fe26c06b2b0 msgr2=0x7fe26c06b6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-17T23:59:49.988 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:49.983+0000 7fe27384b640 1 -- 172.21.15.196:0/2473825679 shutdown_connections 2024-03-17T23:59:49.988 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:49.983+0000 7fe27384b640 1 -- 172.21.15.196:0/2473825679 wait complete. 2024-03-17T23:59:49.989 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:49.987+0000 7fe27384b640 1 Processor -- start 2024-03-17T23:59:49.989 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:49.987+0000 7fe27384b640 1 -- start start 2024-03-17T23:59:49.992 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:49.987+0000 7fe27384b640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe26c0b0150 0x7fe26c152ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:59:49.992 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:49.987+0000 7fe27384b640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe26c0c4660 0x7fe26c159180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:59:49.992 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:49.987+0000 7fe27384b640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe26c0c8240 0x7fe26c1514a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:59:49.992 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:49.987+0000 7fe27384b640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fe26c1671b0 con 0x7fe26c0b0150 2024-03-17T23:59:49.993 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:49.987+0000 7fe2715e7640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe26c0b0150 0x7fe26c152ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:59:49.993 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:49.987+0000 7fe2715e7640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe26c0b0150 0x7fe26c152ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.196:34248/0 (socket says 172.21.15.196:34248) 2024-03-17T23:59:49.993 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:49.987+0000 7fe27384b640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7fe26c167030 con 0x7fe26c0c4660 2024-03-17T23:59:49.993 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:49.987+0000 7fe2715e7640 1 -- 172.21.15.196:0/1194014485 learned_addr learned my addr 172.21.15.196:0/1194014485 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-03-17T23:59:49.993 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:49.987+0000 7fe27384b640 1 -- 172.21.15.196:0/1194014485 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7fe26c167330 con 0x7fe26c0c8240 2024-03-17T23:59:49.993 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:49.987+0000 7fe270de6640 1 --2- 172.21.15.196:0/1194014485 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe26c0c4660 0x7fe26c159180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:59:49.993 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:49.987+0000 7fe271de8640 1 --2- 172.21.15.196:0/1194014485 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe26c0c8240 0x7fe26c1514a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:59:49.993 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:49.987+0000 7fe2715e7640 1 -- 172.21.15.196:0/1194014485 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe26c0c8240 msgr2=0x7fe26c1514a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:59:49.993 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:49.987+0000 7fe2715e7640 1 --2- 172.21.15.196:0/1194014485 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe26c0c8240 0x7fe26c1514a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:59:49.993 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:49.987+0000 7fe2715e7640 1 -- 172.21.15.196:0/1194014485 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe26c0c4660 msgr2=0x7fe26c159180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:59:49.993 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:49.987+0000 7fe2715e7640 1 --2- 172.21.15.196:0/1194014485 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe26c0c4660 0x7fe26c159180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:59:49.993 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:49.987+0000 7fe2715e7640 1 -- 172.21.15.196:0/1194014485 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe26c159e80 con 0x7fe26c0b0150 2024-03-17T23:59:49.993 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:49.987+0000 7fe2715e7640 1 --2- 172.21.15.196:0/1194014485 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe26c0b0150 0x7fe26c152ce0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fe26801ab50 tx=0x7fe268019240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:59:49.994 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:49.987+0000 7fe261ffb640 1 -- 172.21.15.196:0/1194014485 <== mon.0 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2680ba070 con 0x7fe26c0b0150 2024-03-17T23:59:49.994 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:49.987+0000 7fe261ffb640 1 -- 172.21.15.196:0/1194014485 <== mon.0 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2680ab9b0 con 0x7fe26c0b0150 2024-03-17T23:59:49.994 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:49.987+0000 7fe27384b640 1 -- 172.21.15.196:0/1194014485 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe26c15a140 con 0x7fe26c0b0150 2024-03-17T23:59:49.994 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:49.987+0000 7fe261ffb640 1 -- 172.21.15.196:0/1194014485 <== mon.0 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2680b0040 con 0x7fe26c0b0150 2024-03-17T23:59:49.994 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:49.987+0000 7fe27384b640 1 -- 172.21.15.196:0/1194014485 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe26c1f60b0 con 0x7fe26c0b0150 2024-03-17T23:59:49.994 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:49.991+0000 7fe2577fe640 1 -- 172.21.15.196:0/1194014485 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe2440052a0 con 0x7fe26c0b0150 2024-03-17T23:59:49.995 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:49.991+0000 7fe261ffb640 1 -- 172.21.15.196:0/1194014485 <== mon.0 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 5) ==== 87083+0+0 (secure 0 0 0) 0x7fe2680bd070 con 0x7fe26c0b0150 2024-03-17T23:59:49.995 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:49.991+0000 7fe261ffb640 1 --2- 172.21.15.196:0/1194014485 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7fe250067660 0x7fe250069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:59:49.995 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:49.991+0000 7fe261ffb640 1 -- 172.21.15.196:0/1194014485 <== mon.0 v2:172.21.15.196:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7fe26811ea60 con 0x7fe26c0b0150 2024-03-17T23:59:49.995 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:49.991+0000 7fe270de6640 1 --2- 172.21.15.196:0/1194014485 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7fe250067660 0x7fe250069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:59:49.995 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:49.991+0000 7fe270de6640 1 --2- 172.21.15.196:0/1194014485 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7fe250067660 0x7fe250069b20 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fe26c153a90 tx=0x7fe25c009190 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:59:50.002 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:49.999+0000 7fe261ffb640 1 -- 172.21.15.196:0/1194014485 <== mon.0 v2:172.21.15.196:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177849 (secure 0 0 0) 0x7fe268016090 con 0x7fe26c0b0150 2024-03-17T23:59:50.262 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:50.259+0000 7fe2577fe640 1 -- 172.21.15.196:0/1194014485 --> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fe244000bd0 con 0x7fe250067660 2024-03-17T23:59:50.279 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:50.275+0000 7fe261ffb640 1 -- 172.21.15.196:0/1194014485 <== mgr.4099 v2:172.21.15.204:6832/2505201055 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+254117 (secure 0 0 0) 0x7fe244000bd0 con 0x7fe250067660 2024-03-17T23:59:50.282 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-03-17T23:59:50.283 INFO:teuthology.orchestra.run.smithi196.stderr:dumped all 2024-03-17T23:59:50.284 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:50.279+0000 7fe2577fe640 1 -- 172.21.15.196:0/1194014485 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7fe250067660 msgr2=0x7fe250069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:59:50.284 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:50.279+0000 7fe2577fe640 1 --2- 172.21.15.196:0/1194014485 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7fe250067660 0x7fe250069b20 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fe26c153a90 tx=0x7fe25c009190 comp rx=0 tx=0).stop 2024-03-17T23:59:50.285 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:50.279+0000 7fe2577fe640 1 -- 172.21.15.196:0/1194014485 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe26c0b0150 msgr2=0x7fe26c152ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:59:50.285 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:50.279+0000 7fe2577fe640 1 --2- 172.21.15.196:0/1194014485 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe26c0b0150 0x7fe26c152ce0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fe26801ab50 tx=0x7fe268019240 comp rx=0 tx=0).stop 2024-03-17T23:59:50.285 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:50.279+0000 7fe2577fe640 1 -- 172.21.15.196:0/1194014485 shutdown_connections 2024-03-17T23:59:50.285 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:50.279+0000 7fe2577fe640 1 --2- 172.21.15.196:0/1194014485 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7fe250067660 0x7fe250069b20 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:59:50.285 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:50.279+0000 7fe2577fe640 1 --2- 172.21.15.196:0/1194014485 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe26c0c8240 0x7fe26c1514a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:59:50.285 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:50.279+0000 7fe2577fe640 1 --2- 172.21.15.196:0/1194014485 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe26c0c4660 0x7fe26c159180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:59:50.285 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:50.279+0000 7fe2577fe640 1 --2- 172.21.15.196:0/1194014485 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe26c0b0150 0x7fe26c152ce0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:59:50.285 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:50.279+0000 7fe2577fe640 1 -- 172.21.15.196:0/1194014485 >> 172.21.15.196:0/1194014485 conn(0x7fe26c06b2b0 msgr2=0x7fe26c06b690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-17T23:59:50.285 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:50.279+0000 7fe2577fe640 1 -- 172.21.15.196:0/1194014485 shutdown_connections 2024-03-17T23:59:50.285 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:50.279+0000 7fe2577fe640 1 -- 172.21.15.196:0/1194014485 wait complete. 2024-03-17T23:59:50.298 INFO:teuthology.orchestra.run.smithi196.stdout:{"pg_ready":true,"pg_map":{"version":134,"stamp":"2024-03-17T23:59:50.028670+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":131409282,"num_objects":131,"num_object_clones":0,"num_object_copies":262,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":131,"num_whiteouts":0,"num_read":3164,"num_read_kb":1535472,"num_write":30477,"num_write_kb":4409625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":34009,"ondisk_log_size":34009,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":451864,"kb_used_data":91416,"kb_used_omap":12,"kb_used_meta":360371,"kb_avail":754522856,"statfs":{"total":773094113280,"available":772631404544,"internally_reserved":0,"allocated":93609984,"data_stored":263520924,"data_compressed":38669382,"data_compressed_allocated":50274304,"data_compressed_original":221667328,"omap_allocated":12748,"internal_metadata":369020468},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-6303676,"num_objects":-1292,"num_object_clones":0,"num_object_copies":-2584,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-1292,"num_whiteouts":0,"num_read":19,"num_read_kb":164,"num_write":1475,"num_write_kb":4172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003919"},"pg_stats":[{"pgid":"3.3f","version":"23'416","reported_seq":466,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:42.798627+0000","last_change":"2024-03-17T23:56:01.208245+0000","last_active":"2024-03-17T23:59:42.798627+0000","last_peered":"2024-03-17T23:59:42.798627+0000","last_clean":"2024-03-17T23:59:42.798627+0000","last_became_active":"2024-03-17T23:56:01.207533+0000","last_became_peered":"2024-03-17T23:56:01.207533+0000","last_unstale":"2024-03-17T23:59:42.798627+0000","last_undegraded":"2024-03-17T23:59:42.798627+0000","last_fullsized":"2024-03-17T23:59:42.798627+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":416,"log_dups_size":0,"ondisk_log_size":416,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T09:33:28.935701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":22799,"num_write":382,"num_write_kb":63271,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"23'451","reported_seq":558,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:42.769225+0000","last_change":"2024-03-17T23:56:01.193546+0000","last_active":"2024-03-17T23:59:42.769225+0000","last_peered":"2024-03-17T23:59:42.769225+0000","last_clean":"2024-03-17T23:59:42.769225+0000","last_became_active":"2024-03-17T23:56:01.192736+0000","last_became_peered":"2024-03-17T23:56:01.192736+0000","last_unstale":"2024-03-17T23:59:42.769225+0000","last_undegraded":"2024-03-17T23:59:42.769225+0000","last_fullsized":"2024-03-17T23:59:42.769225+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":451,"log_dups_size":0,"ondisk_log_size":451,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T07:03:18.208772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":90,"num_read_kb":44601,"num_write":422,"num_write_kb":92038,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"23'361","reported_seq":395,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:42.770813+0000","last_change":"2024-03-17T23:56:01.188859+0000","last_active":"2024-03-17T23:59:42.770813+0000","last_peered":"2024-03-17T23:59:42.770813+0000","last_clean":"2024-03-17T23:59:42.770813+0000","last_became_active":"2024-03-17T23:56:01.188339+0000","last_became_peered":"2024-03-17T23:56:01.188339+0000","last_unstale":"2024-03-17T23:59:42.770813+0000","last_undegraded":"2024-03-17T23:59:42.770813+0000","last_fullsized":"2024-03-17T23:59:42.770813+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":361,"log_dups_size":0,"ondisk_log_size":361,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T05:26:03.654839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":9522,"num_write":340,"num_write_kb":42370,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"23'375","reported_seq":429,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:42.797389+0000","last_change":"2024-03-17T23:56:01.204810+0000","last_active":"2024-03-17T23:59:42.797389+0000","last_peered":"2024-03-17T23:59:42.797389+0000","last_clean":"2024-03-17T23:59:42.797389+0000","last_became_active":"2024-03-17T23:56:01.196978+0000","last_became_peered":"2024-03-17T23:56:01.196978+0000","last_unstale":"2024-03-17T23:59:42.797389+0000","last_undegraded":"2024-03-17T23:59:42.797389+0000","last_fullsized":"2024-03-17T23:59:42.797389+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":375,"log_dups_size":0,"ondisk_log_size":375,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T06:25:58.489959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":11889,"num_write":341,"num_write_kb":42361,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"23'410","reported_seq":465,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:42.776537+0000","last_change":"2024-03-17T23:56:01.195423+0000","last_active":"2024-03-17T23:59:42.776537+0000","last_peered":"2024-03-17T23:59:42.776537+0000","last_clean":"2024-03-17T23:59:42.776537+0000","last_became_active":"2024-03-17T23:56:01.194710+0000","last_became_peered":"2024-03-17T23:56:01.194710+0000","last_unstale":"2024-03-17T23:59:42.776537+0000","last_undegraded":"2024-03-17T23:59:42.776537+0000","last_fullsized":"2024-03-17T23:59:42.776537+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":410,"log_dups_size":0,"ondisk_log_size":410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T06:25:58.489959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":20292,"num_write":376,"num_write_kb":22112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"23'379","reported_seq":420,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:42.791477+0000","last_change":"2024-03-17T23:56:01.204633+0000","last_active":"2024-03-17T23:59:42.791477+0000","last_peered":"2024-03-17T23:59:42.791477+0000","last_clean":"2024-03-17T23:59:42.791477+0000","last_became_active":"2024-03-17T23:56:01.192908+0000","last_became_peered":"2024-03-17T23:56:01.192908+0000","last_unstale":"2024-03-17T23:59:42.791477+0000","last_undegraded":"2024-03-17T23:59:42.791477+0000","last_fullsized":"2024-03-17T23:59:42.791477+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":379,"log_dups_size":0,"ondisk_log_size":379,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T03:49:46.522282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":17487,"num_write":350,"num_write_kb":34234,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"23'439","reported_seq":524,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:42.780782+0000","last_change":"2024-03-17T23:56:01.208861+0000","last_active":"2024-03-17T23:59:42.780782+0000","last_peered":"2024-03-17T23:59:42.780782+0000","last_clean":"2024-03-17T23:59:42.780782+0000","last_became_active":"2024-03-17T23:56:01.199550+0000","last_became_peered":"2024-03-17T23:56:01.199550+0000","last_unstale":"2024-03-17T23:59:42.780782+0000","last_undegraded":"2024-03-17T23:59:42.780782+0000","last_fullsized":"2024-03-17T23:59:42.780782+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T00:21:36.556648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":32233,"num_write":412,"num_write_kb":77021,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"23'355","reported_seq":410,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:42.798751+0000","last_change":"2024-03-17T23:56:01.212574+0000","last_active":"2024-03-17T23:59:42.798751+0000","last_peered":"2024-03-17T23:59:42.798751+0000","last_clean":"2024-03-17T23:59:42.798751+0000","last_became_active":"2024-03-17T23:56:01.211860+0000","last_became_peered":"2024-03-17T23:56:01.211860+0000","last_unstale":"2024-03-17T23:59:42.798751+0000","last_undegraded":"2024-03-17T23:59:42.798751+0000","last_fullsized":"2024-03-17T23:59:42.798751+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":355,"log_dups_size":0,"ondisk_log_size":355,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T02:15:18.353466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":19734,"num_write":322,"num_write_kb":51043,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"23'422","reported_seq":471,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:42.803353+0000","last_change":"2024-03-17T23:56:01.214731+0000","last_active":"2024-03-17T23:59:42.803353+0000","last_peered":"2024-03-17T23:59:42.803353+0000","last_clean":"2024-03-17T23:59:42.803353+0000","last_became_active":"2024-03-17T23:56:01.213795+0000","last_became_peered":"2024-03-17T23:56:01.213795+0000","last_unstale":"2024-03-17T23:59:42.803353+0000","last_undegraded":"2024-03-17T23:59:42.803353+0000","last_fullsized":"2024-03-17T23:59:42.803353+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":422,"log_dups_size":0,"ondisk_log_size":422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T11:32:23.716236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":22221,"num_write":389,"num_write_kb":59485,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"23'402","reported_seq":455,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:42.803564+0000","last_change":"2024-03-17T23:56:01.212409+0000","last_active":"2024-03-17T23:59:42.803564+0000","last_peered":"2024-03-17T23:59:42.803564+0000","last_clean":"2024-03-17T23:59:42.803564+0000","last_became_active":"2024-03-17T23:56:01.211620+0000","last_became_peered":"2024-03-17T23:56:01.211620+0000","last_unstale":"2024-03-17T23:59:42.803564+0000","last_undegraded":"2024-03-17T23:59:42.803564+0000","last_fullsized":"2024-03-17T23:59:42.803564+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T11:40:55.653472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":18482,"num_write":357,"num_write_kb":55072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"23'371","reported_seq":425,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:42.800374+0000","last_change":"2024-03-17T23:56:01.212568+0000","last_active":"2024-03-17T23:59:42.800374+0000","last_peered":"2024-03-17T23:59:42.800374+0000","last_clean":"2024-03-17T23:59:42.800374+0000","last_became_active":"2024-03-17T23:56:01.211561+0000","last_became_peered":"2024-03-17T23:56:01.211561+0000","last_unstale":"2024-03-17T23:59:42.800374+0000","last_undegraded":"2024-03-17T23:59:42.800374+0000","last_fullsized":"2024-03-17T23:59:42.800374+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":371,"log_dups_size":0,"ondisk_log_size":371,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T02:46:13.650384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":21281,"num_write":349,"num_write_kb":38541,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"23'389","reported_seq":431,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:42.785259+0000","last_change":"2024-03-17T23:56:01.186811+0000","last_active":"2024-03-17T23:59:42.785259+0000","last_peered":"2024-03-17T23:59:42.785259+0000","last_clean":"2024-03-17T23:59:42.785259+0000","last_became_active":"2024-03-17T23:56:01.186012+0000","last_became_peered":"2024-03-17T23:56:01.186012+0000","last_unstale":"2024-03-17T23:59:42.785259+0000","last_undegraded":"2024-03-17T23:59:42.785259+0000","last_fullsized":"2024-03-17T23:59:42.785259+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":389,"log_dups_size":0,"ondisk_log_size":389,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T10:35:20.142750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":10579,"num_write":363,"num_write_kb":91649,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"23'398","reported_seq":463,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:42.784930+0000","last_change":"2024-03-17T23:56:01.213648+0000","last_active":"2024-03-17T23:59:42.784930+0000","last_peered":"2024-03-17T23:59:42.784930+0000","last_clean":"2024-03-17T23:59:42.784930+0000","last_became_active":"2024-03-17T23:56:01.205058+0000","last_became_peered":"2024-03-17T23:56:01.205058+0000","last_unstale":"2024-03-17T23:59:42.784930+0000","last_undegraded":"2024-03-17T23:59:42.784930+0000","last_fullsized":"2024-03-17T23:59:42.784930+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T03:49:46.522282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":19128,"num_write":366,"num_write_kb":47322,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"23'424","reported_seq":494,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:42.778219+0000","last_change":"2024-03-17T23:56:01.196817+0000","last_active":"2024-03-17T23:59:42.778219+0000","last_peered":"2024-03-17T23:59:42.778219+0000","last_clean":"2024-03-17T23:59:42.778219+0000","last_became_active":"2024-03-17T23:56:01.195960+0000","last_became_peered":"2024-03-17T23:56:01.195960+0000","last_unstale":"2024-03-17T23:59:42.778219+0000","last_undegraded":"2024-03-17T23:59:42.778219+0000","last_fullsized":"2024-03-17T23:59:42.778219+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T10:13:51.662432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":28789,"num_write":400,"num_write_kb":133401,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"23'431","reported_seq":488,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:42.790618+0000","last_change":"2024-03-17T23:56:01.182140+0000","last_active":"2024-03-17T23:59:42.790618+0000","last_peered":"2024-03-17T23:59:42.790618+0000","last_clean":"2024-03-17T23:59:42.790618+0000","last_became_active":"2024-03-17T23:56:01.181405+0000","last_became_peered":"2024-03-17T23:56:01.181405+0000","last_unstale":"2024-03-17T23:59:42.790618+0000","last_undegraded":"2024-03-17T23:59:42.790618+0000","last_fullsized":"2024-03-17T23:59:42.790618+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":431,"log_dups_size":0,"ondisk_log_size":431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T02:46:13.650384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":18708,"num_write":399,"num_write_kb":108829,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"23'444","reported_seq":492,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:42.794403+0000","last_change":"2024-03-17T23:56:01.194871+0000","last_active":"2024-03-17T23:59:42.794403+0000","last_peered":"2024-03-17T23:59:42.794403+0000","last_clean":"2024-03-17T23:59:42.794403+0000","last_became_active":"2024-03-17T23:56:01.193384+0000","last_became_peered":"2024-03-17T23:56:01.193384+0000","last_unstale":"2024-03-17T23:59:42.794403+0000","last_undegraded":"2024-03-17T23:59:42.794403+0000","last_fullsized":"2024-03-17T23:59:42.794403+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":444,"log_dups_size":0,"ondisk_log_size":444,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T11:40:55.653472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":15377,"num_write":410,"num_write_kb":59358,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"23'402","reported_seq":442,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:42.794413+0000","last_change":"2024-03-17T23:56:49.201529+0000","last_active":"2024-03-17T23:59:42.794413+0000","last_peered":"2024-03-17T23:59:42.794413+0000","last_clean":"2024-03-17T23:59:42.794413+0000","last_became_active":"2024-03-17T23:56:49.201243+0000","last_became_peered":"2024-03-17T23:56:49.201243+0000","last_unstale":"2024-03-17T23:59:42.794413+0000","last_undegraded":"2024-03-17T23:59:42.794413+0000","last_fullsized":"2024-03-17T23:59:42.794413+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T11:01:47.143880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":17500,"num_write":362,"num_write_kb":30628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"23'423","reported_seq":524,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:42.790589+0000","last_change":"2024-03-17T23:56:01.186830+0000","last_active":"2024-03-17T23:59:42.790589+0000","last_peered":"2024-03-17T23:59:42.790589+0000","last_clean":"2024-03-17T23:59:42.790589+0000","last_became_active":"2024-03-17T23:56:01.186001+0000","last_became_peered":"2024-03-17T23:56:01.186001+0000","last_unstale":"2024-03-17T23:59:42.790589+0000","last_undegraded":"2024-03-17T23:59:42.790589+0000","last_fullsized":"2024-03-17T23:59:42.790589+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T01:56:02.340062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":84,"num_read_kb":38931,"num_write":386,"num_write_kb":103946,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"23'421","reported_seq":493,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:42.782611+0000","last_change":"2024-03-17T23:56:01.195354+0000","last_active":"2024-03-17T23:59:42.782611+0000","last_peered":"2024-03-17T23:59:42.782611+0000","last_clean":"2024-03-17T23:59:42.782611+0000","last_became_active":"2024-03-17T23:56:01.194579+0000","last_became_peered":"2024-03-17T23:56:01.194579+0000","last_unstale":"2024-03-17T23:59:42.782611+0000","last_undegraded":"2024-03-17T23:59:42.782611+0000","last_fullsized":"2024-03-17T23:59:42.782611+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T07:53:44.598091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":55,"num_read_kb":28885,"num_write":381,"num_write_kb":71633,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"23'457","reported_seq":552,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:42.792052+0000","last_change":"2024-03-17T23:56:01.193429+0000","last_active":"2024-03-17T23:59:42.792052+0000","last_peered":"2024-03-17T23:59:42.792052+0000","last_clean":"2024-03-17T23:59:42.792052+0000","last_became_active":"2024-03-17T23:56:01.192711+0000","last_became_peered":"2024-03-17T23:56:01.192711+0000","last_unstale":"2024-03-17T23:59:42.792052+0000","last_undegraded":"2024-03-17T23:59:42.792052+0000","last_fullsized":"2024-03-17T23:59:42.792052+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":457,"log_dups_size":0,"ondisk_log_size":457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T08:24:06.922044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":48668,"num_write":427,"num_write_kb":117132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"23'407","reported_seq":460,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:42.798540+0000","last_change":"2024-03-17T23:56:01.203203+0000","last_active":"2024-03-17T23:59:42.798540+0000","last_peered":"2024-03-17T23:59:42.798540+0000","last_clean":"2024-03-17T23:59:42.798540+0000","last_became_active":"2024-03-17T23:56:01.202491+0000","last_became_peered":"2024-03-17T23:56:01.202491+0000","last_unstale":"2024-03-17T23:59:42.798540+0000","last_undegraded":"2024-03-17T23:59:42.798540+0000","last_fullsized":"2024-03-17T23:59:42.798540+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T11:35:21.037222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":19175,"num_write":379,"num_write_kb":50742,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"23'423","reported_seq":479,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:42.783044+0000","last_change":"2024-03-17T23:56:49.199752+0000","last_active":"2024-03-17T23:59:42.783044+0000","last_peered":"2024-03-17T23:59:42.783044+0000","last_clean":"2024-03-17T23:59:42.783044+0000","last_became_active":"2024-03-17T23:56:49.199410+0000","last_became_peered":"2024-03-17T23:56:49.199410+0000","last_unstale":"2024-03-17T23:59:42.783044+0000","last_undegraded":"2024-03-17T23:59:42.783044+0000","last_fullsized":"2024-03-17T23:59:42.783044+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T03:18:40.457769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":41103,"num_write":390,"num_write_kb":67292,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.29","version":"23'406","reported_seq":463,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:42.787483+0000","last_change":"2024-03-17T23:56:01.213157+0000","last_active":"2024-03-17T23:59:42.787483+0000","last_peered":"2024-03-17T23:59:42.787483+0000","last_clean":"2024-03-17T23:59:42.787483+0000","last_became_active":"2024-03-17T23:56:01.205601+0000","last_became_peered":"2024-03-17T23:56:01.205601+0000","last_unstale":"2024-03-17T23:59:42.787483+0000","last_undegraded":"2024-03-17T23:59:42.787483+0000","last_fullsized":"2024-03-17T23:59:42.787483+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T00:26:55.287891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":19558,"num_write":374,"num_write_kb":63755,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"23'448","reported_seq":535,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:42.794334+0000","last_change":"2024-03-17T23:56:01.194995+0000","last_active":"2024-03-17T23:59:42.794334+0000","last_peered":"2024-03-17T23:59:42.794334+0000","last_clean":"2024-03-17T23:59:42.794334+0000","last_became_active":"2024-03-17T23:56:01.194290+0000","last_became_peered":"2024-03-17T23:56:01.194290+0000","last_unstale":"2024-03-17T23:59:42.794334+0000","last_undegraded":"2024-03-17T23:59:42.794334+0000","last_fullsized":"2024-03-17T23:59:42.794334+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T07:03:18.208772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":70,"num_read_kb":26782,"num_write":421,"num_write_kb":88405,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"23'403","reported_seq":456,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:42.782500+0000","last_change":"2024-03-17T23:56:01.205233+0000","last_active":"2024-03-17T23:59:42.782500+0000","last_peered":"2024-03-17T23:59:42.782500+0000","last_clean":"2024-03-17T23:59:42.782500+0000","last_became_active":"2024-03-17T23:56:01.204456+0000","last_became_peered":"2024-03-17T23:56:01.204456+0000","last_unstale":"2024-03-17T23:59:42.782500+0000","last_undegraded":"2024-03-17T23:59:42.782500+0000","last_fullsized":"2024-03-17T23:59:42.782500+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":403,"log_dups_size":0,"ondisk_log_size":403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T06:25:58.489959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":21212,"num_write":389,"num_write_kb":62665,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"23'456","reported_seq":517,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:42.800573+0000","last_change":"2024-03-17T23:56:01.210984+0000","last_active":"2024-03-17T23:59:42.800573+0000","last_peered":"2024-03-17T23:59:42.800573+0000","last_clean":"2024-03-17T23:59:42.800573+0000","last_became_active":"2024-03-17T23:56:01.210025+0000","last_became_peered":"2024-03-17T23:56:01.210025+0000","last_unstale":"2024-03-17T23:59:42.800573+0000","last_undegraded":"2024-03-17T23:59:42.800573+0000","last_fullsized":"2024-03-17T23:59:42.800573+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":456,"log_dups_size":0,"ondisk_log_size":456,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T00:26:55.287891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":24179,"num_write":417,"num_write_kb":68058,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"23'406","reported_seq":488,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:42.757304+0000","last_change":"2024-03-17T23:56:01.205461+0000","last_active":"2024-03-17T23:59:42.757304+0000","last_peered":"2024-03-17T23:59:42.757304+0000","last_clean":"2024-03-17T23:59:42.757304+0000","last_became_active":"2024-03-17T23:56:01.204676+0000","last_became_peered":"2024-03-17T23:56:01.204676+0000","last_unstale":"2024-03-17T23:59:42.757304+0000","last_undegraded":"2024-03-17T23:59:42.757304+0000","last_fullsized":"2024-03-17T23:59:42.757304+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T11:40:55.653472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":32120,"num_write":380,"num_write_kb":55330,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"23'390","reported_seq":470,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:42.784777+0000","last_change":"2024-03-17T23:56:01.205530+0000","last_active":"2024-03-17T23:59:42.784777+0000","last_peered":"2024-03-17T23:59:42.784777+0000","last_clean":"2024-03-17T23:59:42.784777+0000","last_became_active":"2024-03-17T23:56:01.204637+0000","last_became_peered":"2024-03-17T23:56:01.204637+0000","last_unstale":"2024-03-17T23:59:42.784777+0000","last_undegraded":"2024-03-17T23:59:42.784777+0000","last_fullsized":"2024-03-17T23:59:42.784777+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T07:03:18.208772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":33745,"num_write":363,"num_write_kb":72094,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"23'405","reported_seq":483,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:42.789252+0000","last_change":"2024-03-17T23:56:01.207143+0000","last_active":"2024-03-17T23:59:42.789252+0000","last_peered":"2024-03-17T23:59:42.789252+0000","last_clean":"2024-03-17T23:59:42.789252+0000","last_became_active":"2024-03-17T23:56:01.206466+0000","last_became_peered":"2024-03-17T23:56:01.206466+0000","last_unstale":"2024-03-17T23:59:42.789252+0000","last_undegraded":"2024-03-17T23:59:42.789252+0000","last_fullsized":"2024-03-17T23:59:42.789252+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T02:46:13.650384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":31525,"num_write":373,"num_write_kb":67528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"23'457","reported_seq":519,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:42.791548+0000","last_change":"2024-03-17T23:56:01.205414+0000","last_active":"2024-03-17T23:59:42.791548+0000","last_peered":"2024-03-17T23:59:42.791548+0000","last_clean":"2024-03-17T23:59:42.791548+0000","last_became_active":"2024-03-17T23:56:01.204418+0000","last_became_peered":"2024-03-17T23:56:01.204418+0000","last_unstale":"2024-03-17T23:59:42.791548+0000","last_undegraded":"2024-03-17T23:59:42.791548+0000","last_fullsized":"2024-03-17T23:59:42.791548+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":457,"log_dups_size":0,"ondisk_log_size":457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T03:59:56.032635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":20620,"num_write":418,"num_write_kb":58690,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"23'455","reported_seq":528,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:42.798202+0000","last_change":"2024-03-17T23:56:01.213242+0000","last_active":"2024-03-17T23:59:42.798202+0000","last_peered":"2024-03-17T23:59:42.798202+0000","last_clean":"2024-03-17T23:59:42.798202+0000","last_became_active":"2024-03-17T23:56:01.212456+0000","last_became_peered":"2024-03-17T23:56:01.212456+0000","last_unstale":"2024-03-17T23:59:42.798202+0000","last_undegraded":"2024-03-17T23:59:42.798202+0000","last_fullsized":"2024-03-17T23:59:42.798202+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":455,"log_dups_size":0,"ondisk_log_size":455,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T11:11:33.525431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":21571,"num_write":428,"num_write_kb":105002,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"23'449","reported_seq":511,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:42.788396+0000","last_change":"2024-03-17T23:56:01.197502+0000","last_active":"2024-03-17T23:59:42.788396+0000","last_peered":"2024-03-17T23:59:42.788396+0000","last_clean":"2024-03-17T23:59:42.788396+0000","last_became_active":"2024-03-17T23:56:01.196672+0000","last_became_peered":"2024-03-17T23:56:01.196672+0000","last_unstale":"2024-03-17T23:59:42.788396+0000","last_undegraded":"2024-03-17T23:59:42.788396+0000","last_fullsized":"2024-03-17T23:59:42.788396+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":449,"log_dups_size":0,"ondisk_log_size":449,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T05:26:03.654839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":29527,"num_write":419,"num_write_kb":89588,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"23'417","reported_seq":480,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:42.782264+0000","last_change":"2024-03-17T23:56:01.169196+0000","last_active":"2024-03-17T23:59:42.782264+0000","last_peered":"2024-03-17T23:59:42.782264+0000","last_clean":"2024-03-17T23:59:42.782264+0000","last_became_active":"2024-03-17T23:56:01.168199+0000","last_became_peered":"2024-03-17T23:56:01.168199+0000","last_unstale":"2024-03-17T23:59:42.782264+0000","last_undegraded":"2024-03-17T23:59:42.782264+0000","last_fullsized":"2024-03-17T23:59:42.782264+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T11:11:33.525431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":34411,"num_write":387,"num_write_kb":91588,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"23'76","reported_seq":95,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:39.379696+0000","last_change":"2024-03-17T23:56:00.675134+0000","last_active":"2024-03-17T23:59:39.379696+0000","last_peered":"2024-03-17T23:59:39.379696+0000","last_clean":"2024-03-17T23:59:39.379696+0000","last_became_active":"2024-03-17T23:56:00.674772+0000","last_became_peered":"2024-03-17T23:56:00.674772+0000","last_unstale":"2024-03-17T23:59:39.379696+0000","last_undegraded":"2024-03-17T23:59:39.379696+0000","last_fullsized":"2024-03-17T23:59:39.379696+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_clean_scrub_stamp":"2024-03-17T23:55:59.626739+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T07:03:16.148691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4195508,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33,"num_write_kb":4113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"23'387","reported_seq":428,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:42.792854+0000","last_change":"2024-03-17T23:56:01.199837+0000","last_active":"2024-03-17T23:59:42.792854+0000","last_peered":"2024-03-17T23:59:42.792854+0000","last_clean":"2024-03-17T23:59:42.792854+0000","last_became_active":"2024-03-17T23:56:01.199084+0000","last_became_peered":"2024-03-17T23:56:01.199084+0000","last_unstale":"2024-03-17T23:59:42.792854+0000","last_undegraded":"2024-03-17T23:59:42.792854+0000","last_fullsized":"2024-03-17T23:59:42.792854+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":387,"log_dups_size":0,"ondisk_log_size":387,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T00:26:55.287891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":13388,"num_write":363,"num_write_kb":66558,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"23'376","reported_seq":395,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:38.393706+0000","last_change":"2024-03-17T23:56:00.683252+0000","last_active":"2024-03-17T23:59:38.393706+0000","last_peered":"2024-03-17T23:59:38.393706+0000","last_clean":"2024-03-17T23:59:38.393706+0000","last_became_active":"2024-03-17T23:56:00.682487+0000","last_became_peered":"2024-03-17T23:56:00.682487+0000","last_unstale":"2024-03-17T23:59:38.393706+0000","last_undegraded":"2024-03-17T23:59:38.393706+0000","last_fullsized":"2024-03-17T23:59:38.393706+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_clean_scrub_stamp":"2024-03-17T23:55:59.626739+0000","objects_scrubbed":0,"log_size":376,"log_dups_size":0,"ondisk_log_size":376,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T04:07:26.256885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":319,"num_write_kb":12441,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"23'246","reported_seq":265,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:38.403114+0000","last_change":"2024-03-17T23:56:00.688353+0000","last_active":"2024-03-17T23:59:38.403114+0000","last_peered":"2024-03-17T23:59:38.403114+0000","last_clean":"2024-03-17T23:59:38.403114+0000","last_became_active":"2024-03-17T23:56:00.688016+0000","last_became_peered":"2024-03-17T23:56:00.688016+0000","last_unstale":"2024-03-17T23:59:38.403114+0000","last_undegraded":"2024-03-17T23:59:38.403114+0000","last_fullsized":"2024-03-17T23:59:38.403114+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_clean_scrub_stamp":"2024-03-17T23:55:59.626739+0000","objects_scrubbed":0,"log_size":246,"log_dups_size":0,"ondisk_log_size":246,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T09:07:52.005791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":201,"num_write_kb":4204,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"23'436","reported_seq":488,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:42.768722+0000","last_change":"2024-03-17T23:56:01.211541+0000","last_active":"2024-03-17T23:59:42.768722+0000","last_peered":"2024-03-17T23:59:42.768722+0000","last_clean":"2024-03-17T23:59:42.768722+0000","last_became_active":"2024-03-17T23:56:01.205709+0000","last_became_peered":"2024-03-17T23:56:01.205709+0000","last_unstale":"2024-03-17T23:59:42.768722+0000","last_undegraded":"2024-03-17T23:59:42.768722+0000","last_fullsized":"2024-03-17T23:59:42.768722+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":436,"log_dups_size":0,"ondisk_log_size":436,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T11:35:21.037222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":21447,"num_write":401,"num_write_kb":58853,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"23'777","reported_seq":796,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:37.491924+0000","last_change":"2024-03-17T23:56:00.690234+0000","last_active":"2024-03-17T23:59:37.491924+0000","last_peered":"2024-03-17T23:59:37.491924+0000","last_clean":"2024-03-17T23:59:37.491924+0000","last_became_active":"2024-03-17T23:56:00.689202+0000","last_became_peered":"2024-03-17T23:56:00.689202+0000","last_unstale":"2024-03-17T23:59:37.491924+0000","last_undegraded":"2024-03-17T23:59:37.491924+0000","last_fullsized":"2024-03-17T23:59:37.491924+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_clean_scrub_stamp":"2024-03-17T23:55:59.626739+0000","objects_scrubbed":0,"log_size":777,"log_dups_size":0,"ondisk_log_size":777,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T05:52:39.451210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389190,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":707,"num_write_kb":8542,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"23'416","reported_seq":458,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:42.763828+0000","last_change":"2024-03-17T23:56:49.077939+0000","last_active":"2024-03-17T23:59:42.763828+0000","last_peered":"2024-03-17T23:59:42.763828+0000","last_clean":"2024-03-17T23:59:42.763828+0000","last_became_active":"2024-03-17T23:56:49.077645+0000","last_became_peered":"2024-03-17T23:56:49.077645+0000","last_unstale":"2024-03-17T23:59:42.763828+0000","last_undegraded":"2024-03-17T23:59:42.763828+0000","last_fullsized":"2024-03-17T23:59:42.763828+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":416,"log_dups_size":0,"ondisk_log_size":416,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T09:27:16.124506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":16384,"num_write":381,"num_write_kb":66829,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"23'56","reported_seq":75,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:42.707701+0000","last_change":"2024-03-17T23:56:00.696649+0000","last_active":"2024-03-17T23:59:42.707701+0000","last_peered":"2024-03-17T23:59:42.707701+0000","last_clean":"2024-03-17T23:59:42.707701+0000","last_became_active":"2024-03-17T23:56:00.696307+0000","last_became_peered":"2024-03-17T23:56:00.696307+0000","last_unstale":"2024-03-17T23:59:42.707701+0000","last_undegraded":"2024-03-17T23:59:42.707701+0000","last_fullsized":"2024-03-17T23:59:42.707701+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_clean_scrub_stamp":"2024-03-17T23:55:59.626739+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T07:28:27.310340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"23'399","reported_seq":426,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:42.797918+0000","last_change":"2024-03-17T23:56:01.194103+0000","last_active":"2024-03-17T23:59:42.797918+0000","last_peered":"2024-03-17T23:59:42.797918+0000","last_clean":"2024-03-17T23:59:42.797918+0000","last_became_active":"2024-03-17T23:56:01.193354+0000","last_became_peered":"2024-03-17T23:56:01.193354+0000","last_unstale":"2024-03-17T23:59:42.797918+0000","last_undegraded":"2024-03-17T23:59:42.797918+0000","last_fullsized":"2024-03-17T23:59:42.797918+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T00:21:36.556648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":5056,"num_write":368,"num_write_kb":26036,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"23'216","reported_seq":235,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:40.404457+0000","last_change":"2024-03-17T23:56:00.689876+0000","last_active":"2024-03-17T23:59:40.404457+0000","last_peered":"2024-03-17T23:59:40.404457+0000","last_clean":"2024-03-17T23:59:40.404457+0000","last_became_active":"2024-03-17T23:56:00.688667+0000","last_became_peered":"2024-03-17T23:56:00.688667+0000","last_unstale":"2024-03-17T23:59:40.404457+0000","last_undegraded":"2024-03-17T23:59:40.404457+0000","last_fullsized":"2024-03-17T23:59:40.404457+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_clean_scrub_stamp":"2024-03-17T23:55:59.626739+0000","objects_scrubbed":0,"log_size":216,"log_dups_size":0,"ondisk_log_size":216,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T09:45:24.650866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":150,"num_write_kb":4172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"23'399","reported_seq":431,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:42.775949+0000","last_change":"2024-03-17T23:56:49.085328+0000","last_active":"2024-03-17T23:59:42.775949+0000","last_peered":"2024-03-17T23:59:42.775949+0000","last_clean":"2024-03-17T23:59:42.775949+0000","last_became_active":"2024-03-17T23:56:49.085029+0000","last_became_peered":"2024-03-17T23:56:49.085029+0000","last_unstale":"2024-03-17T23:59:42.775949+0000","last_undegraded":"2024-03-17T23:59:42.775949+0000","last_fullsized":"2024-03-17T23:59:42.775949+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T06:47:05.968601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":4310,"num_write":367,"num_write_kb":43629,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"23'139","reported_seq":158,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:41.384518+0000","last_change":"2024-03-17T23:56:00.677495+0000","last_active":"2024-03-17T23:59:41.384518+0000","last_peered":"2024-03-17T23:59:41.384518+0000","last_clean":"2024-03-17T23:59:41.384518+0000","last_became_active":"2024-03-17T23:56:00.677165+0000","last_became_peered":"2024-03-17T23:56:00.677165+0000","last_unstale":"2024-03-17T23:59:41.384518+0000","last_undegraded":"2024-03-17T23:59:41.384518+0000","last_fullsized":"2024-03-17T23:59:41.384518+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_clean_scrub_stamp":"2024-03-17T23:55:59.626739+0000","objects_scrubbed":0,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T04:07:26.256885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":91,"num_write_kb":92,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"23'391","reported_seq":452,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:42.786019+0000","last_change":"2024-03-17T23:56:01.190913+0000","last_active":"2024-03-17T23:59:42.786019+0000","last_peered":"2024-03-17T23:59:42.786019+0000","last_clean":"2024-03-17T23:59:42.786019+0000","last_became_active":"2024-03-17T23:56:01.190191+0000","last_became_peered":"2024-03-17T23:56:01.190191+0000","last_unstale":"2024-03-17T23:59:42.786019+0000","last_undegraded":"2024-03-17T23:59:42.786019+0000","last_fullsized":"2024-03-17T23:59:42.786019+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T09:57:50.285832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":22035,"num_write":358,"num_write_kb":71462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"23'261","reported_seq":280,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:42.708202+0000","last_change":"2024-03-17T23:56:00.686597+0000","last_active":"2024-03-17T23:59:42.708202+0000","last_peered":"2024-03-17T23:59:42.708202+0000","last_clean":"2024-03-17T23:59:42.708202+0000","last_became_active":"2024-03-17T23:56:00.685757+0000","last_became_peered":"2024-03-17T23:56:00.685757+0000","last_unstale":"2024-03-17T23:59:42.708202+0000","last_undegraded":"2024-03-17T23:59:42.708202+0000","last_fullsized":"2024-03-17T23:59:42.708202+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_clean_scrub_stamp":"2024-03-17T23:55:59.626739+0000","objects_scrubbed":0,"log_size":261,"log_dups_size":0,"ondisk_log_size":261,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T10:35:19.139554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11902300,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":217,"num_write_kb":11743,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"23'404","reported_seq":469,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:42.794840+0000","last_change":"2024-03-17T23:56:01.216238+0000","last_active":"2024-03-17T23:59:42.794840+0000","last_peered":"2024-03-17T23:59:42.794840+0000","last_clean":"2024-03-17T23:59:42.794840+0000","last_became_active":"2024-03-17T23:56:01.215526+0000","last_became_peered":"2024-03-17T23:56:01.215526+0000","last_unstale":"2024-03-17T23:59:42.794840+0000","last_undegraded":"2024-03-17T23:59:42.794840+0000","last_fullsized":"2024-03-17T23:59:42.794840+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T03:18:40.457769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":29805,"num_write":370,"num_write_kb":75602,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"23'543","reported_seq":562,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:37.441750+0000","last_change":"2024-03-17T23:56:00.682756+0000","last_active":"2024-03-17T23:59:37.441750+0000","last_peered":"2024-03-17T23:59:37.441750+0000","last_clean":"2024-03-17T23:59:37.441750+0000","last_became_active":"2024-03-17T23:56:00.682392+0000","last_became_peered":"2024-03-17T23:56:00.682392+0000","last_unstale":"2024-03-17T23:59:37.441750+0000","last_undegraded":"2024-03-17T23:59:37.441750+0000","last_fullsized":"2024-03-17T23:59:37.441750+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_clean_scrub_stamp":"2024-03-17T23:55:59.626739+0000","objects_scrubbed":0,"log_size":543,"log_dups_size":0,"ondisk_log_size":543,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T04:54:08.515514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388676,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":488,"num_write_kb":8403,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"23'418","reported_seq":480,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:42.795714+0000","last_change":"2024-03-17T23:56:01.218114+0000","last_active":"2024-03-17T23:59:42.795714+0000","last_peered":"2024-03-17T23:59:42.795714+0000","last_clean":"2024-03-17T23:59:42.795714+0000","last_became_active":"2024-03-17T23:56:01.217434+0000","last_became_peered":"2024-03-17T23:56:01.217434+0000","last_unstale":"2024-03-17T23:59:42.795714+0000","last_undegraded":"2024-03-17T23:59:42.795714+0000","last_fullsized":"2024-03-17T23:59:42.795714+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T06:56:40.687109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":24728,"num_write":388,"num_write_kb":63632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"23'69","reported_seq":88,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:40.390514+0000","last_change":"2024-03-17T23:56:00.696766+0000","last_active":"2024-03-17T23:59:40.390514+0000","last_peered":"2024-03-17T23:59:40.390514+0000","last_clean":"2024-03-17T23:59:40.390514+0000","last_became_active":"2024-03-17T23:56:00.695592+0000","last_became_peered":"2024-03-17T23:56:00.695592+0000","last_unstale":"2024-03-17T23:59:40.390514+0000","last_undegraded":"2024-03-17T23:59:40.390514+0000","last_fullsized":"2024-03-17T23:59:40.390514+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_clean_scrub_stamp":"2024-03-17T23:55:59.626739+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T04:07:26.256885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"23'401","reported_seq":467,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:42.795485+0000","last_change":"2024-03-17T23:56:01.208385+0000","last_active":"2024-03-17T23:59:42.795485+0000","last_peered":"2024-03-17T23:59:42.795485+0000","last_clean":"2024-03-17T23:59:42.795485+0000","last_became_active":"2024-03-17T23:56:01.207791+0000","last_became_peered":"2024-03-17T23:56:01.207791+0000","last_unstale":"2024-03-17T23:59:42.795485+0000","last_undegraded":"2024-03-17T23:59:42.795485+0000","last_fullsized":"2024-03-17T23:59:42.795485+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T11:08:21.695552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":27500,"num_write":363,"num_write_kb":68441,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"23'70","reported_seq":89,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:39.432969+0000","last_change":"2024-03-17T23:56:00.686159+0000","last_active":"2024-03-17T23:59:39.432969+0000","last_peered":"2024-03-17T23:59:39.432969+0000","last_clean":"2024-03-17T23:59:39.432969+0000","last_became_active":"2024-03-17T23:56:00.685354+0000","last_became_peered":"2024-03-17T23:56:00.685354+0000","last_unstale":"2024-03-17T23:59:39.432969+0000","last_undegraded":"2024-03-17T23:59:39.432969+0000","last_fullsized":"2024-03-17T23:59:39.432969+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_clean_scrub_stamp":"2024-03-17T23:55:59.626739+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T09:45:24.650866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"23'449","reported_seq":503,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:42.784590+0000","last_change":"2024-03-17T23:56:01.197137+0000","last_active":"2024-03-17T23:59:42.784590+0000","last_peered":"2024-03-17T23:59:42.784590+0000","last_clean":"2024-03-17T23:59:42.784590+0000","last_became_active":"2024-03-17T23:56:01.196356+0000","last_became_peered":"2024-03-17T23:56:01.196356+0000","last_unstale":"2024-03-17T23:59:42.784590+0000","last_undegraded":"2024-03-17T23:59:42.784590+0000","last_fullsized":"2024-03-17T23:59:42.784590+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":449,"log_dups_size":0,"ondisk_log_size":449,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T11:35:21.037222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":24107,"num_write":423,"num_write_kb":92187,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"23'76","reported_seq":95,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:40.420907+0000","last_change":"2024-03-17T23:56:00.682828+0000","last_active":"2024-03-17T23:59:40.420907+0000","last_peered":"2024-03-17T23:59:40.420907+0000","last_clean":"2024-03-17T23:59:40.420907+0000","last_became_active":"2024-03-17T23:56:00.682469+0000","last_became_peered":"2024-03-17T23:56:00.682469+0000","last_unstale":"2024-03-17T23:59:40.420907+0000","last_undegraded":"2024-03-17T23:59:40.420907+0000","last_fullsized":"2024-03-17T23:59:40.420907+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_clean_scrub_stamp":"2024-03-17T23:55:59.626739+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T05:52:39.451210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"23'486","reported_seq":562,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:42.795657+0000","last_change":"2024-03-17T23:56:01.209356+0000","last_active":"2024-03-17T23:59:42.795657+0000","last_peered":"2024-03-17T23:59:42.795657+0000","last_clean":"2024-03-17T23:59:42.795657+0000","last_became_active":"2024-03-17T23:56:01.208381+0000","last_became_peered":"2024-03-17T23:56:01.208381+0000","last_unstale":"2024-03-17T23:59:42.795657+0000","last_undegraded":"2024-03-17T23:59:42.795657+0000","last_fullsized":"2024-03-17T23:59:42.795657+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":486,"log_dups_size":0,"ondisk_log_size":486,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T03:01:01.120023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":26966,"num_write":455,"num_write_kb":93532,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"23'177","reported_seq":196,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:40.454947+0000","last_change":"2024-03-17T23:56:00.683595+0000","last_active":"2024-03-17T23:59:40.454947+0000","last_peered":"2024-03-17T23:59:40.454947+0000","last_clean":"2024-03-17T23:59:40.454947+0000","last_became_active":"2024-03-17T23:56:00.681338+0000","last_became_peered":"2024-03-17T23:56:00.681338+0000","last_unstale":"2024-03-17T23:59:40.454947+0000","last_undegraded":"2024-03-17T23:59:40.454947+0000","last_fullsized":"2024-03-17T23:59:40.454947+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_clean_scrub_stamp":"2024-03-17T23:55:59.626739+0000","objects_scrubbed":0,"log_size":177,"log_dups_size":0,"ondisk_log_size":177,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T08:58:55.725638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":124,"num_write_kb":4160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"23'378","reported_seq":419,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:42.786885+0000","last_change":"2024-03-17T23:56:01.212669+0000","last_active":"2024-03-17T23:59:42.786885+0000","last_peered":"2024-03-17T23:59:42.786885+0000","last_clean":"2024-03-17T23:59:42.786885+0000","last_became_active":"2024-03-17T23:56:01.206691+0000","last_became_peered":"2024-03-17T23:56:01.206691+0000","last_unstale":"2024-03-17T23:59:42.786885+0000","last_undegraded":"2024-03-17T23:59:42.786885+0000","last_fullsized":"2024-03-17T23:59:42.786885+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":378,"log_dups_size":0,"ondisk_log_size":378,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T03:59:56.032635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":10737,"num_write":348,"num_write_kb":63025,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"23'326","reported_seq":345,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:38.421026+0000","last_change":"2024-03-17T23:56:00.690801+0000","last_active":"2024-03-17T23:59:38.421026+0000","last_peered":"2024-03-17T23:59:38.421026+0000","last_clean":"2024-03-17T23:59:38.421026+0000","last_became_active":"2024-03-17T23:56:00.690516+0000","last_became_peered":"2024-03-17T23:56:00.690516+0000","last_unstale":"2024-03-17T23:59:38.421026+0000","last_undegraded":"2024-03-17T23:59:38.421026+0000","last_fullsized":"2024-03-17T23:59:38.421026+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_clean_scrub_stamp":"2024-03-17T23:55:59.626739+0000","objects_scrubbed":0,"log_size":326,"log_dups_size":0,"ondisk_log_size":326,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T09:07:52.005791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":276,"num_write_kb":4244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"23'384","reported_seq":452,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:42.803873+0000","last_change":"2024-03-17T23:56:01.213733+0000","last_active":"2024-03-17T23:59:42.803873+0000","last_peered":"2024-03-17T23:59:42.803873+0000","last_clean":"2024-03-17T23:59:42.803873+0000","last_became_active":"2024-03-17T23:56:01.213095+0000","last_became_peered":"2024-03-17T23:56:01.213095+0000","last_unstale":"2024-03-17T23:59:42.803873+0000","last_undegraded":"2024-03-17T23:59:42.803873+0000","last_fullsized":"2024-03-17T23:59:42.803873+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T08:57:40.944494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":39304,"num_write":347,"num_write_kb":50502,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"23'572","reported_seq":591,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:38.404189+0000","last_change":"2024-03-17T23:56:00.672267+0000","last_active":"2024-03-17T23:59:38.404189+0000","last_peered":"2024-03-17T23:59:38.404189+0000","last_clean":"2024-03-17T23:59:38.404189+0000","last_became_active":"2024-03-17T23:56:00.671655+0000","last_became_peered":"2024-03-17T23:56:00.671655+0000","last_unstale":"2024-03-17T23:59:38.404189+0000","last_undegraded":"2024-03-17T23:59:38.404189+0000","last_fullsized":"2024-03-17T23:59:38.404189+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_clean_scrub_stamp":"2024-03-17T23:55:59.626739+0000","objects_scrubbed":0,"log_size":572,"log_dups_size":0,"ondisk_log_size":572,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T09:45:24.650866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":517,"num_write_kb":4347,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"23'451","reported_seq":497,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:42.794648+0000","last_change":"2024-03-17T23:56:01.204789+0000","last_active":"2024-03-17T23:59:42.794648+0000","last_peered":"2024-03-17T23:59:42.794648+0000","last_clean":"2024-03-17T23:59:42.794648+0000","last_became_active":"2024-03-17T23:56:01.196002+0000","last_became_peered":"2024-03-17T23:56:01.196002+0000","last_unstale":"2024-03-17T23:59:42.794648+0000","last_undegraded":"2024-03-17T23:59:42.794648+0000","last_fullsized":"2024-03-17T23:59:42.794648+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":451,"log_dups_size":0,"ondisk_log_size":451,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T07:53:44.598091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":21931,"num_write":417,"num_write_kb":63333,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"23'70","reported_seq":89,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:40.428715+0000","last_change":"2024-03-17T23:56:00.679054+0000","last_active":"2024-03-17T23:59:40.428715+0000","last_peered":"2024-03-17T23:59:40.428715+0000","last_clean":"2024-03-17T23:59:40.428715+0000","last_became_active":"2024-03-17T23:56:00.677831+0000","last_became_peered":"2024-03-17T23:56:00.677831+0000","last_unstale":"2024-03-17T23:59:40.428715+0000","last_undegraded":"2024-03-17T23:59:40.428715+0000","last_fullsized":"2024-03-17T23:59:40.428715+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_clean_scrub_stamp":"2024-03-17T23:55:59.626739+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T04:07:26.256885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1752,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"23'407","reported_seq":466,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:42.800461+0000","last_change":"2024-03-17T23:56:01.214619+0000","last_active":"2024-03-17T23:59:42.800461+0000","last_peered":"2024-03-17T23:59:42.800461+0000","last_clean":"2024-03-17T23:59:42.800461+0000","last_became_active":"2024-03-17T23:56:01.213960+0000","last_became_peered":"2024-03-17T23:56:01.213960+0000","last_unstale":"2024-03-17T23:59:42.800461+0000","last_undegraded":"2024-03-17T23:59:42.800461+0000","last_fullsized":"2024-03-17T23:59:42.800461+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T11:01:47.143880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":22422,"num_write":380,"num_write_kb":66960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":175,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:56:49.197633+0000","last_change":"2024-03-17T23:55:58.106405+0000","last_active":"2024-03-17T23:56:49.197633+0000","last_peered":"2024-03-17T23:56:49.197633+0000","last_clean":"2024-03-17T23:56:49.197633+0000","last_became_active":"2024-03-17T23:55:58.104493+0000","last_became_peered":"2024-03-17T23:55:58.104493+0000","last_unstale":"2024-03-17T23:56:49.197633+0000","last_undegraded":"2024-03-17T23:56:49.197633+0000","last_fullsized":"2024-03-17T23:56:49.197633+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:55:56.609001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:55:56.609001+0000","last_clean_scrub_stamp":"2024-03-17T23:55:56.609001+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T08:58:52.707900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"23'82","reported_seq":101,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:40.434177+0000","last_change":"2024-03-17T23:56:00.678791+0000","last_active":"2024-03-17T23:59:40.434177+0000","last_peered":"2024-03-17T23:59:40.434177+0000","last_clean":"2024-03-17T23:59:40.434177+0000","last_became_active":"2024-03-17T23:56:00.677660+0000","last_became_peered":"2024-03-17T23:56:00.677660+0000","last_unstale":"2024-03-17T23:59:40.434177+0000","last_undegraded":"2024-03-17T23:59:40.434177+0000","last_fullsized":"2024-03-17T23:59:40.434177+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_clean_scrub_stamp":"2024-03-17T23:55:59.626739+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T07:28:27.310340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"23'360","reported_seq":396,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:42.798746+0000","last_change":"2024-03-17T23:56:01.213073+0000","last_active":"2024-03-17T23:59:42.798746+0000","last_peered":"2024-03-17T23:59:42.798746+0000","last_clean":"2024-03-17T23:59:42.798746+0000","last_became_active":"2024-03-17T23:56:01.212434+0000","last_became_peered":"2024-03-17T23:56:01.212434+0000","last_unstale":"2024-03-17T23:59:42.798746+0000","last_undegraded":"2024-03-17T23:59:42.798746+0000","last_fullsized":"2024-03-17T23:59:42.798746+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":360,"log_dups_size":0,"ondisk_log_size":360,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T08:24:06.922044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":8076,"num_write":326,"num_write_kb":42301,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"23'420","reported_seq":439,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:37.438690+0000","last_change":"2024-03-17T23:56:00.700634+0000","last_active":"2024-03-17T23:59:37.438690+0000","last_peered":"2024-03-17T23:59:37.438690+0000","last_clean":"2024-03-17T23:59:37.438690+0000","last_became_active":"2024-03-17T23:56:00.691617+0000","last_became_peered":"2024-03-17T23:56:00.691617+0000","last_unstale":"2024-03-17T23:59:37.438690+0000","last_undegraded":"2024-03-17T23:59:37.438690+0000","last_fullsized":"2024-03-17T23:59:37.438690+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_clean_scrub_stamp":"2024-03-17T23:55:59.626739+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T11:11:32.522234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":366,"num_write_kb":8360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"23'408","reported_seq":508,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:42.790845+0000","last_change":"2024-03-17T23:56:01.199855+0000","last_active":"2024-03-17T23:59:42.790845+0000","last_peered":"2024-03-17T23:59:42.790845+0000","last_clean":"2024-03-17T23:59:42.790845+0000","last_became_active":"2024-03-17T23:56:01.199121+0000","last_became_peered":"2024-03-17T23:56:01.199121+0000","last_unstale":"2024-03-17T23:59:42.790845+0000","last_undegraded":"2024-03-17T23:59:42.790845+0000","last_fullsized":"2024-03-17T23:59:42.790845+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T09:59:28.908069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":83,"num_read_kb":44834,"num_write":382,"num_write_kb":112569,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"23'288","reported_seq":517,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:42.380720+0000","last_change":"2024-03-17T23:56:00.686560+0000","last_active":"2024-03-17T23:59:42.380720+0000","last_peered":"2024-03-17T23:59:42.380720+0000","last_clean":"2024-03-17T23:59:42.380720+0000","last_became_active":"2024-03-17T23:56:00.686215+0000","last_became_peered":"2024-03-17T23:56:00.686215+0000","last_unstale":"2024-03-17T23:59:42.380720+0000","last_undegraded":"2024-03-17T23:59:42.380720+0000","last_fullsized":"2024-03-17T23:59:42.380720+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_clean_scrub_stamp":"2024-03-17T23:55:59.626739+0000","objects_scrubbed":0,"log_size":288,"log_dups_size":0,"ondisk_log_size":288,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T07:28:27.310340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1468046,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":210,"num_read_kb":1570,"num_write":217,"num_write_kb":1574,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"23'404","reported_seq":435,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:42.740134+0000","last_change":"2024-03-17T23:56:01.193197+0000","last_active":"2024-03-17T23:59:42.740134+0000","last_peered":"2024-03-17T23:59:42.740134+0000","last_clean":"2024-03-17T23:59:42.740134+0000","last_became_active":"2024-03-17T23:56:01.192117+0000","last_became_peered":"2024-03-17T23:56:01.192117+0000","last_unstale":"2024-03-17T23:59:42.740134+0000","last_undegraded":"2024-03-17T23:59:42.740134+0000","last_fullsized":"2024-03-17T23:59:42.740134+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T11:35:21.037222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":8404,"num_write":369,"num_write_kb":38222,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"23'564","reported_seq":583,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:36.422446+0000","last_change":"2024-03-17T23:56:00.696254+0000","last_active":"2024-03-17T23:59:36.422446+0000","last_peered":"2024-03-17T23:59:36.422446+0000","last_clean":"2024-03-17T23:59:36.422446+0000","last_became_active":"2024-03-17T23:56:00.694605+0000","last_became_peered":"2024-03-17T23:56:00.694605+0000","last_unstale":"2024-03-17T23:59:36.422446+0000","last_undegraded":"2024-03-17T23:59:36.422446+0000","last_fullsized":"2024-03-17T23:59:36.422446+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_clean_scrub_stamp":"2024-03-17T23:55:59.626739+0000","objects_scrubbed":0,"log_size":564,"log_dups_size":0,"ondisk_log_size":564,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T10:35:19.139554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389196,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":500,"num_write_kb":8435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"23'401","reported_seq":450,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:42.782955+0000","last_change":"2024-03-17T23:56:01.188278+0000","last_active":"2024-03-17T23:59:42.782955+0000","last_peered":"2024-03-17T23:59:42.782955+0000","last_clean":"2024-03-17T23:59:42.782955+0000","last_became_active":"2024-03-17T23:56:01.187571+0000","last_became_peered":"2024-03-17T23:56:01.187571+0000","last_unstale":"2024-03-17T23:59:42.782955+0000","last_undegraded":"2024-03-17T23:59:42.782955+0000","last_fullsized":"2024-03-17T23:59:42.782955+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T09:45:25.654063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":12494,"num_write":368,"num_write_kb":72170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"23'57","reported_seq":76,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:39.400365+0000","last_change":"2024-03-17T23:56:00.680290+0000","last_active":"2024-03-17T23:59:39.400365+0000","last_peered":"2024-03-17T23:59:39.400365+0000","last_clean":"2024-03-17T23:59:39.400365+0000","last_became_active":"2024-03-17T23:56:00.679981+0000","last_became_peered":"2024-03-17T23:56:00.679981+0000","last_unstale":"2024-03-17T23:59:39.400365+0000","last_undegraded":"2024-03-17T23:59:39.400365+0000","last_fullsized":"2024-03-17T23:59:39.400365+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_clean_scrub_stamp":"2024-03-17T23:55:59.626739+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T10:35:19.139554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"23'455","reported_seq":561,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:42.799702+0000","last_change":"2024-03-17T23:56:01.216640+0000","last_active":"2024-03-17T23:59:42.799702+0000","last_peered":"2024-03-17T23:59:42.799702+0000","last_clean":"2024-03-17T23:59:42.799702+0000","last_became_active":"2024-03-17T23:56:01.216145+0000","last_became_peered":"2024-03-17T23:56:01.216145+0000","last_unstale":"2024-03-17T23:59:42.799702+0000","last_undegraded":"2024-03-17T23:59:42.799702+0000","last_fullsized":"2024-03-17T23:59:42.799702+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":455,"log_dups_size":0,"ondisk_log_size":455,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T11:01:47.143880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":89,"num_read_kb":46763,"num_write":422,"num_write_kb":133395,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"23'223","reported_seq":242,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:39.393925+0000","last_change":"2024-03-17T23:56:00.692896+0000","last_active":"2024-03-17T23:59:39.393925+0000","last_peered":"2024-03-17T23:59:39.393925+0000","last_clean":"2024-03-17T23:59:39.393925+0000","last_became_active":"2024-03-17T23:56:00.692054+0000","last_became_peered":"2024-03-17T23:56:00.692054+0000","last_unstale":"2024-03-17T23:59:39.393925+0000","last_undegraded":"2024-03-17T23:59:39.393925+0000","last_fullsized":"2024-03-17T23:59:39.393925+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_clean_scrub_stamp":"2024-03-17T23:55:59.626739+0000","objects_scrubbed":0,"log_size":223,"log_dups_size":0,"ondisk_log_size":223,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T10:55:17.061099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194416,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":164,"num_write_kb":4176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"23'370","reported_seq":424,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:42.757675+0000","last_change":"2024-03-17T23:56:01.189102+0000","last_active":"2024-03-17T23:59:42.757675+0000","last_peered":"2024-03-17T23:59:42.757675+0000","last_clean":"2024-03-17T23:59:42.757675+0000","last_became_active":"2024-03-17T23:56:01.188353+0000","last_became_peered":"2024-03-17T23:56:01.188353+0000","last_unstale":"2024-03-17T23:59:42.757675+0000","last_undegraded":"2024-03-17T23:59:42.757675+0000","last_fullsized":"2024-03-17T23:59:42.757675+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":370,"log_dups_size":0,"ondisk_log_size":370,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T00:26:55.287891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":24684,"num_write":328,"num_write_kb":42609,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"23'207","reported_seq":226,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:40.794446+0000","last_change":"2024-03-17T23:56:00.689216+0000","last_active":"2024-03-17T23:59:40.794446+0000","last_peered":"2024-03-17T23:59:40.794446+0000","last_clean":"2024-03-17T23:59:40.794446+0000","last_became_active":"2024-03-17T23:56:00.688978+0000","last_became_peered":"2024-03-17T23:56:00.688978+0000","last_unstale":"2024-03-17T23:59:40.794446+0000","last_undegraded":"2024-03-17T23:59:40.794446+0000","last_fullsized":"2024-03-17T23:59:40.794446+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_clean_scrub_stamp":"2024-03-17T23:55:59.626739+0000","objects_scrubbed":0,"log_size":207,"log_dups_size":0,"ondisk_log_size":207,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T09:57:49.282635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":418,"num_write_kb":1562,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"23'361","reported_seq":444,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:42.798955+0000","last_change":"2024-03-17T23:56:01.212041+0000","last_active":"2024-03-17T23:59:42.798955+0000","last_peered":"2024-03-17T23:59:42.798955+0000","last_clean":"2024-03-17T23:59:42.798955+0000","last_became_active":"2024-03-17T23:56:01.211359+0000","last_became_peered":"2024-03-17T23:56:01.211359+0000","last_unstale":"2024-03-17T23:59:42.798955+0000","last_undegraded":"2024-03-17T23:59:42.798955+0000","last_fullsized":"2024-03-17T23:59:42.798955+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":361,"log_dups_size":0,"ondisk_log_size":361,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T11:08:21.695552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":37046,"num_write":339,"num_write_kb":87516,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"23'69","reported_seq":88,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:39.510095+0000","last_change":"2024-03-17T23:56:00.686768+0000","last_active":"2024-03-17T23:59:39.510095+0000","last_peered":"2024-03-17T23:59:39.510095+0000","last_clean":"2024-03-17T23:59:39.510095+0000","last_became_active":"2024-03-17T23:56:00.685461+0000","last_became_peered":"2024-03-17T23:56:00.685461+0000","last_unstale":"2024-03-17T23:59:39.510095+0000","last_undegraded":"2024-03-17T23:59:39.510095+0000","last_fullsized":"2024-03-17T23:59:39.510095+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_clean_scrub_stamp":"2024-03-17T23:55:59.626739+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T05:52:39.451210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"23'472","reported_seq":554,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:42.767925+0000","last_change":"2024-03-17T23:56:01.196364+0000","last_active":"2024-03-17T23:59:42.767925+0000","last_peered":"2024-03-17T23:59:42.767925+0000","last_clean":"2024-03-17T23:59:42.767925+0000","last_became_active":"2024-03-17T23:56:01.191450+0000","last_became_peered":"2024-03-17T23:56:01.191450+0000","last_unstale":"2024-03-17T23:59:42.767925+0000","last_undegraded":"2024-03-17T23:59:42.767925+0000","last_fullsized":"2024-03-17T23:59:42.767925+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":472,"log_dups_size":0,"ondisk_log_size":472,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T02:15:18.353466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":42881,"num_write":439,"num_write_kb":88369,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"23'498","reported_seq":517,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:39.392192+0000","last_change":"2024-03-17T23:56:00.691812+0000","last_active":"2024-03-17T23:59:39.392192+0000","last_peered":"2024-03-17T23:59:39.392192+0000","last_clean":"2024-03-17T23:59:39.392192+0000","last_became_active":"2024-03-17T23:56:00.691381+0000","last_became_peered":"2024-03-17T23:56:00.691381+0000","last_unstale":"2024-03-17T23:59:39.392192+0000","last_undegraded":"2024-03-17T23:59:39.392192+0000","last_fullsized":"2024-03-17T23:59:39.392192+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_clean_scrub_stamp":"2024-03-17T23:55:59.626739+0000","objects_scrubbed":0,"log_size":498,"log_dups_size":0,"ondisk_log_size":498,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T10:35:19.139554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":442,"num_write_kb":4310,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"23'444","reported_seq":509,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:42.745522+0000","last_change":"2024-03-17T23:56:01.195278+0000","last_active":"2024-03-17T23:59:42.745522+0000","last_peered":"2024-03-17T23:59:42.745522+0000","last_clean":"2024-03-17T23:59:42.745522+0000","last_became_active":"2024-03-17T23:56:01.192316+0000","last_became_peered":"2024-03-17T23:56:01.192316+0000","last_unstale":"2024-03-17T23:59:42.745522+0000","last_undegraded":"2024-03-17T23:59:42.745522+0000","last_fullsized":"2024-03-17T23:59:42.745522+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":444,"log_dups_size":0,"ondisk_log_size":444,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T04:07:27.260081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":21819,"num_write":413,"num_write_kb":30190,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"23'60","reported_seq":79,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:38.460611+0000","last_change":"2024-03-17T23:56:00.703680+0000","last_active":"2024-03-17T23:59:38.460611+0000","last_peered":"2024-03-17T23:59:38.460611+0000","last_clean":"2024-03-17T23:59:38.460611+0000","last_became_active":"2024-03-17T23:56:00.703439+0000","last_became_peered":"2024-03-17T23:56:00.703439+0000","last_unstale":"2024-03-17T23:59:38.460611+0000","last_undegraded":"2024-03-17T23:59:38.460611+0000","last_fullsized":"2024-03-17T23:59:38.460611+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_clean_scrub_stamp":"2024-03-17T23:55:59.626739+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T11:11:32.522234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"23'411","reported_seq":446,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:42.761413+0000","last_change":"2024-03-17T23:56:01.191678+0000","last_active":"2024-03-17T23:59:42.761413+0000","last_peered":"2024-03-17T23:59:42.761413+0000","last_clean":"2024-03-17T23:59:42.761413+0000","last_became_active":"2024-03-17T23:56:01.190681+0000","last_became_peered":"2024-03-17T23:56:01.190681+0000","last_unstale":"2024-03-17T23:59:42.761413+0000","last_undegraded":"2024-03-17T23:59:42.761413+0000","last_fullsized":"2024-03-17T23:59:42.761413+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T02:46:13.650384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":2591,"num_write":372,"num_write_kb":17971,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"23'151","reported_seq":170,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:38.428986+0000","last_change":"2024-03-17T23:56:00.679281+0000","last_active":"2024-03-17T23:59:38.428986+0000","last_peered":"2024-03-17T23:59:38.428986+0000","last_clean":"2024-03-17T23:59:38.428986+0000","last_became_active":"2024-03-17T23:56:00.678950+0000","last_became_peered":"2024-03-17T23:56:00.678950+0000","last_unstale":"2024-03-17T23:59:38.428986+0000","last_undegraded":"2024-03-17T23:59:38.428986+0000","last_fullsized":"2024-03-17T23:59:38.428986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_clean_scrub_stamp":"2024-03-17T23:55:59.626739+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T05:52:39.451210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":92,"num_write_kb":4145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"23'431","reported_seq":495,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:42.775522+0000","last_change":"2024-03-17T23:56:01.215539+0000","last_active":"2024-03-17T23:59:42.775522+0000","last_peered":"2024-03-17T23:59:42.775522+0000","last_clean":"2024-03-17T23:59:42.775522+0000","last_became_active":"2024-03-17T23:56:01.211163+0000","last_became_peered":"2024-03-17T23:56:01.211163+0000","last_unstale":"2024-03-17T23:59:42.775522+0000","last_undegraded":"2024-03-17T23:59:42.775522+0000","last_fullsized":"2024-03-17T23:59:42.775522+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":431,"log_dups_size":0,"ondisk_log_size":431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T11:40:55.653472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":16100,"num_write":395,"num_write_kb":71500,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"23'122","reported_seq":141,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:38.372796+0000","last_change":"2024-03-17T23:56:00.692384+0000","last_active":"2024-03-17T23:59:38.372796+0000","last_peered":"2024-03-17T23:59:38.372796+0000","last_clean":"2024-03-17T23:59:38.372796+0000","last_became_active":"2024-03-17T23:56:00.684178+0000","last_became_peered":"2024-03-17T23:56:00.684178+0000","last_unstale":"2024-03-17T23:59:38.372796+0000","last_undegraded":"2024-03-17T23:59:38.372796+0000","last_fullsized":"2024-03-17T23:59:38.372796+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_clean_scrub_stamp":"2024-03-17T23:55:59.626739+0000","objects_scrubbed":0,"log_size":122,"log_dups_size":0,"ondisk_log_size":122,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T09:45:24.650866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":65,"num_write_kb":8221,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"23'446","reported_seq":538,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:42.790168+0000","last_change":"2024-03-17T23:56:01.193547+0000","last_active":"2024-03-17T23:59:42.790168+0000","last_peered":"2024-03-17T23:59:42.790168+0000","last_clean":"2024-03-17T23:59:42.790168+0000","last_became_active":"2024-03-17T23:56:01.192775+0000","last_became_peered":"2024-03-17T23:56:01.192775+0000","last_unstale":"2024-03-17T23:59:42.790168+0000","last_undegraded":"2024-03-17T23:59:42.790168+0000","last_fullsized":"2024-03-17T23:59:42.790168+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":446,"log_dups_size":0,"ondisk_log_size":446,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T02:15:18.353466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":28843,"num_write":412,"num_write_kb":84625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"23'388","reported_seq":455,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:42.800309+0000","last_change":"2024-03-17T23:56:01.178436+0000","last_active":"2024-03-17T23:59:42.800309+0000","last_peered":"2024-03-17T23:59:42.800309+0000","last_clean":"2024-03-17T23:59:42.800309+0000","last_became_active":"2024-03-17T23:56:01.177533+0000","last_became_peered":"2024-03-17T23:56:01.177533+0000","last_unstale":"2024-03-17T23:59:42.800309+0000","last_undegraded":"2024-03-17T23:59:42.800309+0000","last_fullsized":"2024-03-17T23:59:42.800309+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":388,"log_dups_size":0,"ondisk_log_size":388,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T03:18:40.457769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":28876,"num_write":348,"num_write_kb":79477,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"23'250","reported_seq":269,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:40.435836+0000","last_change":"2024-03-17T23:56:00.691483+0000","last_active":"2024-03-17T23:59:40.435836+0000","last_peered":"2024-03-17T23:59:40.435836+0000","last_clean":"2024-03-17T23:59:40.435836+0000","last_became_active":"2024-03-17T23:56:00.684714+0000","last_became_peered":"2024-03-17T23:56:00.684714+0000","last_unstale":"2024-03-17T23:59:40.435836+0000","last_undegraded":"2024-03-17T23:59:40.435836+0000","last_fullsized":"2024-03-17T23:59:40.435836+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_clean_scrub_stamp":"2024-03-17T23:55:59.626739+0000","objects_scrubbed":0,"log_size":250,"log_dups_size":0,"ondisk_log_size":250,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T09:57:49.282635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":200,"num_write_kb":4200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"23'366","reported_seq":420,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:42.797532+0000","last_change":"2024-03-17T23:56:01.194350+0000","last_active":"2024-03-17T23:59:42.797532+0000","last_peered":"2024-03-17T23:59:42.797532+0000","last_clean":"2024-03-17T23:59:42.797532+0000","last_became_active":"2024-03-17T23:56:01.193625+0000","last_became_peered":"2024-03-17T23:56:01.193625+0000","last_unstale":"2024-03-17T23:59:42.797532+0000","last_undegraded":"2024-03-17T23:59:42.797532+0000","last_fullsized":"2024-03-17T23:59:42.797532+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T11:08:21.695552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":17870,"num_write":332,"num_write_kb":22223,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"23'265","reported_seq":284,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:40.468483+0000","last_change":"2024-03-17T23:56:00.699785+0000","last_active":"2024-03-17T23:59:40.468483+0000","last_peered":"2024-03-17T23:59:40.468483+0000","last_clean":"2024-03-17T23:59:40.468483+0000","last_became_active":"2024-03-17T23:56:00.699049+0000","last_became_peered":"2024-03-17T23:56:00.699049+0000","last_unstale":"2024-03-17T23:59:40.468483+0000","last_undegraded":"2024-03-17T23:59:40.468483+0000","last_fullsized":"2024-03-17T23:59:40.468483+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_clean_scrub_stamp":"2024-03-17T23:55:59.626739+0000","objects_scrubbed":0,"log_size":265,"log_dups_size":0,"ondisk_log_size":265,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T01:56:01.336865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":190,"num_write_kb":12389,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"23'368","reported_seq":446,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:42.799409+0000","last_change":"2024-03-17T23:56:01.208117+0000","last_active":"2024-03-17T23:59:42.799409+0000","last_peered":"2024-03-17T23:59:42.799409+0000","last_clean":"2024-03-17T23:59:42.799409+0000","last_became_active":"2024-03-17T23:56:01.207342+0000","last_became_peered":"2024-03-17T23:56:01.207342+0000","last_unstale":"2024-03-17T23:59:42.799409+0000","last_undegraded":"2024-03-17T23:59:42.799409+0000","last_fullsized":"2024-03-17T23:59:42.799409+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":368,"log_dups_size":0,"ondisk_log_size":368,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T08:24:06.922044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":38707,"num_write":341,"num_write_kb":47027,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"23'59","reported_seq":78,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:38.432162+0000","last_change":"2024-03-17T23:56:00.691595+0000","last_active":"2024-03-17T23:59:38.432162+0000","last_peered":"2024-03-17T23:59:38.432162+0000","last_clean":"2024-03-17T23:59:38.432162+0000","last_became_active":"2024-03-17T23:56:00.690892+0000","last_became_peered":"2024-03-17T23:56:00.690892+0000","last_unstale":"2024-03-17T23:59:38.432162+0000","last_undegraded":"2024-03-17T23:59:38.432162+0000","last_fullsized":"2024-03-17T23:59:38.432162+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_clean_scrub_stamp":"2024-03-17T23:55:59.626739+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T07:28:27.310340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":4104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"23'416","reported_seq":458,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:42.789760+0000","last_change":"2024-03-17T23:56:01.212430+0000","last_active":"2024-03-17T23:59:42.789760+0000","last_peered":"2024-03-17T23:59:42.789760+0000","last_clean":"2024-03-17T23:59:42.789760+0000","last_became_active":"2024-03-17T23:56:01.204930+0000","last_became_peered":"2024-03-17T23:56:01.204930+0000","last_unstale":"2024-03-17T23:59:42.789760+0000","last_undegraded":"2024-03-17T23:59:42.789760+0000","last_fullsized":"2024-03-17T23:59:42.789760+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":416,"log_dups_size":0,"ondisk_log_size":416,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T04:45:41.506781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":21060,"num_write":382,"num_write_kb":52186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"23'128","reported_seq":147,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:39.504888+0000","last_change":"2024-03-17T23:56:00.682405+0000","last_active":"2024-03-17T23:59:39.504888+0000","last_peered":"2024-03-17T23:59:39.504888+0000","last_clean":"2024-03-17T23:59:39.504888+0000","last_became_active":"2024-03-17T23:56:00.681938+0000","last_became_peered":"2024-03-17T23:56:00.681938+0000","last_unstale":"2024-03-17T23:59:39.504888+0000","last_undegraded":"2024-03-17T23:59:39.504888+0000","last_fullsized":"2024-03-17T23:59:39.504888+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_clean_scrub_stamp":"2024-03-17T23:55:59.626739+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T07:03:16.148691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":81,"num_write_kb":4133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2838,"num_read_kb":1533802,"num_write":24369,"num_write_kb":4275114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26399,"ondisk_log_size":26399,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":130818914,"num_objects":129,"num_object_clones":0,"num_object_copies":258,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":129,"num_whiteouts":0,"num_read":210,"num_read_kb":1570,"num_write":5949,"num_write_kb":132095,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":91545600,"data_stored":261637828,"data_compressed":38603034,"data_compressed_allocated":50184192,"data_compressed_original":220520448,"omap_allocated":0,"internal_metadata":0},"log_size":7493,"ondisk_log_size":7493,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66348,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574898,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":64480,"kb_used_data":15256,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94307360,"statfs":{"total":96636764160,"available":96570736640,"internally_reserved":0,"allocated":15622144,"data_stored":51012493,"data_compressed":7591170,"data_compressed_allocated":9641984,"data_compressed_original":45223936,"omap_allocated":1590,"internal_metadata":50395594},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574898,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":53036,"kb_used_data":13540,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94318804,"statfs":{"total":96636764160,"available":96582455296,"internally_reserved":0,"allocated":13864960,"data_stored":45545899,"data_compressed":7083231,"data_compressed_allocated":9031680,"data_compressed_original":40890368,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574897,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60172,"kb_used_data":10948,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94311668,"statfs":{"total":96636764160,"available":96575148032,"internally_reserved":0,"allocated":11210752,"data_stored":25258133,"data_compressed":3535502,"data_compressed_allocated":4878336,"data_compressed_original":19124224,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574899,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":70952,"kb_used_data":17568,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94300888,"statfs":{"total":96636764160,"available":96564109312,"internally_reserved":0,"allocated":17989632,"data_stored":46227051,"data_compressed":6636651,"data_compressed_allocated":8818688,"data_compressed_original":37232640,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574900,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41684,"kb_used_data":10508,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94330156,"statfs":{"total":96636764160,"available":96594079744,"internally_reserved":0,"allocated":10760192,"data_stored":34430955,"data_compressed":5296110,"data_compressed_allocated":6660096,"data_compressed_original":30515200,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574899,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33936,"kb_used_data":2760,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94337904,"statfs":{"total":96636764160,"available":96602013696,"internally_reserved":0,"allocated":2826240,"data_stored":5752077,"data_compressed":755556,"data_compressed_allocated":1044480,"data_compressed_original":4157440,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574898,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":67656,"kb_used_data":10112,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94304184,"statfs":{"total":96636764160,"available":96567484416,"internally_reserved":0,"allocated":10354688,"data_stored":25255151,"data_compressed":3481816,"data_compressed_allocated":4526080,"data_compressed_original":19607552,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574897,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59948,"kb_used_data":10724,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94311892,"statfs":{"total":96636764160,"available":96575377408,"internally_reserved":0,"allocated":10981376,"data_stored":30039165,"data_compressed":4289346,"data_compressed_allocated":5672960,"data_compressed_original":24915968,"omap_allocated":1592,"internal_metadata":50395592},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33174,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33174,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":10674176,"data_stored":29361002,"data_compressed":4256172,"data_compressed_allocated":5627904,"data_compressed_original":24342528,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":10113024,"data_stored":25167356,"data_compressed":3481816,"data_compressed_allocated":4526080,"data_compressed_original":19607552,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":2584576,"data_stored":5664282,"data_compressed":755556,"data_compressed_allocated":1044480,"data_compressed_original":4157440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":10518528,"data_stored":34343160,"data_compressed":5296110,"data_compressed_allocated":6660096,"data_compressed_original":30515200,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":17747968,"data_stored":46139256,"data_compressed":6636651,"data_compressed_allocated":8818688,"data_compressed_original":37232640,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":10969088,"data_stored":25170338,"data_compressed":3535502,"data_compressed_allocated":4878336,"data_compressed_original":19124224,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":13623296,"data_stored":45458104,"data_compressed":7083231,"data_compressed_allocated":9031680,"data_compressed_original":40890368,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":15314944,"data_stored":50334330,"data_compressed":7557996,"data_compressed_allocated":9596928,"data_compressed_original":44650496,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-17T23:59:50.302 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-17T23:59:50.466 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:50.463+0000 7f960a7fb640 1 Processor -- start 2024-03-17T23:59:50.466 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:50.463+0000 7f960a7fb640 1 -- start start 2024-03-17T23:59:50.468 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:50.463+0000 7f960a7fb640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f9604151c40 0x7f96040c80d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:59:50.468 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:50.463+0000 7f960a7fb640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f9604152020 0x7f960415b810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:59:50.468 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:50.463+0000 7f960a7fb640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9604157b60 0x7f960415bd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:59:50.468 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:50.463+0000 7f960a7fb640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7f96041580a0 con 0x7f9604151c40 2024-03-17T23:59:50.468 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:50.463+0000 7f960a7fb640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 -- 0x7f9604158360 con 0x7f9604152020 2024-03-17T23:59:50.468 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:50.463+0000 7f960a7fb640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f9604158640 con 0x7f9604157b60 2024-03-17T23:59:50.468 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:50.463+0000 7f9608d98640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9604157b60 0x7f960415bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:59:50.468 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:50.463+0000 7f9603fff640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f9604151c40 0x7f96040c80d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:59:50.468 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:50.463+0000 7f9608d98640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9604157b60 0x7f960415bd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3301/0 says I am v2:172.21.15.196:60572/0 (socket says 172.21.15.196:60572) 2024-03-17T23:59:50.468 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:50.463+0000 7f9608d98640 1 -- 172.21.15.196:0/1873448549 learned_addr learned my addr 172.21.15.196:0/1873448549 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-03-17T23:59:50.468 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:50.463+0000 7f9603fff640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f9604151c40 0x7f96040c80d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.196:34258/0 (socket says 172.21.15.196:34258) 2024-03-17T23:59:50.469 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:50.463+0000 7f96037fe640 1 --2- 172.21.15.196:0/1873448549 >> v2:172.21.15.204:3300/0 conn(0x7f9604152020 0x7f960415b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:59:50.469 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:50.463+0000 7f9608d98640 1 -- 172.21.15.196:0/1873448549 >> v2:172.21.15.204:3300/0 conn(0x7f9604152020 msgr2=0x7f960415b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-17T23:59:50.469 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:50.463+0000 7f9608d98640 1 --2- 172.21.15.196:0/1873448549 >> v2:172.21.15.204:3300/0 conn(0x7f9604152020 0x7f960415b810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:59:50.469 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:50.463+0000 7f9608d98640 1 -- 172.21.15.196:0/1873448549 >> v2:172.21.15.196:3300/0 conn(0x7f9604151c40 msgr2=0x7f96040c80d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-17T23:59:50.469 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:50.463+0000 7f9608d98640 1 --2- 172.21.15.196:0/1873448549 >> v2:172.21.15.196:3300/0 conn(0x7f9604151c40 0x7f96040c80d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:59:50.469 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:50.463+0000 7f9608d98640 1 -- 172.21.15.196:0/1873448549 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9604158920 con 0x7f9604157b60 2024-03-17T23:59:50.469 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:50.463+0000 7f96037fe640 1 --2- 172.21.15.196:0/1873448549 >> v2:172.21.15.204:3300/0 conn(0x7f9604152020 0x7f960415b810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-17T23:59:50.471 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:50.467+0000 7f9608d98640 1 --2- 172.21.15.196:0/1873448549 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9604157b60 0x7f960415bd50 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f96040b06b0 tx=0x7f95fc01c9f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fa2ee0da4ea0a16c server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:59:50.471 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:50.467+0000 7f9602ffd640 1 -- 172.21.15.196:0/1873448549 <== mon.2 v2:172.21.15.204:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96040c2ac0 con 0x7f9604157b60 2024-03-17T23:59:50.471 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:50.467+0000 7f9602ffd640 1 -- 172.21.15.196:0/1873448549 <== mon.2 v2:172.21.15.204:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f95fc0a5780 con 0x7f9604157b60 2024-03-17T23:59:50.471 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:50.467+0000 7f9602ffd640 1 -- 172.21.15.196:0/1873448549 <== mon.2 v2:172.21.15.204:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95fc0a5b50 con 0x7f9604157b60 2024-03-17T23:59:50.472 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:50.467+0000 7f960a7fb640 1 -- 172.21.15.196:0/1873448549 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9604157b60 msgr2=0x7f960415bd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:59:50.472 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:50.467+0000 7f960a7fb640 1 --2- 172.21.15.196:0/1873448549 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9604157b60 0x7f960415bd50 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f96040b06b0 tx=0x7f95fc01c9f0 comp rx=0 tx=0).stop 2024-03-17T23:59:50.472 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:50.471+0000 7f960a7fb640 1 -- 172.21.15.196:0/1873448549 shutdown_connections 2024-03-17T23:59:50.473 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:50.471+0000 7f960a7fb640 1 --2- 172.21.15.196:0/1873448549 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9604157b60 0x7f960415bd50 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:59:50.473 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:50.471+0000 7f960a7fb640 1 --2- 172.21.15.196:0/1873448549 >> v2:172.21.15.204:3300/0 conn(0x7f9604152020 0x7f960415b810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:59:50.473 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:50.471+0000 7f960a7fb640 1 --2- 172.21.15.196:0/1873448549 >> v2:172.21.15.196:3300/0 conn(0x7f9604151c40 0x7f96040c80d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:59:50.473 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:50.471+0000 7f960a7fb640 1 -- 172.21.15.196:0/1873448549 >> 172.21.15.196:0/1873448549 conn(0x7f9604071020 msgr2=0x7f9604071430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-17T23:59:50.473 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:50.471+0000 7f960a7fb640 1 -- 172.21.15.196:0/1873448549 shutdown_connections 2024-03-17T23:59:50.473 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:50.471+0000 7f960a7fb640 1 -- 172.21.15.196:0/1873448549 wait complete. 2024-03-17T23:59:50.474 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:50.471+0000 7f960a7fb640 1 Processor -- start 2024-03-17T23:59:50.474 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:50.471+0000 7f960a7fb640 1 -- start start 2024-03-17T23:59:50.476 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:50.471+0000 7f960a7fb640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9604151c40 0x7f9604161010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:59:50.476 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:50.471+0000 7f960a7fb640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9604152020 0x7f960406d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:59:50.476 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:50.471+0000 7f960a7fb640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9604157b60 0x7f960414aee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:59:50.477 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:50.471+0000 7f960a7fb640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f96040c9f70 con 0x7f9604152020 2024-03-17T23:59:50.477 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:50.471+0000 7f960a7fb640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f96040c9df0 con 0x7f9604151c40 2024-03-17T23:59:50.477 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:50.471+0000 7f960a7fb640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f96040ca0f0 con 0x7f9604157b60 2024-03-17T23:59:50.477 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:50.471+0000 7f96037fe640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9604152020 0x7f960406d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:59:50.477 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:50.471+0000 7f96037fe640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9604152020 0x7f960406d7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.196:34268/0 (socket says 172.21.15.196:34268) 2024-03-17T23:59:50.477 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:50.471+0000 7f96037fe640 1 -- 172.21.15.196:0/2563505446 learned_addr learned my addr 172.21.15.196:0/2563505446 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-03-17T23:59:50.477 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:50.471+0000 7f9608d98640 1 --2- 172.21.15.196:0/2563505446 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9604157b60 0x7f960414aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:59:50.477 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:50.471+0000 7f9603fff640 1 --2- 172.21.15.196:0/2563505446 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9604151c40 0x7f9604161010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:59:50.477 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:50.471+0000 7f96037fe640 1 -- 172.21.15.196:0/2563505446 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9604157b60 msgr2=0x7f960414aee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:59:50.477 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:50.471+0000 7f96037fe640 1 --2- 172.21.15.196:0/2563505446 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9604157b60 0x7f960414aee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:59:50.477 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:50.471+0000 7f96037fe640 1 -- 172.21.15.196:0/2563505446 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9604151c40 msgr2=0x7f9604161010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:59:50.477 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:50.471+0000 7f96037fe640 1 --2- 172.21.15.196:0/2563505446 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9604151c40 0x7f9604161010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:59:50.477 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:50.471+0000 7f96037fe640 1 -- 172.21.15.196:0/2563505446 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96040b0a90 con 0x7f9604152020 2024-03-17T23:59:50.478 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:50.471+0000 7f9603fff640 1 --2- 172.21.15.196:0/2563505446 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9604151c40 0x7f9604161010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-17T23:59:50.478 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:50.471+0000 7f96037fe640 1 --2- 172.21.15.196:0/2563505446 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9604152020 0x7f960406d7c0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f95f800e840 tx=0x7f95f800ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:59:50.478 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:50.471+0000 7f9600ff9640 1 -- 172.21.15.196:0/2563505446 <== mon.0 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95f8017070 con 0x7f9604152020 2024-03-17T23:59:50.478 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:50.471+0000 7f9600ff9640 1 -- 172.21.15.196:0/2563505446 <== mon.0 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f95f800c8d0 con 0x7f9604152020 2024-03-17T23:59:50.478 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:50.471+0000 7f960a7fb640 1 -- 172.21.15.196:0/2563505446 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96040b07f0 con 0x7f9604152020 2024-03-17T23:59:50.478 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:50.471+0000 7f960a7fb640 1 -- 172.21.15.196:0/2563505446 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f960406ca80 con 0x7f9604152020 2024-03-17T23:59:50.478 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:50.475+0000 7f9600ff9640 1 -- 172.21.15.196:0/2563505446 <== mon.0 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95f800f040 con 0x7f9604152020 2024-03-17T23:59:50.479 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:50.475+0000 7f960a7fb640 1 -- 172.21.15.196:0/2563505446 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f95e40052a0 con 0x7f9604152020 2024-03-17T23:59:50.479 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:50.475+0000 7f9600ff9640 1 -- 172.21.15.196:0/2563505446 <== mon.0 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 5) ==== 87083+0+0 (secure 0 0 0) 0x7f95f801a070 con 0x7f9604152020 2024-03-17T23:59:50.479 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:50.475+0000 7f9600ff9640 1 --2- 172.21.15.196:0/2563505446 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f95f0067660 0x7f95f0069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:59:50.479 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:50.475+0000 7f9600ff9640 1 -- 172.21.15.196:0/2563505446 <== mon.0 v2:172.21.15.196:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7f95f8085400 con 0x7f9604152020 2024-03-17T23:59:50.479 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:50.475+0000 7f9603fff640 1 --2- 172.21.15.196:0/2563505446 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f95f0067660 0x7f95f0069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:59:50.479 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:50.475+0000 7f9603fff640 1 --2- 172.21.15.196:0/2563505446 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f95f0067660 0x7f95f0069b20 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f95f4009b30 tx=0x7f95f4008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:59:50.483 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:50.479+0000 7f9600ff9640 1 -- 172.21.15.196:0/2563505446 <== mon.0 v2:172.21.15.196:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177849 (secure 0 0 0) 0x7f95f80559b0 con 0x7f9604152020 2024-03-17T23:59:50.776 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:50.771+0000 7f960a7fb640 1 -- 172.21.15.196:0/2563505446 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f95e4005860 con 0x7f9604152020 2024-03-17T23:59:50.777 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:50.775+0000 7f9600ff9640 1 -- 172.21.15.196:0/2563505446 <== mon.0 v2:172.21.15.196:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) ==== 74+0+16891 (secure 0 0 0) 0x7f95f8059a50 con 0x7f9604152020 2024-03-17T23:59:50.778 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-03-17T23:59:50.778 INFO:teuthology.orchestra.run.smithi196.stdout:{"epoch":23,"fsid":"b80f9c80-17ad-4126-8957-4c0c46f5b803","created":"2024-03-17T23:55:43.368838+0000","modified":"2024-03-17T23:56:49.062022+0000","last_up_change":"2024-03-17T23:55:54.132187+0000","last_in_change":"2024-03-17T23:55:46.016435+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-17T23:55:56.030640+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-17T23:55:58.658234+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-17T23:56:00.003208+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"224d699f-bc10-4661-a8b5-6ca73290ffa0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6806","nonce":1194547591},{"type":"v1","addr":"172.21.15.196:6807","nonce":1194547591}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6809","nonce":1194547591},{"type":"v1","addr":"172.21.15.196:6811","nonce":1194547591}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6814","nonce":1194547591},{"type":"v1","addr":"172.21.15.196:6815","nonce":1194547591}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6812","nonce":1194547591},{"type":"v1","addr":"172.21.15.196:6813","nonce":1194547591}]},"public_addr":"172.21.15.196:6807/1194547591","cluster_addr":"172.21.15.196:6811/1194547591","heartbeat_back_addr":"172.21.15.196:6815/1194547591","heartbeat_front_addr":"172.21.15.196:6813/1194547591","state":["exists","up"]},{"osd":1,"uuid":"d8d6a0b0-450b-4ab5-b143-d4f36286e81e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6800","nonce":1901246986},{"type":"v1","addr":"172.21.15.196:6801","nonce":1901246986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6802","nonce":1901246986},{"type":"v1","addr":"172.21.15.196:6803","nonce":1901246986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6808","nonce":1901246986},{"type":"v1","addr":"172.21.15.196:6810","nonce":1901246986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6804","nonce":1901246986},{"type":"v1","addr":"172.21.15.196:6805","nonce":1901246986}]},"public_addr":"172.21.15.196:6801/1901246986","cluster_addr":"172.21.15.196:6803/1901246986","heartbeat_back_addr":"172.21.15.196:6810/1901246986","heartbeat_front_addr":"172.21.15.196:6805/1901246986","state":["exists","up"]},{"osd":2,"uuid":"d732ba94-1db0-41ed-930a-5abb6188980a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6824","nonce":673819559},{"type":"v1","addr":"172.21.15.196:6825","nonce":673819559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6826","nonce":673819559},{"type":"v1","addr":"172.21.15.196:6827","nonce":673819559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6830","nonce":673819559},{"type":"v1","addr":"172.21.15.196:6831","nonce":673819559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6828","nonce":673819559},{"type":"v1","addr":"172.21.15.196:6829","nonce":673819559}]},"public_addr":"172.21.15.196:6825/673819559","cluster_addr":"172.21.15.196:6827/673819559","heartbeat_back_addr":"172.21.15.196:6831/673819559","heartbeat_front_addr":"172.21.15.196:6829/673819559","state":["exists","up"]},{"osd":3,"uuid":"b79cab98-a49f-4544-b6b0-546dcfbd47a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6816","nonce":1104340623},{"type":"v1","addr":"172.21.15.196:6817","nonce":1104340623}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6818","nonce":1104340623},{"type":"v1","addr":"172.21.15.196:6819","nonce":1104340623}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6822","nonce":1104340623},{"type":"v1","addr":"172.21.15.196:6823","nonce":1104340623}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6820","nonce":1104340623},{"type":"v1","addr":"172.21.15.196:6821","nonce":1104340623}]},"public_addr":"172.21.15.196:6817/1104340623","cluster_addr":"172.21.15.196:6819/1104340623","heartbeat_back_addr":"172.21.15.196:6823/1104340623","heartbeat_front_addr":"172.21.15.196:6821/1104340623","state":["exists","up"]},{"osd":4,"uuid":"d5892856-6eb4-4188-beb0-368f64169af1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6816","nonce":658561863},{"type":"v1","addr":"172.21.15.204:6818","nonce":658561863}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6819","nonce":658561863},{"type":"v1","addr":"172.21.15.204:6821","nonce":658561863}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6826","nonce":658561863},{"type":"v1","addr":"172.21.15.204:6828","nonce":658561863}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6823","nonce":658561863},{"type":"v1","addr":"172.21.15.204:6825","nonce":658561863}]},"public_addr":"172.21.15.204:6818/658561863","cluster_addr":"172.21.15.204:6821/658561863","heartbeat_back_addr":"172.21.15.204:6828/658561863","heartbeat_front_addr":"172.21.15.204:6825/658561863","state":["exists","up"]},{"osd":5,"uuid":"89d6b48d-aa8a-4cb8-aa2e-e0aae04928b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6817","nonce":3367327749},{"type":"v1","addr":"172.21.15.204:6820","nonce":3367327749}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6822","nonce":3367327749},{"type":"v1","addr":"172.21.15.204:6824","nonce":3367327749}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6830","nonce":3367327749},{"type":"v1","addr":"172.21.15.204:6831","nonce":3367327749}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6827","nonce":3367327749},{"type":"v1","addr":"172.21.15.204:6829","nonce":3367327749}]},"public_addr":"172.21.15.204:6820/3367327749","cluster_addr":"172.21.15.204:6824/3367327749","heartbeat_back_addr":"172.21.15.204:6831/3367327749","heartbeat_front_addr":"172.21.15.204:6829/3367327749","state":["exists","up"]},{"osd":6,"uuid":"ff7d0949-2836-42a6-a63d-bc5a4269e080","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6805","nonce":2586742078},{"type":"v1","addr":"172.21.15.204:6807","nonce":2586742078}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6809","nonce":2586742078},{"type":"v1","addr":"172.21.15.204:6811","nonce":2586742078}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6814","nonce":2586742078},{"type":"v1","addr":"172.21.15.204:6815","nonce":2586742078}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6812","nonce":2586742078},{"type":"v1","addr":"172.21.15.204:6813","nonce":2586742078}]},"public_addr":"172.21.15.204:6807/2586742078","cluster_addr":"172.21.15.204:6811/2586742078","heartbeat_back_addr":"172.21.15.204:6815/2586742078","heartbeat_front_addr":"172.21.15.204:6813/2586742078","state":["exists","up"]},{"osd":7,"uuid":"42bcc14b-70b3-4c59-bf81-41436e4eb272","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6800","nonce":3361860686},{"type":"v1","addr":"172.21.15.204:6801","nonce":3361860686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6802","nonce":3361860686},{"type":"v1","addr":"172.21.15.204:6803","nonce":3361860686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6808","nonce":3361860686},{"type":"v1","addr":"172.21.15.204:6810","nonce":3361860686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6804","nonce":3361860686},{"type":"v1","addr":"172.21.15.204:6806","nonce":3361860686}]},"public_addr":"172.21.15.204:6801/3361860686","cluster_addr":"172.21.15.204:6803/3361860686","heartbeat_back_addr":"172.21.15.204:6810/3361860686","heartbeat_front_addr":"172.21.15.204:6806/3361860686","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-17T23:55:51.372683+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-17T23:55:51.466291+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-17T23:55:51.608084+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-17T23:55:51.680819+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-17T23:55:51.528198+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-17T23:55:51.537065+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-17T23:55:51.558146+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-17T23:55:51.382540+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.17","mappings":[{"from":5,"to":1}]},{"pgid":"3.19","mappings":[{"from":3,"to":2}]},{"pgid":"3.2a","mappings":[{"from":5,"to":2}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-17T23:59:50.780 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:50.775+0000 7f960a7fb640 1 -- 172.21.15.196:0/2563505446 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f95f0067660 msgr2=0x7f95f0069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:59:50.780 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:50.775+0000 7f960a7fb640 1 --2- 172.21.15.196:0/2563505446 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f95f0067660 0x7f95f0069b20 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f95f4009b30 tx=0x7f95f4008040 comp rx=0 tx=0).stop 2024-03-17T23:59:50.780 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:50.775+0000 7f960a7fb640 1 -- 172.21.15.196:0/2563505446 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9604152020 msgr2=0x7f960406d7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:59:50.781 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:50.775+0000 7f960a7fb640 1 --2- 172.21.15.196:0/2563505446 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9604152020 0x7f960406d7c0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f95f800e840 tx=0x7f95f800ed00 comp rx=0 tx=0).stop 2024-03-17T23:59:50.781 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:50.775+0000 7f960a7fb640 1 -- 172.21.15.196:0/2563505446 shutdown_connections 2024-03-17T23:59:50.781 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:50.775+0000 7f960a7fb640 1 --2- 172.21.15.196:0/2563505446 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f95f0067660 0x7f95f0069b20 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:59:50.781 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:50.775+0000 7f960a7fb640 1 --2- 172.21.15.196:0/2563505446 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9604157b60 0x7f960414aee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:59:50.781 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:50.775+0000 7f960a7fb640 1 --2- 172.21.15.196:0/2563505446 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9604152020 0x7f960406d7c0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:59:50.781 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:50.775+0000 7f960a7fb640 1 --2- 172.21.15.196:0/2563505446 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9604151c40 0x7f9604161010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:59:50.781 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:50.775+0000 7f960a7fb640 1 -- 172.21.15.196:0/2563505446 >> 172.21.15.196:0/2563505446 conn(0x7f9604071020 msgr2=0x7f96040c2ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-17T23:59:50.781 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:50.775+0000 7f960a7fb640 1 -- 172.21.15.196:0/2563505446 shutdown_connections 2024-03-17T23:59:50.781 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:50.775+0000 7f960a7fb640 1 -- 172.21.15.196:0/2563505446 wait complete. 2024-03-17T23:59:51.796 INFO:tasks.ceph:Scrubbing osd.0 2024-03-17T23:59:51.797 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-03-17T23:59:51.924 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:51.919+0000 7f7831c56640 1 Processor -- start 2024-03-17T23:59:51.924 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:51.919+0000 7f7831c56640 1 -- start start 2024-03-17T23:59:51.925 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:51.923+0000 7f7831c56640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f782c151e60 0x7f782c0c8030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:59:51.925 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:51.923+0000 7f7831c56640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f782c0c8570 0x7f782c0ca090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:59:51.925 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:51.923+0000 7f7831c56640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f782c0c2650 0x7f782c0ca5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:59:51.926 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:51.923+0000 7f7831c56640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7f782c0c31b0 con 0x7f782c0c8570 2024-03-17T23:59:51.926 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:51.923+0000 7f7831c56640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 -- 0x7f782c0c3490 con 0x7f782c0c2650 2024-03-17T23:59:51.926 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:51.923+0000 7f7831c56640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f782c0c3770 con 0x7f782c151e60 2024-03-17T23:59:51.926 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:51.923+0000 7f782affd640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f782c0c8570 0x7f782c0ca090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:59:51.926 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:51.923+0000 7f782affd640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f782c0c8570 0x7f782c0ca090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.196:34282/0 (socket says 172.21.15.196:34282) 2024-03-17T23:59:51.926 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:51.923+0000 7f782affd640 1 -- 172.21.15.196:0/327680369 learned_addr learned my addr 172.21.15.196:0/327680369 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-03-17T23:59:51.926 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:51.923+0000 7f782b7fe640 1 --2- 172.21.15.196:0/327680369 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f782c151e60 0x7f782c0c8030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:59:51.926 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:51.923+0000 7f782bfff640 1 --2- 172.21.15.196:0/327680369 >> v2:172.21.15.204:3300/0 conn(0x7f782c0c2650 0x7f782c0ca5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:59:51.926 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:51.923+0000 7f782affd640 1 -- 172.21.15.196:0/327680369 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f782c151e60 msgr2=0x7f782c0c8030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-17T23:59:51.927 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:51.923+0000 7f782affd640 1 --2- 172.21.15.196:0/327680369 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f782c151e60 0x7f782c0c8030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:59:51.927 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:51.923+0000 7f782affd640 1 -- 172.21.15.196:0/327680369 >> v2:172.21.15.204:3300/0 conn(0x7f782c0c2650 msgr2=0x7f782c0ca5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-17T23:59:51.927 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:51.923+0000 7f782affd640 1 --2- 172.21.15.196:0/327680369 >> v2:172.21.15.204:3300/0 conn(0x7f782c0c2650 0x7f782c0ca5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:59:51.927 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:51.923+0000 7f782affd640 1 -- 172.21.15.196:0/327680369 --> v2:172.21.15.196:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f782c0c3a50 con 0x7f782c0c8570 2024-03-17T23:59:51.928 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:51.923+0000 7f782affd640 1 --2- 172.21.15.196:0/327680369 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f782c0c8570 0x7f782c0ca090 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f782c06e660 tx=0x7f782001ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=908dd638dda1774c server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:59:51.928 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:51.927+0000 7f782a7fc640 1 -- 172.21.15.196:0/327680369 <== mon.0 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78200b5070 con 0x7f782c0c8570 2024-03-17T23:59:51.928 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:51.927+0000 7f782a7fc640 1 -- 172.21.15.196:0/327680369 <== mon.0 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f78200a89d0 con 0x7f782c0c8570 2024-03-17T23:59:51.928 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:51.927+0000 7f782a7fc640 1 -- 172.21.15.196:0/327680369 <== mon.0 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78200a8da0 con 0x7f782c0c8570 2024-03-17T23:59:51.929 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:51.927+0000 7f7831c56640 1 -- 172.21.15.196:0/327680369 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f782c0c8570 msgr2=0x7f782c0ca090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:59:51.929 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:51.927+0000 7f7831c56640 1 --2- 172.21.15.196:0/327680369 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f782c0c8570 0x7f782c0ca090 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f782c06e660 tx=0x7f782001ed10 comp rx=0 tx=0).stop 2024-03-17T23:59:51.929 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:51.927+0000 7f7831c56640 1 -- 172.21.15.196:0/327680369 shutdown_connections 2024-03-17T23:59:51.929 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:51.927+0000 7f7831c56640 1 --2- 172.21.15.196:0/327680369 >> v2:172.21.15.204:3300/0 conn(0x7f782c0c2650 0x7f782c0ca5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:59:51.929 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:51.927+0000 7f7831c56640 1 --2- 172.21.15.196:0/327680369 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f782c0c8570 0x7f782c0ca090 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:59:51.929 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:51.927+0000 7f7831c56640 1 --2- 172.21.15.196:0/327680369 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f782c151e60 0x7f782c0c8030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:59:51.930 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:51.927+0000 7f7831c56640 1 -- 172.21.15.196:0/327680369 >> 172.21.15.196:0/327680369 conn(0x7f782c06bc60 msgr2=0x7f782c0710c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-17T23:59:51.930 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:51.927+0000 7f7831c56640 1 -- 172.21.15.196:0/327680369 shutdown_connections 2024-03-17T23:59:51.930 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:51.927+0000 7f7831c56640 1 -- 172.21.15.196:0/327680369 wait complete. 2024-03-17T23:59:51.931 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:51.927+0000 7f7831c56640 1 Processor -- start 2024-03-17T23:59:51.931 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:51.927+0000 7f7831c56640 1 -- start start 2024-03-17T23:59:51.933 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:51.927+0000 7f7831c56640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f782c0c2650 0x7f782c1ee970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:59:51.934 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:51.927+0000 7f7831c56640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f782c0c8570 0x7f782c145e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:59:51.934 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:51.931+0000 7f7831c56640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f782c151e60 0x7f782c1463a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:59:51.934 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:51.931+0000 7f7831c56640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f782c1523c0 con 0x7f782c0c8570 2024-03-17T23:59:51.934 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:51.931+0000 7f7831c56640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f782c152240 con 0x7f782c151e60 2024-03-17T23:59:51.934 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:51.931+0000 7f7831c56640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f782c15b7f0 con 0x7f782c0c2650 2024-03-17T23:59:51.934 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:51.931+0000 7f782affd640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f782c0c8570 0x7f782c145e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:59:51.934 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:51.931+0000 7f782affd640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f782c0c8570 0x7f782c145e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.196:34290/0 (socket says 172.21.15.196:34290) 2024-03-17T23:59:51.934 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:51.931+0000 7f782affd640 1 -- 172.21.15.196:0/3757509672 learned_addr learned my addr 172.21.15.196:0/3757509672 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-03-17T23:59:51.934 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:51.931+0000 7f782b7fe640 1 --2- 172.21.15.196:0/3757509672 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f782c0c2650 0x7f782c1ee970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:59:51.934 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:51.931+0000 7f782bfff640 1 --2- 172.21.15.196:0/3757509672 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f782c151e60 0x7f782c1463a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:59:51.934 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:51.931+0000 7f782affd640 1 -- 172.21.15.196:0/3757509672 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f782c0c2650 msgr2=0x7f782c1ee970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:59:51.935 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:51.931+0000 7f782affd640 1 --2- 172.21.15.196:0/3757509672 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f782c0c2650 0x7f782c1ee970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:59:51.935 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:51.931+0000 7f782affd640 1 -- 172.21.15.196:0/3757509672 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f782c151e60 msgr2=0x7f782c1463a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:59:51.935 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:51.931+0000 7f782affd640 1 --2- 172.21.15.196:0/3757509672 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f782c151e60 0x7f782c1463a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:59:51.935 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:51.931+0000 7f782affd640 1 -- 172.21.15.196:0/3757509672 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f782c0cb6e0 con 0x7f782c0c8570 2024-03-17T23:59:51.935 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:51.931+0000 7f782affd640 1 --2- 172.21.15.196:0/3757509672 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f782c0c8570 0x7f782c145e60 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f782001f5b0 tx=0x7f782001bab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:59:51.935 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:51.931+0000 7f7813fff640 1 -- 172.21.15.196:0/3757509672 <== mon.0 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78200be070 con 0x7f782c0c8570 2024-03-17T23:59:51.935 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:51.931+0000 7f7813fff640 1 -- 172.21.15.196:0/3757509672 <== mon.0 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f78200043c0 con 0x7f782c0c8570 2024-03-17T23:59:51.935 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:51.931+0000 7f7831c56640 1 -- 172.21.15.196:0/3757509672 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f782c0cb9c0 con 0x7f782c0c8570 2024-03-17T23:59:51.935 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:51.931+0000 7f7813fff640 1 -- 172.21.15.196:0/3757509672 <== mon.0 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78200b5040 con 0x7f782c0c8570 2024-03-17T23:59:51.935 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:51.931+0000 7f7831c56640 1 -- 172.21.15.196:0/3757509672 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f782c0cbf80 con 0x7f782c0c8570 2024-03-17T23:59:51.935 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:51.931+0000 7f7811ffb640 1 -- 172.21.15.196:0/3757509672 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f7804001040 con 0x7f782c0c8570 2024-03-17T23:59:51.936 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:51.931+0000 7f7813fff640 1 -- 172.21.15.196:0/3757509672 <== mon.0 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 5) ==== 87083+0+0 (secure 0 0 0) 0x7f78200c1070 con 0x7f782c0c8570 2024-03-17T23:59:51.937 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:51.931+0000 7f7813fff640 1 --2- 172.21.15.196:0/3757509672 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f7818067690 0x7f7818069b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:59:51.937 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:51.931+0000 7f7813fff640 1 -- 172.21.15.196:0/3757509672 <== mon.0 v2:172.21.15.196:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7f7820122140 con 0x7f782c0c8570 2024-03-17T23:59:51.937 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:51.931+0000 7f782b7fe640 1 --2- 172.21.15.196:0/3757509672 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f7818067690 0x7f7818069b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:59:51.937 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:51.931+0000 7f7813fff640 1 --2- 172.21.15.196:0/3757509672 >> [v2:172.21.15.196:6806/1194547591,v1:172.21.15.196:6807/1194547591] conn(0x7f781806f9b0 0x7f7818071e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:59:51.937 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:51.931+0000 7f7813fff640 1 -- 172.21.15.196:0/3757509672 --> [v2:172.21.15.196:6806/1194547591,v1:172.21.15.196:6807/1194547591] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7818072500 con 0x7f781806f9b0 2024-03-17T23:59:51.937 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:51.931+0000 7f7813fff640 1 -- 172.21.15.196:0/3757509672 <== mon.0 v2:172.21.15.196:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f7820129050 con 0x7f782c0c8570 2024-03-17T23:59:51.937 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:51.931+0000 7f782bfff640 1 --2- 172.21.15.196:0/3757509672 >> [v2:172.21.15.196:6806/1194547591,v1:172.21.15.196:6807/1194547591] conn(0x7f781806f9b0 0x7f7818071e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:59:51.937 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:51.931+0000 7f782bfff640 1 --2- 172.21.15.196:0/3757509672 >> [v2:172.21.15.196:6806/1194547591,v1:172.21.15.196:6807/1194547591] conn(0x7f781806f9b0 0x7f7818071e30 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:59:51.937 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:51.931+0000 7f782b7fe640 1 --2- 172.21.15.196:0/3757509672 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f7818067690 0x7f7818069b50 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f781c00d8d0 tx=0x7f781c008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:59:51.937 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:51.935+0000 7f7813fff640 1 -- 172.21.15.196:0/3757509672 <== osd.0 v2:172.21.15.196:6806/1194547591 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f7818072500 con 0x7f781806f9b0 2024-03-17T23:59:51.949 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:51.947+0000 7f7811ffb640 1 -- 172.21.15.196:0/3757509672 --> [v2:172.21.15.196:6806/1194547591,v1:172.21.15.196:6807/1194547591] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f7804002e40 con 0x7f781806f9b0 2024-03-17T23:59:51.950 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:51.947+0000 7f7813fff640 1 -- 172.21.15.196:0/3757509672 <== osd.0 v2:172.21.15.196:6806/1194547591 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f7804002e40 con 0x7f781806f9b0 2024-03-17T23:59:51.950 INFO:teuthology.orchestra.run.smithi196.stdout:{ 2024-03-17T23:59:51.950 INFO:teuthology.orchestra.run.smithi196.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-03-17T23:59:51.950 INFO:teuthology.orchestra.run.smithi196.stdout:} 2024-03-17T23:59:51.951 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:51.947+0000 7f7811ffb640 1 -- 172.21.15.196:0/3757509672 >> [v2:172.21.15.196:6806/1194547591,v1:172.21.15.196:6807/1194547591] conn(0x7f781806f9b0 msgr2=0x7f7818071e30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:59:51.951 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:51.947+0000 7f7811ffb640 1 --2- 172.21.15.196:0/3757509672 >> [v2:172.21.15.196:6806/1194547591,v1:172.21.15.196:6807/1194547591] conn(0x7f781806f9b0 0x7f7818071e30 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:59:51.951 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:51.947+0000 7f7811ffb640 1 -- 172.21.15.196:0/3757509672 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f7818067690 msgr2=0x7f7818069b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:59:51.951 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:51.947+0000 7f7811ffb640 1 --2- 172.21.15.196:0/3757509672 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f7818067690 0x7f7818069b50 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f781c00d8d0 tx=0x7f781c008040 comp rx=0 tx=0).stop 2024-03-17T23:59:51.951 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:51.947+0000 7f7811ffb640 1 -- 172.21.15.196:0/3757509672 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f782c0c8570 msgr2=0x7f782c145e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:59:51.952 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:51.947+0000 7f7811ffb640 1 --2- 172.21.15.196:0/3757509672 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f782c0c8570 0x7f782c145e60 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f782001f5b0 tx=0x7f782001bab0 comp rx=0 tx=0).stop 2024-03-17T23:59:51.952 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:51.947+0000 7f782bfff640 1 -- 172.21.15.196:0/3757509672 reap_dead start 2024-03-17T23:59:51.952 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:51.947+0000 7f7811ffb640 1 -- 172.21.15.196:0/3757509672 shutdown_connections 2024-03-17T23:59:51.952 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:51.947+0000 7f7811ffb640 1 -- 172.21.15.196:0/3757509672 >> 172.21.15.196:0/3757509672 conn(0x7f782c06bc60 msgr2=0x7f782c1480b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-17T23:59:51.952 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:51.947+0000 7f7811ffb640 1 -- 172.21.15.196:0/3757509672 shutdown_connections 2024-03-17T23:59:51.952 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:51.947+0000 7f7811ffb640 1 -- 172.21.15.196:0/3757509672 wait complete. 2024-03-17T23:59:51.965 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-03-17T23:59:52.072 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:52.067+0000 7ff762462640 1 Processor -- start 2024-03-17T23:59:52.072 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:52.067+0000 7ff762462640 1 -- start start 2024-03-17T23:59:52.073 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:52.071+0000 7ff762462640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7ff75c150e80 0x7ff75c15a120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:59:52.073 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:52.071+0000 7ff762462640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7ff75c0c8310 0x7ff75c1614b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:59:52.073 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:52.071+0000 7ff762462640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff75c0c44c0 con 0x7ff75c0c6fe0 2024-03-17T23:59:52.073 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:52.071+0000 7ff762462640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7ff75c1573b0 con 0x7ff75c0c8310 2024-03-17T23:59:52.074 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:52.071+0000 7ff762462640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 -- 0x7ff75c0c3f00 con 0x7ff75c150e80 2024-03-17T23:59:52.074 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:52.071+0000 7ff7609ff640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7ff75c0c8310 0x7ff75c1614b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:59:52.074 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:52.071+0000 7ff75b7fe640 1 --1- >> v1:172.21.15.196:6789/0 conn(0x7ff75c0c6fe0 0x7ff75c072b30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.196:6789/0 says I am v1:172.21.15.196:59280/0 (socket says 172.21.15.196:59280) 2024-03-17T23:59:52.074 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:52.071+0000 7ff75b7fe640 1 -- 172.21.15.196:0/3179361288 learned_addr learned my addr 172.21.15.196:0/3179361288 (peer_addr_for_me v1:172.21.15.196:0/0) 2024-03-17T23:59:52.074 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:52.071+0000 7ff75bfff640 1 --2- 172.21.15.196:0/3179361288 >> v2:172.21.15.204:3300/0 conn(0x7ff75c150e80 0x7ff75c15a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:59:52.074 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:52.071+0000 7ff7609ff640 1 -- 172.21.15.196:0/3179361288 >> v2:172.21.15.204:3300/0 conn(0x7ff75c150e80 msgr2=0x7ff75c15a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-17T23:59:52.074 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:52.071+0000 7ff7609ff640 1 --2- 172.21.15.196:0/3179361288 >> v2:172.21.15.204:3300/0 conn(0x7ff75c150e80 0x7ff75c15a120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:59:52.074 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:52.071+0000 7ff7609ff640 1 -- 172.21.15.196:0/3179361288 >> v1:172.21.15.196:6789/0 conn(0x7ff75c0c6fe0 legacy=0x7ff75c072b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:59:52.074 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:52.071+0000 7ff7609ff640 1 -- 172.21.15.196:0/3179361288 --> v2:172.21.15.196:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff75c0c41e0 con 0x7ff75c0c8310 2024-03-17T23:59:52.074 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:52.071+0000 7ff75affd640 1 -- 172.21.15.196:0/3179361288 <== mon.0 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1514274849 0 0) 0x7ff75c0c44c0 con 0x7ff75c0c6fe0 2024-03-17T23:59:52.075 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:52.071+0000 7ff7609ff640 1 --2- 172.21.15.196:0/3179361288 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff75c0c8310 0x7ff75c1614b0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7ff75c070c50 tx=0x7ff75401f110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=952d5c845576f05d server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:59:52.075 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:52.071+0000 7ff75affd640 1 -- 172.21.15.196:0/3179361288 <== mon.0 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7540b4070 con 0x7ff75c0c8310 2024-03-17T23:59:52.076 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:52.071+0000 7ff75affd640 1 -- 172.21.15.196:0/3179361288 <== mon.0 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff7540af600 con 0x7ff75c0c8310 2024-03-17T23:59:52.076 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:52.071+0000 7ff75affd640 1 -- 172.21.15.196:0/3179361288 <== mon.0 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7540af9d0 con 0x7ff75c0c8310 2024-03-17T23:59:52.077 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:52.075+0000 7ff762462640 1 -- 172.21.15.196:0/3179361288 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff75c0c8310 msgr2=0x7ff75c1614b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:59:52.077 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:52.075+0000 7ff762462640 1 --2- 172.21.15.196:0/3179361288 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff75c0c8310 0x7ff75c1614b0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7ff75c070c50 tx=0x7ff75401f110 comp rx=0 tx=0).stop 2024-03-17T23:59:52.077 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:52.075+0000 7ff762462640 1 -- 172.21.15.196:0/3179361288 shutdown_connections 2024-03-17T23:59:52.077 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:52.075+0000 7ff762462640 1 --2- 172.21.15.196:0/3179361288 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff75c0c8310 0x7ff75c1614b0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:59:52.077 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:52.075+0000 7ff762462640 1 --2- 172.21.15.196:0/3179361288 >> v2:172.21.15.204:3300/0 conn(0x7ff75c150e80 0x7ff75c15a120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:59:52.077 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:52.075+0000 7ff762462640 1 -- 172.21.15.196:0/3179361288 >> 172.21.15.196:0/3179361288 conn(0x7ff75c06c3c0 msgr2=0x7ff75c06c7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-17T23:59:52.077 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:52.075+0000 7ff762462640 1 -- 172.21.15.196:0/3179361288 shutdown_connections 2024-03-17T23:59:52.077 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:52.075+0000 7ff762462640 1 -- 172.21.15.196:0/3179361288 wait complete. 2024-03-17T23:59:52.078 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:52.075+0000 7ff762462640 1 Processor -- start 2024-03-17T23:59:52.078 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:52.075+0000 7ff762462640 1 -- start start 2024-03-17T23:59:52.079 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:52.075+0000 7ff762462640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff75c0c6fe0 0x7ff75c0caed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:59:52.079 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:52.075+0000 7ff762462640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff75c0c8310 0x7ff75c0cb6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:59:52.079 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:52.075+0000 7ff762462640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff75c150e80 0x7ff75c0c5dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:59:52.079 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:52.075+0000 7ff762462640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7ff75c151260 con 0x7ff75c0c6fe0 2024-03-17T23:59:52.079 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:52.075+0000 7ff762462640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7ff75c157040 con 0x7ff75c0c8310 2024-03-17T23:59:52.079 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:52.075+0000 7ff762462640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7ff75c15a660 con 0x7ff75c150e80 2024-03-17T23:59:52.080 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:52.075+0000 7ff75bfff640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff75c0c6fe0 0x7ff75c0caed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:59:52.080 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:52.075+0000 7ff75bfff640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff75c0c6fe0 0x7ff75c0caed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.196:34318/0 (socket says 172.21.15.196:34318) 2024-03-17T23:59:52.080 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:52.075+0000 7ff75bfff640 1 -- 172.21.15.196:0/2800255700 learned_addr learned my addr 172.21.15.196:0/2800255700 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-03-17T23:59:52.080 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:52.075+0000 7ff7609ff640 1 --2- 172.21.15.196:0/2800255700 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff75c150e80 0x7ff75c0c5dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:59:52.080 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:52.075+0000 7ff75bfff640 1 -- 172.21.15.196:0/2800255700 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff75c150e80 msgr2=0x7ff75c0c5dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:59:52.080 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:52.075+0000 7ff75bfff640 1 --2- 172.21.15.196:0/2800255700 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff75c150e80 0x7ff75c0c5dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:59:52.080 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:52.075+0000 7ff75bfff640 1 -- 172.21.15.196:0/2800255700 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff75c0c8310 msgr2=0x7ff75c0cb6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:59:52.080 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:52.075+0000 7ff75bfff640 1 --2- 172.21.15.196:0/2800255700 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff75c0c8310 0x7ff75c0cb6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:59:52.080 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:52.075+0000 7ff75bfff640 1 -- 172.21.15.196:0/2800255700 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff75c14b2d0 con 0x7ff75c0c6fe0 2024-03-17T23:59:52.080 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:52.075+0000 7ff75bfff640 1 --2- 172.21.15.196:0/2800255700 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff75c0c6fe0 0x7ff75c0caed0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7ff74c00e8a0 tx=0x7ff74c00eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:59:52.081 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:52.075+0000 7ff758ff9640 1 -- 172.21.15.196:0/2800255700 <== mon.0 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff74c017070 con 0x7ff75c0c6fe0 2024-03-17T23:59:52.081 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:52.075+0000 7ff758ff9640 1 -- 172.21.15.196:0/2800255700 <== mon.0 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff74c00c940 con 0x7ff75c0c6fe0 2024-03-17T23:59:52.081 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:52.075+0000 7ff758ff9640 1 -- 172.21.15.196:0/2800255700 <== mon.0 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff74c00ccf0 con 0x7ff75c0c6fe0 2024-03-17T23:59:52.081 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:52.075+0000 7ff762462640 1 -- 172.21.15.196:0/2800255700 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff75c14b570 con 0x7ff75c0c6fe0 2024-03-17T23:59:52.082 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:52.075+0000 7ff762462640 1 -- 172.21.15.196:0/2800255700 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff75c14d290 con 0x7ff75c0c6fe0 2024-03-17T23:59:52.082 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:52.075+0000 7ff762462640 1 -- 172.21.15.196:0/2800255700 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff75c0689a0 con 0x7ff75c0c6fe0 2024-03-17T23:59:52.082 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:52.079+0000 7ff758ff9640 1 -- 172.21.15.196:0/2800255700 <== mon.0 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 5) ==== 87083+0+0 (secure 0 0 0) 0x7ff74c01a070 con 0x7ff75c0c6fe0 2024-03-17T23:59:52.082 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:52.079+0000 7ff758ff9640 1 --2- 172.21.15.196:0/2800255700 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7ff748067660 0x7ff748069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:59:52.082 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:52.079+0000 7ff758ff9640 1 -- 172.21.15.196:0/2800255700 <== mon.0 v2:172.21.15.196:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7ff74c085fd0 con 0x7ff75c0c6fe0 2024-03-17T23:59:52.082 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:52.079+0000 7ff75b7fe640 1 --2- 172.21.15.196:0/2800255700 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7ff748067660 0x7ff748069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:59:52.083 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:52.079+0000 7ff75b7fe640 1 --2- 172.21.15.196:0/2800255700 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7ff748067660 0x7ff748069b20 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7ff7500011f0 tx=0x7ff750007930 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:59:52.089 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:52.087+0000 7ff758ff9640 1 -- 172.21.15.196:0/2800255700 <== mon.0 v2:172.21.15.196:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177849 (secure 0 0 0) 0x7ff74c056c20 con 0x7ff75c0c6fe0 2024-03-17T23:59:52.390 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:52.387+0000 7ff762462640 1 -- 172.21.15.196:0/2800255700 --> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) -- 0x7ff75c073650 con 0x7ff748067660 2024-03-17T23:59:52.391 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:52.387+0000 7ff758ff9640 1 -- 172.21.15.196:0/2800255700 <== mgr.4099 v2:172.21.15.204:6832/2505201055 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7ff75c073650 con 0x7ff748067660 2024-03-17T23:59:52.391 INFO:teuthology.orchestra.run.smithi196.stderr:instructed osd(s) 0 to deep-scrub 2024-03-17T23:59:52.394 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:52.391+0000 7ff762462640 1 -- 172.21.15.196:0/2800255700 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7ff748067660 msgr2=0x7ff748069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:59:52.394 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:52.391+0000 7ff762462640 1 --2- 172.21.15.196:0/2800255700 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7ff748067660 0x7ff748069b20 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7ff7500011f0 tx=0x7ff750007930 comp rx=0 tx=0).stop 2024-03-17T23:59:52.394 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:52.391+0000 7ff762462640 1 -- 172.21.15.196:0/2800255700 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff75c0c6fe0 msgr2=0x7ff75c0caed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:59:52.394 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:52.391+0000 7ff762462640 1 --2- 172.21.15.196:0/2800255700 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff75c0c6fe0 0x7ff75c0caed0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7ff74c00e8a0 tx=0x7ff74c00eca0 comp rx=0 tx=0).stop 2024-03-17T23:59:52.394 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:52.391+0000 7ff762462640 1 -- 172.21.15.196:0/2800255700 shutdown_connections 2024-03-17T23:59:52.394 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:52.391+0000 7ff762462640 1 --2- 172.21.15.196:0/2800255700 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7ff748067660 0x7ff748069b20 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:59:52.394 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:52.391+0000 7ff762462640 1 --2- 172.21.15.196:0/2800255700 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff75c150e80 0x7ff75c0c5dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:59:52.394 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:52.391+0000 7ff762462640 1 --2- 172.21.15.196:0/2800255700 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff75c0c8310 0x7ff75c0cb6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:59:52.394 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:52.391+0000 7ff762462640 1 --2- 172.21.15.196:0/2800255700 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff75c0c6fe0 0x7ff75c0caed0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:59:52.394 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:52.391+0000 7ff762462640 1 -- 172.21.15.196:0/2800255700 >> 172.21.15.196:0/2800255700 conn(0x7ff75c06c3c0 msgr2=0x7ff75c072df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-17T23:59:52.395 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:52.391+0000 7ff762462640 1 -- 172.21.15.196:0/2800255700 shutdown_connections 2024-03-17T23:59:52.395 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:52.391+0000 7ff762462640 1 -- 172.21.15.196:0/2800255700 wait complete. 2024-03-17T23:59:52.412 INFO:tasks.ceph:Scrubbing osd.1 2024-03-17T23:59:52.412 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-03-17T23:59:52.524 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:52.519+0000 7f7396715640 1 Processor -- start 2024-03-17T23:59:52.524 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:52.519+0000 7f7396715640 1 -- start start 2024-03-17T23:59:52.525 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:52.523+0000 7f7396715640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f7390151ed0 0x7f73900730b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:59:52.525 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:52.523+0000 7f7396715640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7390157f10 0x7f73901583c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:59:52.525 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:52.523+0000 7f7396715640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f73900c7320 con 0x7f73900735f0 2024-03-17T23:59:52.525 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:52.523+0000 7f7396715640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 -- 0x7f739006b640 con 0x7f7390151ed0 2024-03-17T23:59:52.525 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:52.523+0000 7f7396715640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f7390158900 con 0x7f7390157f10 2024-03-17T23:59:52.525 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:52.523+0000 7f738f7fe640 1 --1- >> v1:172.21.15.196:6789/0 conn(0x7f73900735f0 0x7f73900c5c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.196:6789/0 says I am v1:172.21.15.196:56794/0 (socket says 172.21.15.196:56794) 2024-03-17T23:59:52.526 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:52.523+0000 7f738f7fe640 1 -- 172.21.15.196:0/4131945184 learned_addr learned my addr 172.21.15.196:0/4131945184 (peer_addr_for_me v1:172.21.15.196:0/0) 2024-03-17T23:59:52.526 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:52.523+0000 7f738ffff640 1 --2- 172.21.15.196:0/4131945184 >> v2:172.21.15.204:3300/0 conn(0x7f7390151ed0 0x7f73900730b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:59:52.526 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:52.523+0000 7f7394cb2640 1 --2- 172.21.15.196:0/4131945184 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7390157f10 0x7f73901583c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:59:52.526 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:52.523+0000 7f738effd640 1 -- 172.21.15.196:0/4131945184 <== mon.0 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3464260698 0 0) 0x7f73900c7320 con 0x7f73900735f0 2024-03-17T23:59:52.526 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:52.523+0000 7f738effd640 1 -- 172.21.15.196:0/4131945184 --> v1:172.21.15.196:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7378003530 con 0x7f73900735f0 2024-03-17T23:59:52.526 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:52.523+0000 7f7394cb2640 1 -- 172.21.15.196:0/4131945184 >> v2:172.21.15.204:3300/0 conn(0x7f7390151ed0 msgr2=0x7f73900730b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-17T23:59:52.526 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:52.523+0000 7f7394cb2640 1 --2- 172.21.15.196:0/4131945184 >> v2:172.21.15.204:3300/0 conn(0x7f7390151ed0 0x7f73900730b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:59:52.526 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:52.523+0000 7f7394cb2640 1 -- 172.21.15.196:0/4131945184 >> v1:172.21.15.196:6789/0 conn(0x7f73900735f0 legacy=0x7f73900c5c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:59:52.526 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:52.523+0000 7f7394cb2640 1 -- 172.21.15.196:0/4131945184 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73900c7600 con 0x7f7390157f10 2024-03-17T23:59:52.528 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:52.527+0000 7f7394cb2640 1 --2- 172.21.15.196:0/4131945184 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7390157f10 0x7f73901583c0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f7388009d90 tx=0x7f738801f150 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bbf3dbcc1df9fc99 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:59:52.529 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:52.527+0000 7f738effd640 1 -- 172.21.15.196:0/4131945184 <== mon.2 v2:172.21.15.204:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73880b4070 con 0x7f7390157f10 2024-03-17T23:59:52.529 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:52.527+0000 7f738effd640 1 -- 172.21.15.196:0/4131945184 <== mon.2 v2:172.21.15.204:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f73880af600 con 0x7f7390157f10 2024-03-17T23:59:52.529 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:52.527+0000 7f738effd640 1 -- 172.21.15.196:0/4131945184 <== mon.2 v2:172.21.15.204:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73880af9b0 con 0x7f7390157f10 2024-03-17T23:59:52.530 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:52.527+0000 7f7396715640 1 -- 172.21.15.196:0/4131945184 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7390157f10 msgr2=0x7f73901583c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:59:52.530 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:52.527+0000 7f7396715640 1 --2- 172.21.15.196:0/4131945184 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7390157f10 0x7f73901583c0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f7388009d90 tx=0x7f738801f150 comp rx=0 tx=0).stop 2024-03-17T23:59:52.530 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:52.527+0000 7f7396715640 1 -- 172.21.15.196:0/4131945184 shutdown_connections 2024-03-17T23:59:52.530 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:52.527+0000 7f7396715640 1 --2- 172.21.15.196:0/4131945184 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7390157f10 0x7f73901583c0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:59:52.530 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:52.527+0000 7f7396715640 1 --2- 172.21.15.196:0/4131945184 >> v2:172.21.15.204:3300/0 conn(0x7f7390151ed0 0x7f73900730b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:59:52.530 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:52.527+0000 7f7396715640 1 -- 172.21.15.196:0/4131945184 >> 172.21.15.196:0/4131945184 conn(0x7f7390067680 msgr2=0x7f73900cc500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-17T23:59:52.531 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:52.527+0000 7f7396715640 1 -- 172.21.15.196:0/4131945184 shutdown_connections 2024-03-17T23:59:52.531 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:52.527+0000 7f7396715640 1 -- 172.21.15.196:0/4131945184 wait complete. 2024-03-17T23:59:52.531 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:52.527+0000 7f7396715640 1 Processor -- start 2024-03-17T23:59:52.531 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:52.527+0000 7f7396715640 1 -- start start 2024-03-17T23:59:52.533 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:52.527+0000 7f7396715640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f73900735f0 0x7f7390150950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:59:52.534 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:52.531+0000 7f7396715640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7390151ed0 0x7f73901ed120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:59:52.534 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:52.531+0000 7f7396715640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7390157f10 0x7f7390148030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:59:52.534 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:52.531+0000 7f7396715640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f739006be50 con 0x7f7390151ed0 2024-03-17T23:59:52.534 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:52.531+0000 7f7396715640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f739006bb70 con 0x7f7390157f10 2024-03-17T23:59:52.534 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:52.531+0000 7f7396715640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f73901522b0 con 0x7f73900735f0 2024-03-17T23:59:52.534 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:52.531+0000 7f738ffff640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f73900735f0 0x7f7390150950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:59:52.534 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:52.531+0000 7f738f7fe640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7390151ed0 0x7f73901ed120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:59:52.534 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:52.531+0000 7f738ffff640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f73900735f0 0x7f7390150950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3301/0 says I am v2:172.21.15.196:49090/0 (socket says 172.21.15.196:49090) 2024-03-17T23:59:52.534 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:52.531+0000 7f738ffff640 1 -- 172.21.15.196:0/4254749193 learned_addr learned my addr 172.21.15.196:0/4254749193 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-03-17T23:59:52.535 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:52.531+0000 7f7394cb2640 1 --2- 172.21.15.196:0/4254749193 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7390157f10 0x7f7390148030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:59:52.535 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:52.531+0000 7f738f7fe640 1 -- 172.21.15.196:0/4254749193 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f73900735f0 msgr2=0x7f7390150950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:59:52.535 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:52.531+0000 7f738f7fe640 1 --2- 172.21.15.196:0/4254749193 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f73900735f0 0x7f7390150950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:59:52.535 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:52.531+0000 7f738f7fe640 1 -- 172.21.15.196:0/4254749193 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7390157f10 msgr2=0x7f7390148030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:59:52.535 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:52.531+0000 7f738f7fe640 1 --2- 172.21.15.196:0/4254749193 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7390157f10 0x7f7390148030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:59:52.535 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:52.531+0000 7f738f7fe640 1 -- 172.21.15.196:0/4254749193 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f739014efd0 con 0x7f7390151ed0 2024-03-17T23:59:52.535 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:52.531+0000 7f7394cb2640 1 --2- 172.21.15.196:0/4254749193 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7390157f10 0x7f7390148030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-17T23:59:52.535 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:52.531+0000 7f738ffff640 1 --2- 172.21.15.196:0/4254749193 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f73900735f0 0x7f7390150950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-17T23:59:52.535 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:52.531+0000 7f738f7fe640 1 --2- 172.21.15.196:0/4254749193 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7390151ed0 0x7f73901ed120 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f7390073a30 tx=0x7f738400c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:59:52.535 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:52.531+0000 7f738cff9640 1 -- 172.21.15.196:0/4254749193 <== mon.0 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7384017070 con 0x7f7390151ed0 2024-03-17T23:59:52.535 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:52.531+0000 7f738cff9640 1 -- 172.21.15.196:0/4254749193 <== mon.0 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7384005cf0 con 0x7f7390151ed0 2024-03-17T23:59:52.535 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:52.531+0000 7f7396715640 1 -- 172.21.15.196:0/4254749193 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f73901ed660 con 0x7f7390151ed0 2024-03-17T23:59:52.536 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:52.531+0000 7f738cff9640 1 -- 172.21.15.196:0/4254749193 <== mon.0 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73840072f0 con 0x7f7390151ed0 2024-03-17T23:59:52.536 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:52.531+0000 7f7396715640 1 -- 172.21.15.196:0/4254749193 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f73901f07a0 con 0x7f7390151ed0 2024-03-17T23:59:52.536 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:52.531+0000 7f7396715640 1 -- 172.21.15.196:0/4254749193 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f73901f0e60 con 0x7f7390151ed0 2024-03-17T23:59:52.537 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:52.531+0000 7f738cff9640 1 -- 172.21.15.196:0/4254749193 <== mon.0 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 5) ==== 87083+0+0 (secure 0 0 0) 0x7f738401a070 con 0x7f7390151ed0 2024-03-17T23:59:52.537 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:52.531+0000 7f738cff9640 1 --2- 172.21.15.196:0/4254749193 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f737c067660 0x7f737c069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:59:52.537 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:52.531+0000 7f738cff9640 1 -- 172.21.15.196:0/4254749193 <== mon.0 v2:172.21.15.196:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7f7384085370 con 0x7f7390151ed0 2024-03-17T23:59:52.537 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:52.531+0000 7f738ffff640 1 --2- 172.21.15.196:0/4254749193 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f737c067660 0x7f737c069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:59:52.537 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:52.531+0000 7f738cff9640 1 --2- 172.21.15.196:0/4254749193 >> [v2:172.21.15.196:6800/1901246986,v1:172.21.15.196:6801/1901246986] conn(0x7f737c06f9e0 0x7f737c071e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:59:52.537 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:52.531+0000 7f738cff9640 1 -- 172.21.15.196:0/4254749193 --> [v2:172.21.15.196:6800/1901246986,v1:172.21.15.196:6801/1901246986] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7384020ec0 con 0x7f737c06f9e0 2024-03-17T23:59:52.537 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:52.531+0000 7f738cff9640 1 -- 172.21.15.196:0/4254749193 <== mon.0 v2:172.21.15.196:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f7384085800 con 0x7f7390151ed0 2024-03-17T23:59:52.538 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:52.531+0000 7f7394cb2640 1 --2- 172.21.15.196:0/4254749193 >> [v2:172.21.15.196:6800/1901246986,v1:172.21.15.196:6801/1901246986] conn(0x7f737c06f9e0 0x7f737c071e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:59:52.538 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:52.531+0000 7f7394cb2640 1 --2- 172.21.15.196:0/4254749193 >> [v2:172.21.15.196:6800/1901246986,v1:172.21.15.196:6801/1901246986] conn(0x7f737c06f9e0 0x7f737c071e60 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:59:52.538 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:52.531+0000 7f738ffff640 1 --2- 172.21.15.196:0/4254749193 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f737c067660 0x7f737c069b20 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f7380011310 tx=0x7f7380009190 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:59:52.538 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:52.535+0000 7f738cff9640 1 -- 172.21.15.196:0/4254749193 <== osd.1 v2:172.21.15.196:6800/1901246986 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f7384020ec0 con 0x7f737c06f9e0 2024-03-17T23:59:52.549 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:52.547+0000 7f7396715640 1 -- 172.21.15.196:0/4254749193 --> [v2:172.21.15.196:6800/1901246986,v1:172.21.15.196:6801/1901246986] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f73900689a0 con 0x7f737c06f9e0 2024-03-17T23:59:52.549 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:52.547+0000 7f738cff9640 1 -- 172.21.15.196:0/4254749193 <== osd.1 v2:172.21.15.196:6800/1901246986 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f73900689a0 con 0x7f737c06f9e0 2024-03-17T23:59:52.550 INFO:teuthology.orchestra.run.smithi196.stdout:{ 2024-03-17T23:59:52.550 INFO:teuthology.orchestra.run.smithi196.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-03-17T23:59:52.550 INFO:teuthology.orchestra.run.smithi196.stdout:} 2024-03-17T23:59:52.551 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:52.547+0000 7f7396715640 1 -- 172.21.15.196:0/4254749193 >> [v2:172.21.15.196:6800/1901246986,v1:172.21.15.196:6801/1901246986] conn(0x7f737c06f9e0 msgr2=0x7f737c071e60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:59:52.551 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:52.547+0000 7f7396715640 1 --2- 172.21.15.196:0/4254749193 >> [v2:172.21.15.196:6800/1901246986,v1:172.21.15.196:6801/1901246986] conn(0x7f737c06f9e0 0x7f737c071e60 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:59:52.551 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:52.547+0000 7f7396715640 1 -- 172.21.15.196:0/4254749193 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f737c067660 msgr2=0x7f737c069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:59:52.551 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:52.547+0000 7f7396715640 1 --2- 172.21.15.196:0/4254749193 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f737c067660 0x7f737c069b20 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f7380011310 tx=0x7f7380009190 comp rx=0 tx=0).stop 2024-03-17T23:59:52.551 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:52.547+0000 7f7396715640 1 -- 172.21.15.196:0/4254749193 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7390151ed0 msgr2=0x7f73901ed120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:59:52.551 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:52.547+0000 7f7396715640 1 --2- 172.21.15.196:0/4254749193 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7390151ed0 0x7f73901ed120 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f7390073a30 tx=0x7f738400c890 comp rx=0 tx=0).stop 2024-03-17T23:59:52.551 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:52.547+0000 7f7394cb2640 1 -- 172.21.15.196:0/4254749193 reap_dead start 2024-03-17T23:59:52.551 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:52.547+0000 7f7396715640 1 -- 172.21.15.196:0/4254749193 shutdown_connections 2024-03-17T23:59:52.551 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:52.547+0000 7f7396715640 1 -- 172.21.15.196:0/4254749193 >> 172.21.15.196:0/4254749193 conn(0x7f7390067680 msgr2=0x7f739006cc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-17T23:59:52.551 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:52.547+0000 7f7396715640 1 -- 172.21.15.196:0/4254749193 shutdown_connections 2024-03-17T23:59:52.551 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:52.547+0000 7f7396715640 1 -- 172.21.15.196:0/4254749193 wait complete. 2024-03-17T23:59:52.565 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-03-17T23:59:52.670 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:52.667+0000 7f6cc93b0640 1 Processor -- start 2024-03-17T23:59:52.670 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:52.667+0000 7f6cc93b0640 1 -- start start 2024-03-17T23:59:52.674 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:52.667+0000 7f6cc93b0640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f6cc4154340 0x7f6cc40c8d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:59:52.674 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:52.667+0000 7f6cc93b0640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6cc415d5d0 con 0x7f6cc4153f60 2024-03-17T23:59:52.674 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:52.667+0000 7f6cc93b0640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6cc415d8b0 con 0x7f6cc415aa70 2024-03-17T23:59:52.674 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:52.667+0000 7f6cc93b0640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 -- 0x7f6cc4072770 con 0x7f6cc4154340 2024-03-17T23:59:52.674 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:52.667+0000 7f6cc2ffd640 1 --1- >> v1:172.21.15.196:6789/0 conn(0x7f6cc4153f60 0x7f6cc40705f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.196:6789/0 says I am v1:172.21.15.196:56806/0 (socket says 172.21.15.196:56806) 2024-03-17T23:59:52.674 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:52.667+0000 7f6cc2ffd640 1 -- 172.21.15.196:0/2928157751 learned_addr learned my addr 172.21.15.196:0/2928157751 (peer_addr_for_me v1:172.21.15.196:0/0) 2024-03-17T23:59:52.674 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:52.667+0000 7f6cc27fc640 1 --2- 172.21.15.196:0/2928157751 >> v2:172.21.15.204:3300/0 conn(0x7f6cc4154340 0x7f6cc40c8d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:59:52.675 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:52.667+0000 7f6cc1ffb640 1 -- 172.21.15.196:0/2928157751 <== mon.0 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2307132510 0 0) 0x7f6cc415d5d0 con 0x7f6cc4153f60 2024-03-17T23:59:52.675 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:52.667+0000 7f6cc1ffb640 1 -- 172.21.15.196:0/2928157751 --> v1:172.21.15.196:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6cac003530 con 0x7f6cc4153f60 2024-03-17T23:59:52.675 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:52.667+0000 7f6cc1ffb640 1 -- 172.21.15.196:0/2928157751 <== mon.1 v1:172.21.15.204:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1132384651 0 0) 0x7f6cc415d8b0 con 0x7f6cc415aa70 2024-03-17T23:59:52.675 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:52.667+0000 7f6cc1ffb640 1 -- 172.21.15.196:0/2928157751 --> v1:172.21.15.204:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6cc415d5d0 con 0x7f6cc415aa70 2024-03-17T23:59:52.675 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:52.667+0000 7f6cc1ffb640 1 -- 172.21.15.196:0/2928157751 <== mon.0 v1:172.21.15.196:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2847694274 0 0) 0x7f6cac003530 con 0x7f6cc4153f60 2024-03-17T23:59:52.675 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:52.667+0000 7f6cc1ffb640 1 -- 172.21.15.196:0/2928157751 >> v2:172.21.15.204:3300/0 conn(0x7f6cc4154340 msgr2=0x7f6cc40c8d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-17T23:59:52.675 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:52.667+0000 7f6cc1ffb640 1 --2- 172.21.15.196:0/2928157751 >> v2:172.21.15.204:3300/0 conn(0x7f6cc4154340 0x7f6cc40c8d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:59:52.675 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:52.667+0000 7f6cc1ffb640 1 -- 172.21.15.196:0/2928157751 >> v1:172.21.15.204:6789/0 conn(0x7f6cc415aa70 legacy=0x7f6cc4072c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:59:52.675 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:52.667+0000 7f6cc1ffb640 1 -- 172.21.15.196:0/2928157751 --> v1:172.21.15.196:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6cc415db90 con 0x7f6cc4153f60 2024-03-17T23:59:52.675 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:52.667+0000 7f6cc1ffb640 1 -- 172.21.15.196:0/2928157751 <== mon.0 v1:172.21.15.196:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 981458915 0 0) 0x7f6cb4001680 con 0x7f6cc4153f60 2024-03-17T23:59:52.675 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:52.667+0000 7f6cc1ffb640 1 -- 172.21.15.196:0/2928157751 >> v1:172.21.15.196:6789/0 conn(0x7f6cc4153f60 legacy=0x7f6cc40705f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:59:52.675 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:52.667+0000 7f6cc1ffb640 1 --2- 172.21.15.196:0/2928157751 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6cac003b50 0x7f6cac003f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:59:52.675 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:52.667+0000 7f6cc1ffb640 1 --2- 172.21.15.196:0/2928157751 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f6cac004810 0x7f6cac004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:59:52.675 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:52.667+0000 7f6cc1ffb640 1 --2- 172.21.15.196:0/2928157751 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6cac0051d0 0x7f6cac00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:59:52.676 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:52.667+0000 7f6cc1ffb640 1 -- 172.21.15.196:0/2928157751 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f6cac00bfc0 con 0x7f6cac0051d0 2024-03-17T23:59:52.676 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:52.667+0000 7f6cc1ffb640 1 -- 172.21.15.196:0/2928157751 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f6cac00c140 con 0x7f6cac004810 2024-03-17T23:59:52.676 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:52.667+0000 7f6cc1ffb640 1 -- 172.21.15.196:0/2928157751 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f6cac00c340 con 0x7f6cac003b50 2024-03-17T23:59:52.676 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:52.667+0000 7f6cc37fe640 1 --2- 172.21.15.196:0/2928157751 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6cac0051d0 0x7f6cac00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:59:52.676 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:52.671+0000 7f6cc2ffd640 1 --2- 172.21.15.196:0/2928157751 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6cac003b50 0x7f6cac003f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:59:52.676 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:52.671+0000 7f6cc27fc640 1 --2- 172.21.15.196:0/2928157751 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f6cac004810 0x7f6cac004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:59:52.676 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:52.671+0000 7f6cc37fe640 1 -- 172.21.15.196:0/2928157751 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6cac003b50 msgr2=0x7f6cac003f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-17T23:59:52.676 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:52.671+0000 7f6cc37fe640 1 --2- 172.21.15.196:0/2928157751 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6cac003b50 0x7f6cac003f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:59:52.676 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:52.671+0000 7f6cc37fe640 1 -- 172.21.15.196:0/2928157751 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f6cac004810 msgr2=0x7f6cac004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-17T23:59:52.676 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:52.671+0000 7f6cc37fe640 1 --2- 172.21.15.196:0/2928157751 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f6cac004810 0x7f6cac004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:59:52.676 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:52.671+0000 7f6cc37fe640 1 -- 172.21.15.196:0/2928157751 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6cac003530 con 0x7f6cac0051d0 2024-03-17T23:59:52.679 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:52.671+0000 7f6cc37fe640 1 -- 172.21.15.196:0/2928157751 reap_dead start 2024-03-17T23:59:52.680 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:52.671+0000 7f6cc37fe640 1 --2- 172.21.15.196:0/2928157751 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6cac0051d0 0x7f6cac00b9d0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f6cbc007fd0 tx=0x7f6cbc01c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e91d6e54f1fb24d3 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:59:52.680 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:52.671+0000 7f6cc1ffb640 1 -- 172.21.15.196:0/2928157751 <== mon.0 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cbc001c20 con 0x7f6cac0051d0 2024-03-17T23:59:52.680 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:52.671+0000 7f6cc1ffb640 1 -- 172.21.15.196:0/2928157751 <== mon.0 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6cbc003b80 con 0x7f6cac0051d0 2024-03-17T23:59:52.680 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:52.671+0000 7f6cc1ffb640 1 -- 172.21.15.196:0/2928157751 <== mon.0 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cbc005080 con 0x7f6cac0051d0 2024-03-17T23:59:52.680 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:52.671+0000 7f6cc93b0640 1 -- 172.21.15.196:0/2928157751 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6cac0051d0 msgr2=0x7f6cac00b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:59:52.680 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:52.671+0000 7f6cc93b0640 1 --2- 172.21.15.196:0/2928157751 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6cac0051d0 0x7f6cac00b9d0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f6cbc007fd0 tx=0x7f6cbc01c8e0 comp rx=0 tx=0).stop 2024-03-17T23:59:52.680 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:52.671+0000 7f6cc93b0640 1 -- 172.21.15.196:0/2928157751 shutdown_connections 2024-03-17T23:59:52.680 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:52.671+0000 7f6cc93b0640 1 --2- 172.21.15.196:0/2928157751 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6cac0051d0 0x7f6cac00b9d0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:59:52.680 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:52.671+0000 7f6cc93b0640 1 -- 172.21.15.196:0/2928157751 >> 172.21.15.196:0/2928157751 conn(0x7f6cc406c3c0 msgr2=0x7f6cc406c7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-17T23:59:52.680 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:52.671+0000 7f6cc93b0640 1 -- 172.21.15.196:0/2928157751 shutdown_connections 2024-03-17T23:59:52.680 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:52.671+0000 7f6cc93b0640 1 -- 172.21.15.196:0/2928157751 wait complete. 2024-03-17T23:59:52.680 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:52.675+0000 7f6cc93b0640 1 Processor -- start 2024-03-17T23:59:52.681 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:52.675+0000 7f6cc93b0640 1 -- start start 2024-03-17T23:59:52.681 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:52.675+0000 7f6cc93b0640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6cac0051d0 0x7f6cc40cbd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:59:52.681 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:52.675+0000 7f6cc93b0640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6cc415bad0 0x7f6cc415bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:59:52.681 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:52.675+0000 7f6cc93b0640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f6cc4148bc0 0x7f6cc4149040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:59:52.681 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:52.675+0000 7f6cc93b0640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f6cc415d380 con 0x7f6cac0051d0 2024-03-17T23:59:52.681 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:52.675+0000 7f6cc93b0640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f6cc415e150 con 0x7f6cc4148bc0 2024-03-17T23:59:52.681 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:52.675+0000 7f6cc93b0640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f6cc40705f0 con 0x7f6cc415bad0 2024-03-17T23:59:52.681 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:52.675+0000 7f6cc2ffd640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6cac0051d0 0x7f6cc40cbd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:59:52.681 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:52.675+0000 7f6cc27fc640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6cc415bad0 0x7f6cc415bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:59:52.681 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:52.675+0000 7f6cc2ffd640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6cac0051d0 0x7f6cc40cbd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.196:38414/0 (socket says 172.21.15.196:38414) 2024-03-17T23:59:52.681 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:52.675+0000 7f6cc2ffd640 1 -- 172.21.15.196:0/1321610648 learned_addr learned my addr 172.21.15.196:0/1321610648 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-03-17T23:59:52.681 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:52.675+0000 7f6cc37fe640 1 --2- 172.21.15.196:0/1321610648 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f6cc4148bc0 0x7f6cc4149040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:59:52.681 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:52.675+0000 7f6cc2ffd640 1 -- 172.21.15.196:0/1321610648 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6cc415bad0 msgr2=0x7f6cc415bf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:59:52.682 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:52.675+0000 7f6cc2ffd640 1 --2- 172.21.15.196:0/1321610648 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6cc415bad0 0x7f6cc415bf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:59:52.682 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:52.675+0000 7f6cc2ffd640 1 -- 172.21.15.196:0/1321610648 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f6cc4148bc0 msgr2=0x7f6cc4149040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:59:52.682 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:52.675+0000 7f6cc2ffd640 1 --2- 172.21.15.196:0/1321610648 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f6cc4148bc0 0x7f6cc4149040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:59:52.682 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:52.675+0000 7f6cc2ffd640 1 -- 172.21.15.196:0/1321610648 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6cc40caa40 con 0x7f6cac0051d0 2024-03-17T23:59:52.682 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:52.675+0000 7f6cc2ffd640 1 --2- 172.21.15.196:0/1321610648 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6cac0051d0 0x7f6cc40cbd70 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f6cb40017d0 tx=0x7f6cb4007430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:59:52.682 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:52.675+0000 7f6cab7fe640 1 -- 172.21.15.196:0/1321610648 <== mon.0 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cb401a070 con 0x7f6cac0051d0 2024-03-17T23:59:52.682 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:52.675+0000 7f6cab7fe640 1 -- 172.21.15.196:0/1321610648 <== mon.0 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6cb400f750 con 0x7f6cac0051d0 2024-03-17T23:59:52.682 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:52.675+0000 7f6cc93b0640 1 -- 172.21.15.196:0/1321610648 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6cc40ca480 con 0x7f6cac0051d0 2024-03-17T23:59:52.682 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:52.675+0000 7f6cab7fe640 1 -- 172.21.15.196:0/1321610648 <== mon.0 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cb400fb20 con 0x7f6cac0051d0 2024-03-17T23:59:52.682 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:52.675+0000 7f6cc93b0640 1 -- 172.21.15.196:0/1321610648 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6cc415aff0 con 0x7f6cac0051d0 2024-03-17T23:59:52.683 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:52.679+0000 7f6cc93b0640 1 -- 172.21.15.196:0/1321610648 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6cc40689a0 con 0x7f6cac0051d0 2024-03-17T23:59:52.683 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:52.679+0000 7f6cab7fe640 1 -- 172.21.15.196:0/1321610648 <== mon.0 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 5) ==== 87083+0+0 (secure 0 0 0) 0x7f6cb401d070 con 0x7f6cac0051d0 2024-03-17T23:59:52.683 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:52.679+0000 7f6cab7fe640 1 --2- 172.21.15.196:0/1321610648 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f6cb0067660 0x7f6cb0069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:59:52.683 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:52.679+0000 7f6cab7fe640 1 -- 172.21.15.196:0/1321610648 <== mon.0 v2:172.21.15.196:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7f6cb4085080 con 0x7f6cac0051d0 2024-03-17T23:59:52.684 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:52.679+0000 7f6cc27fc640 1 --2- 172.21.15.196:0/1321610648 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f6cb0067660 0x7f6cb0069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:59:52.684 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:52.679+0000 7f6cc27fc640 1 --2- 172.21.15.196:0/1321610648 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f6cb0067660 0x7f6cb0069b20 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f6cc40c6b90 tx=0x7f6cb8009190 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:59:52.687 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:52.683+0000 7f6cab7fe640 1 -- 172.21.15.196:0/1321610648 <== mon.0 v2:172.21.15.196:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177849 (secure 0 0 0) 0x7f6cb4055630 con 0x7f6cac0051d0 2024-03-17T23:59:52.982 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:52.979+0000 7f6cc93b0640 1 -- 172.21.15.196:0/1321610648 --> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) -- 0x7f6cc4070bd0 con 0x7f6cb0067660 2024-03-17T23:59:52.983 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:52.979+0000 7f6cab7fe640 1 -- 172.21.15.196:0/1321610648 <== mgr.4099 v2:172.21.15.204:6832/2505201055 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f6cc4070bd0 con 0x7f6cb0067660 2024-03-17T23:59:52.983 INFO:teuthology.orchestra.run.smithi196.stderr:instructed osd(s) 1 to deep-scrub 2024-03-17T23:59:52.986 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:52.983+0000 7f6cc93b0640 1 -- 172.21.15.196:0/1321610648 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f6cb0067660 msgr2=0x7f6cb0069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:59:52.986 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:52.983+0000 7f6cc93b0640 1 --2- 172.21.15.196:0/1321610648 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f6cb0067660 0x7f6cb0069b20 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f6cc40c6b90 tx=0x7f6cb8009190 comp rx=0 tx=0).stop 2024-03-17T23:59:52.986 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:52.983+0000 7f6cc93b0640 1 -- 172.21.15.196:0/1321610648 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6cac0051d0 msgr2=0x7f6cc40cbd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:59:52.986 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:52.983+0000 7f6cc93b0640 1 --2- 172.21.15.196:0/1321610648 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6cac0051d0 0x7f6cc40cbd70 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f6cb40017d0 tx=0x7f6cb4007430 comp rx=0 tx=0).stop 2024-03-17T23:59:52.986 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:52.983+0000 7f6cc93b0640 1 -- 172.21.15.196:0/1321610648 shutdown_connections 2024-03-17T23:59:52.986 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:52.983+0000 7f6cc93b0640 1 --2- 172.21.15.196:0/1321610648 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f6cb0067660 0x7f6cb0069b20 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:59:52.986 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:52.983+0000 7f6cc93b0640 1 --2- 172.21.15.196:0/1321610648 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6cc415bad0 0x7f6cc415bf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:59:52.986 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:52.983+0000 7f6cc93b0640 1 --2- 172.21.15.196:0/1321610648 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f6cc4148bc0 0x7f6cc4149040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:59:52.986 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:52.983+0000 7f6cc93b0640 1 --2- 172.21.15.196:0/1321610648 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6cac0051d0 0x7f6cc40cbd70 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:59:52.987 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:52.983+0000 7f6cc93b0640 1 -- 172.21.15.196:0/1321610648 >> 172.21.15.196:0/1321610648 conn(0x7f6cc406c3c0 msgr2=0x7f6cc4152680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-17T23:59:52.987 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:52.983+0000 7f6cc93b0640 1 -- 172.21.15.196:0/1321610648 shutdown_connections 2024-03-17T23:59:52.987 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:52.983+0000 7f6cc93b0640 1 -- 172.21.15.196:0/1321610648 wait complete. 2024-03-17T23:59:53.002 INFO:tasks.ceph:Scrubbing osd.2 2024-03-17T23:59:53.002 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-03-17T23:59:53.120 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.115+0000 7fe1d7069640 1 Processor -- start 2024-03-17T23:59:53.120 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.115+0000 7fe1d7069640 1 -- start start 2024-03-17T23:59:53.122 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.119+0000 7fe1d7069640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe1d0151e40 0x7fe1d00c96e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:59:53.122 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.119+0000 7fe1d7069640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe1d006b9c0 con 0x7fe1d0158640 2024-03-17T23:59:53.122 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.119+0000 7fe1d7069640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe1d0072ea0 con 0x7fe1d00c5c10 2024-03-17T23:59:53.122 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.119+0000 7fe1d7069640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7fe1d0072500 con 0x7fe1d0151e40 2024-03-17T23:59:53.122 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.119+0000 7fe1d5606640 1 --1- >> v1:172.21.15.196:6789/0 conn(0x7fe1d0158640 0x7fe1d01624d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.196:6789/0 says I am v1:172.21.15.196:56810/0 (socket says 172.21.15.196:56810) 2024-03-17T23:59:53.122 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.119+0000 7fe1d5606640 1 -- 172.21.15.196:0/280753632 learned_addr learned my addr 172.21.15.196:0/280753632 (peer_addr_for_me v1:172.21.15.196:0/0) 2024-03-17T23:59:53.122 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.119+0000 7fe1d4e05640 1 --2- 172.21.15.196:0/280753632 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe1d0151e40 0x7fe1d00c96e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:59:53.123 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.119+0000 7fe1cf7fe640 1 -- 172.21.15.196:0/280753632 <== mon.0 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3096264920 0 0) 0x7fe1d006b9c0 con 0x7fe1d0158640 2024-03-17T23:59:53.123 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.119+0000 7fe1cf7fe640 1 -- 172.21.15.196:0/280753632 --> v1:172.21.15.196:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe1c0003530 con 0x7fe1d0158640 2024-03-17T23:59:53.123 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.119+0000 7fe1d4e05640 1 -- 172.21.15.196:0/280753632 >> v1:172.21.15.204:6789/0 conn(0x7fe1d00c5c10 legacy=0x7fe1d0157f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:59:53.123 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.119+0000 7fe1d4e05640 1 -- 172.21.15.196:0/280753632 >> v1:172.21.15.196:6789/0 conn(0x7fe1d0158640 legacy=0x7fe1d01624d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:59:53.123 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.119+0000 7fe1d4e05640 1 -- 172.21.15.196:0/280753632 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1d0073180 con 0x7fe1d0151e40 2024-03-17T23:59:53.125 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.123+0000 7fe1d4e05640 1 --2- 172.21.15.196:0/280753632 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe1d0151e40 0x7fe1d00c96e0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fe1c40097f0 tx=0x7fe1c401c4e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fd24cc4b013102e server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:59:53.125 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.123+0000 7fe1cf7fe640 1 -- 172.21.15.196:0/280753632 <== mon.2 v2:172.21.15.204:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1c40ab5f0 con 0x7fe1d0151e40 2024-03-17T23:59:53.125 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.123+0000 7fe1cf7fe640 1 -- 172.21.15.196:0/280753632 <== mon.2 v2:172.21.15.204:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe1c40b0070 con 0x7fe1d0151e40 2024-03-17T23:59:53.125 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.123+0000 7fe1cf7fe640 1 -- 172.21.15.196:0/280753632 <== mon.2 v2:172.21.15.204:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1c40ab990 con 0x7fe1d0151e40 2024-03-17T23:59:53.126 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.123+0000 7fe1d7069640 1 -- 172.21.15.196:0/280753632 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe1d0151e40 msgr2=0x7fe1d00c96e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:59:53.126 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.123+0000 7fe1d7069640 1 --2- 172.21.15.196:0/280753632 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe1d0151e40 0x7fe1d00c96e0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fe1c40097f0 tx=0x7fe1c401c4e0 comp rx=0 tx=0).stop 2024-03-17T23:59:53.127 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.123+0000 7fe1d7069640 1 -- 172.21.15.196:0/280753632 shutdown_connections 2024-03-17T23:59:53.127 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.123+0000 7fe1d7069640 1 --2- 172.21.15.196:0/280753632 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe1d0151e40 0x7fe1d00c96e0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:59:53.127 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.123+0000 7fe1d7069640 1 -- 172.21.15.196:0/280753632 >> 172.21.15.196:0/280753632 conn(0x7fe1d0067680 msgr2=0x7fe1d00cc500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-17T23:59:53.127 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.123+0000 7fe1d7069640 1 -- 172.21.15.196:0/280753632 shutdown_connections 2024-03-17T23:59:53.127 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.123+0000 7fe1d7069640 1 -- 172.21.15.196:0/280753632 wait complete. 2024-03-17T23:59:53.128 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.123+0000 7fe1d7069640 1 Processor -- start 2024-03-17T23:59:53.128 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.123+0000 7fe1d7069640 1 -- start start 2024-03-17T23:59:53.131 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.127+0000 7fe1d7069640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe1d00c5c10 0x7fe1d0153920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:59:53.131 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.127+0000 7fe1d7069640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe1d0151e40 0x7fe1d01526e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:59:53.131 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.127+0000 7fe1d7069640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe1d0158640 0x7fe1d00cb280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:59:53.131 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.127+0000 7fe1d7069640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fe1d006bca0 con 0x7fe1d0158640 2024-03-17T23:59:53.131 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.127+0000 7fe1d7069640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7fe1d00c6400 con 0x7fe1d0151e40 2024-03-17T23:59:53.131 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.127+0000 7fe1d7069640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7fe1d006b610 con 0x7fe1d00c5c10 2024-03-17T23:59:53.131 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.127+0000 7fe1d5606640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe1d0158640 0x7fe1d00cb280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:59:53.131 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.127+0000 7fe1d5606640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe1d0158640 0x7fe1d00cb280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.196:38420/0 (socket says 172.21.15.196:38420) 2024-03-17T23:59:53.132 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.127+0000 7fe1d5606640 1 -- 172.21.15.196:0/3837036135 learned_addr learned my addr 172.21.15.196:0/3837036135 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-03-17T23:59:53.132 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.127+0000 7fe1d4e05640 1 --2- 172.21.15.196:0/3837036135 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe1d00c5c10 0x7fe1d0153920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:59:53.132 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.127+0000 7fe1cffff640 1 --2- 172.21.15.196:0/3837036135 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe1d0151e40 0x7fe1d01526e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:59:53.132 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.127+0000 7fe1d5606640 1 -- 172.21.15.196:0/3837036135 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe1d00c5c10 msgr2=0x7fe1d0153920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:59:53.132 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.127+0000 7fe1d5606640 1 --2- 172.21.15.196:0/3837036135 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe1d00c5c10 0x7fe1d0153920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:59:53.132 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.127+0000 7fe1d5606640 1 -- 172.21.15.196:0/3837036135 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe1d0151e40 msgr2=0x7fe1d01526e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:59:53.132 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.127+0000 7fe1d5606640 1 --2- 172.21.15.196:0/3837036135 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe1d0151e40 0x7fe1d01526e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:59:53.132 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.127+0000 7fe1d5606640 1 -- 172.21.15.196:0/3837036135 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1d0156e10 con 0x7fe1d0158640 2024-03-17T23:59:53.132 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.127+0000 7fe1cffff640 1 --2- 172.21.15.196:0/3837036135 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe1d0151e40 0x7fe1d01526e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-17T23:59:53.132 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.127+0000 7fe1d5606640 1 --2- 172.21.15.196:0/3837036135 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe1d0158640 0x7fe1d00cb280 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fe1c800cad0 tx=0x7fe1c800cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:59:53.132 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.127+0000 7fe1cd7fa640 1 -- 172.21.15.196:0/3837036135 <== mon.0 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1c8017070 con 0x7fe1d0158640 2024-03-17T23:59:53.132 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.127+0000 7fe1cd7fa640 1 -- 172.21.15.196:0/3837036135 <== mon.0 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe1c800ac30 con 0x7fe1d0158640 2024-03-17T23:59:53.132 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.127+0000 7fe1d7069640 1 -- 172.21.15.196:0/3837036135 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe1d01570f0 con 0x7fe1d0158640 2024-03-17T23:59:53.133 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.127+0000 7fe1cd7fa640 1 -- 172.21.15.196:0/3837036135 <== mon.0 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1c8012400 con 0x7fe1d0158640 2024-03-17T23:59:53.133 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.127+0000 7fe1d7069640 1 -- 172.21.15.196:0/3837036135 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1d00ca7a0 con 0x7fe1d0158640 2024-03-17T23:59:53.133 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.127+0000 7fe1d7069640 1 -- 172.21.15.196:0/3837036135 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fe1d00689a0 con 0x7fe1d0158640 2024-03-17T23:59:53.134 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.127+0000 7fe1cd7fa640 1 -- 172.21.15.196:0/3837036135 <== mon.0 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 5) ==== 87083+0+0 (secure 0 0 0) 0x7fe1c801a070 con 0x7fe1d0158640 2024-03-17T23:59:53.134 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.131+0000 7fe1cd7fa640 1 --2- 172.21.15.196:0/3837036135 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7fe1b4067660 0x7fe1b4069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:59:53.134 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.131+0000 7fe1cd7fa640 1 -- 172.21.15.196:0/3837036135 <== mon.0 v2:172.21.15.196:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7fe1c8085cb0 con 0x7fe1d0158640 2024-03-17T23:59:53.134 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.131+0000 7fe1d4e05640 1 --2- 172.21.15.196:0/3837036135 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7fe1b4067660 0x7fe1b4069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:59:53.135 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.131+0000 7fe1cd7fa640 1 --2- 172.21.15.196:0/3837036135 >> [v2:172.21.15.196:6824/673819559,v1:172.21.15.196:6825/673819559] conn(0x7fe1b406f9e0 0x7fe1b4071e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:59:53.135 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.131+0000 7fe1cd7fa640 1 -- 172.21.15.196:0/3837036135 --> [v2:172.21.15.196:6824/673819559,v1:172.21.15.196:6825/673819559] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe1b4072530 con 0x7fe1b406f9e0 2024-03-17T23:59:53.135 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.131+0000 7fe1cd7fa640 1 -- 172.21.15.196:0/3837036135 <== mon.0 v2:172.21.15.196:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7fe1c8086140 con 0x7fe1d0158640 2024-03-17T23:59:53.135 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.131+0000 7fe1cffff640 1 --2- 172.21.15.196:0/3837036135 >> [v2:172.21.15.196:6824/673819559,v1:172.21.15.196:6825/673819559] conn(0x7fe1b406f9e0 0x7fe1b4071e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:59:53.135 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.131+0000 7fe1cffff640 1 --2- 172.21.15.196:0/3837036135 >> [v2:172.21.15.196:6824/673819559,v1:172.21.15.196:6825/673819559] conn(0x7fe1b406f9e0 0x7fe1b4071e60 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:59:53.135 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.131+0000 7fe1d4e05640 1 --2- 172.21.15.196:0/3837036135 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7fe1b4067660 0x7fe1b4069b20 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fe1c40af000 tx=0x7fe1c40a7000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:59:53.135 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.131+0000 7fe1cd7fa640 1 -- 172.21.15.196:0/3837036135 <== osd.2 v2:172.21.15.196:6824/673819559 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fe1b4072530 con 0x7fe1b406f9e0 2024-03-17T23:59:53.157 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.155+0000 7fe1d7069640 1 -- 172.21.15.196:0/3837036135 --> [v2:172.21.15.196:6824/673819559,v1:172.21.15.196:6825/673819559] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fe1d00caea0 con 0x7fe1b406f9e0 2024-03-17T23:59:53.158 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.155+0000 7fe1cd7fa640 1 -- 172.21.15.196:0/3837036135 <== osd.2 v2:172.21.15.196:6824/673819559 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fe1d00caea0 con 0x7fe1b406f9e0 2024-03-17T23:59:53.158 INFO:teuthology.orchestra.run.smithi196.stdout:{ 2024-03-17T23:59:53.158 INFO:teuthology.orchestra.run.smithi196.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-03-17T23:59:53.158 INFO:teuthology.orchestra.run.smithi196.stdout:} 2024-03-17T23:59:53.159 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.155+0000 7fe1d7069640 1 -- 172.21.15.196:0/3837036135 >> [v2:172.21.15.196:6824/673819559,v1:172.21.15.196:6825/673819559] conn(0x7fe1b406f9e0 msgr2=0x7fe1b4071e60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:59:53.159 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.155+0000 7fe1d7069640 1 --2- 172.21.15.196:0/3837036135 >> [v2:172.21.15.196:6824/673819559,v1:172.21.15.196:6825/673819559] conn(0x7fe1b406f9e0 0x7fe1b4071e60 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:59:53.159 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.155+0000 7fe1d7069640 1 -- 172.21.15.196:0/3837036135 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7fe1b4067660 msgr2=0x7fe1b4069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:59:53.159 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.155+0000 7fe1d7069640 1 --2- 172.21.15.196:0/3837036135 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7fe1b4067660 0x7fe1b4069b20 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fe1c40af000 tx=0x7fe1c40a7000 comp rx=0 tx=0).stop 2024-03-17T23:59:53.159 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.155+0000 7fe1d7069640 1 -- 172.21.15.196:0/3837036135 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe1d0158640 msgr2=0x7fe1d00cb280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:59:53.159 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.155+0000 7fe1d7069640 1 --2- 172.21.15.196:0/3837036135 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe1d0158640 0x7fe1d00cb280 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fe1c800cad0 tx=0x7fe1c800cf90 comp rx=0 tx=0).stop 2024-03-17T23:59:53.159 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.155+0000 7fe1d5606640 1 -- 172.21.15.196:0/3837036135 reap_dead start 2024-03-17T23:59:53.160 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.155+0000 7fe1d7069640 1 -- 172.21.15.196:0/3837036135 shutdown_connections 2024-03-17T23:59:53.160 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.155+0000 7fe1d7069640 1 -- 172.21.15.196:0/3837036135 >> 172.21.15.196:0/3837036135 conn(0x7fe1d0067680 msgr2=0x7fe1d0151150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-17T23:59:53.160 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.155+0000 7fe1d7069640 1 -- 172.21.15.196:0/3837036135 shutdown_connections 2024-03-17T23:59:53.160 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.155+0000 7fe1d7069640 1 -- 172.21.15.196:0/3837036135 wait complete. 2024-03-17T23:59:53.175 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-03-17T23:59:53.284 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.279+0000 7f454e505640 1 Processor -- start 2024-03-17T23:59:53.284 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.279+0000 7f454e505640 1 -- start start 2024-03-17T23:59:53.287 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.283+0000 7f454e505640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f454806d240 0x7f4548157e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:59:53.287 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.283+0000 7f454e505640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4548152310 con 0x7f4548151f30 2024-03-17T23:59:53.287 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.283+0000 7f454e505640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f45481584d0 con 0x7f454806e270 2024-03-17T23:59:53.287 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.283+0000 7f454e505640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 -- 0x7f454815c3e0 con 0x7f454806d240 2024-03-17T23:59:53.287 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.283+0000 7f4547fff640 1 --1- >> v1:172.21.15.196:6789/0 conn(0x7f4548151f30 0x7f454815bcd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.196:6789/0 says I am v1:172.21.15.196:56812/0 (socket says 172.21.15.196:56812) 2024-03-17T23:59:53.287 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.283+0000 7f4547fff640 1 -- 172.21.15.196:0/2353718293 learned_addr learned my addr 172.21.15.196:0/2353718293 (peer_addr_for_me v1:172.21.15.196:0/0) 2024-03-17T23:59:53.287 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.283+0000 7f454caa2640 1 --2- 172.21.15.196:0/2353718293 >> v2:172.21.15.204:3300/0 conn(0x7f454806d240 0x7f4548157e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:59:53.287 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.283+0000 7f4546ffd640 1 -- 172.21.15.196:0/2353718293 <== mon.0 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2867718947 0 0) 0x7f4548152310 con 0x7f4548151f30 2024-03-17T23:59:53.287 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.283+0000 7f4546ffd640 1 -- 172.21.15.196:0/2353718293 --> v1:172.21.15.196:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4530003530 con 0x7f4548151f30 2024-03-17T23:59:53.288 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.283+0000 7f4546ffd640 1 -- 172.21.15.196:0/2353718293 <== mon.1 v1:172.21.15.204:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4275259508 0 0) 0x7f45481584d0 con 0x7f454806e270 2024-03-17T23:59:53.288 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.283+0000 7f4546ffd640 1 -- 172.21.15.196:0/2353718293 --> v1:172.21.15.204:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4548152310 con 0x7f454806e270 2024-03-17T23:59:53.288 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.283+0000 7f4546ffd640 1 -- 172.21.15.196:0/2353718293 <== mon.0 v1:172.21.15.196:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 96000988 0 0) 0x7f4530003530 con 0x7f4548151f30 2024-03-17T23:59:53.288 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.283+0000 7f4546ffd640 1 -- 172.21.15.196:0/2353718293 >> v2:172.21.15.204:3300/0 conn(0x7f454806d240 msgr2=0x7f4548157e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-17T23:59:53.288 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.283+0000 7f4546ffd640 1 --2- 172.21.15.196:0/2353718293 >> v2:172.21.15.204:3300/0 conn(0x7f454806d240 0x7f4548157e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:59:53.288 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.283+0000 7f4546ffd640 1 -- 172.21.15.196:0/2353718293 >> v1:172.21.15.204:6789/0 conn(0x7f454806e270 legacy=0x7f45480c68a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:59:53.288 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.283+0000 7f4546ffd640 1 -- 172.21.15.196:0/2353718293 --> v1:172.21.15.196:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45481587b0 con 0x7f4548151f30 2024-03-17T23:59:53.288 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.283+0000 7f4546ffd640 1 -- 172.21.15.196:0/2353718293 <== mon.0 v1:172.21.15.196:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 981458915 0 0) 0x7f4538001680 con 0x7f4548151f30 2024-03-17T23:59:53.288 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.283+0000 7f454caa2640 1 --2- 172.21.15.196:0/2353718293 >> v2:172.21.15.204:3300/0 conn(0x7f454806d240 0x7f4548157e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-17T23:59:53.288 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.283+0000 7f4546ffd640 1 -- 172.21.15.196:0/2353718293 >> v1:172.21.15.196:6789/0 conn(0x7f4548151f30 legacy=0x7f454815bcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:59:53.288 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.283+0000 7f4546ffd640 1 --2- 172.21.15.196:0/2353718293 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4530003b50 0x7f4530003f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:59:53.288 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.283+0000 7f4546ffd640 1 --2- 172.21.15.196:0/2353718293 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4530004810 0x7f4530004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:59:53.288 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.283+0000 7f4546ffd640 1 --2- 172.21.15.196:0/2353718293 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f45300051d0 0x7f453000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:59:53.288 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.283+0000 7f4546ffd640 1 -- 172.21.15.196:0/2353718293 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f454815c3e0 con 0x7f4530003b50 2024-03-17T23:59:53.289 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.283+0000 7f4546ffd640 1 -- 172.21.15.196:0/2353718293 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f453000c050 con 0x7f45300051d0 2024-03-17T23:59:53.289 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.283+0000 7f4546ffd640 1 -- 172.21.15.196:0/2353718293 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f453000c250 con 0x7f4530004810 2024-03-17T23:59:53.289 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.283+0000 7f4547fff640 1 --2- 172.21.15.196:0/2353718293 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4530003b50 0x7f4530003f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:59:53.289 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.283+0000 7f45477fe640 1 --2- 172.21.15.196:0/2353718293 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4530004810 0x7f4530004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:59:53.289 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.283+0000 7f4547fff640 1 -- 172.21.15.196:0/2353718293 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4530004810 msgr2=0x7f4530004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-17T23:59:53.289 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.283+0000 7f454caa2640 1 --2- 172.21.15.196:0/2353718293 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f45300051d0 0x7f453000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:59:53.289 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.283+0000 7f4547fff640 1 --2- 172.21.15.196:0/2353718293 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4530004810 0x7f4530004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:59:53.289 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.283+0000 7f4547fff640 1 -- 172.21.15.196:0/2353718293 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f45300051d0 msgr2=0x7f453000b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-17T23:59:53.289 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.283+0000 7f4547fff640 1 --2- 172.21.15.196:0/2353718293 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f45300051d0 0x7f453000b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:59:53.289 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.283+0000 7f4547fff640 1 -- 172.21.15.196:0/2353718293 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4530003530 con 0x7f4530003b50 2024-03-17T23:59:53.289 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.283+0000 7f454caa2640 1 --2- 172.21.15.196:0/2353718293 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f45300051d0 0x7f453000b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-17T23:59:53.289 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.283+0000 7f454caa2640 1 -- 172.21.15.196:0/2353718293 reap_dead start 2024-03-17T23:59:53.293 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.287+0000 7f4547fff640 1 --2- 172.21.15.196:0/2353718293 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4530003b50 0x7f4530003f50 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f453800c210 tx=0x7f453801cbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de093ac067bef163 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:59:53.293 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.287+0000 7f4546ffd640 1 -- 172.21.15.196:0/2353718293 <== mon.0 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4538007cf0 con 0x7f4530003b50 2024-03-17T23:59:53.293 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.287+0000 7f4546ffd640 1 -- 172.21.15.196:0/2353718293 <== mon.0 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f45380a9020 con 0x7f4530003b50 2024-03-17T23:59:53.293 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.287+0000 7f4546ffd640 1 -- 172.21.15.196:0/2353718293 <== mon.0 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4538005b00 con 0x7f4530003b50 2024-03-17T23:59:53.293 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.287+0000 7f454e505640 1 -- 172.21.15.196:0/2353718293 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4530003b50 msgr2=0x7f4530003f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:59:53.293 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.287+0000 7f454e505640 1 --2- 172.21.15.196:0/2353718293 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4530003b50 0x7f4530003f50 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f453800c210 tx=0x7f453801cbe0 comp rx=0 tx=0).stop 2024-03-17T23:59:53.294 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.287+0000 7f454e505640 1 -- 172.21.15.196:0/2353718293 shutdown_connections 2024-03-17T23:59:53.294 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.287+0000 7f454e505640 1 --2- 172.21.15.196:0/2353718293 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4530003b50 0x7f4530003f50 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:59:53.294 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.287+0000 7f454e505640 1 -- 172.21.15.196:0/2353718293 >> 172.21.15.196:0/2353718293 conn(0x7f45480c89a0 msgr2=0x7f45480c8db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-17T23:59:53.294 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.287+0000 7f454e505640 1 -- 172.21.15.196:0/2353718293 shutdown_connections 2024-03-17T23:59:53.294 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.287+0000 7f454e505640 1 -- 172.21.15.196:0/2353718293 wait complete. 2024-03-17T23:59:53.294 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.287+0000 7f454e505640 1 Processor -- start 2024-03-17T23:59:53.294 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.287+0000 7f454e505640 1 -- start start 2024-03-17T23:59:53.294 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.287+0000 7f454e505640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4530003b50 0x7f45481e5ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:59:53.294 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.287+0000 7f454e505640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4548145740 0x7f45481509e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:59:53.294 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.287+0000 7f454e505640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f45481f4c10 0x7f45481f5090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:59:53.294 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.287+0000 7f454e505640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f45480c70b0 con 0x7f4530003b50 2024-03-17T23:59:53.294 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.287+0000 7f454e505640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f4548158250 con 0x7f45481f4c10 2024-03-17T23:59:53.295 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.287+0000 7f454e505640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f454806b2b0 con 0x7f4548145740 2024-03-17T23:59:53.295 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.287+0000 7f4547fff640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4530003b50 0x7f45481e5ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:59:53.295 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.287+0000 7f4547fff640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4530003b50 0x7f45481e5ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.196:38426/0 (socket says 172.21.15.196:38426) 2024-03-17T23:59:53.295 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.287+0000 7f4547fff640 1 -- 172.21.15.196:0/3446661205 learned_addr learned my addr 172.21.15.196:0/3446661205 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-03-17T23:59:53.295 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.287+0000 7f45477fe640 1 --2- 172.21.15.196:0/3446661205 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4548145740 0x7f45481509e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:59:53.295 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.287+0000 7f454caa2640 1 --2- 172.21.15.196:0/3446661205 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f45481f4c10 0x7f45481f5090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:59:53.295 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.287+0000 7f4547fff640 1 -- 172.21.15.196:0/3446661205 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4548145740 msgr2=0x7f45481509e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:59:53.295 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.287+0000 7f4547fff640 1 --2- 172.21.15.196:0/3446661205 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4548145740 0x7f45481509e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:59:53.295 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.287+0000 7f4547fff640 1 -- 172.21.15.196:0/3446661205 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f45481f4c10 msgr2=0x7f45481f5090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:59:53.295 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.287+0000 7f4547fff640 1 --2- 172.21.15.196:0/3446661205 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f45481f4c10 0x7f45481f5090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:59:53.295 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.287+0000 7f4547fff640 1 -- 172.21.15.196:0/3446661205 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4548159790 con 0x7f4530003b50 2024-03-17T23:59:53.295 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.287+0000 7f4547fff640 1 --2- 172.21.15.196:0/3446661205 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4530003b50 0x7f45481e5ff0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f453801ca10 tx=0x7f4530005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:59:53.295 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.287+0000 7f4544ff9640 1 -- 172.21.15.196:0/3446661205 <== mon.0 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4538005e60 con 0x7f4530003b50 2024-03-17T23:59:53.295 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.287+0000 7f4544ff9640 1 -- 172.21.15.196:0/3446661205 <== mon.0 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f45380b2070 con 0x7f4530003b50 2024-03-17T23:59:53.296 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.287+0000 7f454e505640 1 -- 172.21.15.196:0/3446661205 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f45481e6db0 con 0x7f4530003b50 2024-03-17T23:59:53.296 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.287+0000 7f4544ff9640 1 -- 172.21.15.196:0/3446661205 <== mon.0 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4538007cf0 con 0x7f4530003b50 2024-03-17T23:59:53.296 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.287+0000 7f454e505640 1 -- 172.21.15.196:0/3446661205 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45481591d0 con 0x7f4530003b50 2024-03-17T23:59:53.296 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.291+0000 7f454e505640 1 -- 172.21.15.196:0/3446661205 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f45480689a0 con 0x7f4530003b50 2024-03-17T23:59:53.296 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.291+0000 7f4544ff9640 1 -- 172.21.15.196:0/3446661205 <== mon.0 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 5) ==== 87083+0+0 (secure 0 0 0) 0x7f4538007310 con 0x7f4530003b50 2024-03-17T23:59:53.296 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.291+0000 7f4544ff9640 1 --2- 172.21.15.196:0/3446661205 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f4534067690 0x7f4534069b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:59:53.297 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.291+0000 7f4544ff9640 1 -- 172.21.15.196:0/3446661205 <== mon.0 v2:172.21.15.196:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7f453811ea30 con 0x7f4530003b50 2024-03-17T23:59:53.297 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.291+0000 7f45477fe640 1 --2- 172.21.15.196:0/3446661205 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f4534067690 0x7f4534069b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:59:53.297 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.291+0000 7f45477fe640 1 --2- 172.21.15.196:0/3446661205 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f4534067690 0x7f4534069b50 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f4548071f30 tx=0x7f453c009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:59:53.298 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.295+0000 7f4544ff9640 1 -- 172.21.15.196:0/3446661205 <== mon.0 v2:172.21.15.196:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177849 (secure 0 0 0) 0x7f4548159790 con 0x7f4530003b50 2024-03-17T23:59:53.455 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.451+0000 7f454e505640 1 -- 172.21.15.196:0/3446661205 --> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) -- 0x7f4548158f80 con 0x7f4534067690 2024-03-17T23:59:53.456 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.451+0000 7f4544ff9640 1 -- 172.21.15.196:0/3446661205 <== mgr.4099 v2:172.21.15.204:6832/2505201055 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f4548158f80 con 0x7f4534067690 2024-03-17T23:59:53.456 INFO:teuthology.orchestra.run.smithi196.stderr:instructed osd(s) 2 to deep-scrub 2024-03-17T23:59:53.459 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.455+0000 7f454e505640 1 -- 172.21.15.196:0/3446661205 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f4534067690 msgr2=0x7f4534069b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:59:53.459 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.455+0000 7f454e505640 1 --2- 172.21.15.196:0/3446661205 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f4534067690 0x7f4534069b50 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f4548071f30 tx=0x7f453c009040 comp rx=0 tx=0).stop 2024-03-17T23:59:53.459 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.455+0000 7f454e505640 1 -- 172.21.15.196:0/3446661205 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4530003b50 msgr2=0x7f45481e5ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:59:53.459 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.455+0000 7f454e505640 1 --2- 172.21.15.196:0/3446661205 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4530003b50 0x7f45481e5ff0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f453801ca10 tx=0x7f4530005840 comp rx=0 tx=0).stop 2024-03-17T23:59:53.459 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.455+0000 7f454e505640 1 -- 172.21.15.196:0/3446661205 shutdown_connections 2024-03-17T23:59:53.459 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.455+0000 7f454e505640 1 --2- 172.21.15.196:0/3446661205 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f4534067690 0x7f4534069b50 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:59:53.459 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.455+0000 7f454e505640 1 --2- 172.21.15.196:0/3446661205 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4548145740 0x7f45481509e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:59:53.460 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.455+0000 7f454e505640 1 --2- 172.21.15.196:0/3446661205 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f45481f4c10 0x7f45481f5090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:59:53.460 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.455+0000 7f454e505640 1 --2- 172.21.15.196:0/3446661205 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4530003b50 0x7f45481e5ff0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:59:53.460 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.455+0000 7f454e505640 1 -- 172.21.15.196:0/3446661205 >> 172.21.15.196:0/3446661205 conn(0x7f45480c89a0 msgr2=0x7f4548156520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-17T23:59:53.460 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.455+0000 7f454e505640 1 -- 172.21.15.196:0/3446661205 shutdown_connections 2024-03-17T23:59:53.460 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.455+0000 7f454e505640 1 -- 172.21.15.196:0/3446661205 wait complete. 2024-03-17T23:59:53.475 INFO:tasks.ceph:Scrubbing osd.3 2024-03-17T23:59:53.475 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-03-17T23:59:53.590 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.587+0000 7f251658b640 1 Processor -- start 2024-03-17T23:59:53.590 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.587+0000 7f251658b640 1 -- start start 2024-03-17T23:59:53.591 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.587+0000 7f251658b640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f2510158620 0x7f25100c6050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:59:53.591 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.587+0000 7f251658b640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f25100c7320 con 0x7f2510151ed0 2024-03-17T23:59:53.591 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.587+0000 7f251658b640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f25100c7600 con 0x7f25100c5c10 2024-03-17T23:59:53.591 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.587+0000 7f251658b640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7f251006b640 con 0x7f2510158620 2024-03-17T23:59:53.591 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.587+0000 7f2514b28640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f2510158620 0x7f25100c6050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:59:53.591 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.587+0000 7f250ffff640 1 --1- >> v1:172.21.15.196:6789/0 conn(0x7f2510151ed0 0x7f25100730b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.196:6789/0 says I am v1:172.21.15.196:56822/0 (socket says 172.21.15.196:56822) 2024-03-17T23:59:53.591 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.587+0000 7f250ffff640 1 -- 172.21.15.196:0/3116067319 learned_addr learned my addr 172.21.15.196:0/3116067319 (peer_addr_for_me v1:172.21.15.196:0/0) 2024-03-17T23:59:53.591 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.587+0000 7f2514b28640 1 --2- 172.21.15.196:0/3116067319 >> v2:172.21.15.196:3300/0 conn(0x7f2510158620 0x7f25100c6050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.196:38434/0 (socket says 172.21.15.196:38434) 2024-03-17T23:59:53.592 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.587+0000 7f2514b28640 1 -- 172.21.15.196:0/3116067319 >> v1:172.21.15.204:6789/0 conn(0x7f25100c5c10 legacy=0x7f2510157f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:59:53.592 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.587+0000 7f2514b28640 1 -- 172.21.15.196:0/3116067319 >> v1:172.21.15.196:6789/0 conn(0x7f2510151ed0 legacy=0x7f25100730b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:59:53.592 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.587+0000 7f2514b28640 1 -- 172.21.15.196:0/3116067319 --> v2:172.21.15.196:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f251006b890 con 0x7f2510158620 2024-03-17T23:59:53.592 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.587+0000 7f250effd640 1 -- 172.21.15.196:0/3116067319 <== mon.0 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1109209565 0 0) 0x7f25100c7320 con 0x7f2510151ed0 2024-03-17T23:59:53.596 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.591+0000 7f2514b28640 1 --2- 172.21.15.196:0/3116067319 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2510158620 0x7f25100c6050 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f2508009d90 tx=0x7f250801f150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9a7a43f1385168c server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:59:53.596 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.591+0000 7f250effd640 1 -- 172.21.15.196:0/3116067319 <== mon.0 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25080b4070 con 0x7f2510158620 2024-03-17T23:59:53.596 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.591+0000 7f250effd640 1 -- 172.21.15.196:0/3116067319 <== mon.0 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f25080af600 con 0x7f2510158620 2024-03-17T23:59:53.596 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.591+0000 7f250effd640 1 -- 172.21.15.196:0/3116067319 <== mon.0 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25080af9d0 con 0x7f2510158620 2024-03-17T23:59:53.596 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.591+0000 7f251658b640 1 -- 172.21.15.196:0/3116067319 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2510158620 msgr2=0x7f25100c6050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:59:53.596 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.591+0000 7f251658b640 1 --2- 172.21.15.196:0/3116067319 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2510158620 0x7f25100c6050 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f2508009d90 tx=0x7f250801f150 comp rx=0 tx=0).stop 2024-03-17T23:59:53.596 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.591+0000 7f251658b640 1 -- 172.21.15.196:0/3116067319 shutdown_connections 2024-03-17T23:59:53.596 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.591+0000 7f251658b640 1 --2- 172.21.15.196:0/3116067319 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2510158620 0x7f25100c6050 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:59:53.596 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.591+0000 7f251658b640 1 -- 172.21.15.196:0/3116067319 >> 172.21.15.196:0/3116067319 conn(0x7f2510067680 msgr2=0x7f25100cc500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-17T23:59:53.596 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.591+0000 7f251658b640 1 -- 172.21.15.196:0/3116067319 shutdown_connections 2024-03-17T23:59:53.596 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.591+0000 7f251658b640 1 -- 172.21.15.196:0/3116067319 wait complete. 2024-03-17T23:59:53.597 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.595+0000 7f251658b640 1 Processor -- start 2024-03-17T23:59:53.598 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.595+0000 7f251658b640 1 -- start start 2024-03-17T23:59:53.600 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.595+0000 7f251658b640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f25100c5c10 0x7f2510146980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:59:53.600 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.595+0000 7f251658b640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2510151ed0 0x7f25100cb5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:59:53.600 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.595+0000 7f251658b640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2510158620 0x7f25100cbb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:59:53.600 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.595+0000 7f251658b640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f25100737c0 con 0x7f2510158620 2024-03-17T23:59:53.600 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.595+0000 7f251658b640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f251006be50 con 0x7f2510151ed0 2024-03-17T23:59:53.600 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.595+0000 7f251658b640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f25101522b0 con 0x7f25100c5c10 2024-03-17T23:59:53.600 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.595+0000 7f2514b28640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2510158620 0x7f25100cbb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:59:53.601 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.595+0000 7f2514b28640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2510158620 0x7f25100cbb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.196:38448/0 (socket says 172.21.15.196:38448) 2024-03-17T23:59:53.601 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.595+0000 7f2514b28640 1 -- 172.21.15.196:0/2620635610 learned_addr learned my addr 172.21.15.196:0/2620635610 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-03-17T23:59:53.601 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.595+0000 7f250ffff640 1 --2- 172.21.15.196:0/2620635610 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f25100c5c10 0x7f2510146980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:59:53.601 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.595+0000 7f250f7fe640 1 --2- 172.21.15.196:0/2620635610 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2510151ed0 0x7f25100cb5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:59:53.601 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.595+0000 7f2514b28640 1 -- 172.21.15.196:0/2620635610 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f25100c5c10 msgr2=0x7f2510146980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:59:53.601 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.595+0000 7f2514b28640 1 --2- 172.21.15.196:0/2620635610 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f25100c5c10 0x7f2510146980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:59:53.601 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.595+0000 7f2514b28640 1 -- 172.21.15.196:0/2620635610 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2510151ed0 msgr2=0x7f25100cb5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:59:53.601 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.595+0000 7f2514b28640 1 --2- 172.21.15.196:0/2620635610 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2510151ed0 0x7f25100cb5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:59:53.601 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.595+0000 7f2514b28640 1 -- 172.21.15.196:0/2620635610 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25100cc070 con 0x7f2510158620 2024-03-17T23:59:53.601 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.595+0000 7f250f7fe640 1 --2- 172.21.15.196:0/2620635610 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2510151ed0 0x7f25100cb5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-17T23:59:53.601 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.595+0000 7f250ffff640 1 --2- 172.21.15.196:0/2620635610 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f25100c5c10 0x7f2510146980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-17T23:59:53.601 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.595+0000 7f2514b28640 1 --2- 172.21.15.196:0/2620635610 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2510158620 0x7f25100cbb30 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f250801cd80 tx=0x7f250801bef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:59:53.601 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.595+0000 7f250cff9640 1 -- 172.21.15.196:0/2620635610 <== mon.0 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25080b4040 con 0x7f2510158620 2024-03-17T23:59:53.602 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.595+0000 7f250cff9640 1 -- 172.21.15.196:0/2620635610 <== mon.0 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f25080c1070 con 0x7f2510158620 2024-03-17T23:59:53.602 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.595+0000 7f251658b640 1 -- 172.21.15.196:0/2620635610 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f25100c4f70 con 0x7f2510158620 2024-03-17T23:59:53.602 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.595+0000 7f250cff9640 1 -- 172.21.15.196:0/2620635610 <== mon.0 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25080ba690 con 0x7f2510158620 2024-03-17T23:59:53.602 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.595+0000 7f251658b640 1 -- 172.21.15.196:0/2620635610 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25101e19d0 con 0x7f2510158620 2024-03-17T23:59:53.602 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.595+0000 7f251658b640 1 -- 172.21.15.196:0/2620635610 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f25100689a0 con 0x7f2510158620 2024-03-17T23:59:53.603 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.599+0000 7f250cff9640 1 -- 172.21.15.196:0/2620635610 <== mon.0 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 5) ==== 87083+0+0 (secure 0 0 0) 0x7f25080ba830 con 0x7f2510158620 2024-03-17T23:59:53.603 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.599+0000 7f250cff9640 1 --2- 172.21.15.196:0/2620635610 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f24fc067660 0x7f24fc069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:59:53.603 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.599+0000 7f250cff9640 1 -- 172.21.15.196:0/2620635610 <== mon.0 v2:172.21.15.196:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7f2508124d00 con 0x7f2510158620 2024-03-17T23:59:53.603 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.599+0000 7f250ffff640 1 --2- 172.21.15.196:0/2620635610 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f24fc067660 0x7f24fc069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:59:53.603 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.599+0000 7f250cff9640 1 --2- 172.21.15.196:0/2620635610 >> [v2:172.21.15.196:6816/1104340623,v1:172.21.15.196:6817/1104340623] conn(0x7f24fc06f9e0 0x7f24fc071e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:59:53.603 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.599+0000 7f250cff9640 1 -- 172.21.15.196:0/2620635610 --> [v2:172.21.15.196:6816/1104340623,v1:172.21.15.196:6817/1104340623] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f25080c8e70 con 0x7f24fc06f9e0 2024-03-17T23:59:53.604 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.599+0000 7f250cff9640 1 -- 172.21.15.196:0/2620635610 <== mon.0 v2:172.21.15.196:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f2508125190 con 0x7f2510158620 2024-03-17T23:59:53.604 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.599+0000 7f250f7fe640 1 --2- 172.21.15.196:0/2620635610 >> [v2:172.21.15.196:6816/1104340623,v1:172.21.15.196:6817/1104340623] conn(0x7f24fc06f9e0 0x7f24fc071e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:59:53.604 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.599+0000 7f250f7fe640 1 --2- 172.21.15.196:0/2620635610 >> [v2:172.21.15.196:6816/1104340623,v1:172.21.15.196:6817/1104340623] conn(0x7f24fc06f9e0 0x7f24fc071e60 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:59:53.604 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.599+0000 7f250ffff640 1 --2- 172.21.15.196:0/2620635610 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f24fc067660 0x7f24fc069b20 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f2500000f70 tx=0x7f2500007c60 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:59:53.604 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.599+0000 7f250cff9640 1 -- 172.21.15.196:0/2620635610 <== osd.3 v2:172.21.15.196:6816/1104340623 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f25080c8e70 con 0x7f24fc06f9e0 2024-03-17T23:59:53.629 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.627+0000 7f251658b640 1 -- 172.21.15.196:0/2620635610 --> [v2:172.21.15.196:6816/1104340623,v1:172.21.15.196:6817/1104340623] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f2510072bd0 con 0x7f24fc06f9e0 2024-03-17T23:59:53.629 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.627+0000 7f250cff9640 1 -- 172.21.15.196:0/2620635610 <== osd.3 v2:172.21.15.196:6816/1104340623 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f2510072bd0 con 0x7f24fc06f9e0 2024-03-17T23:59:53.630 INFO:teuthology.orchestra.run.smithi196.stdout:{ 2024-03-17T23:59:53.630 INFO:teuthology.orchestra.run.smithi196.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-03-17T23:59:53.630 INFO:teuthology.orchestra.run.smithi196.stdout:} 2024-03-17T23:59:53.631 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.627+0000 7f251658b640 1 -- 172.21.15.196:0/2620635610 >> [v2:172.21.15.196:6816/1104340623,v1:172.21.15.196:6817/1104340623] conn(0x7f24fc06f9e0 msgr2=0x7f24fc071e60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:59:53.631 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.627+0000 7f251658b640 1 --2- 172.21.15.196:0/2620635610 >> [v2:172.21.15.196:6816/1104340623,v1:172.21.15.196:6817/1104340623] conn(0x7f24fc06f9e0 0x7f24fc071e60 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:59:53.631 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.627+0000 7f251658b640 1 -- 172.21.15.196:0/2620635610 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f24fc067660 msgr2=0x7f24fc069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:59:53.631 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.627+0000 7f251658b640 1 --2- 172.21.15.196:0/2620635610 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f24fc067660 0x7f24fc069b20 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f2500000f70 tx=0x7f2500007c60 comp rx=0 tx=0).stop 2024-03-17T23:59:53.631 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.627+0000 7f251658b640 1 -- 172.21.15.196:0/2620635610 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2510158620 msgr2=0x7f25100cbb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:59:53.631 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.627+0000 7f251658b640 1 --2- 172.21.15.196:0/2620635610 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2510158620 0x7f25100cbb30 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f250801cd80 tx=0x7f250801bef0 comp rx=0 tx=0).stop 2024-03-17T23:59:53.631 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.627+0000 7f2514b28640 1 -- 172.21.15.196:0/2620635610 reap_dead start 2024-03-17T23:59:53.631 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.627+0000 7f251658b640 1 -- 172.21.15.196:0/2620635610 shutdown_connections 2024-03-17T23:59:53.631 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.627+0000 7f251658b640 1 -- 172.21.15.196:0/2620635610 >> 172.21.15.196:0/2620635610 conn(0x7f2510067680 msgr2=0x7f251006c3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-17T23:59:53.631 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.627+0000 7f251658b640 1 -- 172.21.15.196:0/2620635610 shutdown_connections 2024-03-17T23:59:53.632 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.627+0000 7f251658b640 1 -- 172.21.15.196:0/2620635610 wait complete. 2024-03-17T23:59:53.644 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-03-17T23:59:53.755 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.751+0000 7fced804b640 1 Processor -- start 2024-03-17T23:59:53.755 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.751+0000 7fced804b640 1 -- start start 2024-03-17T23:59:53.757 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.755+0000 7fced804b640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fced0150e50 0x7fced00c8600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:59:53.757 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.755+0000 7fced804b640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fced006f8d0 0x7fced006fd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:59:53.757 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.755+0000 7fced804b640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fced0151230 con 0x7fced015a470 2024-03-17T23:59:53.757 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.755+0000 7fced804b640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 -- 0x7fced00c7620 con 0x7fced006f8d0 2024-03-17T23:59:53.757 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.755+0000 7fced804b640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7fced00c7900 con 0x7fced0150e50 2024-03-17T23:59:53.757 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.755+0000 7fced55e6640 1 --1- >> v1:172.21.15.196:6789/0 conn(0x7fced015a470 0x7fced015a890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.196:6789/0 says I am v1:172.21.15.196:56830/0 (socket says 172.21.15.196:56830) 2024-03-17T23:59:53.758 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.755+0000 7fced55e6640 1 -- 172.21.15.196:0/2213446504 learned_addr learned my addr 172.21.15.196:0/2213446504 (peer_addr_for_me v1:172.21.15.196:0/0) 2024-03-17T23:59:53.758 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.755+0000 7fced5de7640 1 --2- 172.21.15.196:0/2213446504 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fced0150e50 0x7fced00c8600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:59:53.758 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.755+0000 7fced65e8640 1 --2- 172.21.15.196:0/2213446504 >> v2:172.21.15.204:3300/0 conn(0x7fced006f8d0 0x7fced006fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:59:53.758 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.755+0000 7fced4de5640 1 -- 172.21.15.196:0/2213446504 <== mon.0 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3211613803 0 0) 0x7fced0151230 con 0x7fced015a470 2024-03-17T23:59:53.758 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.755+0000 7fced4de5640 1 -- 172.21.15.196:0/2213446504 --> v1:172.21.15.196:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcebc003530 con 0x7fced015a470 2024-03-17T23:59:53.758 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.755+0000 7fced65e8640 1 -- 172.21.15.196:0/2213446504 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fced0150e50 msgr2=0x7fced00c8600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-17T23:59:53.758 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.755+0000 7fced65e8640 1 --2- 172.21.15.196:0/2213446504 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fced0150e50 0x7fced00c8600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:59:53.758 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.755+0000 7fced65e8640 1 -- 172.21.15.196:0/2213446504 >> v1:172.21.15.196:6789/0 conn(0x7fced015a470 legacy=0x7fced015a890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:59:53.758 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.755+0000 7fced65e8640 1 -- 172.21.15.196:0/2213446504 --> v2:172.21.15.204:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fced00c7be0 con 0x7fced006f8d0 2024-03-17T23:59:53.758 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.755+0000 7fced5de7640 1 --2- 172.21.15.196:0/2213446504 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fced0150e50 0x7fced00c8600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-17T23:59:53.759 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.755+0000 7fced65e8640 1 --2- 172.21.15.196:0/2213446504 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fced006f8d0 0x7fced006fd20 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fcec8009d90 tx=0x7fcec801efa0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7d80ce21b0b8c4cf server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:59:53.760 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.755+0000 7fced4de5640 1 -- 172.21.15.196:0/2213446504 <== mon.1 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcec80b5070 con 0x7fced006f8d0 2024-03-17T23:59:53.760 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.755+0000 7fced4de5640 1 -- 172.21.15.196:0/2213446504 <== mon.1 v2:172.21.15.204:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcec80a8b30 con 0x7fced006f8d0 2024-03-17T23:59:53.760 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.755+0000 7fced4de5640 1 -- 172.21.15.196:0/2213446504 <== mon.1 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcec0001680 con 0x7fced006f8d0 2024-03-17T23:59:53.760 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.759+0000 7fced804b640 1 -- 172.21.15.196:0/2213446504 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fced006f8d0 msgr2=0x7fced006fd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:59:53.761 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.759+0000 7fced804b640 1 --2- 172.21.15.196:0/2213446504 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fced006f8d0 0x7fced006fd20 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fcec8009d90 tx=0x7fcec801efa0 comp rx=0 tx=0).stop 2024-03-17T23:59:53.761 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.759+0000 7fced804b640 1 -- 172.21.15.196:0/2213446504 shutdown_connections 2024-03-17T23:59:53.761 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.759+0000 7fced804b640 1 --2- 172.21.15.196:0/2213446504 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fced006f8d0 0x7fced006fd20 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:59:53.761 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.759+0000 7fced804b640 1 --2- 172.21.15.196:0/2213446504 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fced0150e50 0x7fced00c8600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:59:53.761 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.759+0000 7fced804b640 1 -- 172.21.15.196:0/2213446504 >> 172.21.15.196:0/2213446504 conn(0x7fced00cc420 msgr2=0x7fced00cc830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-17T23:59:53.761 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.759+0000 7fced804b640 1 -- 172.21.15.196:0/2213446504 shutdown_connections 2024-03-17T23:59:53.761 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.759+0000 7fced804b640 1 -- 172.21.15.196:0/2213446504 wait complete. 2024-03-17T23:59:53.761 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.759+0000 7fced804b640 1 Processor -- start 2024-03-17T23:59:53.762 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.759+0000 7fced804b640 1 -- start start 2024-03-17T23:59:53.763 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.759+0000 7fced804b640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fced006f8d0 0x7fced0151470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:59:53.763 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.759+0000 7fced804b640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fced0150e50 0x7fced01ef780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:59:53.763 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.759+0000 7fced804b640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fced015a470 0x7fced00cb600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:59:53.763 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.759+0000 7fced804b640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fced0070db0 con 0x7fced006f8d0 2024-03-17T23:59:53.763 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.759+0000 7fced804b640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7fced00c81a0 con 0x7fced015a470 2024-03-17T23:59:53.763 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.759+0000 7fced804b640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7fced00c8b40 con 0x7fced0150e50 2024-03-17T23:59:53.764 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.759+0000 7fced5de7640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fced006f8d0 0x7fced0151470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:59:53.764 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.759+0000 7fced5de7640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fced006f8d0 0x7fced0151470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.196:38458/0 (socket says 172.21.15.196:38458) 2024-03-17T23:59:53.764 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.759+0000 7fced5de7640 1 -- 172.21.15.196:0/2706552414 learned_addr learned my addr 172.21.15.196:0/2706552414 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-03-17T23:59:53.764 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.759+0000 7fced65e8640 1 --2- 172.21.15.196:0/2706552414 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fced015a470 0x7fced00cb600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:59:53.764 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.759+0000 7fced55e6640 1 --2- 172.21.15.196:0/2706552414 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fced0150e50 0x7fced01ef780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:59:53.764 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.759+0000 7fced5de7640 1 -- 172.21.15.196:0/2706552414 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fced0150e50 msgr2=0x7fced01ef780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:59:53.764 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.759+0000 7fced5de7640 1 --2- 172.21.15.196:0/2706552414 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fced0150e50 0x7fced01ef780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:59:53.764 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.759+0000 7fced5de7640 1 -- 172.21.15.196:0/2706552414 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fced015a470 msgr2=0x7fced00cb600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:59:53.764 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.759+0000 7fced5de7640 1 --2- 172.21.15.196:0/2706552414 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fced015a470 0x7fced00cb600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:59:53.764 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.759+0000 7fced5de7640 1 -- 172.21.15.196:0/2706552414 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fced0153b20 con 0x7fced006f8d0 2024-03-17T23:59:53.764 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.759+0000 7fced5de7640 1 --2- 172.21.15.196:0/2706552414 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fced006f8d0 0x7fced0151470 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fcecc00ec10 tx=0x7fcecc00c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:59:53.764 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.759+0000 7fcec67fc640 1 -- 172.21.15.196:0/2706552414 <== mon.0 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcecc017070 con 0x7fced006f8d0 2024-03-17T23:59:53.765 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.759+0000 7fced804b640 1 -- 172.21.15.196:0/2706552414 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fced014b360 con 0x7fced006f8d0 2024-03-17T23:59:53.765 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.759+0000 7fced804b640 1 -- 172.21.15.196:0/2706552414 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fced014c660 con 0x7fced006f8d0 2024-03-17T23:59:53.765 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.759+0000 7fcec67fc640 1 -- 172.21.15.196:0/2706552414 <== mon.0 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcecc00cc30 con 0x7fced006f8d0 2024-03-17T23:59:53.765 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.759+0000 7fcec67fc640 1 -- 172.21.15.196:0/2706552414 <== mon.0 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcecc021060 con 0x7fced006f8d0 2024-03-17T23:59:53.765 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.759+0000 7fced804b640 1 -- 172.21.15.196:0/2706552414 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fceb80052a0 con 0x7fced006f8d0 2024-03-17T23:59:53.766 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.763+0000 7fcec67fc640 1 -- 172.21.15.196:0/2706552414 <== mon.0 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 5) ==== 87083+0+0 (secure 0 0 0) 0x7fcecc01a070 con 0x7fced006f8d0 2024-03-17T23:59:53.766 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.763+0000 7fcec67fc640 1 --2- 172.21.15.196:0/2706552414 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7fceb4067660 0x7fceb4069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:59:53.766 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.763+0000 7fcec67fc640 1 -- 172.21.15.196:0/2706552414 <== mon.0 v2:172.21.15.196:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7fcecc085b70 con 0x7fced006f8d0 2024-03-17T23:59:53.766 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.763+0000 7fced55e6640 1 --2- 172.21.15.196:0/2706552414 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7fceb4067660 0x7fceb4069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:59:53.766 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.763+0000 7fced55e6640 1 --2- 172.21.15.196:0/2706552414 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7fceb4067660 0x7fceb4069b20 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fced014e370 tx=0x7fcec00018e0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:59:53.768 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.767+0000 7fcec67fc640 1 -- 172.21.15.196:0/2706552414 <== mon.0 v2:172.21.15.196:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177849 (secure 0 0 0) 0x7fcecc056770 con 0x7fced006f8d0 2024-03-17T23:59:53.922 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.919+0000 7fced804b640 1 -- 172.21.15.196:0/2706552414 --> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) -- 0x7fceb8000bd0 con 0x7fceb4067660 2024-03-17T23:59:53.923 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.919+0000 7fcec67fc640 1 -- 172.21.15.196:0/2706552414 <== mgr.4099 v2:172.21.15.204:6832/2505201055 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fceb8000bd0 con 0x7fceb4067660 2024-03-17T23:59:53.924 INFO:teuthology.orchestra.run.smithi196.stderr:instructed osd(s) 3 to deep-scrub 2024-03-17T23:59:53.926 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.923+0000 7fced804b640 1 -- 172.21.15.196:0/2706552414 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7fceb4067660 msgr2=0x7fceb4069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:59:53.926 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.923+0000 7fced804b640 1 --2- 172.21.15.196:0/2706552414 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7fceb4067660 0x7fceb4069b20 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fced014e370 tx=0x7fcec00018e0 comp rx=0 tx=0).stop 2024-03-17T23:59:53.926 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.923+0000 7fced804b640 1 -- 172.21.15.196:0/2706552414 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fced006f8d0 msgr2=0x7fced0151470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:59:53.926 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.923+0000 7fced804b640 1 --2- 172.21.15.196:0/2706552414 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fced006f8d0 0x7fced0151470 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fcecc00ec10 tx=0x7fcecc00c520 comp rx=0 tx=0).stop 2024-03-17T23:59:53.926 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.923+0000 7fced804b640 1 -- 172.21.15.196:0/2706552414 shutdown_connections 2024-03-17T23:59:53.926 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.923+0000 7fced804b640 1 --2- 172.21.15.196:0/2706552414 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7fceb4067660 0x7fceb4069b20 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:59:53.926 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.923+0000 7fced804b640 1 --2- 172.21.15.196:0/2706552414 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fced0150e50 0x7fced01ef780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:59:53.926 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.923+0000 7fced804b640 1 --2- 172.21.15.196:0/2706552414 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fced015a470 0x7fced00cb600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:59:53.926 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.923+0000 7fced804b640 1 --2- 172.21.15.196:0/2706552414 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fced006f8d0 0x7fced0151470 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:59:53.926 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.923+0000 7fced804b640 1 -- 172.21.15.196:0/2706552414 >> 172.21.15.196:0/2706552414 conn(0x7fced00cc420 msgr2=0x7fced00c5790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-17T23:59:53.926 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.923+0000 7fced804b640 1 -- 172.21.15.196:0/2706552414 shutdown_connections 2024-03-17T23:59:53.926 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:53.923+0000 7fced804b640 1 -- 172.21.15.196:0/2706552414 wait complete. 2024-03-17T23:59:53.941 INFO:tasks.ceph:Scrubbing osd.4 2024-03-17T23:59:53.941 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-03-17T23:59:54.054 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:54.051+0000 7f36ced72640 1 Processor -- start 2024-03-17T23:59:54.055 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:54.051+0000 7f36ced72640 1 -- start start 2024-03-17T23:59:54.056 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:54.051+0000 7f36ced72640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f36c8154150 0x7f36c8159da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:59:54.056 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:54.051+0000 7f36ced72640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f36c80cc140 0x7f36c80cc5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:59:54.056 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:54.051+0000 7f36ced72640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f36c815ad40 con 0x7f36c815dcc0 2024-03-17T23:59:54.056 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:54.051+0000 7f36ced72640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7f36c815d830 con 0x7f36c80cc140 2024-03-17T23:59:54.056 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:54.051+0000 7f36ced72640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f36c815a4a0 con 0x7f36c8154150 2024-03-17T23:59:54.056 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:54.051+0000 7f36cd30f640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f36c80cc140 0x7f36c80cc5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:59:54.056 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:54.051+0000 7f36bffff640 1 --1- >> v1:172.21.15.196:6789/0 conn(0x7f36c815dcc0 0x7f36c80cb150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.196:6789/0 says I am v1:172.21.15.196:56840/0 (socket says 172.21.15.196:56840) 2024-03-17T23:59:54.056 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:54.051+0000 7f36bffff640 1 -- 172.21.15.196:0/3266320041 learned_addr learned my addr 172.21.15.196:0/3266320041 (peer_addr_for_me v1:172.21.15.196:0/0) 2024-03-17T23:59:54.056 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:54.051+0000 7f36ccb0e640 1 --2- 172.21.15.196:0/3266320041 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f36c8154150 0x7f36c8159da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:59:54.057 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:54.051+0000 7f36cd30f640 1 -- 172.21.15.196:0/3266320041 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f36c8154150 msgr2=0x7f36c8159da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-17T23:59:54.057 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:54.051+0000 7f36cd30f640 1 --2- 172.21.15.196:0/3266320041 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f36c8154150 0x7f36c8159da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:59:54.057 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:54.051+0000 7f36cd30f640 1 -- 172.21.15.196:0/3266320041 >> v1:172.21.15.196:6789/0 conn(0x7f36c815dcc0 legacy=0x7f36c80cb150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:59:54.057 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:54.051+0000 7f36bf7fe640 1 -- 172.21.15.196:0/3266320041 <== mon.0 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2924210592 0 0) 0x7f36c815ad40 con 0x7f36c815dcc0 2024-03-17T23:59:54.057 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:54.051+0000 7f36cd30f640 1 -- 172.21.15.196:0/3266320041 --> v2:172.21.15.196:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36c815a780 con 0x7f36c80cc140 2024-03-17T23:59:54.057 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:54.051+0000 7f36ccb0e640 1 --2- 172.21.15.196:0/3266320041 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f36c8154150 0x7f36c8159da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-17T23:59:54.059 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:54.055+0000 7f36cd30f640 1 --2- 172.21.15.196:0/3266320041 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f36c80cc140 0x7f36c80cc5b0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f36c815d9b0 tx=0x7f36c001c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3e920bd0d27977d server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:59:54.059 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:54.055+0000 7f36bf7fe640 1 -- 172.21.15.196:0/3266320041 <== mon.0 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36c00b2070 con 0x7f36c80cc140 2024-03-17T23:59:54.059 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:54.055+0000 7f36bf7fe640 1 -- 172.21.15.196:0/3266320041 <== mon.0 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f36c00a5920 con 0x7f36c80cc140 2024-03-17T23:59:54.059 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:54.055+0000 7f36bf7fe640 1 -- 172.21.15.196:0/3266320041 <== mon.0 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36c00a5cf0 con 0x7f36c80cc140 2024-03-17T23:59:54.060 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:54.055+0000 7f36ced72640 1 -- 172.21.15.196:0/3266320041 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f36c80cc140 msgr2=0x7f36c80cc5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:59:54.060 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:54.055+0000 7f36ced72640 1 --2- 172.21.15.196:0/3266320041 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f36c80cc140 0x7f36c80cc5b0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f36c815d9b0 tx=0x7f36c001c950 comp rx=0 tx=0).stop 2024-03-17T23:59:54.060 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:54.055+0000 7f36ced72640 1 -- 172.21.15.196:0/3266320041 shutdown_connections 2024-03-17T23:59:54.060 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:54.055+0000 7f36ced72640 1 --2- 172.21.15.196:0/3266320041 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f36c80cc140 0x7f36c80cc5b0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:59:54.060 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:54.055+0000 7f36ced72640 1 --2- 172.21.15.196:0/3266320041 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f36c8154150 0x7f36c8159da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:59:54.060 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:54.055+0000 7f36ced72640 1 -- 172.21.15.196:0/3266320041 >> 172.21.15.196:0/3266320041 conn(0x7f36c80729e0 msgr2=0x7f36c8072dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-17T23:59:54.061 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:54.055+0000 7f36ced72640 1 -- 172.21.15.196:0/3266320041 shutdown_connections 2024-03-17T23:59:54.061 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:54.055+0000 7f36ced72640 1 -- 172.21.15.196:0/3266320041 wait complete. 2024-03-17T23:59:54.061 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:54.059+0000 7f36ced72640 1 Processor -- start 2024-03-17T23:59:54.061 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:54.059+0000 7f36ced72640 1 -- start start 2024-03-17T23:59:54.063 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:54.059+0000 7f36ced72640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f36c80cc140 0x7f36c80ce870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:59:54.063 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:54.059+0000 7f36ced72640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f36c8154150 0x7f36c815b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:59:54.063 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:54.059+0000 7f36ced72640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f36c815dcc0 0x7f36c815bca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:59:54.063 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:54.059+0000 7f36ced72640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f36c80c4a60 con 0x7f36c815dcc0 2024-03-17T23:59:54.063 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:54.059+0000 7f36ced72640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f36c80c48e0 con 0x7f36c8154150 2024-03-17T23:59:54.063 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:54.059+0000 7f36ced72640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f36c815e0a0 con 0x7f36c80cc140 2024-03-17T23:59:54.063 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:54.059+0000 7f36cd30f640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f36c815dcc0 0x7f36c815bca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:59:54.064 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:54.059+0000 7f36cd30f640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f36c815dcc0 0x7f36c815bca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.196:38478/0 (socket says 172.21.15.196:38478) 2024-03-17T23:59:54.064 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:54.059+0000 7f36cd30f640 1 -- 172.21.15.196:0/760996173 learned_addr learned my addr 172.21.15.196:0/760996173 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-03-17T23:59:54.064 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:54.059+0000 7f36ccb0e640 1 --2- 172.21.15.196:0/760996173 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f36c80cc140 0x7f36c80ce870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:59:54.064 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:54.059+0000 7f36bffff640 1 --2- 172.21.15.196:0/760996173 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f36c8154150 0x7f36c815b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:59:54.064 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:54.059+0000 7f36cd30f640 1 -- 172.21.15.196:0/760996173 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f36c80cc140 msgr2=0x7f36c80ce870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:59:54.064 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:54.059+0000 7f36cd30f640 1 --2- 172.21.15.196:0/760996173 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f36c80cc140 0x7f36c80ce870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:59:54.064 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:54.059+0000 7f36cd30f640 1 -- 172.21.15.196:0/760996173 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f36c8154150 msgr2=0x7f36c815b760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:59:54.064 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:54.059+0000 7f36cd30f640 1 --2- 172.21.15.196:0/760996173 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f36c8154150 0x7f36c815b760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:59:54.064 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:54.059+0000 7f36cd30f640 1 -- 172.21.15.196:0/760996173 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36c815ca90 con 0x7f36c815dcc0 2024-03-17T23:59:54.064 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:54.059+0000 7f36cd30f640 1 --2- 172.21.15.196:0/760996173 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f36c815dcc0 0x7f36c815bca0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f36c001b000 tx=0x7f36c00196f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:59:54.064 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:54.059+0000 7f36bd7fa640 1 -- 172.21.15.196:0/760996173 <== mon.0 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36c00b2050 con 0x7f36c815dcc0 2024-03-17T23:59:54.064 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:54.059+0000 7f36bd7fa640 1 -- 172.21.15.196:0/760996173 <== mon.0 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f36c00be070 con 0x7f36c815dcc0 2024-03-17T23:59:54.064 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:54.059+0000 7f36ced72640 1 -- 172.21.15.196:0/760996173 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f36c815cd70 con 0x7f36c815dcc0 2024-03-17T23:59:54.064 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:54.059+0000 7f36bd7fa640 1 -- 172.21.15.196:0/760996173 <== mon.0 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36c00ada70 con 0x7f36c815dcc0 2024-03-17T23:59:54.065 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:54.059+0000 7f36ced72640 1 -- 172.21.15.196:0/760996173 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36c815af60 con 0x7f36c815dcc0 2024-03-17T23:59:54.065 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:54.059+0000 7f36ced72640 1 -- 172.21.15.196:0/760996173 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f36c8068290 con 0x7f36c815dcc0 2024-03-17T23:59:54.065 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:54.063+0000 7f36bd7fa640 1 -- 172.21.15.196:0/760996173 <== mon.0 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 5) ==== 87083+0+0 (secure 0 0 0) 0x7f36c00adc10 con 0x7f36c815dcc0 2024-03-17T23:59:54.066 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:54.063+0000 7f36bd7fa640 1 --2- 172.21.15.196:0/760996173 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f36b4067660 0x7f36b4069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:59:54.066 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:54.063+0000 7f36bd7fa640 1 -- 172.21.15.196:0/760996173 <== mon.0 v2:172.21.15.196:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7f36c0121470 con 0x7f36c815dcc0 2024-03-17T23:59:54.066 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:54.063+0000 7f36ccb0e640 1 --2- 172.21.15.196:0/760996173 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f36b4067660 0x7f36b4069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:59:54.066 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:54.063+0000 7f36bd7fa640 1 --2- 172.21.15.196:0/760996173 >> [v2:172.21.15.204:6816/658561863,v1:172.21.15.204:6818/658561863] conn(0x7f36b406f980 0x7f36b4071e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:59:54.066 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:54.063+0000 7f36bd7fa640 1 -- 172.21.15.196:0/760996173 --> [v2:172.21.15.204:6816/658561863,v1:172.21.15.204:6818/658561863] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f36c00c5e70 con 0x7f36b406f980 2024-03-17T23:59:54.066 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:54.063+0000 7f36bd7fa640 1 -- 172.21.15.196:0/760996173 <== mon.0 v2:172.21.15.196:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f36c0121900 con 0x7f36c815dcc0 2024-03-17T23:59:54.066 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:54.063+0000 7f36bffff640 1 --2- 172.21.15.196:0/760996173 >> [v2:172.21.15.204:6816/658561863,v1:172.21.15.204:6818/658561863] conn(0x7f36b406f980 0x7f36b4071e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:59:54.067 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:54.063+0000 7f36ccb0e640 1 --2- 172.21.15.196:0/760996173 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f36b4067660 0x7f36b4069b20 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f36c400ba10 tx=0x7f36c4008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:59:54.067 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:54.063+0000 7f36bffff640 1 --2- 172.21.15.196:0/760996173 >> [v2:172.21.15.204:6816/658561863,v1:172.21.15.204:6818/658561863] conn(0x7f36b406f980 0x7f36b4071e00 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:59:54.068 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:54.067+0000 7f36bd7fa640 1 -- 172.21.15.196:0/760996173 <== osd.4 v2:172.21.15.204:6816/658561863 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f36c00c5e70 con 0x7f36b406f980 2024-03-17T23:59:54.090 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:54.087+0000 7f36ced72640 1 -- 172.21.15.196:0/760996173 --> [v2:172.21.15.204:6816/658561863,v1:172.21.15.204:6818/658561863] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f36c814e1e0 con 0x7f36b406f980 2024-03-17T23:59:54.090 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:54.087+0000 7f36bd7fa640 1 -- 172.21.15.196:0/760996173 <== osd.4 v2:172.21.15.204:6816/658561863 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f36c814e1e0 con 0x7f36b406f980 2024-03-17T23:59:54.090 INFO:teuthology.orchestra.run.smithi196.stdout:{ 2024-03-17T23:59:54.091 INFO:teuthology.orchestra.run.smithi196.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-03-17T23:59:54.091 INFO:teuthology.orchestra.run.smithi196.stdout:} 2024-03-17T23:59:54.091 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:54.087+0000 7f36ced72640 1 -- 172.21.15.196:0/760996173 >> [v2:172.21.15.204:6816/658561863,v1:172.21.15.204:6818/658561863] conn(0x7f36b406f980 msgr2=0x7f36b4071e00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:59:54.092 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:54.087+0000 7f36ced72640 1 --2- 172.21.15.196:0/760996173 >> [v2:172.21.15.204:6816/658561863,v1:172.21.15.204:6818/658561863] conn(0x7f36b406f980 0x7f36b4071e00 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:59:54.092 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:54.087+0000 7f36ced72640 1 -- 172.21.15.196:0/760996173 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f36b4067660 msgr2=0x7f36b4069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:59:54.092 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:54.087+0000 7f36ced72640 1 --2- 172.21.15.196:0/760996173 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f36b4067660 0x7f36b4069b20 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f36c400ba10 tx=0x7f36c4008040 comp rx=0 tx=0).stop 2024-03-17T23:59:54.092 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:54.087+0000 7f36ced72640 1 -- 172.21.15.196:0/760996173 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f36c815dcc0 msgr2=0x7f36c815bca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:59:54.092 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:54.087+0000 7f36ced72640 1 --2- 172.21.15.196:0/760996173 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f36c815dcc0 0x7f36c815bca0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f36c001b000 tx=0x7f36c00196f0 comp rx=0 tx=0).stop 2024-03-17T23:59:54.092 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:54.087+0000 7f36cd30f640 1 -- 172.21.15.196:0/760996173 reap_dead start 2024-03-17T23:59:54.092 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:54.087+0000 7f36ced72640 1 -- 172.21.15.196:0/760996173 shutdown_connections 2024-03-17T23:59:54.092 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:54.087+0000 7f36ced72640 1 -- 172.21.15.196:0/760996173 >> 172.21.15.196:0/760996173 conn(0x7f36c80729e0 msgr2=0x7f36c8072dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-17T23:59:54.092 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:54.087+0000 7f36ced72640 1 -- 172.21.15.196:0/760996173 shutdown_connections 2024-03-17T23:59:54.092 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:54.087+0000 7f36ced72640 1 -- 172.21.15.196:0/760996173 wait complete. 2024-03-17T23:59:54.111 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-03-17T23:59:54.223 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:54.219+0000 7f822c1e3640 1 Processor -- start 2024-03-17T23:59:54.223 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:54.219+0000 7f822c1e3640 1 -- start start 2024-03-17T23:59:54.224 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:54.219+0000 7f822c1e3640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f8224151d00 0x7f822406fb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:59:54.224 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:54.219+0000 7f822c1e3640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f82240c6fe0 0x7f82240c5cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:59:54.224 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:54.219+0000 7f822c1e3640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f82240c74b0 con 0x7f822406be30 2024-03-17T23:59:54.225 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:54.219+0000 7f822c1e3640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7f8224070420 con 0x7f8224151d00 2024-03-17T23:59:54.225 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:54.219+0000 7f822c1e3640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f8224070700 con 0x7f82240c6fe0 2024-03-17T23:59:54.225 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:54.223+0000 7f8229f7f640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f8224151d00 0x7f822406fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:59:54.225 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:54.223+0000 7f822a780640 1 --1- >> v1:172.21.15.196:6789/0 conn(0x7f822406be30 0x7f8224157f20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.196:6789/0 says I am v1:172.21.15.196:56850/0 (socket says 172.21.15.196:56850) 2024-03-17T23:59:54.225 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:54.223+0000 7f822a780640 1 -- 172.21.15.196:0/242553986 learned_addr learned my addr 172.21.15.196:0/242553986 (peer_addr_for_me v1:172.21.15.196:0/0) 2024-03-17T23:59:54.225 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:54.223+0000 7f822977e640 1 --2- 172.21.15.196:0/242553986 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f82240c6fe0 0x7f82240c5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:59:54.225 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:54.223+0000 7f8229f7f640 1 -- 172.21.15.196:0/242553986 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f82240c6fe0 msgr2=0x7f82240c5cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-17T23:59:54.225 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:54.223+0000 7f8229f7f640 1 --2- 172.21.15.196:0/242553986 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f82240c6fe0 0x7f82240c5cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:59:54.225 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:54.223+0000 7f8229f7f640 1 -- 172.21.15.196:0/242553986 >> v1:172.21.15.196:6789/0 conn(0x7f822406be30 legacy=0x7f8224157f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:59:54.225 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:54.223+0000 7f8228f7d640 1 -- 172.21.15.196:0/242553986 <== mon.0 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3337228691 0 0) 0x7f82240c74b0 con 0x7f822406be30 2024-03-17T23:59:54.225 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:54.223+0000 7f8229f7f640 1 -- 172.21.15.196:0/242553986 --> v2:172.21.15.196:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82240709e0 con 0x7f8224151d00 2024-03-17T23:59:54.227 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:54.223+0000 7f8229f7f640 1 --2- 172.21.15.196:0/242553986 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8224151d00 0x7f822406fb80 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f82200097c0 tx=0x7f822001c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a990df6026316cdf server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:59:54.227 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:54.223+0000 7f8228f7d640 1 -- 172.21.15.196:0/242553986 <== mon.0 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82200b1070 con 0x7f8224151d00 2024-03-17T23:59:54.227 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:54.223+0000 7f8228f7d640 1 -- 172.21.15.196:0/242553986 <== mon.0 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f82200ac410 con 0x7f8224151d00 2024-03-17T23:59:54.227 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:54.223+0000 7f8228f7d640 1 -- 172.21.15.196:0/242553986 <== mon.0 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82200ac7e0 con 0x7f8224151d00 2024-03-17T23:59:54.228 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:54.223+0000 7f822c1e3640 1 -- 172.21.15.196:0/242553986 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8224151d00 msgr2=0x7f822406fb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:59:54.228 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:54.223+0000 7f822c1e3640 1 --2- 172.21.15.196:0/242553986 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8224151d00 0x7f822406fb80 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f82200097c0 tx=0x7f822001c4a0 comp rx=0 tx=0).stop 2024-03-17T23:59:54.229 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:54.227+0000 7f822c1e3640 1 -- 172.21.15.196:0/242553986 shutdown_connections 2024-03-17T23:59:54.229 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:54.227+0000 7f822c1e3640 1 --2- 172.21.15.196:0/242553986 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f82240c6fe0 0x7f82240c5cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:59:54.229 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:54.227+0000 7f822c1e3640 1 --2- 172.21.15.196:0/242553986 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8224151d00 0x7f822406fb80 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:59:54.229 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:54.227+0000 7f822c1e3640 1 -- 172.21.15.196:0/242553986 >> 172.21.15.196:0/242553986 conn(0x7f822406c3c0 msgr2=0x7f822406c7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-17T23:59:54.229 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:54.227+0000 7f822c1e3640 1 -- 172.21.15.196:0/242553986 shutdown_connections 2024-03-17T23:59:54.229 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:54.227+0000 7f822c1e3640 1 -- 172.21.15.196:0/242553986 wait complete. 2024-03-17T23:59:54.229 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:54.227+0000 7f822c1e3640 1 Processor -- start 2024-03-17T23:59:54.230 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:54.227+0000 7f822c1e3640 1 -- start start 2024-03-17T23:59:54.231 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:54.227+0000 7f822c1e3640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f822406be30 0x7f8224142b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:59:54.231 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:54.227+0000 7f822c1e3640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f82240c6fe0 0x7f82240cb690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:59:54.231 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:54.227+0000 7f822c1e3640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8224151d00 0x7f822414a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:59:54.232 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:54.227+0000 7f822c1e3640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f8224165070 con 0x7f8224151d00 2024-03-17T23:59:54.232 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:54.227+0000 7f822c1e3640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f8224164ef0 con 0x7f822406be30 2024-03-17T23:59:54.232 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:54.227+0000 7f822c1e3640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f82241651f0 con 0x7f82240c6fe0 2024-03-17T23:59:54.232 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:54.227+0000 7f822a780640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8224151d00 0x7f822414a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:59:54.232 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:54.227+0000 7f822977e640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f82240c6fe0 0x7f82240cb690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:59:54.232 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:54.227+0000 7f822a780640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8224151d00 0x7f822414a8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.196:38486/0 (socket says 172.21.15.196:38486) 2024-03-17T23:59:54.232 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:54.227+0000 7f822a780640 1 -- 172.21.15.196:0/2593274736 learned_addr learned my addr 172.21.15.196:0/2593274736 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-03-17T23:59:54.232 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:54.227+0000 7f8229f7f640 1 --2- 172.21.15.196:0/2593274736 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f822406be30 0x7f8224142b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:59:54.232 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:54.227+0000 7f822a780640 1 -- 172.21.15.196:0/2593274736 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f82240c6fe0 msgr2=0x7f82240cb690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:59:54.232 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:54.227+0000 7f822a780640 1 --2- 172.21.15.196:0/2593274736 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f82240c6fe0 0x7f82240cb690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:59:54.232 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:54.227+0000 7f822a780640 1 -- 172.21.15.196:0/2593274736 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f822406be30 msgr2=0x7f8224142b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:59:54.232 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:54.227+0000 7f822a780640 1 --2- 172.21.15.196:0/2593274736 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f822406be30 0x7f8224142b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:59:54.232 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:54.227+0000 7f822a780640 1 -- 172.21.15.196:0/2593274736 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82241f21c0 con 0x7f8224151d00 2024-03-17T23:59:54.233 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:54.227+0000 7f822a780640 1 --2- 172.21.15.196:0/2593274736 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8224151d00 0x7f822414a8c0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f821c00c730 tx=0x7f821c00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:59:54.233 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:54.227+0000 7f821a7fc640 1 -- 172.21.15.196:0/2593274736 <== mon.0 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f821c018070 con 0x7f8224151d00 2024-03-17T23:59:54.233 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:54.227+0000 7f821a7fc640 1 -- 172.21.15.196:0/2593274736 <== mon.0 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f821c00ce40 con 0x7f8224151d00 2024-03-17T23:59:54.233 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:54.227+0000 7f821a7fc640 1 -- 172.21.15.196:0/2593274736 <== mon.0 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f821c00a860 con 0x7f8224151d00 2024-03-17T23:59:54.233 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:54.227+0000 7f822c1e3640 1 -- 172.21.15.196:0/2593274736 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8224149700 con 0x7f8224151d00 2024-03-17T23:59:54.233 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:54.231+0000 7f822c1e3640 1 -- 172.21.15.196:0/2593274736 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8224149cc0 con 0x7f8224151d00 2024-03-17T23:59:54.234 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:54.231+0000 7f822c1e3640 1 -- 172.21.15.196:0/2593274736 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f82240689a0 con 0x7f8224151d00 2024-03-17T23:59:54.234 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:54.231+0000 7f821a7fc640 1 -- 172.21.15.196:0/2593274736 <== mon.0 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 5) ==== 87083+0+0 (secure 0 0 0) 0x7f821c00aa00 con 0x7f8224151d00 2024-03-17T23:59:54.234 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:54.231+0000 7f821a7fc640 1 --2- 172.21.15.196:0/2593274736 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f8208067660 0x7f8208069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:59:54.235 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:54.231+0000 7f821a7fc640 1 -- 172.21.15.196:0/2593274736 <== mon.0 v2:172.21.15.196:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7f821c085470 con 0x7f8224151d00 2024-03-17T23:59:54.235 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:54.231+0000 7f8229f7f640 1 --2- 172.21.15.196:0/2593274736 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f8208067660 0x7f8208069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:59:54.235 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:54.231+0000 7f8229f7f640 1 --2- 172.21.15.196:0/2593274736 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f8208067660 0x7f8208069b20 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f82200ae000 tx=0x7f8220008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:59:54.241 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:54.239+0000 7f821a7fc640 1 -- 172.21.15.196:0/2593274736 <== mon.0 v2:172.21.15.196:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177849 (secure 0 0 0) 0x7f821c021070 con 0x7f8224151d00 2024-03-17T23:59:54.395 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:54.391+0000 7f822c1e3640 1 -- 172.21.15.196:0/2593274736 --> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) -- 0x7f82241494b0 con 0x7f8208067660 2024-03-17T23:59:54.396 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:54.391+0000 7f821a7fc640 1 -- 172.21.15.196:0/2593274736 <== mgr.4099 v2:172.21.15.204:6832/2505201055 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f82241494b0 con 0x7f8208067660 2024-03-17T23:59:54.396 INFO:teuthology.orchestra.run.smithi196.stderr:instructed osd(s) 4 to deep-scrub 2024-03-17T23:59:54.399 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:54.395+0000 7f822c1e3640 1 -- 172.21.15.196:0/2593274736 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f8208067660 msgr2=0x7f8208069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:59:54.399 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:54.395+0000 7f822c1e3640 1 --2- 172.21.15.196:0/2593274736 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f8208067660 0x7f8208069b20 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f82200ae000 tx=0x7f8220008040 comp rx=0 tx=0).stop 2024-03-17T23:59:54.399 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:54.395+0000 7f822c1e3640 1 -- 172.21.15.196:0/2593274736 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8224151d00 msgr2=0x7f822414a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:59:54.399 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:54.395+0000 7f822c1e3640 1 --2- 172.21.15.196:0/2593274736 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8224151d00 0x7f822414a8c0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f821c00c730 tx=0x7f821c00cbf0 comp rx=0 tx=0).stop 2024-03-17T23:59:54.399 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:54.395+0000 7f822c1e3640 1 -- 172.21.15.196:0/2593274736 shutdown_connections 2024-03-17T23:59:54.399 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:54.395+0000 7f822c1e3640 1 --2- 172.21.15.196:0/2593274736 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f8208067660 0x7f8208069b20 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:59:54.399 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:54.395+0000 7f822c1e3640 1 --2- 172.21.15.196:0/2593274736 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f82240c6fe0 0x7f82240cb690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:59:54.399 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:54.395+0000 7f822c1e3640 1 --2- 172.21.15.196:0/2593274736 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8224151d00 0x7f822414a8c0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:59:54.399 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:54.395+0000 7f822c1e3640 1 --2- 172.21.15.196:0/2593274736 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f822406be30 0x7f8224142b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:59:54.399 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:54.395+0000 7f822c1e3640 1 -- 172.21.15.196:0/2593274736 >> 172.21.15.196:0/2593274736 conn(0x7f822406c3c0 msgr2=0x7f82240c97b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-17T23:59:54.400 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:54.395+0000 7f822c1e3640 1 -- 172.21.15.196:0/2593274736 shutdown_connections 2024-03-17T23:59:54.400 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:54.395+0000 7f822c1e3640 1 -- 172.21.15.196:0/2593274736 wait complete. 2024-03-17T23:59:54.414 INFO:tasks.ceph:Scrubbing osd.5 2024-03-17T23:59:54.414 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-03-17T23:59:54.564 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:54.563+0000 7f74fb1b1640 1 Processor -- start 2024-03-17T23:59:54.564 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:54.563+0000 7f74fb1b1640 1 -- start start 2024-03-17T23:59:54.566 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:54.563+0000 7f74fb1b1640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f74f4151e40 0x7f74f40c96e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:59:54.566 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:54.563+0000 7f74fb1b1640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f74f40c5c10 0x7f74f40c6080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:59:54.566 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:54.563+0000 7f74fb1b1640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f74f406b9c0 con 0x7f74f4157f30 2024-03-17T23:59:54.566 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:54.563+0000 7f74fb1b1640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 -- 0x7f74f4072500 con 0x7f74f4151e40 2024-03-17T23:59:54.567 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:54.563+0000 7f74fb1b1640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f74f4072ea0 con 0x7f74f40c5c10 2024-03-17T23:59:54.567 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:54.563+0000 7f74f974e640 1 --1- >> v1:172.21.15.196:6789/0 conn(0x7f74f4157f30 0x7f74f41583a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.196:6789/0 says I am v1:172.21.15.196:56864/0 (socket says 172.21.15.196:56864) 2024-03-17T23:59:54.567 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:54.563+0000 7f74f974e640 1 -- 172.21.15.196:0/1543549611 learned_addr learned my addr 172.21.15.196:0/1543549611 (peer_addr_for_me v1:172.21.15.196:0/0) 2024-03-17T23:59:54.567 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:54.563+0000 7f74f8f4d640 1 --2- 172.21.15.196:0/1543549611 >> v2:172.21.15.204:3300/0 conn(0x7f74f4151e40 0x7f74f40c96e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:59:54.567 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:54.563+0000 7f74f3fff640 1 --2- 172.21.15.196:0/1543549611 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f74f40c5c10 0x7f74f40c6080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:59:54.567 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:54.563+0000 7f74f37fe640 1 -- 172.21.15.196:0/1543549611 <== mon.0 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 228793121 0 0) 0x7f74f406b9c0 con 0x7f74f4157f30 2024-03-17T23:59:54.567 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:54.563+0000 7f74f37fe640 1 -- 172.21.15.196:0/1543549611 --> v1:172.21.15.196:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f74e4003530 con 0x7f74f4157f30 2024-03-17T23:59:54.567 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:54.563+0000 7f74f8f4d640 1 -- 172.21.15.196:0/1543549611 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f74f40c5c10 msgr2=0x7f74f40c6080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-17T23:59:54.567 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:54.563+0000 7f74f8f4d640 1 --2- 172.21.15.196:0/1543549611 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f74f40c5c10 0x7f74f40c6080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:59:54.567 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:54.563+0000 7f74f8f4d640 1 -- 172.21.15.196:0/1543549611 >> v1:172.21.15.196:6789/0 conn(0x7f74f4157f30 legacy=0x7f74f41583a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:59:54.567 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:54.563+0000 7f74f8f4d640 1 -- 172.21.15.196:0/1543549611 --> v2:172.21.15.204:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74f4073180 con 0x7f74f4151e40 2024-03-17T23:59:54.568 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:54.567+0000 7f74f8f4d640 1 --2- 172.21.15.196:0/1543549611 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f74f4151e40 0x7f74f40c96e0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f74e80097c0 tx=0x7f74e801c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c9a489dffc20da13 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:59:54.569 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:54.567+0000 7f74f37fe640 1 -- 172.21.15.196:0/1543549611 <== mon.1 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74e80b1070 con 0x7f74f4151e40 2024-03-17T23:59:54.569 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:54.567+0000 7f74f37fe640 1 -- 172.21.15.196:0/1543549611 <== mon.1 v2:172.21.15.204:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f74e80ac410 con 0x7f74f4151e40 2024-03-17T23:59:54.569 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:54.567+0000 7f74f37fe640 1 -- 172.21.15.196:0/1543549611 <== mon.1 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74e80ac7c0 con 0x7f74f4151e40 2024-03-17T23:59:54.570 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:54.567+0000 7f74fb1b1640 1 -- 172.21.15.196:0/1543549611 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f74f4151e40 msgr2=0x7f74f40c96e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:59:54.570 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:54.567+0000 7f74fb1b1640 1 --2- 172.21.15.196:0/1543549611 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f74f4151e40 0x7f74f40c96e0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f74e80097c0 tx=0x7f74e801c4a0 comp rx=0 tx=0).stop 2024-03-17T23:59:54.570 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:54.567+0000 7f74fb1b1640 1 -- 172.21.15.196:0/1543549611 shutdown_connections 2024-03-17T23:59:54.570 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:54.567+0000 7f74fb1b1640 1 --2- 172.21.15.196:0/1543549611 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f74f40c5c10 0x7f74f40c6080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:59:54.570 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:54.567+0000 7f74fb1b1640 1 --2- 172.21.15.196:0/1543549611 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f74f4151e40 0x7f74f40c96e0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:59:54.570 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:54.567+0000 7f74fb1b1640 1 -- 172.21.15.196:0/1543549611 >> 172.21.15.196:0/1543549611 conn(0x7f74f4067680 msgr2=0x7f74f40cc500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-17T23:59:54.570 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:54.567+0000 7f74fb1b1640 1 -- 172.21.15.196:0/1543549611 shutdown_connections 2024-03-17T23:59:54.570 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:54.567+0000 7f74fb1b1640 1 -- 172.21.15.196:0/1543549611 wait complete. 2024-03-17T23:59:54.571 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:54.567+0000 7f74fb1b1640 1 Processor -- start 2024-03-17T23:59:54.571 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:54.567+0000 7f74fb1b1640 1 -- start start 2024-03-17T23:59:54.574 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:54.571+0000 7f74fb1b1640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f74f40c5c10 0x7f74f41f4a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:59:54.574 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:54.571+0000 7f74fb1b1640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f74f4151e40 0x7f74f4142b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:59:54.574 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:54.571+0000 7f74fb1b1640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f74f4157f30 0x7f74f41410d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:59:54.574 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:54.571+0000 7f74fb1b1640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f74f406b610 con 0x7f74f40c5c10 2024-03-17T23:59:54.574 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:54.571+0000 7f74fb1b1640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f74f406bca0 con 0x7f74f4157f30 2024-03-17T23:59:54.574 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:54.571+0000 7f74fb1b1640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f74f41f4fa0 con 0x7f74f4151e40 2024-03-17T23:59:54.575 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:54.571+0000 7f74f8f4d640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f74f40c5c10 0x7f74f41f4a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:59:54.575 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:54.571+0000 7f74f8f4d640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f74f40c5c10 0x7f74f41f4a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.196:38498/0 (socket says 172.21.15.196:38498) 2024-03-17T23:59:54.575 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:54.571+0000 7f74f8f4d640 1 -- 172.21.15.196:0/2884554383 learned_addr learned my addr 172.21.15.196:0/2884554383 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-03-17T23:59:54.575 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:54.571+0000 7f74f3fff640 1 --2- 172.21.15.196:0/2884554383 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f74f4151e40 0x7f74f4142b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:59:54.575 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:54.571+0000 7f74f974e640 1 --2- 172.21.15.196:0/2884554383 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f74f4157f30 0x7f74f41410d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:59:54.575 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:54.571+0000 7f74f8f4d640 1 -- 172.21.15.196:0/2884554383 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f74f4151e40 msgr2=0x7f74f4142b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:59:54.575 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:54.571+0000 7f74f8f4d640 1 --2- 172.21.15.196:0/2884554383 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f74f4151e40 0x7f74f4142b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:59:54.575 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:54.571+0000 7f74f8f4d640 1 -- 172.21.15.196:0/2884554383 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f74f4157f30 msgr2=0x7f74f41410d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:59:54.575 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:54.571+0000 7f74f8f4d640 1 --2- 172.21.15.196:0/2884554383 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f74f4157f30 0x7f74f41410d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:59:54.575 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:54.571+0000 7f74f8f4d640 1 -- 172.21.15.196:0/2884554383 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74f41f0bf0 con 0x7f74f40c5c10 2024-03-17T23:59:54.575 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:54.571+0000 7f74f8f4d640 1 --2- 172.21.15.196:0/2884554383 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f74f40c5c10 0x7f74f41f4a60 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f74e801ab50 tx=0x7f74e8019240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:59:54.576 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:54.571+0000 7f74f17fa640 1 -- 172.21.15.196:0/2884554383 <== mon.0 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74e80bb070 con 0x7f74f40c5c10 2024-03-17T23:59:54.576 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:54.571+0000 7f74f17fa640 1 -- 172.21.15.196:0/2884554383 <== mon.0 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f74e80036a0 con 0x7f74f40c5c10 2024-03-17T23:59:54.576 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:54.571+0000 7f74fb1b1640 1 -- 172.21.15.196:0/2884554383 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f74f41f0e90 con 0x7f74f40c5c10 2024-03-17T23:59:54.576 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:54.571+0000 7f74f17fa640 1 -- 172.21.15.196:0/2884554383 <== mon.0 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74e80b1040 con 0x7f74f40c5c10 2024-03-17T23:59:54.576 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:54.571+0000 7f74fb1b1640 1 -- 172.21.15.196:0/2884554383 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f74f41f1450 con 0x7f74f40c5c10 2024-03-17T23:59:54.576 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:54.571+0000 7f74fb1b1640 1 -- 172.21.15.196:0/2884554383 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f74f40689a0 con 0x7f74f40c5c10 2024-03-17T23:59:54.577 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:54.571+0000 7f74f17fa640 1 -- 172.21.15.196:0/2884554383 <== mon.0 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 5) ==== 87083+0+0 (secure 0 0 0) 0x7f74e80be070 con 0x7f74f40c5c10 2024-03-17T23:59:54.577 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:54.571+0000 7f74f17fa640 1 --2- 172.21.15.196:0/2884554383 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f74d8067690 0x7f74d8069b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:59:54.578 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:54.571+0000 7f74f17fa640 1 -- 172.21.15.196:0/2884554383 <== mon.0 v2:172.21.15.196:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7f74e811e8f0 con 0x7f74f40c5c10 2024-03-17T23:59:54.578 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:54.571+0000 7f74f17fa640 1 --2- 172.21.15.196:0/2884554383 >> [v2:172.21.15.204:6817/3367327749,v1:172.21.15.204:6820/3367327749] conn(0x7f74d806fa10 0x7f74d8071e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:59:54.578 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:54.571+0000 7f74f17fa640 1 -- 172.21.15.196:0/2884554383 --> [v2:172.21.15.204:6817/3367327749,v1:172.21.15.204:6820/3367327749] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f74d8072560 con 0x7f74d806fa10 2024-03-17T23:59:54.578 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:54.571+0000 7f74f17fa640 1 -- 172.21.15.196:0/2884554383 <== mon.0 v2:172.21.15.196:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f74e81232c0 con 0x7f74f40c5c10 2024-03-17T23:59:54.578 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:54.571+0000 7f74f3fff640 1 --2- 172.21.15.196:0/2884554383 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f74d8067690 0x7f74d8069b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:59:54.578 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:54.571+0000 7f74f974e640 1 --2- 172.21.15.196:0/2884554383 >> [v2:172.21.15.204:6817/3367327749,v1:172.21.15.204:6820/3367327749] conn(0x7f74d806fa10 0x7f74d8071e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:59:54.578 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:54.575+0000 7f74f974e640 1 --2- 172.21.15.196:0/2884554383 >> [v2:172.21.15.204:6817/3367327749,v1:172.21.15.204:6820/3367327749] conn(0x7f74d806fa10 0x7f74d8071e90 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:59:54.578 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:54.575+0000 7f74f3fff640 1 --2- 172.21.15.196:0/2884554383 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f74d8067690 0x7f74d8069b50 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f74f4162480 tx=0x7f74e0009190 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:59:54.578 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:54.575+0000 7f74f17fa640 1 -- 172.21.15.196:0/2884554383 <== osd.5 v2:172.21.15.204:6817/3367327749 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f74d8072560 con 0x7f74d806fa10 2024-03-17T23:59:54.603 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:54.599+0000 7f74fb1b1640 1 -- 172.21.15.196:0/2884554383 --> [v2:172.21.15.204:6817/3367327749,v1:172.21.15.204:6820/3367327749] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f74f406b3f0 con 0x7f74d806fa10 2024-03-17T23:59:54.603 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:54.599+0000 7f74f17fa640 1 -- 172.21.15.196:0/2884554383 <== osd.5 v2:172.21.15.204:6817/3367327749 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f74f406b3f0 con 0x7f74d806fa10 2024-03-17T23:59:54.603 INFO:teuthology.orchestra.run.smithi196.stdout:{ 2024-03-17T23:59:54.603 INFO:teuthology.orchestra.run.smithi196.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-03-17T23:59:54.603 INFO:teuthology.orchestra.run.smithi196.stdout:} 2024-03-17T23:59:54.604 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:54.599+0000 7f74fb1b1640 1 -- 172.21.15.196:0/2884554383 >> [v2:172.21.15.204:6817/3367327749,v1:172.21.15.204:6820/3367327749] conn(0x7f74d806fa10 msgr2=0x7f74d8071e90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:59:54.604 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:54.599+0000 7f74fb1b1640 1 --2- 172.21.15.196:0/2884554383 >> [v2:172.21.15.204:6817/3367327749,v1:172.21.15.204:6820/3367327749] conn(0x7f74d806fa10 0x7f74d8071e90 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:59:54.605 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:54.599+0000 7f74fb1b1640 1 -- 172.21.15.196:0/2884554383 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f74d8067690 msgr2=0x7f74d8069b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:59:54.605 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:54.599+0000 7f74fb1b1640 1 --2- 172.21.15.196:0/2884554383 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f74d8067690 0x7f74d8069b50 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f74f4162480 tx=0x7f74e0009190 comp rx=0 tx=0).stop 2024-03-17T23:59:54.605 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:54.599+0000 7f74fb1b1640 1 -- 172.21.15.196:0/2884554383 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f74f40c5c10 msgr2=0x7f74f41f4a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:59:54.605 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:54.599+0000 7f74fb1b1640 1 --2- 172.21.15.196:0/2884554383 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f74f40c5c10 0x7f74f41f4a60 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f74e801ab50 tx=0x7f74e8019240 comp rx=0 tx=0).stop 2024-03-17T23:59:54.605 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:54.599+0000 7f74f974e640 1 -- 172.21.15.196:0/2884554383 reap_dead start 2024-03-17T23:59:54.605 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:54.599+0000 7f74fb1b1640 1 -- 172.21.15.196:0/2884554383 shutdown_connections 2024-03-17T23:59:54.605 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:54.599+0000 7f74fb1b1640 1 -- 172.21.15.196:0/2884554383 >> 172.21.15.196:0/2884554383 conn(0x7f74f4067680 msgr2=0x7f74f414e630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-17T23:59:54.605 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:54.599+0000 7f74fb1b1640 1 -- 172.21.15.196:0/2884554383 shutdown_connections 2024-03-17T23:59:54.605 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:54.599+0000 7f74fb1b1640 1 -- 172.21.15.196:0/2884554383 wait complete. 2024-03-17T23:59:54.619 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-03-17T23:59:54.740 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:54.735+0000 7f112bdc0640 1 Processor -- start 2024-03-17T23:59:54.740 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:54.735+0000 7f112bdc0640 1 -- start start 2024-03-17T23:59:54.741 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:54.739+0000 7f112bdc0640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f1124151d00 0x7f112406fb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:59:54.741 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:54.739+0000 7f112bdc0640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f112406be30 0x7f1124157f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:59:54.741 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:54.739+0000 7f112bdc0640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f11240c74b0 con 0x7f11240c6fe0 2024-03-17T23:59:54.741 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:54.739+0000 7f112bdc0640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 -- 0x7f1124070420 con 0x7f1124151d00 2024-03-17T23:59:54.741 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:54.739+0000 7f112bdc0640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f1124070700 con 0x7f112406be30 2024-03-17T23:59:54.741 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:54.739+0000 7f112935b640 1 --1- >> v1:172.21.15.196:6789/0 conn(0x7f11240c6fe0 0x7f11240c5cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.196:6789/0 says I am v1:172.21.15.196:56866/0 (socket says 172.21.15.196:56866) 2024-03-17T23:59:54.741 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:54.739+0000 7f112935b640 1 -- 172.21.15.196:0/1417005975 learned_addr learned my addr 172.21.15.196:0/1417005975 (peer_addr_for_me v1:172.21.15.196:0/0) 2024-03-17T23:59:54.742 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:54.739+0000 7f1129b5c640 1 --2- 172.21.15.196:0/1417005975 >> v2:172.21.15.204:3300/0 conn(0x7f1124151d00 0x7f112406fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:59:54.742 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:54.739+0000 7f112a35d640 1 --2- 172.21.15.196:0/1417005975 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f112406be30 0x7f1124157f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:59:54.742 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:54.739+0000 7f1128b5a640 1 -- 172.21.15.196:0/1417005975 <== mon.0 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 302593333 0 0) 0x7f11240c74b0 con 0x7f11240c6fe0 2024-03-17T23:59:54.742 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:54.739+0000 7f1128b5a640 1 -- 172.21.15.196:0/1417005975 --> v1:172.21.15.196:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1110003530 con 0x7f11240c6fe0 2024-03-17T23:59:54.742 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:54.739+0000 7f1129b5c640 1 -- 172.21.15.196:0/1417005975 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f112406be30 msgr2=0x7f1124157f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-17T23:59:54.742 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:54.739+0000 7f1129b5c640 1 --2- 172.21.15.196:0/1417005975 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f112406be30 0x7f1124157f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:59:54.742 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:54.739+0000 7f1129b5c640 1 -- 172.21.15.196:0/1417005975 >> v1:172.21.15.196:6789/0 conn(0x7f11240c6fe0 legacy=0x7f11240c5cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:59:54.742 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:54.739+0000 7f1129b5c640 1 -- 172.21.15.196:0/1417005975 --> v2:172.21.15.204:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11240709e0 con 0x7f1124151d00 2024-03-17T23:59:54.743 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:54.739+0000 7f1129b5c640 1 --2- 172.21.15.196:0/1417005975 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1124151d00 0x7f112406fb80 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f11200097f0 tx=0x7f112001c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b11189f1a8ab3720 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:59:54.743 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:54.739+0000 7f1128b5a640 1 -- 172.21.15.196:0/1417005975 <== mon.1 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11200b1070 con 0x7f1124151d00 2024-03-17T23:59:54.743 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:54.739+0000 7f1128b5a640 1 -- 172.21.15.196:0/1417005975 <== mon.1 v2:172.21.15.204:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f11200ac410 con 0x7f1124151d00 2024-03-17T23:59:54.744 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:54.739+0000 7f112bdc0640 1 -- 172.21.15.196:0/1417005975 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1124151d00 msgr2=0x7f112406fb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:59:54.744 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:54.739+0000 7f112bdc0640 1 --2- 172.21.15.196:0/1417005975 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1124151d00 0x7f112406fb80 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f11200097f0 tx=0x7f112001c4a0 comp rx=0 tx=0).stop 2024-03-17T23:59:54.744 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:54.739+0000 7f112bdc0640 1 -- 172.21.15.196:0/1417005975 shutdown_connections 2024-03-17T23:59:54.744 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:54.739+0000 7f112bdc0640 1 --2- 172.21.15.196:0/1417005975 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f112406be30 0x7f1124157f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:59:54.744 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:54.739+0000 7f112bdc0640 1 --2- 172.21.15.196:0/1417005975 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1124151d00 0x7f112406fb80 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:59:54.745 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:54.739+0000 7f112bdc0640 1 -- 172.21.15.196:0/1417005975 >> 172.21.15.196:0/1417005975 conn(0x7f112406c3c0 msgr2=0x7f112406c7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-17T23:59:54.745 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:54.739+0000 7f112bdc0640 1 -- 172.21.15.196:0/1417005975 shutdown_connections 2024-03-17T23:59:54.745 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:54.739+0000 7f112bdc0640 1 -- 172.21.15.196:0/1417005975 wait complete. 2024-03-17T23:59:54.747 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:54.743+0000 7f112bdc0640 1 Processor -- start 2024-03-17T23:59:54.747 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:54.743+0000 7f112bdc0640 1 -- start start 2024-03-17T23:59:54.747 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:54.743+0000 7f112bdc0640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f112406be30 0x7f1124147b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:59:54.747 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:54.743+0000 7f112bdc0640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f11240c6fe0 0x7f11241f7490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:59:54.747 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:54.743+0000 7f112bdc0640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1124151d00 0x7f1124155180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:59:54.747 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:54.743+0000 7f112bdc0640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f11240c6400 con 0x7f112406be30 2024-03-17T23:59:54.747 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:54.743+0000 7f112bdc0640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f11240c5af0 con 0x7f11240c6fe0 2024-03-17T23:59:54.747 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:54.743+0000 7f112bdc0640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f11240c6580 con 0x7f1124151d00 2024-03-17T23:59:54.747 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:54.743+0000 7f1129b5c640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f112406be30 0x7f1124147b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:59:54.747 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:54.743+0000 7f1129b5c640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f112406be30 0x7f1124147b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.196:38506/0 (socket says 172.21.15.196:38506) 2024-03-17T23:59:54.748 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:54.743+0000 7f1129b5c640 1 -- 172.21.15.196:0/1580781992 learned_addr learned my addr 172.21.15.196:0/1580781992 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-03-17T23:59:54.748 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:54.743+0000 7f112935b640 1 --2- 172.21.15.196:0/1580781992 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f11240c6fe0 0x7f11241f7490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:59:54.748 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:54.743+0000 7f112a35d640 1 --2- 172.21.15.196:0/1580781992 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1124151d00 0x7f1124155180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:59:54.748 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:54.743+0000 7f1129b5c640 1 -- 172.21.15.196:0/1580781992 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1124151d00 msgr2=0x7f1124155180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:59:54.748 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:54.743+0000 7f1129b5c640 1 --2- 172.21.15.196:0/1580781992 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1124151d00 0x7f1124155180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:59:54.748 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:54.743+0000 7f1129b5c640 1 -- 172.21.15.196:0/1580781992 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f11240c6fe0 msgr2=0x7f11241f7490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:59:54.748 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:54.743+0000 7f1129b5c640 1 --2- 172.21.15.196:0/1580781992 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f11240c6fe0 0x7f11241f7490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:59:54.748 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:54.743+0000 7f1129b5c640 1 -- 172.21.15.196:0/1580781992 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1124148190 con 0x7f112406be30 2024-03-17T23:59:54.748 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:54.743+0000 7f112935b640 1 --2- 172.21.15.196:0/1580781992 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f11240c6fe0 0x7f11241f7490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-17T23:59:54.748 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:54.743+0000 7f1129b5c640 1 --2- 172.21.15.196:0/1580781992 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f112406be30 0x7f1124147b50 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f112001a0d0 tx=0x7f1120019240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:59:54.748 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:54.743+0000 7f111a7fc640 1 -- 172.21.15.196:0/1580781992 <== mon.0 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11200bb070 con 0x7f112406be30 2024-03-17T23:59:54.748 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:54.743+0000 7f111a7fc640 1 -- 172.21.15.196:0/1580781992 <== mon.0 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f11200036e0 con 0x7f112406be30 2024-03-17T23:59:54.748 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:54.743+0000 7f112bdc0640 1 -- 172.21.15.196:0/1580781992 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1124148450 con 0x7f112406be30 2024-03-17T23:59:54.748 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:54.743+0000 7f111a7fc640 1 -- 172.21.15.196:0/1580781992 <== mon.0 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11200b1040 con 0x7f112406be30 2024-03-17T23:59:54.749 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:54.743+0000 7f112bdc0640 1 -- 172.21.15.196:0/1580781992 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1124154980 con 0x7f112406be30 2024-03-17T23:59:54.749 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:54.743+0000 7f112bdc0640 1 -- 172.21.15.196:0/1580781992 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f11240689a0 con 0x7f112406be30 2024-03-17T23:59:54.749 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:54.747+0000 7f111a7fc640 1 -- 172.21.15.196:0/1580781992 <== mon.0 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 5) ==== 87083+0+0 (secure 0 0 0) 0x7f11200be070 con 0x7f112406be30 2024-03-17T23:59:54.750 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:54.747+0000 7f111a7fc640 1 --2- 172.21.15.196:0/1580781992 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f1108067660 0x7f1108069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:59:54.750 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:54.747+0000 7f111a7fc640 1 -- 172.21.15.196:0/1580781992 <== mon.0 v2:172.21.15.196:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7f112011e550 con 0x7f112406be30 2024-03-17T23:59:54.750 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:54.747+0000 7f112935b640 1 --2- 172.21.15.196:0/1580781992 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f1108067660 0x7f1108069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:59:54.750 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:54.747+0000 7f112935b640 1 --2- 172.21.15.196:0/1580781992 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f1108067660 0x7f1108069b20 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f11241400c0 tx=0x7f1114009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:59:54.753 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:54.751+0000 7f111a7fc640 1 -- 172.21.15.196:0/1580781992 <== mon.0 v2:172.21.15.196:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177849 (secure 0 0 0) 0x7f1120016090 con 0x7f112406be30 2024-03-17T23:59:54.908 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:54.903+0000 7f112bdc0640 1 -- 172.21.15.196:0/1580781992 --> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) -- 0x7f112406b640 con 0x7f1108067660 2024-03-17T23:59:54.909 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:54.907+0000 7f111a7fc640 1 -- 172.21.15.196:0/1580781992 <== mgr.4099 v2:172.21.15.204:6832/2505201055 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f112406b640 con 0x7f1108067660 2024-03-17T23:59:54.909 INFO:teuthology.orchestra.run.smithi196.stderr:instructed osd(s) 5 to deep-scrub 2024-03-17T23:59:54.911 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:54.907+0000 7f112bdc0640 1 -- 172.21.15.196:0/1580781992 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f1108067660 msgr2=0x7f1108069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:59:54.912 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:54.907+0000 7f112bdc0640 1 --2- 172.21.15.196:0/1580781992 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f1108067660 0x7f1108069b20 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f11241400c0 tx=0x7f1114009040 comp rx=0 tx=0).stop 2024-03-17T23:59:54.912 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:54.907+0000 7f112bdc0640 1 -- 172.21.15.196:0/1580781992 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f112406be30 msgr2=0x7f1124147b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:59:54.912 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:54.907+0000 7f112bdc0640 1 --2- 172.21.15.196:0/1580781992 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f112406be30 0x7f1124147b50 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f112001a0d0 tx=0x7f1120019240 comp rx=0 tx=0).stop 2024-03-17T23:59:54.912 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:54.907+0000 7f112bdc0640 1 -- 172.21.15.196:0/1580781992 shutdown_connections 2024-03-17T23:59:54.912 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:54.907+0000 7f112bdc0640 1 --2- 172.21.15.196:0/1580781992 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f1108067660 0x7f1108069b20 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:59:54.912 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:54.907+0000 7f112bdc0640 1 --2- 172.21.15.196:0/1580781992 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1124151d00 0x7f1124155180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:59:54.912 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:54.907+0000 7f112bdc0640 1 --2- 172.21.15.196:0/1580781992 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f11240c6fe0 0x7f11241f7490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:59:54.912 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:54.907+0000 7f112bdc0640 1 --2- 172.21.15.196:0/1580781992 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f112406be30 0x7f1124147b50 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:59:54.912 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:54.907+0000 7f112bdc0640 1 -- 172.21.15.196:0/1580781992 >> 172.21.15.196:0/1580781992 conn(0x7f112406c3c0 msgr2=0x7f11240c8e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-17T23:59:54.912 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:54.907+0000 7f112bdc0640 1 -- 172.21.15.196:0/1580781992 shutdown_connections 2024-03-17T23:59:54.912 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:54.907+0000 7f112bdc0640 1 -- 172.21.15.196:0/1580781992 wait complete. 2024-03-17T23:59:54.927 INFO:tasks.ceph:Scrubbing osd.6 2024-03-17T23:59:54.927 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-03-17T23:59:55.037 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:55.035+0000 7f977c557640 1 Processor -- start 2024-03-17T23:59:55.037 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:55.035+0000 7f977c557640 1 -- start start 2024-03-17T23:59:55.039 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:55.035+0000 7f977c557640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f9774151dc0 0x7f97740cde60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:59:55.039 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:55.035+0000 7f977c557640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f977406f400 0x7f97740c24e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:59:55.039 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:55.035+0000 7f977c557640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f977406f920 con 0x7f977406fbf0 2024-03-17T23:59:55.040 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:55.035+0000 7f977c557640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 -- 0x7f97740c77a0 con 0x7f9774151dc0 2024-03-17T23:59:55.040 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:55.035+0000 7f977c557640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f9774157c30 con 0x7f977406f400 2024-03-17T23:59:55.040 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:55.035+0000 7f977aaf4640 1 --1- >> v1:172.21.15.196:6789/0 conn(0x7f977406fbf0 0x7f977415b110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.196:6789/0 says I am v1:172.21.15.196:56870/0 (socket says 172.21.15.196:56870) 2024-03-17T23:59:55.040 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:55.035+0000 7f977aaf4640 1 -- 172.21.15.196:0/1740853205 learned_addr learned my addr 172.21.15.196:0/1740853205 (peer_addr_for_me v1:172.21.15.196:0/0) 2024-03-17T23:59:55.040 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:55.035+0000 7f9779af2640 1 --2- 172.21.15.196:0/1740853205 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f977406f400 0x7f97740c24e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:59:55.040 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:55.035+0000 7f977a2f3640 1 --2- 172.21.15.196:0/1740853205 >> v2:172.21.15.204:3300/0 conn(0x7f9774151dc0 0x7f97740cde60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:59:55.040 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:55.035+0000 7f97792f1640 1 -- 172.21.15.196:0/1740853205 <== mon.0 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1683318911 0 0) 0x7f977406f920 con 0x7f977406fbf0 2024-03-17T23:59:55.040 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:55.035+0000 7f97792f1640 1 -- 172.21.15.196:0/1740853205 --> v1:172.21.15.196:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9760003530 con 0x7f977406fbf0 2024-03-17T23:59:55.040 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:55.035+0000 7f977a2f3640 1 -- 172.21.15.196:0/1740853205 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f977406f400 msgr2=0x7f97740c24e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-17T23:59:55.040 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:55.035+0000 7f977a2f3640 1 --2- 172.21.15.196:0/1740853205 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f977406f400 0x7f97740c24e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:59:55.040 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:55.035+0000 7f977a2f3640 1 -- 172.21.15.196:0/1740853205 >> v1:172.21.15.196:6789/0 conn(0x7f977406fbf0 legacy=0x7f977415b110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:59:55.040 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:55.035+0000 7f977a2f3640 1 -- 172.21.15.196:0/1740853205 --> v2:172.21.15.204:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9774157f10 con 0x7f9774151dc0 2024-03-17T23:59:55.042 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:55.039+0000 7f977a2f3640 1 --2- 172.21.15.196:0/1740853205 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9774151dc0 0x7f97740cde60 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f97700097c0 tx=0x7f977001ecb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2b7f988bddf26c63 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:59:55.043 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:55.039+0000 7f97792f1640 1 -- 172.21.15.196:0/1740853205 <== mon.1 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97700b5070 con 0x7f9774151dc0 2024-03-17T23:59:55.043 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:55.039+0000 7f97792f1640 1 -- 172.21.15.196:0/1740853205 <== mon.1 v2:172.21.15.204:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f97700a8990 con 0x7f9774151dc0 2024-03-17T23:59:55.043 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:55.039+0000 7f97792f1640 1 -- 172.21.15.196:0/1740853205 <== mon.1 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97700a8d40 con 0x7f9774151dc0 2024-03-17T23:59:55.044 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:55.039+0000 7f977c557640 1 -- 172.21.15.196:0/1740853205 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9774151dc0 msgr2=0x7f97740cde60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:59:55.044 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:55.039+0000 7f977c557640 1 --2- 172.21.15.196:0/1740853205 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9774151dc0 0x7f97740cde60 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f97700097c0 tx=0x7f977001ecb0 comp rx=0 tx=0).stop 2024-03-17T23:59:55.044 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:55.039+0000 7f977c557640 1 -- 172.21.15.196:0/1740853205 shutdown_connections 2024-03-17T23:59:55.044 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:55.039+0000 7f977c557640 1 --2- 172.21.15.196:0/1740853205 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f977406f400 0x7f97740c24e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:59:55.044 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:55.039+0000 7f977c557640 1 --2- 172.21.15.196:0/1740853205 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9774151dc0 0x7f97740cde60 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:59:55.044 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:55.039+0000 7f977c557640 1 -- 172.21.15.196:0/1740853205 >> 172.21.15.196:0/1740853205 conn(0x7f977406b2b0 msgr2=0x7f977406b6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-17T23:59:55.044 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:55.039+0000 7f977c557640 1 -- 172.21.15.196:0/1740853205 shutdown_connections 2024-03-17T23:59:55.044 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:55.039+0000 7f977c557640 1 -- 172.21.15.196:0/1740853205 wait complete. 2024-03-17T23:59:55.045 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:55.043+0000 7f977c557640 1 Processor -- start 2024-03-17T23:59:55.045 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:55.043+0000 7f977c557640 1 -- start start 2024-03-17T23:59:55.048 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:55.043+0000 7f977c557640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f977406f400 0x7f97741f1520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:59:55.048 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:55.043+0000 7f977c557640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f977406fbf0 0x7f97741edf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:59:55.048 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:55.043+0000 7f977c557640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9774151dc0 0x7f97740c5c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:59:55.048 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:55.043+0000 7f977c557640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f97741521a0 con 0x7f977406f400 2024-03-17T23:59:55.048 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:55.043+0000 7f977c557640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f97741584d0 con 0x7f977406fbf0 2024-03-17T23:59:55.049 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:55.043+0000 7f977c557640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f977415b820 con 0x7f9774151dc0 2024-03-17T23:59:55.049 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:55.043+0000 7f977a2f3640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f977406f400 0x7f97741f1520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:59:55.049 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:55.043+0000 7f977a2f3640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f977406f400 0x7f97741f1520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.196:38512/0 (socket says 172.21.15.196:38512) 2024-03-17T23:59:55.049 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:55.043+0000 7f977a2f3640 1 -- 172.21.15.196:0/745328415 learned_addr learned my addr 172.21.15.196:0/745328415 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-03-17T23:59:55.049 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:55.043+0000 7f9779af2640 1 --2- 172.21.15.196:0/745328415 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f977406fbf0 0x7f97741edf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:59:55.049 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:55.043+0000 7f977aaf4640 1 --2- 172.21.15.196:0/745328415 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9774151dc0 0x7f97740c5c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:59:55.049 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:55.043+0000 7f977a2f3640 1 -- 172.21.15.196:0/745328415 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9774151dc0 msgr2=0x7f97740c5c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:59:55.049 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:55.043+0000 7f977a2f3640 1 --2- 172.21.15.196:0/745328415 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9774151dc0 0x7f97740c5c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:59:55.049 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:55.043+0000 7f977a2f3640 1 -- 172.21.15.196:0/745328415 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f977406fbf0 msgr2=0x7f97741edf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:59:55.049 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:55.043+0000 7f977a2f3640 1 --2- 172.21.15.196:0/745328415 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f977406fbf0 0x7f97741edf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:59:55.049 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:55.043+0000 7f977a2f3640 1 -- 172.21.15.196:0/745328415 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97740cd370 con 0x7f977406f400 2024-03-17T23:59:55.049 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:55.043+0000 7f977aaf4640 1 --2- 172.21.15.196:0/745328415 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9774151dc0 0x7f97740c5c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-17T23:59:55.049 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:55.043+0000 7f977a2f3640 1 --2- 172.21.15.196:0/745328415 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f977406f400 0x7f97741f1520 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f97700b3040 tx=0x7f977001ba50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:59:55.050 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:55.043+0000 7f976affd640 1 -- 172.21.15.196:0/745328415 <== mon.0 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97700be070 con 0x7f977406f400 2024-03-17T23:59:55.050 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:55.043+0000 7f976affd640 1 -- 172.21.15.196:0/745328415 <== mon.0 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9770004230 con 0x7f977406f400 2024-03-17T23:59:55.050 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:55.043+0000 7f977c557640 1 -- 172.21.15.196:0/745328415 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f97741552a0 con 0x7f977406f400 2024-03-17T23:59:55.050 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:55.043+0000 7f976affd640 1 -- 172.21.15.196:0/745328415 <== mon.0 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97700b5040 con 0x7f977406f400 2024-03-17T23:59:55.050 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:55.043+0000 7f977c557640 1 -- 172.21.15.196:0/745328415 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f977415a060 con 0x7f977406f400 2024-03-17T23:59:55.050 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:55.047+0000 7f977c557640 1 -- 172.21.15.196:0/745328415 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f97741ed600 con 0x7f977406f400 2024-03-17T23:59:55.051 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:55.047+0000 7f976affd640 1 -- 172.21.15.196:0/745328415 <== mon.0 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 5) ==== 87083+0+0 (secure 0 0 0) 0x7f97700c1070 con 0x7f977406f400 2024-03-17T23:59:55.051 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:55.047+0000 7f976affd640 1 --2- 172.21.15.196:0/745328415 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f9758067690 0x7f9758069b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:59:55.051 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:55.047+0000 7f976affd640 1 -- 172.21.15.196:0/745328415 <== mon.0 v2:172.21.15.196:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7f97701224f0 con 0x7f977406f400 2024-03-17T23:59:55.051 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:55.047+0000 7f976affd640 1 --2- 172.21.15.196:0/745328415 >> [v2:172.21.15.204:6805/2586742078,v1:172.21.15.204:6807/2586742078] conn(0x7f975806fa10 0x7f9758071e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:59:55.052 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:55.047+0000 7f976affd640 1 -- 172.21.15.196:0/745328415 --> [v2:172.21.15.204:6805/2586742078,v1:172.21.15.204:6807/2586742078] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f97700aaea0 con 0x7f975806fa10 2024-03-17T23:59:55.052 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:55.047+0000 7f976affd640 1 -- 172.21.15.196:0/745328415 <== mon.0 v2:172.21.15.196:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f9770122980 con 0x7f977406f400 2024-03-17T23:59:55.052 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:55.047+0000 7f9779af2640 1 --2- 172.21.15.196:0/745328415 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f9758067690 0x7f9758069b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:59:55.052 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:55.047+0000 7f977aaf4640 1 --2- 172.21.15.196:0/745328415 >> [v2:172.21.15.204:6805/2586742078,v1:172.21.15.204:6807/2586742078] conn(0x7f975806fa10 0x7f9758071e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:59:55.052 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:55.047+0000 7f977aaf4640 1 --2- 172.21.15.196:0/745328415 >> [v2:172.21.15.204:6805/2586742078,v1:172.21.15.204:6807/2586742078] conn(0x7f975806fa10 0x7f9758071e90 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:59:55.052 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:55.047+0000 7f9779af2640 1 --2- 172.21.15.196:0/745328415 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f9758067690 0x7f9758069b50 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f977415c060 tx=0x7f9764009190 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:59:55.052 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:55.051+0000 7f976affd640 1 -- 172.21.15.196:0/745328415 <== osd.6 v2:172.21.15.204:6805/2586742078 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f97700aaea0 con 0x7f975806fa10 2024-03-17T23:59:55.065 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:55.063+0000 7f977c557640 1 -- 172.21.15.196:0/745328415 --> [v2:172.21.15.204:6805/2586742078,v1:172.21.15.204:6807/2586742078] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f97741ed600 con 0x7f975806fa10 2024-03-17T23:59:55.065 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:55.063+0000 7f976affd640 1 -- 172.21.15.196:0/745328415 <== osd.6 v2:172.21.15.204:6805/2586742078 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f97741ed600 con 0x7f975806fa10 2024-03-17T23:59:55.065 INFO:teuthology.orchestra.run.smithi196.stdout:{ 2024-03-17T23:59:55.066 INFO:teuthology.orchestra.run.smithi196.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-03-17T23:59:55.066 INFO:teuthology.orchestra.run.smithi196.stdout:} 2024-03-17T23:59:55.067 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:55.063+0000 7f977c557640 1 -- 172.21.15.196:0/745328415 >> [v2:172.21.15.204:6805/2586742078,v1:172.21.15.204:6807/2586742078] conn(0x7f975806fa10 msgr2=0x7f9758071e90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:59:55.067 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:55.063+0000 7f977c557640 1 --2- 172.21.15.196:0/745328415 >> [v2:172.21.15.204:6805/2586742078,v1:172.21.15.204:6807/2586742078] conn(0x7f975806fa10 0x7f9758071e90 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:59:55.067 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:55.063+0000 7f977c557640 1 -- 172.21.15.196:0/745328415 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f9758067690 msgr2=0x7f9758069b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:59:55.067 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:55.063+0000 7f977c557640 1 --2- 172.21.15.196:0/745328415 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f9758067690 0x7f9758069b50 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f977415c060 tx=0x7f9764009190 comp rx=0 tx=0).stop 2024-03-17T23:59:55.067 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:55.063+0000 7f977c557640 1 -- 172.21.15.196:0/745328415 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f977406f400 msgr2=0x7f97741f1520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:59:55.067 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:55.063+0000 7f977c557640 1 --2- 172.21.15.196:0/745328415 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f977406f400 0x7f97741f1520 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f97700b3040 tx=0x7f977001ba50 comp rx=0 tx=0).stop 2024-03-17T23:59:55.067 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:55.063+0000 7f977aaf4640 1 -- 172.21.15.196:0/745328415 reap_dead start 2024-03-17T23:59:55.067 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:55.063+0000 7f977c557640 1 -- 172.21.15.196:0/745328415 shutdown_connections 2024-03-17T23:59:55.067 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:55.063+0000 7f977c557640 1 -- 172.21.15.196:0/745328415 >> 172.21.15.196:0/745328415 conn(0x7f977406b2b0 msgr2=0x7f9774156e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-17T23:59:55.067 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:55.063+0000 7f977c557640 1 -- 172.21.15.196:0/745328415 shutdown_connections 2024-03-17T23:59:55.067 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:55.063+0000 7f977c557640 1 -- 172.21.15.196:0/745328415 wait complete. 2024-03-17T23:59:55.080 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-03-17T23:59:55.189 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:55.187+0000 7fb1c8329640 1 Processor -- start 2024-03-17T23:59:55.189 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:55.187+0000 7fb1c8329640 1 -- start start 2024-03-17T23:59:55.191 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:55.187+0000 7fb1c8329640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fb1c0154340 0x7fb1c00c8d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:59:55.191 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:55.187+0000 7fb1c8329640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb1c015d5d0 con 0x7fb1c0153f60 2024-03-17T23:59:55.191 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:55.187+0000 7fb1c8329640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb1c015d8b0 con 0x7fb1c015aa70 2024-03-17T23:59:55.191 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:55.187+0000 7fb1c8329640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 -- 0x7fb1c0072770 con 0x7fb1c0154340 2024-03-17T23:59:55.191 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:55.187+0000 7fb1c60c5640 1 --1- >> v1:172.21.15.196:6789/0 conn(0x7fb1c0153f60 0x7fb1c00705f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.196:6789/0 says I am v1:172.21.15.196:56886/0 (socket says 172.21.15.196:56886) 2024-03-17T23:59:55.191 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:55.187+0000 7fb1c60c5640 1 -- 172.21.15.196:0/3739396261 learned_addr learned my addr 172.21.15.196:0/3739396261 (peer_addr_for_me v1:172.21.15.196:0/0) 2024-03-17T23:59:55.191 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:55.187+0000 7fb1c58c4640 1 --2- 172.21.15.196:0/3739396261 >> v2:172.21.15.204:3300/0 conn(0x7fb1c0154340 0x7fb1c00c8d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:59:55.191 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:55.187+0000 7fb1c50c3640 1 -- 172.21.15.196:0/3739396261 <== mon.0 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1656253226 0 0) 0x7fb1c015d5d0 con 0x7fb1c0153f60 2024-03-17T23:59:55.191 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:55.187+0000 7fb1c50c3640 1 -- 172.21.15.196:0/3739396261 --> v1:172.21.15.196:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb1ac003530 con 0x7fb1c0153f60 2024-03-17T23:59:55.192 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:55.187+0000 7fb1c58c4640 1 -- 172.21.15.196:0/3739396261 >> v1:172.21.15.204:6789/0 conn(0x7fb1c015aa70 legacy=0x7fb1c0072c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:59:55.192 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:55.187+0000 7fb1c58c4640 1 -- 172.21.15.196:0/3739396261 >> v1:172.21.15.196:6789/0 conn(0x7fb1c0153f60 legacy=0x7fb1c00705f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:59:55.192 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:55.187+0000 7fb1c58c4640 1 -- 172.21.15.196:0/3739396261 --> v2:172.21.15.204:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1c015db90 con 0x7fb1c0154340 2024-03-17T23:59:55.194 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:55.191+0000 7fb1c58c4640 1 --2- 172.21.15.196:0/3739396261 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb1c0154340 0x7fb1c00c8d60 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fb1b00097c0 tx=0x7fb1b001ec90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1c86870395fa7212 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:59:55.194 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:55.191+0000 7fb1c50c3640 1 -- 172.21.15.196:0/3739396261 <== mon.1 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1b00b5070 con 0x7fb1c0154340 2024-03-17T23:59:55.194 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:55.191+0000 7fb1c50c3640 1 -- 172.21.15.196:0/3739396261 <== mon.1 v2:172.21.15.204:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb1b00a8990 con 0x7fb1c0154340 2024-03-17T23:59:55.194 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:55.191+0000 7fb1c50c3640 1 -- 172.21.15.196:0/3739396261 <== mon.1 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1b00a8d40 con 0x7fb1c0154340 2024-03-17T23:59:55.195 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:55.191+0000 7fb1c8329640 1 -- 172.21.15.196:0/3739396261 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb1c0154340 msgr2=0x7fb1c00c8d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:59:55.195 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:55.191+0000 7fb1c8329640 1 --2- 172.21.15.196:0/3739396261 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb1c0154340 0x7fb1c00c8d60 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fb1b00097c0 tx=0x7fb1b001ec90 comp rx=0 tx=0).stop 2024-03-17T23:59:55.196 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:55.191+0000 7fb1c8329640 1 -- 172.21.15.196:0/3739396261 shutdown_connections 2024-03-17T23:59:55.196 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:55.191+0000 7fb1c8329640 1 --2- 172.21.15.196:0/3739396261 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb1c0154340 0x7fb1c00c8d60 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:59:55.196 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:55.191+0000 7fb1c8329640 1 -- 172.21.15.196:0/3739396261 >> 172.21.15.196:0/3739396261 conn(0x7fb1c006c3c0 msgr2=0x7fb1c006c7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-17T23:59:55.196 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:55.191+0000 7fb1c8329640 1 -- 172.21.15.196:0/3739396261 shutdown_connections 2024-03-17T23:59:55.196 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:55.191+0000 7fb1c8329640 1 -- 172.21.15.196:0/3739396261 wait complete. 2024-03-17T23:59:55.197 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:55.195+0000 7fb1c8329640 1 Processor -- start 2024-03-17T23:59:55.197 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:55.195+0000 7fb1c8329640 1 -- start start 2024-03-17T23:59:55.199 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:55.195+0000 7fb1c8329640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb1c0153f60 0x7fb1c0152d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:59:55.200 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:55.195+0000 7fb1c8329640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb1c0154340 0x7fb1c00ca9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:59:55.200 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:55.195+0000 7fb1c8329640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb1c015aa70 0x7fb1c00caee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:59:55.200 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:55.195+0000 7fb1c8329640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fb1c015e150 con 0x7fb1c015aa70 2024-03-17T23:59:55.200 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:55.195+0000 7fb1c8329640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7fb1c015d380 con 0x7fb1c0154340 2024-03-17T23:59:55.200 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:55.195+0000 7fb1c8329640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7fb1c0070d00 con 0x7fb1c0153f60 2024-03-17T23:59:55.200 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:55.195+0000 7fb1c68c6640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb1c015aa70 0x7fb1c00caee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:59:55.200 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:55.195+0000 7fb1c68c6640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb1c015aa70 0x7fb1c00caee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.196:38522/0 (socket says 172.21.15.196:38522) 2024-03-17T23:59:55.200 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:55.195+0000 7fb1c60c5640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb1c0153f60 0x7fb1c0152d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:59:55.200 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:55.195+0000 7fb1c68c6640 1 -- 172.21.15.196:0/635975184 learned_addr learned my addr 172.21.15.196:0/635975184 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-03-17T23:59:55.200 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:55.195+0000 7fb1c58c4640 1 --2- 172.21.15.196:0/635975184 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb1c0154340 0x7fb1c00ca9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:59:55.200 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:55.195+0000 7fb1c68c6640 1 -- 172.21.15.196:0/635975184 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb1c0153f60 msgr2=0x7fb1c0152d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:59:55.200 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:55.195+0000 7fb1c68c6640 1 --2- 172.21.15.196:0/635975184 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb1c0153f60 0x7fb1c0152d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:59:55.200 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:55.195+0000 7fb1c68c6640 1 -- 172.21.15.196:0/635975184 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb1c0154340 msgr2=0x7fb1c00ca9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:59:55.201 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:55.195+0000 7fb1c68c6640 1 --2- 172.21.15.196:0/635975184 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb1c0154340 0x7fb1c00ca9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:59:55.201 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:55.195+0000 7fb1c68c6640 1 -- 172.21.15.196:0/635975184 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1c0155830 con 0x7fb1c015aa70 2024-03-17T23:59:55.201 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:55.195+0000 7fb1c58c4640 1 --2- 172.21.15.196:0/635975184 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb1c0154340 0x7fb1c00ca9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-17T23:59:55.201 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:55.195+0000 7fb1c60c5640 1 --2- 172.21.15.196:0/635975184 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb1c0153f60 0x7fb1c0152d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-17T23:59:55.201 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:55.195+0000 7fb1c68c6640 1 --2- 172.21.15.196:0/635975184 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb1c015aa70 0x7fb1c00caee0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fb1b800c760 tx=0x7fb1b800cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:59:55.201 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:55.195+0000 7fb1b6ffd640 1 -- 172.21.15.196:0/635975184 <== mon.0 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1b8003b80 con 0x7fb1c015aa70 2024-03-17T23:59:55.201 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:55.195+0000 7fb1b6ffd640 1 -- 172.21.15.196:0/635975184 <== mon.0 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb1b8003d20 con 0x7fb1c015aa70 2024-03-17T23:59:55.201 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:55.195+0000 7fb1b6ffd640 1 -- 172.21.15.196:0/635975184 <== mon.0 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1b800aa30 con 0x7fb1c015aa70 2024-03-17T23:59:55.201 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:55.195+0000 7fb1c8329640 1 -- 172.21.15.196:0/635975184 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb1c0157380 con 0x7fb1c015aa70 2024-03-17T23:59:55.201 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:55.195+0000 7fb1c8329640 1 -- 172.21.15.196:0/635975184 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1c0155ad0 con 0x7fb1c015aa70 2024-03-17T23:59:55.202 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:55.199+0000 7fb1c8329640 1 -- 172.21.15.196:0/635975184 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb1c00689a0 con 0x7fb1c015aa70 2024-03-17T23:59:55.202 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:55.199+0000 7fb1b6ffd640 1 -- 172.21.15.196:0/635975184 <== mon.0 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 5) ==== 87083+0+0 (secure 0 0 0) 0x7fb1b800abd0 con 0x7fb1c015aa70 2024-03-17T23:59:55.202 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:55.199+0000 7fb1b6ffd640 1 --2- 172.21.15.196:0/635975184 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7fb1a4067690 0x7fb1a4069b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:59:55.202 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:55.199+0000 7fb1b6ffd640 1 -- 172.21.15.196:0/635975184 <== mon.0 v2:172.21.15.196:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7fb1b80855f0 con 0x7fb1c015aa70 2024-03-17T23:59:55.202 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:55.199+0000 7fb1c60c5640 1 --2- 172.21.15.196:0/635975184 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7fb1a4067690 0x7fb1a4069b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:59:55.203 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:55.199+0000 7fb1c60c5640 1 --2- 172.21.15.196:0/635975184 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7fb1a4067690 0x7fb1a4069b50 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fb1bc0011f0 tx=0x7fb1bc007d40 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:59:55.210 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:55.207+0000 7fb1b6ffd640 1 -- 172.21.15.196:0/635975184 <== mon.0 v2:172.21.15.196:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177849 (secure 0 0 0) 0x7fb1b8055c30 con 0x7fb1c015aa70 2024-03-17T23:59:55.507 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:55.503+0000 7fb1c8329640 1 -- 172.21.15.196:0/635975184 --> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) -- 0x7fb1c0155d10 con 0x7fb1a4067690 2024-03-17T23:59:55.507 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:55.503+0000 7fb1b6ffd640 1 -- 172.21.15.196:0/635975184 <== mgr.4099 v2:172.21.15.204:6832/2505201055 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fb1bc007750 con 0x7fb1a4067690 2024-03-17T23:59:55.507 INFO:teuthology.orchestra.run.smithi196.stderr:instructed osd(s) 6 to deep-scrub 2024-03-17T23:59:55.509 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:55.507+0000 7fb1c8329640 1 -- 172.21.15.196:0/635975184 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7fb1a4067690 msgr2=0x7fb1a4069b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:59:55.509 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:55.507+0000 7fb1c8329640 1 --2- 172.21.15.196:0/635975184 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7fb1a4067690 0x7fb1a4069b50 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fb1bc0011f0 tx=0x7fb1bc007d40 comp rx=0 tx=0).stop 2024-03-17T23:59:55.510 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:55.507+0000 7fb1c8329640 1 -- 172.21.15.196:0/635975184 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb1c015aa70 msgr2=0x7fb1c00caee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:59:55.510 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:55.507+0000 7fb1c8329640 1 --2- 172.21.15.196:0/635975184 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb1c015aa70 0x7fb1c00caee0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fb1b800c760 tx=0x7fb1b800cc20 comp rx=0 tx=0).stop 2024-03-17T23:59:55.510 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:55.507+0000 7fb1c8329640 1 -- 172.21.15.196:0/635975184 shutdown_connections 2024-03-17T23:59:55.510 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:55.507+0000 7fb1c8329640 1 --2- 172.21.15.196:0/635975184 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7fb1a4067690 0x7fb1a4069b50 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:59:55.510 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:55.507+0000 7fb1c8329640 1 --2- 172.21.15.196:0/635975184 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb1c015aa70 0x7fb1c00caee0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:59:55.510 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:55.507+0000 7fb1c8329640 1 --2- 172.21.15.196:0/635975184 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb1c0154340 0x7fb1c00ca9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:59:55.510 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:55.507+0000 7fb1c8329640 1 --2- 172.21.15.196:0/635975184 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb1c0153f60 0x7fb1c0152d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:59:55.510 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:55.507+0000 7fb1c8329640 1 -- 172.21.15.196:0/635975184 >> 172.21.15.196:0/635975184 conn(0x7fb1c006c3c0 msgr2=0x7fb1c00c8120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-17T23:59:55.510 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:55.507+0000 7fb1c8329640 1 -- 172.21.15.196:0/635975184 shutdown_connections 2024-03-17T23:59:55.510 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:55.507+0000 7fb1c8329640 1 -- 172.21.15.196:0/635975184 wait complete. 2024-03-17T23:59:55.531 INFO:tasks.ceph:Scrubbing osd.7 2024-03-17T23:59:55.531 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-03-17T23:59:55.642 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:55.639+0000 7f7ae57ef640 1 Processor -- start 2024-03-17T23:59:55.642 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:55.639+0000 7f7ae57ef640 1 -- start start 2024-03-17T23:59:55.644 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:55.639+0000 7f7ae57ef640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f7ae0157690 0x7f7ae015a140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:59:55.644 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:55.639+0000 7f7ae57ef640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7ae00c71b0 0x7f7ae0072a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:59:55.644 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:55.639+0000 7f7ae57ef640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7ae015a840 con 0x7f7ae0073390 2024-03-17T23:59:55.644 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:55.639+0000 7f7ae57ef640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7f7ae0072600 con 0x7f7ae0157690 2024-03-17T23:59:55.644 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:55.639+0000 7f7ae57ef640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f7ae015b0e0 con 0x7f7ae00c71b0 2024-03-17T23:59:55.644 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:55.639+0000 7f7adeffd640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f7ae0157690 0x7f7ae015a140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:59:55.645 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:55.639+0000 7f7adeffd640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f7ae0157690 0x7f7ae015a140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.196:38530/0 (socket says 172.21.15.196:38530) 2024-03-17T23:59:55.645 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:55.639+0000 7f7adeffd640 1 -- 172.21.15.196:0/635530848 learned_addr learned my addr 172.21.15.196:0/635530848 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-03-17T23:59:55.645 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:55.639+0000 7f7ade7fc640 1 --2- 172.21.15.196:0/635530848 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7ae00c71b0 0x7f7ae0072a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:59:55.645 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:55.639+0000 7f7adeffd640 1 -- 172.21.15.196:0/635530848 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7ae00c71b0 msgr2=0x7f7ae0072a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-17T23:59:55.645 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:55.639+0000 7f7adeffd640 1 --2- 172.21.15.196:0/635530848 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7ae00c71b0 0x7f7ae0072a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:59:55.645 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:55.639+0000 7f7adeffd640 1 -- 172.21.15.196:0/635530848 >> v1:172.21.15.204:6789/0 conn(0x7f7ae0073390 legacy=0x7f7ae006f480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:59:55.645 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:55.639+0000 7f7adeffd640 1 -- 172.21.15.196:0/635530848 --> v2:172.21.15.196:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ae015ab20 con 0x7f7ae0157690 2024-03-17T23:59:55.645 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:55.639+0000 7f7ade7fc640 1 --2- 172.21.15.196:0/635530848 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7ae00c71b0 0x7f7ae0072a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-17T23:59:55.646 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:55.643+0000 7f7adeffd640 1 --2- 172.21.15.196:0/635530848 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7ae0157690 0x7f7ae015a140 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f7ad0009870 tx=0x7f7ad001c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddf0193b0453f032 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:59:55.646 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:55.643+0000 7f7addffb640 1 -- 172.21.15.196:0/635530848 <== mon.0 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ad00a7070 con 0x7f7ae0157690 2024-03-17T23:59:55.647 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:55.643+0000 7f7addffb640 1 -- 172.21.15.196:0/635530848 <== mon.0 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ad00b0070 con 0x7f7ae0157690 2024-03-17T23:59:55.647 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:55.643+0000 7f7addffb640 1 -- 172.21.15.196:0/635530848 <== mon.0 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ad00ab890 con 0x7f7ae0157690 2024-03-17T23:59:55.647 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:55.643+0000 7f7ae57ef640 1 -- 172.21.15.196:0/635530848 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7ae0157690 msgr2=0x7f7ae015a140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:59:55.647 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:55.643+0000 7f7ae57ef640 1 --2- 172.21.15.196:0/635530848 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7ae0157690 0x7f7ae015a140 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f7ad0009870 tx=0x7f7ad001c560 comp rx=0 tx=0).stop 2024-03-17T23:59:55.647 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:55.643+0000 7f7ae57ef640 1 -- 172.21.15.196:0/635530848 shutdown_connections 2024-03-17T23:59:55.647 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:55.643+0000 7f7ae57ef640 1 --2- 172.21.15.196:0/635530848 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7ae00c71b0 0x7f7ae0072a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:59:55.647 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:55.643+0000 7f7ae57ef640 1 --2- 172.21.15.196:0/635530848 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7ae0157690 0x7f7ae015a140 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:59:55.647 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:55.643+0000 7f7ae57ef640 1 -- 172.21.15.196:0/635530848 >> 172.21.15.196:0/635530848 conn(0x7f7ae00cbea0 msgr2=0x7f7ae00cc2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-17T23:59:55.647 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:55.643+0000 7f7ae57ef640 1 -- 172.21.15.196:0/635530848 shutdown_connections 2024-03-17T23:59:55.647 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:55.643+0000 7f7ae57ef640 1 -- 172.21.15.196:0/635530848 wait complete. 2024-03-17T23:59:55.649 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:55.643+0000 7f7ae57ef640 1 Processor -- start 2024-03-17T23:59:55.649 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:55.643+0000 7f7ae57ef640 1 -- start start 2024-03-17T23:59:55.649 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:55.643+0000 7f7ae57ef640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7ae0073390 0x7f7ae00c2800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:59:55.649 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:55.647+0000 7f7ae57ef640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7ae00c71b0 0x7f7ae00c1f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:59:55.649 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:55.647+0000 7f7ae57ef640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7ae0157690 0x7f7ae01f5da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:59:55.649 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:55.647+0000 7f7ae57ef640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f7ae0157bf0 con 0x7f7ae0157690 2024-03-17T23:59:55.649 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:55.647+0000 7f7ae57ef640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f7ae0157a70 con 0x7f7ae00c71b0 2024-03-17T23:59:55.650 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:55.647+0000 7f7ae57ef640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f7ae006fb90 con 0x7f7ae0073390 2024-03-17T23:59:55.650 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:55.647+0000 7f7adf7fe640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7ae0157690 0x7f7ae01f5da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:59:55.650 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:55.647+0000 7f7adf7fe640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7ae0157690 0x7f7ae01f5da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.196:38534/0 (socket says 172.21.15.196:38534) 2024-03-17T23:59:55.650 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:55.647+0000 7f7adf7fe640 1 -- 172.21.15.196:0/3557762034 learned_addr learned my addr 172.21.15.196:0/3557762034 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-03-17T23:59:55.650 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:55.647+0000 7f7adeffd640 1 --2- 172.21.15.196:0/3557762034 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7ae0073390 0x7f7ae00c2800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:59:55.650 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:55.647+0000 7f7ade7fc640 1 --2- 172.21.15.196:0/3557762034 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7ae00c71b0 0x7f7ae00c1f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:59:55.650 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:55.647+0000 7f7adf7fe640 1 -- 172.21.15.196:0/3557762034 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7ae0073390 msgr2=0x7f7ae00c2800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:59:55.650 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:55.647+0000 7f7adf7fe640 1 --2- 172.21.15.196:0/3557762034 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7ae0073390 0x7f7ae00c2800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:59:55.650 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:55.647+0000 7f7adf7fe640 1 -- 172.21.15.196:0/3557762034 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7ae00c71b0 msgr2=0x7f7ae00c1f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:59:55.650 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:55.647+0000 7f7adf7fe640 1 --2- 172.21.15.196:0/3557762034 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7ae00c71b0 0x7f7ae00c1f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:59:55.650 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:55.647+0000 7f7adf7fe640 1 -- 172.21.15.196:0/3557762034 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ae0151e70 con 0x7f7ae0157690 2024-03-17T23:59:55.650 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:55.647+0000 7f7adf7fe640 1 --2- 172.21.15.196:0/3557762034 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7ae0157690 0x7f7ae01f5da0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f7ad800c7a0 tx=0x7f7ad800cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:59:55.651 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:55.647+0000 7f7ac77fe640 1 -- 172.21.15.196:0/3557762034 <== mon.0 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ad8003b80 con 0x7f7ae0157690 2024-03-17T23:59:55.651 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:55.647+0000 7f7ac77fe640 1 -- 172.21.15.196:0/3557762034 <== mon.0 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ad8003d20 con 0x7f7ae0157690 2024-03-17T23:59:55.651 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:55.647+0000 7f7ae57ef640 1 -- 172.21.15.196:0/3557762034 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ae0152150 con 0x7f7ae0157690 2024-03-17T23:59:55.651 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:55.647+0000 7f7ac77fe640 1 -- 172.21.15.196:0/3557762034 <== mon.0 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ad800aa90 con 0x7f7ae0157690 2024-03-17T23:59:55.651 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:55.647+0000 7f7ae57ef640 1 -- 172.21.15.196:0/3557762034 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ae00c59d0 con 0x7f7ae0157690 2024-03-17T23:59:55.652 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:55.647+0000 7f7ae57ef640 1 -- 172.21.15.196:0/3557762034 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f7ae0152670 con 0x7f7ae0157690 2024-03-17T23:59:55.652 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:55.647+0000 7f7ac77fe640 1 -- 172.21.15.196:0/3557762034 <== mon.0 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 5) ==== 87083+0+0 (secure 0 0 0) 0x7f7ad800ac30 con 0x7f7ae0157690 2024-03-17T23:59:55.652 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:55.647+0000 7f7ac77fe640 1 --2- 172.21.15.196:0/3557762034 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f7acc067690 0x7f7acc069b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:59:55.653 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:55.647+0000 7f7ac77fe640 1 -- 172.21.15.196:0/3557762034 <== mon.0 v2:172.21.15.196:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7f7ad80862a0 con 0x7f7ae0157690 2024-03-17T23:59:55.653 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:55.647+0000 7f7ac77fe640 1 --2- 172.21.15.196:0/3557762034 >> [v2:172.21.15.204:6800/3361860686,v1:172.21.15.204:6801/3361860686] conn(0x7f7acc06fa10 0x7f7acc071e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:59:55.653 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:55.647+0000 7f7ac77fe640 1 -- 172.21.15.196:0/3557762034 --> [v2:172.21.15.204:6800/3361860686,v1:172.21.15.204:6801/3361860686] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7ad8023e80 con 0x7f7acc06fa10 2024-03-17T23:59:55.653 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:55.647+0000 7f7ac77fe640 1 -- 172.21.15.196:0/3557762034 <== mon.0 v2:172.21.15.196:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f7ad8086730 con 0x7f7ae0157690 2024-03-17T23:59:55.653 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:55.647+0000 7f7adeffd640 1 --2- 172.21.15.196:0/3557762034 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f7acc067690 0x7f7acc069b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:59:55.653 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:55.647+0000 7f7ade7fc640 1 --2- 172.21.15.196:0/3557762034 >> [v2:172.21.15.204:6800/3361860686,v1:172.21.15.204:6801/3361860686] conn(0x7f7acc06fa10 0x7f7acc071e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:59:55.653 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:55.651+0000 7f7adeffd640 1 --2- 172.21.15.196:0/3557762034 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f7acc067690 0x7f7acc069b50 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f7ad00af000 tx=0x7f7ad00a7000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:59:55.653 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:55.651+0000 7f7ade7fc640 1 --2- 172.21.15.196:0/3557762034 >> [v2:172.21.15.204:6800/3361860686,v1:172.21.15.204:6801/3361860686] conn(0x7f7acc06fa10 0x7f7acc071e90 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:59:55.654 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:55.651+0000 7f7ac77fe640 1 -- 172.21.15.196:0/3557762034 <== osd.7 v2:172.21.15.204:6800/3361860686 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f7ad8023e80 con 0x7f7acc06fa10 2024-03-17T23:59:55.666 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:55.663+0000 7f7ae57ef640 1 -- 172.21.15.196:0/3557762034 --> [v2:172.21.15.204:6800/3361860686,v1:172.21.15.204:6801/3361860686] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f7ae0068290 con 0x7f7acc06fa10 2024-03-17T23:59:55.667 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:55.663+0000 7f7ac77fe640 1 -- 172.21.15.196:0/3557762034 <== osd.7 v2:172.21.15.204:6800/3361860686 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f7ae0068290 con 0x7f7acc06fa10 2024-03-17T23:59:55.667 INFO:teuthology.orchestra.run.smithi196.stdout:{ 2024-03-17T23:59:55.667 INFO:teuthology.orchestra.run.smithi196.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-03-17T23:59:55.667 INFO:teuthology.orchestra.run.smithi196.stdout:} 2024-03-17T23:59:55.668 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:55.663+0000 7f7ae57ef640 1 -- 172.21.15.196:0/3557762034 >> [v2:172.21.15.204:6800/3361860686,v1:172.21.15.204:6801/3361860686] conn(0x7f7acc06fa10 msgr2=0x7f7acc071e90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:59:55.668 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:55.663+0000 7f7ae57ef640 1 --2- 172.21.15.196:0/3557762034 >> [v2:172.21.15.204:6800/3361860686,v1:172.21.15.204:6801/3361860686] conn(0x7f7acc06fa10 0x7f7acc071e90 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:59:55.668 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:55.663+0000 7f7ae57ef640 1 -- 172.21.15.196:0/3557762034 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f7acc067690 msgr2=0x7f7acc069b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:59:55.668 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:55.663+0000 7f7ae57ef640 1 --2- 172.21.15.196:0/3557762034 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f7acc067690 0x7f7acc069b50 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f7ad00af000 tx=0x7f7ad00a7000 comp rx=0 tx=0).stop 2024-03-17T23:59:55.668 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:55.663+0000 7f7ae57ef640 1 -- 172.21.15.196:0/3557762034 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7ae0157690 msgr2=0x7f7ae01f5da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:59:55.668 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:55.663+0000 7f7ae57ef640 1 --2- 172.21.15.196:0/3557762034 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7ae0157690 0x7f7ae01f5da0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f7ad800c7a0 tx=0x7f7ad800cc60 comp rx=0 tx=0).stop 2024-03-17T23:59:55.668 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:55.663+0000 7f7adf7fe640 1 -- 172.21.15.196:0/3557762034 reap_dead start 2024-03-17T23:59:55.668 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:55.663+0000 7f7ae57ef640 1 -- 172.21.15.196:0/3557762034 shutdown_connections 2024-03-17T23:59:55.668 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:55.663+0000 7f7ae57ef640 1 -- 172.21.15.196:0/3557762034 >> 172.21.15.196:0/3557762034 conn(0x7f7ae00cbea0 msgr2=0x7f7ae00c6920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-17T23:59:55.669 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:55.663+0000 7f7ae57ef640 1 -- 172.21.15.196:0/3557762034 shutdown_connections 2024-03-17T23:59:55.669 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:55.663+0000 7f7ae57ef640 1 -- 172.21.15.196:0/3557762034 wait complete. 2024-03-17T23:59:55.682 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-03-17T23:59:55.785 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:55.783+0000 7fda3eb4f640 1 Processor -- start 2024-03-17T23:59:55.786 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:55.783+0000 7fda3eb4f640 1 -- start start 2024-03-17T23:59:55.787 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:55.783+0000 7fda3eb4f640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fda3815a260 0x7fda3815a660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:59:55.787 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:55.783+0000 7fda3eb4f640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fda38154620 con 0x7fda38154240 2024-03-17T23:59:55.787 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:55.783+0000 7fda3eb4f640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fda380c7830 con 0x7fda38072430 2024-03-17T23:59:55.787 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:55.783+0000 7fda3eb4f640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7fda380c7b10 con 0x7fda3815a260 2024-03-17T23:59:55.787 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:55.783+0000 7fda37fff640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fda3815a260 0x7fda3815a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:59:55.787 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:55.783+0000 7fda3c8eb640 1 --1- >> v1:172.21.15.196:6789/0 conn(0x7fda38154240 0x7fda3806fca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.196:6789/0 says I am v1:172.21.15.196:56896/0 (socket says 172.21.15.196:56896) 2024-03-17T23:59:55.787 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:55.783+0000 7fda3c8eb640 1 -- 172.21.15.196:0/3045640692 learned_addr learned my addr 172.21.15.196:0/3045640692 (peer_addr_for_me v1:172.21.15.196:0/0) 2024-03-17T23:59:55.787 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:55.783+0000 7fda37fff640 1 -- 172.21.15.196:0/3045640692 >> v1:172.21.15.204:6789/0 conn(0x7fda38072430 legacy=0x7fda380728c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:59:55.788 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:55.783+0000 7fda37fff640 1 -- 172.21.15.196:0/3045640692 >> v1:172.21.15.196:6789/0 conn(0x7fda38154240 legacy=0x7fda3806fca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:59:55.788 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:55.783+0000 7fda377fe640 1 -- 172.21.15.196:0/3045640692 <== mon.0 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3405039148 0 0) 0x7fda280014a0 con 0x7fda38154240 2024-03-17T23:59:55.788 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:55.783+0000 7fda37fff640 1 -- 172.21.15.196:0/3045640692 --> v2:172.21.15.196:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda380c7df0 con 0x7fda3815a260 2024-03-17T23:59:55.790 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:55.787+0000 7fda37fff640 1 --2- 172.21.15.196:0/3045640692 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fda3815a260 0x7fda3815a660 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fda2c0097c0 tx=0x7fda2c01ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=964c0ac9db82e21a server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:59:55.790 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:55.787+0000 7fda377fe640 1 -- 172.21.15.196:0/3045640692 <== mon.0 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda2c0b5070 con 0x7fda3815a260 2024-03-17T23:59:55.790 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:55.787+0000 7fda377fe640 1 -- 172.21.15.196:0/3045640692 <== mon.0 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda2c0a8990 con 0x7fda3815a260 2024-03-17T23:59:55.790 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:55.787+0000 7fda377fe640 1 -- 172.21.15.196:0/3045640692 <== mon.0 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda2c0a8d60 con 0x7fda3815a260 2024-03-17T23:59:55.791 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:55.787+0000 7fda3eb4f640 1 -- 172.21.15.196:0/3045640692 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fda3815a260 msgr2=0x7fda3815a660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:59:55.791 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:55.787+0000 7fda3eb4f640 1 --2- 172.21.15.196:0/3045640692 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fda3815a260 0x7fda3815a660 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fda2c0097c0 tx=0x7fda2c01ec90 comp rx=0 tx=0).stop 2024-03-17T23:59:55.791 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:55.787+0000 7fda3eb4f640 1 -- 172.21.15.196:0/3045640692 shutdown_connections 2024-03-17T23:59:55.792 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:55.787+0000 7fda3eb4f640 1 --2- 172.21.15.196:0/3045640692 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fda3815a260 0x7fda3815a660 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:59:55.792 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:55.787+0000 7fda3eb4f640 1 -- 172.21.15.196:0/3045640692 >> 172.21.15.196:0/3045640692 conn(0x7fda380cc420 msgr2=0x7fda380cc830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-17T23:59:55.792 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:55.787+0000 7fda3eb4f640 1 -- 172.21.15.196:0/3045640692 shutdown_connections 2024-03-17T23:59:55.792 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:55.787+0000 7fda3eb4f640 1 -- 172.21.15.196:0/3045640692 wait complete. 2024-03-17T23:59:55.794 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:55.787+0000 7fda3eb4f640 1 Processor -- start 2024-03-17T23:59:55.794 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:55.787+0000 7fda3eb4f640 1 -- start start 2024-03-17T23:59:55.794 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:55.791+0000 7fda3eb4f640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fda38072430 0x7fda380c5aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:59:55.794 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:55.791+0000 7fda3eb4f640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fda38154240 0x7fda380cb350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:59:55.794 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:55.791+0000 7fda3eb4f640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fda3815a260 0x7fda380cb890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:59:55.794 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:55.791+0000 7fda3eb4f640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fda380c8720 con 0x7fda38154240 2024-03-17T23:59:55.794 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:55.791+0000 7fda3eb4f640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7fda380c83b0 con 0x7fda38072430 2024-03-17T23:59:55.794 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:55.791+0000 7fda3eb4f640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7fda3815aba0 con 0x7fda3815a260 2024-03-17T23:59:55.795 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:55.791+0000 7fda37fff640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fda38154240 0x7fda380cb350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:59:55.795 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:55.791+0000 7fda37fff640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fda38154240 0x7fda380cb350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.196:38548/0 (socket says 172.21.15.196:38548) 2024-03-17T23:59:55.795 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:55.791+0000 7fda37fff640 1 -- 172.21.15.196:0/3941345524 learned_addr learned my addr 172.21.15.196:0/3941345524 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-03-17T23:59:55.795 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:55.791+0000 7fda3d0ec640 1 --2- 172.21.15.196:0/3941345524 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fda3815a260 0x7fda380cb890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:59:55.795 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:55.791+0000 7fda3c8eb640 1 --2- 172.21.15.196:0/3941345524 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fda38072430 0x7fda380c5aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:59:55.795 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:55.791+0000 7fda37fff640 1 -- 172.21.15.196:0/3941345524 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fda3815a260 msgr2=0x7fda380cb890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:59:55.795 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:55.791+0000 7fda37fff640 1 --2- 172.21.15.196:0/3941345524 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fda3815a260 0x7fda380cb890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:59:55.795 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:55.791+0000 7fda37fff640 1 -- 172.21.15.196:0/3941345524 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fda38072430 msgr2=0x7fda380c5aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:59:55.795 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:55.791+0000 7fda37fff640 1 --2- 172.21.15.196:0/3941345524 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fda38072430 0x7fda380c5aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:59:55.795 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:55.791+0000 7fda37fff640 1 -- 172.21.15.196:0/3941345524 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda380c4680 con 0x7fda38154240 2024-03-17T23:59:55.795 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:55.791+0000 7fda3c8eb640 1 --2- 172.21.15.196:0/3941345524 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fda38072430 0x7fda380c5aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-17T23:59:55.795 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:55.791+0000 7fda37fff640 1 --2- 172.21.15.196:0/3941345524 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fda38154240 0x7fda380cb350 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fda2c0097c0 tx=0x7fda2c01ba30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:59:55.795 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:55.791+0000 7fda357fa640 1 -- 172.21.15.196:0/3941345524 <== mon.0 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda2c0c2070 con 0x7fda38154240 2024-03-17T23:59:55.796 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:55.791+0000 7fda357fa640 1 -- 172.21.15.196:0/3941345524 <== mon.0 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda2c004230 con 0x7fda38154240 2024-03-17T23:59:55.796 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:55.791+0000 7fda3eb4f640 1 -- 172.21.15.196:0/3941345524 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fda380c4900 con 0x7fda38154240 2024-03-17T23:59:55.796 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:55.791+0000 7fda357fa640 1 -- 172.21.15.196:0/3941345524 <== mon.0 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda2c0b5040 con 0x7fda38154240 2024-03-17T23:59:55.796 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:55.791+0000 7fda3eb4f640 1 -- 172.21.15.196:0/3941345524 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fda380ca870 con 0x7fda38154240 2024-03-17T23:59:55.796 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:55.791+0000 7fda3eb4f640 1 -- 172.21.15.196:0/3941345524 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fda380689a0 con 0x7fda38154240 2024-03-17T23:59:55.796 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:55.791+0000 7fda357fa640 1 -- 172.21.15.196:0/3941345524 <== mon.0 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 5) ==== 87083+0+0 (secure 0 0 0) 0x7fda2c0c5070 con 0x7fda38154240 2024-03-17T23:59:55.797 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:55.791+0000 7fda357fa640 1 --2- 172.21.15.196:0/3941345524 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7fda24067690 0x7fda24069b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:59:55.797 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:55.791+0000 7fda357fa640 1 -- 172.21.15.196:0/3941345524 <== mon.0 v2:172.21.15.196:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7fda2c1228a0 con 0x7fda38154240 2024-03-17T23:59:55.797 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:55.795+0000 7fda3c8eb640 1 --2- 172.21.15.196:0/3941345524 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7fda24067690 0x7fda24069b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:59:55.797 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:55.795+0000 7fda3c8eb640 1 --2- 172.21.15.196:0/3941345524 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7fda24067690 0x7fda24069b50 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fda280012f0 tx=0x7fda28007da0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:59:55.804 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:55.803+0000 7fda357fa640 1 -- 172.21.15.196:0/3941345524 <== mon.0 v2:172.21.15.196:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177849 (secure 0 0 0) 0x7fda380c4680 con 0x7fda38154240 2024-03-17T23:59:56.097 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:56.095+0000 7fda3eb4f640 1 -- 172.21.15.196:0/3941345524 --> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) -- 0x7fda380c4ec0 con 0x7fda24067690 2024-03-17T23:59:56.098 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:56.095+0000 7fda357fa640 1 -- 172.21.15.196:0/3941345524 <== mgr.4099 v2:172.21.15.204:6832/2505201055 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fda380c4ec0 con 0x7fda24067690 2024-03-17T23:59:56.098 INFO:teuthology.orchestra.run.smithi196.stderr:instructed osd(s) 7 to deep-scrub 2024-03-17T23:59:56.101 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:56.099+0000 7fda3eb4f640 1 -- 172.21.15.196:0/3941345524 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7fda24067690 msgr2=0x7fda24069b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:59:56.101 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:56.099+0000 7fda3eb4f640 1 --2- 172.21.15.196:0/3941345524 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7fda24067690 0x7fda24069b50 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fda280012f0 tx=0x7fda28007da0 comp rx=0 tx=0).stop 2024-03-17T23:59:56.101 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:56.099+0000 7fda3eb4f640 1 -- 172.21.15.196:0/3941345524 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fda38154240 msgr2=0x7fda380cb350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:59:56.101 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:56.099+0000 7fda3eb4f640 1 --2- 172.21.15.196:0/3941345524 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fda38154240 0x7fda380cb350 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fda2c0097c0 tx=0x7fda2c01ba30 comp rx=0 tx=0).stop 2024-03-17T23:59:56.101 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:56.099+0000 7fda3eb4f640 1 -- 172.21.15.196:0/3941345524 shutdown_connections 2024-03-17T23:59:56.101 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:56.099+0000 7fda3eb4f640 1 --2- 172.21.15.196:0/3941345524 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7fda24067690 0x7fda24069b50 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:59:56.101 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:56.099+0000 7fda3eb4f640 1 --2- 172.21.15.196:0/3941345524 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fda3815a260 0x7fda380cb890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:59:56.101 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:56.099+0000 7fda3eb4f640 1 --2- 172.21.15.196:0/3941345524 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fda38154240 0x7fda380cb350 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:59:56.101 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:56.099+0000 7fda3eb4f640 1 --2- 172.21.15.196:0/3941345524 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fda38072430 0x7fda380c5aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:59:56.101 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:56.099+0000 7fda3eb4f640 1 -- 172.21.15.196:0/3941345524 >> 172.21.15.196:0/3941345524 conn(0x7fda380cc420 msgr2=0x7fda380c6b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-17T23:59:56.101 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:56.099+0000 7fda3eb4f640 1 -- 172.21.15.196:0/3941345524 shutdown_connections 2024-03-17T23:59:56.102 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:56.099+0000 7fda3eb4f640 1 -- 172.21.15.196:0/3941345524 wait complete. 2024-03-17T23:59:56.121 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-17T23:59:56.229 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:56.227+0000 7fee30fe0640 1 Processor -- start 2024-03-17T23:59:56.229 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:56.227+0000 7fee30fe0640 1 -- start start 2024-03-17T23:59:56.232 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:56.227+0000 7fee30fe0640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fee2c0c8240 0x7fee2c0c9b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:59:56.232 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:56.227+0000 7fee30fe0640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fee2c06fea0 con 0x7fee2c0b0150 2024-03-17T23:59:56.232 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:56.227+0000 7fee30fe0640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fee2c070180 con 0x7fee2c0c4660 2024-03-17T23:59:56.233 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:56.227+0000 7fee30fe0640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 -- 0x7fee2c0b0530 con 0x7fee2c0c8240 2024-03-17T23:59:56.233 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:56.227+0000 7fee2a59c640 1 --1- >> v1:172.21.15.196:6789/0 conn(0x7fee2c0b0150 0x7fee2c06c3c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.196:6789/0 says I am v1:172.21.15.196:56910/0 (socket says 172.21.15.196:56910) 2024-03-17T23:59:56.233 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:56.227+0000 7fee2a59c640 1 -- 172.21.15.196:0/1623646622 learned_addr learned my addr 172.21.15.196:0/1623646622 (peer_addr_for_me v1:172.21.15.196:0/0) 2024-03-17T23:59:56.233 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:56.227+0000 7fee29d9b640 1 --2- 172.21.15.196:0/1623646622 >> v2:172.21.15.204:3300/0 conn(0x7fee2c0c8240 0x7fee2c0c9b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:59:56.233 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:56.227+0000 7fee2959a640 1 -- 172.21.15.196:0/1623646622 <== mon.0 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3966108214 0 0) 0x7fee2c06fea0 con 0x7fee2c0b0150 2024-03-17T23:59:56.233 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:56.227+0000 7fee2959a640 1 -- 172.21.15.196:0/1623646622 --> v1:172.21.15.196:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fee14003530 con 0x7fee2c0b0150 2024-03-17T23:59:56.233 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:56.227+0000 7fee2959a640 1 -- 172.21.15.196:0/1623646622 <== mon.0 v1:172.21.15.196:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 760943072 0 0) 0x7fee14003530 con 0x7fee2c0b0150 2024-03-17T23:59:56.233 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:56.227+0000 7fee2959a640 1 -- 172.21.15.196:0/1623646622 >> v2:172.21.15.204:3300/0 conn(0x7fee2c0c8240 msgr2=0x7fee2c0c9b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-17T23:59:56.233 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:56.227+0000 7fee2959a640 1 --2- 172.21.15.196:0/1623646622 >> v2:172.21.15.204:3300/0 conn(0x7fee2c0c8240 0x7fee2c0c9b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:59:56.233 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:56.227+0000 7fee2959a640 1 -- 172.21.15.196:0/1623646622 >> v1:172.21.15.204:6789/0 conn(0x7fee2c0c4660 legacy=0x7fee2c164810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:59:56.233 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:56.227+0000 7fee2959a640 1 -- 172.21.15.196:0/1623646622 --> v1:172.21.15.196:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee2c0c8cb0 con 0x7fee2c0b0150 2024-03-17T23:59:56.233 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:56.227+0000 7fee2959a640 1 -- 172.21.15.196:0/1623646622 <== mon.0 v1:172.21.15.196:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 981458915 0 0) 0x7fee1c001680 con 0x7fee2c0b0150 2024-03-17T23:59:56.233 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:56.227+0000 7fee2959a640 1 -- 172.21.15.196:0/1623646622 >> v1:172.21.15.196:6789/0 conn(0x7fee2c0b0150 legacy=0x7fee2c06c3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:59:56.233 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:56.227+0000 7fee2959a640 1 --2- 172.21.15.196:0/1623646622 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fee140039c0 0x7fee14003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:59:56.234 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:56.227+0000 7fee2959a640 1 --2- 172.21.15.196:0/1623646622 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fee140043c0 0x7fee14004890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:59:56.234 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:56.227+0000 7fee2959a640 1 --2- 172.21.15.196:0/1623646622 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fee14005090 0x7fee1400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:59:56.234 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:56.227+0000 7fee2959a640 1 -- 172.21.15.196:0/1623646622 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fee2c0b0530 con 0x7fee14005090 2024-03-17T23:59:56.234 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:56.227+0000 7fee2959a640 1 -- 172.21.15.196:0/1623646622 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7fee1400bff0 con 0x7fee140043c0 2024-03-17T23:59:56.234 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:56.227+0000 7fee2959a640 1 -- 172.21.15.196:0/1623646622 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7fee1400c1f0 con 0x7fee140039c0 2024-03-17T23:59:56.234 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:56.227+0000 7fee2ad9d640 1 --2- 172.21.15.196:0/1623646622 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fee14005090 0x7fee1400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:59:56.234 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:56.227+0000 7fee29d9b640 1 --2- 172.21.15.196:0/1623646622 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fee140043c0 0x7fee14004890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:59:56.234 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:56.227+0000 7fee2a59c640 1 --2- 172.21.15.196:0/1623646622 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fee140039c0 0x7fee14003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:59:56.234 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:56.227+0000 7fee2ad9d640 1 -- 172.21.15.196:0/1623646622 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fee140039c0 msgr2=0x7fee14003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-17T23:59:56.234 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:56.227+0000 7fee2ad9d640 1 --2- 172.21.15.196:0/1623646622 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fee140039c0 0x7fee14003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:59:56.234 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:56.227+0000 7fee2ad9d640 1 -- 172.21.15.196:0/1623646622 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fee140043c0 msgr2=0x7fee14004890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-17T23:59:56.234 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:56.227+0000 7fee2ad9d640 1 --2- 172.21.15.196:0/1623646622 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fee140043c0 0x7fee14004890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:59:56.234 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:56.227+0000 7fee2ad9d640 1 -- 172.21.15.196:0/1623646622 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee14003530 con 0x7fee14005090 2024-03-17T23:59:56.236 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:56.231+0000 7fee2ad9d640 1 -- 172.21.15.196:0/1623646622 reap_dead start 2024-03-17T23:59:56.236 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:56.231+0000 7fee2ad9d640 1 --2- 172.21.15.196:0/1623646622 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fee14005090 0x7fee1400b9d0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fee24001f60 tx=0x7fee2401c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4b8336d3f9350d7 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:59:56.236 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:56.231+0000 7fee2959a640 1 -- 172.21.15.196:0/1623646622 <== mon.0 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee24001b60 con 0x7fee14005090 2024-03-17T23:59:56.236 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:56.231+0000 7fee2959a640 1 -- 172.21.15.196:0/1623646622 <== mon.0 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee24003b80 con 0x7fee14005090 2024-03-17T23:59:56.236 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:56.231+0000 7fee2959a640 1 -- 172.21.15.196:0/1623646622 <== mon.0 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee240050d0 con 0x7fee14005090 2024-03-17T23:59:56.236 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:56.231+0000 7fee30fe0640 1 -- 172.21.15.196:0/1623646622 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fee14005090 msgr2=0x7fee1400b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:59:56.236 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:56.231+0000 7fee30fe0640 1 --2- 172.21.15.196:0/1623646622 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fee14005090 0x7fee1400b9d0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fee24001f60 tx=0x7fee2401c880 comp rx=0 tx=0).stop 2024-03-17T23:59:56.236 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:56.231+0000 7fee30fe0640 1 -- 172.21.15.196:0/1623646622 shutdown_connections 2024-03-17T23:59:56.236 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:56.231+0000 7fee30fe0640 1 --2- 172.21.15.196:0/1623646622 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fee14005090 0x7fee1400b9d0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:59:56.237 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:56.231+0000 7fee30fe0640 1 -- 172.21.15.196:0/1623646622 >> 172.21.15.196:0/1623646622 conn(0x7fee2c06b2b0 msgr2=0x7fee2c06b6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-17T23:59:56.237 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:56.231+0000 7fee30fe0640 1 -- 172.21.15.196:0/1623646622 shutdown_connections 2024-03-17T23:59:56.237 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:56.231+0000 7fee30fe0640 1 -- 172.21.15.196:0/1623646622 wait complete. 2024-03-17T23:59:56.237 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:56.235+0000 7fee30fe0640 1 Processor -- start 2024-03-17T23:59:56.237 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:56.235+0000 7fee30fe0640 1 -- start start 2024-03-17T23:59:56.239 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:56.235+0000 7fee30fe0640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fee14005090 0x7fee2c1e0250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:59:56.239 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:56.235+0000 7fee30fe0640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fee2c1e1b50 0x7fee2c1ef6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:59:56.239 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:56.235+0000 7fee30fe0640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fee2c1f33d0 0x7fee2c1efc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:59:56.239 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:56.235+0000 7fee30fe0640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fee2c15ab70 con 0x7fee14005090 2024-03-17T23:59:56.239 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:56.235+0000 7fee30fe0640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7fee2c15a9f0 con 0x7fee2c1e1b50 2024-03-17T23:59:56.239 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:56.235+0000 7fee30fe0640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7fee2c15acf0 con 0x7fee2c1f33d0 2024-03-17T23:59:56.239 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:56.235+0000 7fee2a59c640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fee14005090 0x7fee2c1e0250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:59:56.239 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:56.235+0000 7fee2a59c640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fee14005090 0x7fee2c1e0250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.196:38568/0 (socket says 172.21.15.196:38568) 2024-03-17T23:59:56.239 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:56.235+0000 7fee2a59c640 1 -- 172.21.15.196:0/3083736445 learned_addr learned my addr 172.21.15.196:0/3083736445 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-03-17T23:59:56.239 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:56.235+0000 7fee2ad9d640 1 --2- 172.21.15.196:0/3083736445 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fee2c1f33d0 0x7fee2c1efc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:59:56.239 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:56.235+0000 7fee29d9b640 1 --2- 172.21.15.196:0/3083736445 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fee2c1e1b50 0x7fee2c1ef6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:59:56.239 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:56.235+0000 7fee2a59c640 1 -- 172.21.15.196:0/3083736445 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fee2c1f33d0 msgr2=0x7fee2c1efc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:59:56.240 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:56.235+0000 7fee2a59c640 1 --2- 172.21.15.196:0/3083736445 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fee2c1f33d0 0x7fee2c1efc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:59:56.240 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:56.235+0000 7fee2a59c640 1 -- 172.21.15.196:0/3083736445 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fee2c1e1b50 msgr2=0x7fee2c1ef6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:59:56.240 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:56.235+0000 7fee2a59c640 1 --2- 172.21.15.196:0/3083736445 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fee2c1e1b50 0x7fee2c1ef6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:59:56.240 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:56.235+0000 7fee2a59c640 1 -- 172.21.15.196:0/3083736445 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee2c1f38c0 con 0x7fee14005090 2024-03-17T23:59:56.240 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:56.235+0000 7fee2a59c640 1 --2- 172.21.15.196:0/3083736445 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fee14005090 0x7fee2c1e0250 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fee1c011870 tx=0x7fee1c011d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:59:56.240 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:56.235+0000 7fee1affd640 1 -- 172.21.15.196:0/3083736445 <== mon.0 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee1c010040 con 0x7fee14005090 2024-03-17T23:59:56.240 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:56.235+0000 7fee1affd640 1 -- 172.21.15.196:0/3083736445 <== mon.0 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee1c01a070 con 0x7fee14005090 2024-03-17T23:59:56.240 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:56.235+0000 7fee30fe0640 1 -- 172.21.15.196:0/3083736445 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fee2c153170 con 0x7fee14005090 2024-03-17T23:59:56.240 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:56.235+0000 7fee1affd640 1 -- 172.21.15.196:0/3083736445 <== mon.0 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee1c00fde0 con 0x7fee14005090 2024-03-17T23:59:56.240 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:56.235+0000 7fee30fe0640 1 -- 172.21.15.196:0/3083736445 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fee2c158ba0 con 0x7fee14005090 2024-03-17T23:59:56.240 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:56.235+0000 7fee30fe0640 1 -- 172.21.15.196:0/3083736445 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fee2c158990 con 0x7fee14005090 2024-03-17T23:59:56.241 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:56.235+0000 7fee1affd640 1 -- 172.21.15.196:0/3083736445 <== mon.0 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 5) ==== 87083+0+0 (secure 0 0 0) 0x7fee1c01f460 con 0x7fee14005090 2024-03-17T23:59:56.241 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:56.239+0000 7fee1affd640 1 --2- 172.21.15.196:0/3083736445 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7fee0c067660 0x7fee0c069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-17T23:59:56.241 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:56.239+0000 7fee1affd640 1 -- 172.21.15.196:0/3083736445 <== mon.0 v2:172.21.15.196:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7fee1c088a30 con 0x7fee14005090 2024-03-17T23:59:56.241 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:56.239+0000 7fee29d9b640 1 --2- 172.21.15.196:0/3083736445 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7fee0c067660 0x7fee0c069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-17T23:59:56.241 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:56.239+0000 7fee29d9b640 1 --2- 172.21.15.196:0/3083736445 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7fee0c067660 0x7fee0c069b20 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fee2c0c3b20 tx=0x7fee20008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-17T23:59:56.244 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:56.243+0000 7fee1affd640 1 -- 172.21.15.196:0/3083736445 <== mon.0 v2:172.21.15.196:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177849 (secure 0 0 0) 0x7fee1c011e60 con 0x7fee14005090 2024-03-17T23:59:56.394 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:56.391+0000 7fee30fe0640 1 -- 172.21.15.196:0/3083736445 --> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fee2c0689a0 con 0x7fee0c067660 2024-03-17T23:59:56.413 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:56.411+0000 7fee1affd640 1 -- 172.21.15.196:0/3083736445 <== mgr.4099 v2:172.21.15.204:6832/2505201055 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251957 (secure 0 0 0) 0x7fee2c0689a0 con 0x7fee0c067660 2024-03-17T23:59:56.415 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-03-17T23:59:56.417 INFO:teuthology.orchestra.run.smithi196.stderr:dumped all 2024-03-17T23:59:56.418 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:56.415+0000 7fee30fe0640 1 -- 172.21.15.196:0/3083736445 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7fee0c067660 msgr2=0x7fee0c069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:59:56.418 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:56.415+0000 7fee30fe0640 1 --2- 172.21.15.196:0/3083736445 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7fee0c067660 0x7fee0c069b20 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fee2c0c3b20 tx=0x7fee20008040 comp rx=0 tx=0).stop 2024-03-17T23:59:56.418 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:56.415+0000 7fee30fe0640 1 -- 172.21.15.196:0/3083736445 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fee14005090 msgr2=0x7fee2c1e0250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-17T23:59:56.418 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:56.415+0000 7fee30fe0640 1 --2- 172.21.15.196:0/3083736445 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fee14005090 0x7fee2c1e0250 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fee1c011870 tx=0x7fee1c011d30 comp rx=0 tx=0).stop 2024-03-17T23:59:56.418 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:56.415+0000 7fee30fe0640 1 -- 172.21.15.196:0/3083736445 shutdown_connections 2024-03-17T23:59:56.418 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:56.415+0000 7fee30fe0640 1 --2- 172.21.15.196:0/3083736445 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7fee0c067660 0x7fee0c069b20 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:59:56.418 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:56.415+0000 7fee30fe0640 1 --2- 172.21.15.196:0/3083736445 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fee2c1f33d0 0x7fee2c1efc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:59:56.418 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:56.415+0000 7fee30fe0640 1 --2- 172.21.15.196:0/3083736445 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fee2c1e1b50 0x7fee2c1ef6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:59:56.418 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:56.415+0000 7fee30fe0640 1 --2- 172.21.15.196:0/3083736445 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fee14005090 0x7fee2c1e0250 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-17T23:59:56.419 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:56.415+0000 7fee30fe0640 1 -- 172.21.15.196:0/3083736445 >> 172.21.15.196:0/3083736445 conn(0x7fee2c06b2b0 msgr2=0x7fee2c0ca150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-17T23:59:56.419 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:56.415+0000 7fee30fe0640 1 -- 172.21.15.196:0/3083736445 shutdown_connections 2024-03-17T23:59:56.419 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-17T23:59:56.415+0000 7fee30fe0640 1 -- 172.21.15.196:0/3083736445 wait complete. 2024-03-17T23:59:56.433 INFO:teuthology.orchestra.run.smithi196.stdout:{"pg_ready":true,"pg_map":{"version":137,"stamp":"2024-03-17T23:59:56.030461+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":131409282,"num_objects":131,"num_object_clones":0,"num_object_copies":262,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":131,"num_whiteouts":0,"num_read":3164,"num_read_kb":1535472,"num_write":30477,"num_write_kb":4409625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":10000,"num_omap_keys":20,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":34033,"ondisk_log_size":34033,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":451864,"kb_used_data":91416,"kb_used_omap":12,"kb_used_meta":360371,"kb_avail":754522856,"statfs":{"total":773094113280,"available":772631404544,"internally_reserved":0,"allocated":93609984,"data_stored":263520924,"data_compressed":38669382,"data_compressed_allocated":50274304,"data_compressed_original":221667328,"omap_allocated":12748,"internal_metadata":369020468},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-2173063,"num_objects":-271,"num_object_clones":0,"num_object_copies":-542,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-271,"num_whiteouts":0,"num_read":5,"num_read_kb":33,"num_write":291,"num_write_kb":218,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":10000,"num_omap_keys":20,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003823"},"pg_stats":[{"pgid":"3.3f","version":"23'416","reported_seq":466,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:42.798627+0000","last_change":"2024-03-17T23:56:01.208245+0000","last_active":"2024-03-17T23:59:42.798627+0000","last_peered":"2024-03-17T23:59:42.798627+0000","last_clean":"2024-03-17T23:59:42.798627+0000","last_became_active":"2024-03-17T23:56:01.207533+0000","last_became_peered":"2024-03-17T23:56:01.207533+0000","last_unstale":"2024-03-17T23:59:42.798627+0000","last_undegraded":"2024-03-17T23:59:42.798627+0000","last_fullsized":"2024-03-17T23:59:42.798627+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":416,"log_dups_size":0,"ondisk_log_size":416,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T09:33:28.935701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":22799,"num_write":382,"num_write_kb":63271,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"23'451","reported_seq":559,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:42.769348+0000","last_change":"2024-03-17T23:56:01.193546+0000","last_active":"2024-03-17T23:59:42.769348+0000","last_peered":"2024-03-17T23:59:42.769348+0000","last_clean":"2024-03-17T23:59:42.769348+0000","last_became_active":"2024-03-17T23:56:01.192736+0000","last_became_peered":"2024-03-17T23:56:01.192736+0000","last_unstale":"2024-03-17T23:59:42.769348+0000","last_undegraded":"2024-03-17T23:59:42.769348+0000","last_fullsized":"2024-03-17T23:59:42.769348+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":451,"log_dups_size":0,"ondisk_log_size":451,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":90,"num_read_kb":44601,"num_write":422,"num_write_kb":92038,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"23'361","reported_seq":404,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:54.538471+0000","last_change":"2024-03-17T23:59:54.538515+0000","last_active":"2024-03-17T23:59:54.538471+0000","last_peered":"2024-03-17T23:59:54.538471+0000","last_clean":"2024-03-17T23:59:54.538471+0000","last_became_active":"2024-03-17T23:56:01.188339+0000","last_became_peered":"2024-03-17T23:56:01.188339+0000","last_unstale":"2024-03-17T23:59:54.538471+0000","last_undegraded":"2024-03-17T23:59:54.538471+0000","last_fullsized":"2024-03-17T23:59:54.538471+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'361","last_scrub_stamp":"2024-03-17T23:59:54.538346+0000","last_deep_scrub":"23'361","last_deep_scrub_stamp":"2024-03-17T23:59:54.538346+0000","last_clean_scrub_stamp":"2024-03-17T23:59:54.538346+0000","objects_scrubbed":0,"log_size":361,"log_dups_size":0,"ondisk_log_size":361,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T02:27:37.261511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":9522,"num_write":340,"num_write_kb":42370,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"23'375","reported_seq":430,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:42.797953+0000","last_change":"2024-03-17T23:56:01.204810+0000","last_active":"2024-03-17T23:59:42.797953+0000","last_peered":"2024-03-17T23:59:42.797953+0000","last_clean":"2024-03-17T23:59:42.797953+0000","last_became_active":"2024-03-17T23:56:01.196978+0000","last_became_peered":"2024-03-17T23:56:01.196978+0000","last_unstale":"2024-03-17T23:59:42.797953+0000","last_undegraded":"2024-03-17T23:59:42.797953+0000","last_fullsized":"2024-03-17T23:59:42.797953+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":375,"log_dups_size":0,"ondisk_log_size":375,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":11889,"num_write":341,"num_write_kb":42361,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"23'410","reported_seq":465,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:42.776537+0000","last_change":"2024-03-17T23:56:01.195423+0000","last_active":"2024-03-17T23:59:42.776537+0000","last_peered":"2024-03-17T23:59:42.776537+0000","last_clean":"2024-03-17T23:59:42.776537+0000","last_became_active":"2024-03-17T23:56:01.194710+0000","last_became_peered":"2024-03-17T23:56:01.194710+0000","last_unstale":"2024-03-17T23:59:42.776537+0000","last_undegraded":"2024-03-17T23:59:42.776537+0000","last_fullsized":"2024-03-17T23:59:42.776537+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":410,"log_dups_size":0,"ondisk_log_size":410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T06:25:58.489959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":20292,"num_write":376,"num_write_kb":22112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"23'379","reported_seq":421,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:42.793583+0000","last_change":"2024-03-17T23:56:01.204633+0000","last_active":"2024-03-17T23:59:42.793583+0000","last_peered":"2024-03-17T23:59:42.793583+0000","last_clean":"2024-03-17T23:59:42.793583+0000","last_became_active":"2024-03-17T23:56:01.192908+0000","last_became_peered":"2024-03-17T23:56:01.192908+0000","last_unstale":"2024-03-17T23:59:42.793583+0000","last_undegraded":"2024-03-17T23:59:42.793583+0000","last_fullsized":"2024-03-17T23:59:42.793583+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":379,"log_dups_size":0,"ondisk_log_size":379,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":17487,"num_write":350,"num_write_kb":34234,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"23'439","reported_seq":524,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:42.780782+0000","last_change":"2024-03-17T23:56:01.208861+0000","last_active":"2024-03-17T23:59:42.780782+0000","last_peered":"2024-03-17T23:59:42.780782+0000","last_clean":"2024-03-17T23:59:42.780782+0000","last_became_active":"2024-03-17T23:56:01.199550+0000","last_became_peered":"2024-03-17T23:56:01.199550+0000","last_unstale":"2024-03-17T23:59:42.780782+0000","last_undegraded":"2024-03-17T23:59:42.780782+0000","last_fullsized":"2024-03-17T23:59:42.780782+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T00:21:36.556648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":32233,"num_write":412,"num_write_kb":77021,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"23'355","reported_seq":411,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:42.798840+0000","last_change":"2024-03-17T23:56:01.212574+0000","last_active":"2024-03-17T23:59:42.798840+0000","last_peered":"2024-03-17T23:59:42.798840+0000","last_clean":"2024-03-17T23:59:42.798840+0000","last_became_active":"2024-03-17T23:56:01.211860+0000","last_became_peered":"2024-03-17T23:56:01.211860+0000","last_unstale":"2024-03-17T23:59:42.798840+0000","last_undegraded":"2024-03-17T23:59:42.798840+0000","last_fullsized":"2024-03-17T23:59:42.798840+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":355,"log_dups_size":0,"ondisk_log_size":355,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":19734,"num_write":322,"num_write_kb":51043,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"23'422","reported_seq":471,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:42.803353+0000","last_change":"2024-03-17T23:56:01.214731+0000","last_active":"2024-03-17T23:59:42.803353+0000","last_peered":"2024-03-17T23:59:42.803353+0000","last_clean":"2024-03-17T23:59:42.803353+0000","last_became_active":"2024-03-17T23:56:01.213795+0000","last_became_peered":"2024-03-17T23:56:01.213795+0000","last_unstale":"2024-03-17T23:59:42.803353+0000","last_undegraded":"2024-03-17T23:59:42.803353+0000","last_fullsized":"2024-03-17T23:59:42.803353+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":422,"log_dups_size":0,"ondisk_log_size":422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T11:32:23.716236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":22221,"num_write":389,"num_write_kb":59485,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"23'402","reported_seq":455,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:42.803564+0000","last_change":"2024-03-17T23:56:01.212409+0000","last_active":"2024-03-17T23:59:42.803564+0000","last_peered":"2024-03-17T23:59:42.803564+0000","last_clean":"2024-03-17T23:59:42.803564+0000","last_became_active":"2024-03-17T23:56:01.211620+0000","last_became_peered":"2024-03-17T23:56:01.211620+0000","last_unstale":"2024-03-17T23:59:42.803564+0000","last_undegraded":"2024-03-17T23:59:42.803564+0000","last_fullsized":"2024-03-17T23:59:42.803564+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T11:40:55.653472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":18482,"num_write":357,"num_write_kb":55072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"23'371","reported_seq":425,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:42.800374+0000","last_change":"2024-03-17T23:56:01.212568+0000","last_active":"2024-03-17T23:59:42.800374+0000","last_peered":"2024-03-17T23:59:42.800374+0000","last_clean":"2024-03-17T23:59:42.800374+0000","last_became_active":"2024-03-17T23:56:01.211561+0000","last_became_peered":"2024-03-17T23:56:01.211561+0000","last_unstale":"2024-03-17T23:59:42.800374+0000","last_undegraded":"2024-03-17T23:59:42.800374+0000","last_fullsized":"2024-03-17T23:59:42.800374+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":371,"log_dups_size":0,"ondisk_log_size":371,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T02:46:13.650384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":21281,"num_write":349,"num_write_kb":38541,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"23'389","reported_seq":432,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:42.785840+0000","last_change":"2024-03-17T23:56:01.186811+0000","last_active":"2024-03-17T23:59:42.785840+0000","last_peered":"2024-03-17T23:59:42.785840+0000","last_clean":"2024-03-17T23:59:42.785840+0000","last_became_active":"2024-03-17T23:56:01.186012+0000","last_became_peered":"2024-03-17T23:56:01.186012+0000","last_unstale":"2024-03-17T23:59:42.785840+0000","last_undegraded":"2024-03-17T23:59:42.785840+0000","last_fullsized":"2024-03-17T23:59:42.785840+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":389,"log_dups_size":0,"ondisk_log_size":389,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":10579,"num_write":363,"num_write_kb":91649,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"23'398","reported_seq":464,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:42.786478+0000","last_change":"2024-03-17T23:56:01.213648+0000","last_active":"2024-03-17T23:59:42.786478+0000","last_peered":"2024-03-17T23:59:42.786478+0000","last_clean":"2024-03-17T23:59:42.786478+0000","last_became_active":"2024-03-17T23:56:01.205058+0000","last_became_peered":"2024-03-17T23:56:01.205058+0000","last_unstale":"2024-03-17T23:59:42.786478+0000","last_undegraded":"2024-03-17T23:59:42.786478+0000","last_fullsized":"2024-03-17T23:59:42.786478+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":19128,"num_write":366,"num_write_kb":47322,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"23'424","reported_seq":495,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:42.780553+0000","last_change":"2024-03-17T23:56:01.196817+0000","last_active":"2024-03-17T23:59:42.780553+0000","last_peered":"2024-03-17T23:59:42.780553+0000","last_clean":"2024-03-17T23:59:42.780553+0000","last_became_active":"2024-03-17T23:56:01.195960+0000","last_became_peered":"2024-03-17T23:56:01.195960+0000","last_unstale":"2024-03-17T23:59:42.780553+0000","last_undegraded":"2024-03-17T23:59:42.780553+0000","last_fullsized":"2024-03-17T23:59:42.780553+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":28789,"num_write":400,"num_write_kb":133401,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"23'431","reported_seq":489,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:42.791993+0000","last_change":"2024-03-17T23:56:01.182140+0000","last_active":"2024-03-17T23:59:42.791993+0000","last_peered":"2024-03-17T23:59:42.791993+0000","last_clean":"2024-03-17T23:59:42.791993+0000","last_became_active":"2024-03-17T23:56:01.181405+0000","last_became_peered":"2024-03-17T23:56:01.181405+0000","last_unstale":"2024-03-17T23:59:42.791993+0000","last_undegraded":"2024-03-17T23:59:42.791993+0000","last_fullsized":"2024-03-17T23:59:42.791993+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":431,"log_dups_size":0,"ondisk_log_size":431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":18708,"num_write":399,"num_write_kb":108829,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"23'444","reported_seq":493,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:42.797740+0000","last_change":"2024-03-17T23:56:01.194871+0000","last_active":"2024-03-17T23:59:42.797740+0000","last_peered":"2024-03-17T23:59:42.797740+0000","last_clean":"2024-03-17T23:59:42.797740+0000","last_became_active":"2024-03-17T23:56:01.193384+0000","last_became_peered":"2024-03-17T23:56:01.193384+0000","last_unstale":"2024-03-17T23:59:42.797740+0000","last_undegraded":"2024-03-17T23:59:42.797740+0000","last_fullsized":"2024-03-17T23:59:42.797740+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":444,"log_dups_size":0,"ondisk_log_size":444,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":15377,"num_write":410,"num_write_kb":59358,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"23'402","reported_seq":443,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:42.794547+0000","last_change":"2024-03-17T23:56:49.201529+0000","last_active":"2024-03-17T23:59:42.794547+0000","last_peered":"2024-03-17T23:59:42.794547+0000","last_clean":"2024-03-17T23:59:42.794547+0000","last_became_active":"2024-03-17T23:56:49.201243+0000","last_became_peered":"2024-03-17T23:56:49.201243+0000","last_unstale":"2024-03-17T23:59:42.794547+0000","last_undegraded":"2024-03-17T23:59:42.794547+0000","last_fullsized":"2024-03-17T23:59:42.794547+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":17500,"num_write":362,"num_write_kb":30628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"23'423","reported_seq":525,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:42.792940+0000","last_change":"2024-03-17T23:56:01.186830+0000","last_active":"2024-03-17T23:59:42.792940+0000","last_peered":"2024-03-17T23:59:42.792940+0000","last_clean":"2024-03-17T23:59:42.792940+0000","last_became_active":"2024-03-17T23:56:01.186001+0000","last_became_peered":"2024-03-17T23:56:01.186001+0000","last_unstale":"2024-03-17T23:59:42.792940+0000","last_undegraded":"2024-03-17T23:59:42.792940+0000","last_fullsized":"2024-03-17T23:59:42.792940+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":84,"num_read_kb":38931,"num_write":386,"num_write_kb":103946,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"23'421","reported_seq":493,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:42.782611+0000","last_change":"2024-03-17T23:56:01.195354+0000","last_active":"2024-03-17T23:59:42.782611+0000","last_peered":"2024-03-17T23:59:42.782611+0000","last_clean":"2024-03-17T23:59:42.782611+0000","last_became_active":"2024-03-17T23:56:01.194579+0000","last_became_peered":"2024-03-17T23:56:01.194579+0000","last_unstale":"2024-03-17T23:59:42.782611+0000","last_undegraded":"2024-03-17T23:59:42.782611+0000","last_fullsized":"2024-03-17T23:59:42.782611+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T07:53:44.598091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":55,"num_read_kb":28885,"num_write":381,"num_write_kb":71633,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"23'457","reported_seq":552,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:42.792052+0000","last_change":"2024-03-17T23:56:01.193429+0000","last_active":"2024-03-17T23:59:42.792052+0000","last_peered":"2024-03-17T23:59:42.792052+0000","last_clean":"2024-03-17T23:59:42.792052+0000","last_became_active":"2024-03-17T23:56:01.192711+0000","last_became_peered":"2024-03-17T23:56:01.192711+0000","last_unstale":"2024-03-17T23:59:42.792052+0000","last_undegraded":"2024-03-17T23:59:42.792052+0000","last_fullsized":"2024-03-17T23:59:42.792052+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":457,"log_dups_size":0,"ondisk_log_size":457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T08:24:06.922044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":48668,"num_write":427,"num_write_kb":117132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"23'407","reported_seq":461,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:42.798661+0000","last_change":"2024-03-17T23:56:01.203203+0000","last_active":"2024-03-17T23:59:42.798661+0000","last_peered":"2024-03-17T23:59:42.798661+0000","last_clean":"2024-03-17T23:59:42.798661+0000","last_became_active":"2024-03-17T23:56:01.202491+0000","last_became_peered":"2024-03-17T23:56:01.202491+0000","last_unstale":"2024-03-17T23:59:42.798661+0000","last_undegraded":"2024-03-17T23:59:42.798661+0000","last_fullsized":"2024-03-17T23:59:42.798661+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":19175,"num_write":379,"num_write_kb":50742,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"23'423","reported_seq":480,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:42.783200+0000","last_change":"2024-03-17T23:56:49.199752+0000","last_active":"2024-03-17T23:59:42.783200+0000","last_peered":"2024-03-17T23:59:42.783200+0000","last_clean":"2024-03-17T23:59:42.783200+0000","last_became_active":"2024-03-17T23:56:49.199410+0000","last_became_peered":"2024-03-17T23:56:49.199410+0000","last_unstale":"2024-03-17T23:59:42.783200+0000","last_undegraded":"2024-03-17T23:59:42.783200+0000","last_fullsized":"2024-03-17T23:59:42.783200+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":41103,"num_write":390,"num_write_kb":67292,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.29","version":"23'406","reported_seq":464,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:42.790352+0000","last_change":"2024-03-17T23:56:01.213157+0000","last_active":"2024-03-17T23:59:42.790352+0000","last_peered":"2024-03-17T23:59:42.790352+0000","last_clean":"2024-03-17T23:59:42.790352+0000","last_became_active":"2024-03-17T23:56:01.205601+0000","last_became_peered":"2024-03-17T23:56:01.205601+0000","last_unstale":"2024-03-17T23:59:42.790352+0000","last_undegraded":"2024-03-17T23:59:42.790352+0000","last_fullsized":"2024-03-17T23:59:42.790352+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":19558,"num_write":374,"num_write_kb":63755,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"23'448","reported_seq":536,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:42.794470+0000","last_change":"2024-03-17T23:56:01.194995+0000","last_active":"2024-03-17T23:59:42.794470+0000","last_peered":"2024-03-17T23:59:42.794470+0000","last_clean":"2024-03-17T23:59:42.794470+0000","last_became_active":"2024-03-17T23:56:01.194290+0000","last_became_peered":"2024-03-17T23:56:01.194290+0000","last_unstale":"2024-03-17T23:59:42.794470+0000","last_undegraded":"2024-03-17T23:59:42.794470+0000","last_fullsized":"2024-03-17T23:59:42.794470+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":70,"num_read_kb":26782,"num_write":421,"num_write_kb":88405,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"23'403","reported_seq":457,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:42.782837+0000","last_change":"2024-03-17T23:56:01.205233+0000","last_active":"2024-03-17T23:59:42.782837+0000","last_peered":"2024-03-17T23:59:42.782837+0000","last_clean":"2024-03-17T23:59:42.782837+0000","last_became_active":"2024-03-17T23:56:01.204456+0000","last_became_peered":"2024-03-17T23:56:01.204456+0000","last_unstale":"2024-03-17T23:59:42.782837+0000","last_undegraded":"2024-03-17T23:59:42.782837+0000","last_fullsized":"2024-03-17T23:59:42.782837+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":403,"log_dups_size":0,"ondisk_log_size":403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":21212,"num_write":389,"num_write_kb":62665,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"23'456","reported_seq":517,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:42.800573+0000","last_change":"2024-03-17T23:56:01.210984+0000","last_active":"2024-03-17T23:59:42.800573+0000","last_peered":"2024-03-17T23:59:42.800573+0000","last_clean":"2024-03-17T23:59:42.800573+0000","last_became_active":"2024-03-17T23:56:01.210025+0000","last_became_peered":"2024-03-17T23:56:01.210025+0000","last_unstale":"2024-03-17T23:59:42.800573+0000","last_undegraded":"2024-03-17T23:59:42.800573+0000","last_fullsized":"2024-03-17T23:59:42.800573+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":456,"log_dups_size":0,"ondisk_log_size":456,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T00:26:55.287891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":24179,"num_write":417,"num_write_kb":68058,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"23'406","reported_seq":489,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:42.757399+0000","last_change":"2024-03-17T23:56:01.205461+0000","last_active":"2024-03-17T23:59:42.757399+0000","last_peered":"2024-03-17T23:59:42.757399+0000","last_clean":"2024-03-17T23:59:42.757399+0000","last_became_active":"2024-03-17T23:56:01.204676+0000","last_became_peered":"2024-03-17T23:56:01.204676+0000","last_unstale":"2024-03-17T23:59:42.757399+0000","last_undegraded":"2024-03-17T23:59:42.757399+0000","last_fullsized":"2024-03-17T23:59:42.757399+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":32120,"num_write":380,"num_write_kb":55330,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"23'390","reported_seq":471,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:42.784949+0000","last_change":"2024-03-17T23:56:01.205530+0000","last_active":"2024-03-17T23:59:42.784949+0000","last_peered":"2024-03-17T23:59:42.784949+0000","last_clean":"2024-03-17T23:59:42.784949+0000","last_became_active":"2024-03-17T23:56:01.204637+0000","last_became_peered":"2024-03-17T23:56:01.204637+0000","last_unstale":"2024-03-17T23:59:42.784949+0000","last_undegraded":"2024-03-17T23:59:42.784949+0000","last_fullsized":"2024-03-17T23:59:42.784949+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":33745,"num_write":363,"num_write_kb":72094,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"23'405","reported_seq":484,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:42.789290+0000","last_change":"2024-03-17T23:56:01.207143+0000","last_active":"2024-03-17T23:59:42.789290+0000","last_peered":"2024-03-17T23:59:42.789290+0000","last_clean":"2024-03-17T23:59:42.789290+0000","last_became_active":"2024-03-17T23:56:01.206466+0000","last_became_peered":"2024-03-17T23:56:01.206466+0000","last_unstale":"2024-03-17T23:59:42.789290+0000","last_undegraded":"2024-03-17T23:59:42.789290+0000","last_fullsized":"2024-03-17T23:59:42.789290+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":31525,"num_write":373,"num_write_kb":67528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"23'457","reported_seq":520,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:42.793333+0000","last_change":"2024-03-17T23:56:01.205414+0000","last_active":"2024-03-17T23:59:42.793333+0000","last_peered":"2024-03-17T23:59:42.793333+0000","last_clean":"2024-03-17T23:59:42.793333+0000","last_became_active":"2024-03-17T23:56:01.204418+0000","last_became_peered":"2024-03-17T23:56:01.204418+0000","last_unstale":"2024-03-17T23:59:42.793333+0000","last_undegraded":"2024-03-17T23:59:42.793333+0000","last_fullsized":"2024-03-17T23:59:42.793333+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":457,"log_dups_size":0,"ondisk_log_size":457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":20620,"num_write":418,"num_write_kb":58690,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"23'455","reported_seq":529,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:42.798311+0000","last_change":"2024-03-17T23:56:01.213242+0000","last_active":"2024-03-17T23:59:42.798311+0000","last_peered":"2024-03-17T23:59:42.798311+0000","last_clean":"2024-03-17T23:59:42.798311+0000","last_became_active":"2024-03-17T23:56:01.212456+0000","last_became_peered":"2024-03-17T23:56:01.212456+0000","last_unstale":"2024-03-17T23:59:42.798311+0000","last_undegraded":"2024-03-17T23:59:42.798311+0000","last_fullsized":"2024-03-17T23:59:42.798311+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":455,"log_dups_size":0,"ondisk_log_size":455,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":21571,"num_write":428,"num_write_kb":105002,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"23'449","reported_seq":511,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:42.788396+0000","last_change":"2024-03-17T23:56:01.197502+0000","last_active":"2024-03-17T23:59:42.788396+0000","last_peered":"2024-03-17T23:59:42.788396+0000","last_clean":"2024-03-17T23:59:42.788396+0000","last_became_active":"2024-03-17T23:56:01.196672+0000","last_became_peered":"2024-03-17T23:56:01.196672+0000","last_unstale":"2024-03-17T23:59:42.788396+0000","last_undegraded":"2024-03-17T23:59:42.788396+0000","last_fullsized":"2024-03-17T23:59:42.788396+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":449,"log_dups_size":0,"ondisk_log_size":449,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T05:26:03.654839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":29527,"num_write":419,"num_write_kb":89588,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"23'417","reported_seq":481,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:42.782334+0000","last_change":"2024-03-17T23:56:01.169196+0000","last_active":"2024-03-17T23:59:42.782334+0000","last_peered":"2024-03-17T23:59:42.782334+0000","last_clean":"2024-03-17T23:59:42.782334+0000","last_became_active":"2024-03-17T23:56:01.168199+0000","last_became_peered":"2024-03-17T23:56:01.168199+0000","last_unstale":"2024-03-17T23:59:42.782334+0000","last_undegraded":"2024-03-17T23:59:42.782334+0000","last_fullsized":"2024-03-17T23:59:42.782334+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":34411,"num_write":387,"num_write_kb":91588,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"23'78","reported_seq":106,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:54.199480+0000","last_change":"2024-03-17T23:59:54.199523+0000","last_active":"2024-03-17T23:59:54.199480+0000","last_peered":"2024-03-17T23:59:54.199480+0000","last_clean":"2024-03-17T23:59:54.199480+0000","last_became_active":"2024-03-17T23:56:00.674772+0000","last_became_peered":"2024-03-17T23:56:00.674772+0000","last_unstale":"2024-03-17T23:59:54.199480+0000","last_undegraded":"2024-03-17T23:59:54.199480+0000","last_fullsized":"2024-03-17T23:59:54.199480+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'78","last_scrub_stamp":"2024-03-17T23:59:54.199388+0000","last_deep_scrub":"23'78","last_deep_scrub_stamp":"2024-03-17T23:59:54.199388+0000","last_clean_scrub_stamp":"2024-03-17T23:59:54.199388+0000","objects_scrubbed":3,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T09:59:35.071392+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4195508,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33,"num_write_kb":4113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"23'387","reported_seq":429,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:42.792953+0000","last_change":"2024-03-17T23:56:01.199837+0000","last_active":"2024-03-17T23:59:42.792953+0000","last_peered":"2024-03-17T23:59:42.792953+0000","last_clean":"2024-03-17T23:59:42.792953+0000","last_became_active":"2024-03-17T23:56:01.199084+0000","last_became_peered":"2024-03-17T23:56:01.199084+0000","last_unstale":"2024-03-17T23:59:42.792953+0000","last_undegraded":"2024-03-17T23:59:42.792953+0000","last_fullsized":"2024-03-17T23:59:42.792953+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":387,"log_dups_size":0,"ondisk_log_size":387,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":13388,"num_write":363,"num_write_kb":66558,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"23'376","reported_seq":395,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:38.393706+0000","last_change":"2024-03-17T23:56:00.683252+0000","last_active":"2024-03-17T23:59:38.393706+0000","last_peered":"2024-03-17T23:59:38.393706+0000","last_clean":"2024-03-17T23:59:38.393706+0000","last_became_active":"2024-03-17T23:56:00.682487+0000","last_became_peered":"2024-03-17T23:56:00.682487+0000","last_unstale":"2024-03-17T23:59:38.393706+0000","last_undegraded":"2024-03-17T23:59:38.393706+0000","last_fullsized":"2024-03-17T23:59:38.393706+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_clean_scrub_stamp":"2024-03-17T23:55:59.626739+0000","objects_scrubbed":0,"log_size":376,"log_dups_size":0,"ondisk_log_size":376,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T04:07:26.256885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":319,"num_write_kb":12441,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"23'246","reported_seq":266,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:40.380794+0000","last_change":"2024-03-17T23:56:00.688353+0000","last_active":"2024-03-17T23:59:40.380794+0000","last_peered":"2024-03-17T23:59:40.380794+0000","last_clean":"2024-03-17T23:59:40.380794+0000","last_became_active":"2024-03-17T23:56:00.688016+0000","last_became_peered":"2024-03-17T23:56:00.688016+0000","last_unstale":"2024-03-17T23:59:40.380794+0000","last_undegraded":"2024-03-17T23:59:40.380794+0000","last_fullsized":"2024-03-17T23:59:40.380794+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_clean_scrub_stamp":"2024-03-17T23:55:59.626739+0000","objects_scrubbed":0,"log_size":246,"log_dups_size":0,"ondisk_log_size":246,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":201,"num_write_kb":4204,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"23'436","reported_seq":489,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:42.768838+0000","last_change":"2024-03-17T23:56:01.211541+0000","last_active":"2024-03-17T23:59:42.768838+0000","last_peered":"2024-03-17T23:59:42.768838+0000","last_clean":"2024-03-17T23:59:42.768838+0000","last_became_active":"2024-03-17T23:56:01.205709+0000","last_became_peered":"2024-03-17T23:56:01.205709+0000","last_unstale":"2024-03-17T23:59:42.768838+0000","last_undegraded":"2024-03-17T23:59:42.768838+0000","last_fullsized":"2024-03-17T23:59:42.768838+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":436,"log_dups_size":0,"ondisk_log_size":436,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":21447,"num_write":401,"num_write_kb":58853,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"23'777","reported_seq":797,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:40.425493+0000","last_change":"2024-03-17T23:56:00.690234+0000","last_active":"2024-03-17T23:59:40.425493+0000","last_peered":"2024-03-17T23:59:40.425493+0000","last_clean":"2024-03-17T23:59:40.425493+0000","last_became_active":"2024-03-17T23:56:00.689202+0000","last_became_peered":"2024-03-17T23:56:00.689202+0000","last_unstale":"2024-03-17T23:59:40.425493+0000","last_undegraded":"2024-03-17T23:59:40.425493+0000","last_fullsized":"2024-03-17T23:59:40.425493+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_clean_scrub_stamp":"2024-03-17T23:55:59.626739+0000","objects_scrubbed":0,"log_size":777,"log_dups_size":0,"ondisk_log_size":777,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389190,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":707,"num_write_kb":8542,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"23'416","reported_seq":459,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:42.765274+0000","last_change":"2024-03-17T23:56:49.077939+0000","last_active":"2024-03-17T23:59:42.765274+0000","last_peered":"2024-03-17T23:59:42.765274+0000","last_clean":"2024-03-17T23:59:42.765274+0000","last_became_active":"2024-03-17T23:56:49.077645+0000","last_became_peered":"2024-03-17T23:56:49.077645+0000","last_unstale":"2024-03-17T23:59:42.765274+0000","last_undegraded":"2024-03-17T23:59:42.765274+0000","last_fullsized":"2024-03-17T23:59:42.765274+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":416,"log_dups_size":0,"ondisk_log_size":416,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":16384,"num_write":381,"num_write_kb":66829,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"23'56","reported_seq":75,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:42.707701+0000","last_change":"2024-03-17T23:56:00.696649+0000","last_active":"2024-03-17T23:59:42.707701+0000","last_peered":"2024-03-17T23:59:42.707701+0000","last_clean":"2024-03-17T23:59:42.707701+0000","last_became_active":"2024-03-17T23:56:00.696307+0000","last_became_peered":"2024-03-17T23:56:00.696307+0000","last_unstale":"2024-03-17T23:59:42.707701+0000","last_undegraded":"2024-03-17T23:59:42.707701+0000","last_fullsized":"2024-03-17T23:59:42.707701+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_clean_scrub_stamp":"2024-03-17T23:55:59.626739+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T07:28:27.310340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"23'399","reported_seq":427,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:42.798653+0000","last_change":"2024-03-17T23:56:01.194103+0000","last_active":"2024-03-17T23:59:42.798653+0000","last_peered":"2024-03-17T23:59:42.798653+0000","last_clean":"2024-03-17T23:59:42.798653+0000","last_became_active":"2024-03-17T23:56:01.193354+0000","last_became_peered":"2024-03-17T23:56:01.193354+0000","last_unstale":"2024-03-17T23:59:42.798653+0000","last_undegraded":"2024-03-17T23:59:42.798653+0000","last_fullsized":"2024-03-17T23:59:42.798653+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":5056,"num_write":368,"num_write_kb":26036,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"23'216","reported_seq":236,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:40.489648+0000","last_change":"2024-03-17T23:56:00.689876+0000","last_active":"2024-03-17T23:59:40.489648+0000","last_peered":"2024-03-17T23:59:40.489648+0000","last_clean":"2024-03-17T23:59:40.489648+0000","last_became_active":"2024-03-17T23:56:00.688667+0000","last_became_peered":"2024-03-17T23:56:00.688667+0000","last_unstale":"2024-03-17T23:59:40.489648+0000","last_undegraded":"2024-03-17T23:59:40.489648+0000","last_fullsized":"2024-03-17T23:59:40.489648+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_clean_scrub_stamp":"2024-03-17T23:55:59.626739+0000","objects_scrubbed":0,"log_size":216,"log_dups_size":0,"ondisk_log_size":216,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":150,"num_write_kb":4172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"23'399","reported_seq":432,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:42.776022+0000","last_change":"2024-03-17T23:56:49.085328+0000","last_active":"2024-03-17T23:59:42.776022+0000","last_peered":"2024-03-17T23:59:42.776022+0000","last_clean":"2024-03-17T23:59:42.776022+0000","last_became_active":"2024-03-17T23:56:49.085029+0000","last_became_peered":"2024-03-17T23:56:49.085029+0000","last_unstale":"2024-03-17T23:59:42.776022+0000","last_undegraded":"2024-03-17T23:59:42.776022+0000","last_fullsized":"2024-03-17T23:59:42.776022+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":4310,"num_write":367,"num_write_kb":43629,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"23'142","reported_seq":170,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:54.759261+0000","last_change":"2024-03-17T23:59:54.759287+0000","last_active":"2024-03-17T23:59:54.759261+0000","last_peered":"2024-03-17T23:59:54.759261+0000","last_clean":"2024-03-17T23:59:54.759261+0000","last_became_active":"2024-03-17T23:56:00.677165+0000","last_became_peered":"2024-03-17T23:56:00.677165+0000","last_unstale":"2024-03-17T23:59:54.759261+0000","last_undegraded":"2024-03-17T23:59:54.759261+0000","last_fullsized":"2024-03-17T23:59:54.759261+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'142","last_scrub_stamp":"2024-03-17T23:59:54.759204+0000","last_deep_scrub":"23'142","last_deep_scrub_stamp":"2024-03-17T23:59:54.759204+0000","last_clean_scrub_stamp":"2024-03-17T23:59:54.759204+0000","objects_scrubbed":4,"log_size":142,"log_dups_size":0,"ondisk_log_size":142,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T02:27:37.482369+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":91,"num_write_kb":92,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"23'391","reported_seq":453,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:42.786392+0000","last_change":"2024-03-17T23:56:01.190913+0000","last_active":"2024-03-17T23:59:42.786392+0000","last_peered":"2024-03-17T23:59:42.786392+0000","last_clean":"2024-03-17T23:59:42.786392+0000","last_became_active":"2024-03-17T23:56:01.190191+0000","last_became_peered":"2024-03-17T23:56:01.190191+0000","last_unstale":"2024-03-17T23:59:42.786392+0000","last_undegraded":"2024-03-17T23:59:42.786392+0000","last_fullsized":"2024-03-17T23:59:42.786392+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":22035,"num_write":358,"num_write_kb":71462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"23'261","reported_seq":280,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:42.708202+0000","last_change":"2024-03-17T23:56:00.686597+0000","last_active":"2024-03-17T23:59:42.708202+0000","last_peered":"2024-03-17T23:59:42.708202+0000","last_clean":"2024-03-17T23:59:42.708202+0000","last_became_active":"2024-03-17T23:56:00.685757+0000","last_became_peered":"2024-03-17T23:56:00.685757+0000","last_unstale":"2024-03-17T23:59:42.708202+0000","last_undegraded":"2024-03-17T23:59:42.708202+0000","last_fullsized":"2024-03-17T23:59:42.708202+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_clean_scrub_stamp":"2024-03-17T23:55:59.626739+0000","objects_scrubbed":0,"log_size":261,"log_dups_size":0,"ondisk_log_size":261,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T10:35:19.139554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11902300,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":217,"num_write_kb":11743,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"23'404","reported_seq":469,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:42.794840+0000","last_change":"2024-03-17T23:56:01.216238+0000","last_active":"2024-03-17T23:59:42.794840+0000","last_peered":"2024-03-17T23:59:42.794840+0000","last_clean":"2024-03-17T23:59:42.794840+0000","last_became_active":"2024-03-17T23:56:01.215526+0000","last_became_peered":"2024-03-17T23:56:01.215526+0000","last_unstale":"2024-03-17T23:59:42.794840+0000","last_undegraded":"2024-03-17T23:59:42.794840+0000","last_fullsized":"2024-03-17T23:59:42.794840+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T03:18:40.457769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":29805,"num_write":370,"num_write_kb":75602,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"23'551","reported_seq":579,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:53.581285+0000","last_change":"2024-03-17T23:59:53.581345+0000","last_active":"2024-03-17T23:59:53.581285+0000","last_peered":"2024-03-17T23:59:53.581285+0000","last_clean":"2024-03-17T23:59:53.581285+0000","last_became_active":"2024-03-17T23:56:00.682392+0000","last_became_peered":"2024-03-17T23:56:00.682392+0000","last_unstale":"2024-03-17T23:59:53.581285+0000","last_undegraded":"2024-03-17T23:59:53.581285+0000","last_fullsized":"2024-03-17T23:59:53.581285+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'551","last_scrub_stamp":"2024-03-17T23:59:53.581203+0000","last_deep_scrub":"23'551","last_deep_scrub_stamp":"2024-03-17T23:59:53.581203+0000","last_clean_scrub_stamp":"2024-03-17T23:59:53.581203+0000","objects_scrubbed":8,"log_size":551,"log_dups_size":0,"ondisk_log_size":551,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T09:59:34.453208+0000","scrub_duration":35,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388676,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":488,"num_write_kb":8403,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"23'418","reported_seq":481,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:42.796274+0000","last_change":"2024-03-17T23:56:01.218114+0000","last_active":"2024-03-17T23:59:42.796274+0000","last_peered":"2024-03-17T23:59:42.796274+0000","last_clean":"2024-03-17T23:59:42.796274+0000","last_became_active":"2024-03-17T23:56:01.217434+0000","last_became_peered":"2024-03-17T23:56:01.217434+0000","last_unstale":"2024-03-17T23:59:42.796274+0000","last_undegraded":"2024-03-17T23:59:42.796274+0000","last_fullsized":"2024-03-17T23:59:42.796274+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":24728,"num_write":388,"num_write_kb":63632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"23'69","reported_seq":89,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:40.461521+0000","last_change":"2024-03-17T23:56:00.696766+0000","last_active":"2024-03-17T23:59:40.461521+0000","last_peered":"2024-03-17T23:59:40.461521+0000","last_clean":"2024-03-17T23:59:40.461521+0000","last_became_active":"2024-03-17T23:56:00.695592+0000","last_became_peered":"2024-03-17T23:56:00.695592+0000","last_unstale":"2024-03-17T23:59:40.461521+0000","last_undegraded":"2024-03-17T23:59:40.461521+0000","last_fullsized":"2024-03-17T23:59:40.461521+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_clean_scrub_stamp":"2024-03-17T23:55:59.626739+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"23'401","reported_seq":467,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:42.795485+0000","last_change":"2024-03-17T23:56:01.208385+0000","last_active":"2024-03-17T23:59:42.795485+0000","last_peered":"2024-03-17T23:59:42.795485+0000","last_clean":"2024-03-17T23:59:42.795485+0000","last_became_active":"2024-03-17T23:56:01.207791+0000","last_became_peered":"2024-03-17T23:56:01.207791+0000","last_unstale":"2024-03-17T23:59:42.795485+0000","last_undegraded":"2024-03-17T23:59:42.795485+0000","last_fullsized":"2024-03-17T23:59:42.795485+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T11:08:21.695552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":27500,"num_write":363,"num_write_kb":68441,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"23'70","reported_seq":89,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:39.432969+0000","last_change":"2024-03-17T23:56:00.686159+0000","last_active":"2024-03-17T23:59:39.432969+0000","last_peered":"2024-03-17T23:59:39.432969+0000","last_clean":"2024-03-17T23:59:39.432969+0000","last_became_active":"2024-03-17T23:56:00.685354+0000","last_became_peered":"2024-03-17T23:56:00.685354+0000","last_unstale":"2024-03-17T23:59:39.432969+0000","last_undegraded":"2024-03-17T23:59:39.432969+0000","last_fullsized":"2024-03-17T23:59:39.432969+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_clean_scrub_stamp":"2024-03-17T23:55:59.626739+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T09:45:24.650866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"23'449","reported_seq":503,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:42.784590+0000","last_change":"2024-03-17T23:56:01.197137+0000","last_active":"2024-03-17T23:59:42.784590+0000","last_peered":"2024-03-17T23:59:42.784590+0000","last_clean":"2024-03-17T23:59:42.784590+0000","last_became_active":"2024-03-17T23:56:01.196356+0000","last_became_peered":"2024-03-17T23:56:01.196356+0000","last_unstale":"2024-03-17T23:59:42.784590+0000","last_undegraded":"2024-03-17T23:59:42.784590+0000","last_fullsized":"2024-03-17T23:59:42.784590+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":449,"log_dups_size":0,"ondisk_log_size":449,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T11:35:21.037222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":24107,"num_write":423,"num_write_kb":92187,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"23'76","reported_seq":96,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:42.382102+0000","last_change":"2024-03-17T23:56:00.682828+0000","last_active":"2024-03-17T23:59:42.382102+0000","last_peered":"2024-03-17T23:59:42.382102+0000","last_clean":"2024-03-17T23:59:42.382102+0000","last_became_active":"2024-03-17T23:56:00.682469+0000","last_became_peered":"2024-03-17T23:56:00.682469+0000","last_unstale":"2024-03-17T23:59:42.382102+0000","last_undegraded":"2024-03-17T23:59:42.382102+0000","last_fullsized":"2024-03-17T23:59:42.382102+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_clean_scrub_stamp":"2024-03-17T23:55:59.626739+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"23'486","reported_seq":562,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:42.795657+0000","last_change":"2024-03-17T23:56:01.209356+0000","last_active":"2024-03-17T23:59:42.795657+0000","last_peered":"2024-03-17T23:59:42.795657+0000","last_clean":"2024-03-17T23:59:42.795657+0000","last_became_active":"2024-03-17T23:56:01.208381+0000","last_became_peered":"2024-03-17T23:56:01.208381+0000","last_unstale":"2024-03-17T23:59:42.795657+0000","last_undegraded":"2024-03-17T23:59:42.795657+0000","last_fullsized":"2024-03-17T23:59:42.795657+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":486,"log_dups_size":0,"ondisk_log_size":486,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T03:01:01.120023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":26966,"num_write":455,"num_write_kb":93532,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"23'177","reported_seq":197,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:40.503309+0000","last_change":"2024-03-17T23:56:00.683595+0000","last_active":"2024-03-17T23:59:40.503309+0000","last_peered":"2024-03-17T23:59:40.503309+0000","last_clean":"2024-03-17T23:59:40.503309+0000","last_became_active":"2024-03-17T23:56:00.681338+0000","last_became_peered":"2024-03-17T23:56:00.681338+0000","last_unstale":"2024-03-17T23:59:40.503309+0000","last_undegraded":"2024-03-17T23:59:40.503309+0000","last_fullsized":"2024-03-17T23:59:40.503309+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_clean_scrub_stamp":"2024-03-17T23:55:59.626739+0000","objects_scrubbed":0,"log_size":177,"log_dups_size":0,"ondisk_log_size":177,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":124,"num_write_kb":4160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"23'378","reported_seq":419,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:42.786885+0000","last_change":"2024-03-17T23:56:01.212669+0000","last_active":"2024-03-17T23:59:42.786885+0000","last_peered":"2024-03-17T23:59:42.786885+0000","last_clean":"2024-03-17T23:59:42.786885+0000","last_became_active":"2024-03-17T23:56:01.206691+0000","last_became_peered":"2024-03-17T23:56:01.206691+0000","last_unstale":"2024-03-17T23:59:42.786885+0000","last_undegraded":"2024-03-17T23:59:42.786885+0000","last_fullsized":"2024-03-17T23:59:42.786885+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":378,"log_dups_size":0,"ondisk_log_size":378,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T03:59:56.032635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":10737,"num_write":348,"num_write_kb":63025,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"23'326","reported_seq":346,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:39.401645+0000","last_change":"2024-03-17T23:56:00.690801+0000","last_active":"2024-03-17T23:59:39.401645+0000","last_peered":"2024-03-17T23:59:39.401645+0000","last_clean":"2024-03-17T23:59:39.401645+0000","last_became_active":"2024-03-17T23:56:00.690516+0000","last_became_peered":"2024-03-17T23:56:00.690516+0000","last_unstale":"2024-03-17T23:59:39.401645+0000","last_undegraded":"2024-03-17T23:59:39.401645+0000","last_fullsized":"2024-03-17T23:59:39.401645+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_clean_scrub_stamp":"2024-03-17T23:55:59.626739+0000","objects_scrubbed":0,"log_size":326,"log_dups_size":0,"ondisk_log_size":326,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":276,"num_write_kb":4244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"23'384","reported_seq":452,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:42.803873+0000","last_change":"2024-03-17T23:56:01.213733+0000","last_active":"2024-03-17T23:59:42.803873+0000","last_peered":"2024-03-17T23:59:42.803873+0000","last_clean":"2024-03-17T23:59:42.803873+0000","last_became_active":"2024-03-17T23:56:01.213095+0000","last_became_peered":"2024-03-17T23:56:01.213095+0000","last_unstale":"2024-03-17T23:59:42.803873+0000","last_undegraded":"2024-03-17T23:59:42.803873+0000","last_fullsized":"2024-03-17T23:59:42.803873+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T08:57:40.944494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":39304,"num_write":347,"num_write_kb":50502,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"23'574","reported_seq":602,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:53.751204+0000","last_change":"2024-03-17T23:59:53.751249+0000","last_active":"2024-03-17T23:59:53.751204+0000","last_peered":"2024-03-17T23:59:53.751204+0000","last_clean":"2024-03-17T23:59:53.751204+0000","last_became_active":"2024-03-17T23:56:00.671655+0000","last_became_peered":"2024-03-17T23:56:00.671655+0000","last_unstale":"2024-03-17T23:59:53.751204+0000","last_undegraded":"2024-03-17T23:59:53.751204+0000","last_fullsized":"2024-03-17T23:59:53.751204+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'574","last_scrub_stamp":"2024-03-17T23:59:53.751108+0000","last_deep_scrub":"23'574","last_deep_scrub_stamp":"2024-03-17T23:59:53.751108+0000","last_clean_scrub_stamp":"2024-03-17T23:59:53.751108+0000","objects_scrubbed":2,"log_size":574,"log_dups_size":0,"ondisk_log_size":574,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T09:59:34.623112+0000","scrub_duration":31,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":517,"num_write_kb":4347,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"23'451","reported_seq":498,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:42.797326+0000","last_change":"2024-03-17T23:56:01.204789+0000","last_active":"2024-03-17T23:59:42.797326+0000","last_peered":"2024-03-17T23:59:42.797326+0000","last_clean":"2024-03-17T23:59:42.797326+0000","last_became_active":"2024-03-17T23:56:01.196002+0000","last_became_peered":"2024-03-17T23:56:01.196002+0000","last_unstale":"2024-03-17T23:59:42.797326+0000","last_undegraded":"2024-03-17T23:59:42.797326+0000","last_fullsized":"2024-03-17T23:59:42.797326+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":451,"log_dups_size":0,"ondisk_log_size":451,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":21931,"num_write":417,"num_write_kb":63333,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"23'72","reported_seq":100,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:54.139546+0000","last_change":"2024-03-17T23:59:54.139573+0000","last_active":"2024-03-17T23:59:54.139546+0000","last_peered":"2024-03-17T23:59:54.139546+0000","last_clean":"2024-03-17T23:59:54.139546+0000","last_became_active":"2024-03-17T23:56:00.677831+0000","last_became_peered":"2024-03-17T23:56:00.677831+0000","last_unstale":"2024-03-17T23:59:54.139546+0000","last_undegraded":"2024-03-17T23:59:54.139546+0000","last_fullsized":"2024-03-17T23:59:54.139546+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'72","last_scrub_stamp":"2024-03-17T23:59:54.139486+0000","last_deep_scrub":"23'72","last_deep_scrub_stamp":"2024-03-17T23:59:54.139486+0000","last_clean_scrub_stamp":"2024-03-17T23:59:54.139486+0000","objects_scrubbed":3,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T06:06:22.263462+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1752,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"23'407","reported_seq":466,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:42.800461+0000","last_change":"2024-03-17T23:56:01.214619+0000","last_active":"2024-03-17T23:59:42.800461+0000","last_peered":"2024-03-17T23:59:42.800461+0000","last_clean":"2024-03-17T23:59:42.800461+0000","last_became_active":"2024-03-17T23:56:01.213960+0000","last_became_peered":"2024-03-17T23:56:01.213960+0000","last_unstale":"2024-03-17T23:59:42.800461+0000","last_undegraded":"2024-03-17T23:59:42.800461+0000","last_fullsized":"2024-03-17T23:59:42.800461+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T11:01:47.143880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":22422,"num_write":380,"num_write_kb":66960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":175,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:56:49.197633+0000","last_change":"2024-03-17T23:55:58.106405+0000","last_active":"2024-03-17T23:56:49.197633+0000","last_peered":"2024-03-17T23:56:49.197633+0000","last_clean":"2024-03-17T23:56:49.197633+0000","last_became_active":"2024-03-17T23:55:58.104493+0000","last_became_peered":"2024-03-17T23:55:58.104493+0000","last_unstale":"2024-03-17T23:56:49.197633+0000","last_undegraded":"2024-03-17T23:56:49.197633+0000","last_fullsized":"2024-03-17T23:56:49.197633+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:55:56.609001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:55:56.609001+0000","last_clean_scrub_stamp":"2024-03-17T23:55:56.609001+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T08:58:52.707900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"23'82","reported_seq":102,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:40.469836+0000","last_change":"2024-03-17T23:56:00.678791+0000","last_active":"2024-03-17T23:59:40.469836+0000","last_peered":"2024-03-17T23:59:40.469836+0000","last_clean":"2024-03-17T23:59:40.469836+0000","last_became_active":"2024-03-17T23:56:00.677660+0000","last_became_peered":"2024-03-17T23:56:00.677660+0000","last_unstale":"2024-03-17T23:59:40.469836+0000","last_undegraded":"2024-03-17T23:59:40.469836+0000","last_fullsized":"2024-03-17T23:59:40.469836+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_clean_scrub_stamp":"2024-03-17T23:55:59.626739+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"23'360","reported_seq":397,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:42.798954+0000","last_change":"2024-03-17T23:56:01.213073+0000","last_active":"2024-03-17T23:59:42.798954+0000","last_peered":"2024-03-17T23:59:42.798954+0000","last_clean":"2024-03-17T23:59:42.798954+0000","last_became_active":"2024-03-17T23:56:01.212434+0000","last_became_peered":"2024-03-17T23:56:01.212434+0000","last_unstale":"2024-03-17T23:59:42.798954+0000","last_undegraded":"2024-03-17T23:59:42.798954+0000","last_fullsized":"2024-03-17T23:59:42.798954+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":360,"log_dups_size":0,"ondisk_log_size":360,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":8076,"num_write":326,"num_write_kb":42301,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"23'420","reported_seq":439,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:37.438690+0000","last_change":"2024-03-17T23:56:00.700634+0000","last_active":"2024-03-17T23:59:37.438690+0000","last_peered":"2024-03-17T23:59:37.438690+0000","last_clean":"2024-03-17T23:59:37.438690+0000","last_became_active":"2024-03-17T23:56:00.691617+0000","last_became_peered":"2024-03-17T23:56:00.691617+0000","last_unstale":"2024-03-17T23:59:37.438690+0000","last_undegraded":"2024-03-17T23:59:37.438690+0000","last_fullsized":"2024-03-17T23:59:37.438690+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_clean_scrub_stamp":"2024-03-17T23:55:59.626739+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T11:11:32.522234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":366,"num_write_kb":8360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"23'408","reported_seq":509,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:42.791002+0000","last_change":"2024-03-17T23:56:01.199855+0000","last_active":"2024-03-17T23:59:42.791002+0000","last_peered":"2024-03-17T23:59:42.791002+0000","last_clean":"2024-03-17T23:59:42.791002+0000","last_became_active":"2024-03-17T23:56:01.199121+0000","last_became_peered":"2024-03-17T23:56:01.199121+0000","last_unstale":"2024-03-17T23:59:42.791002+0000","last_undegraded":"2024-03-17T23:59:42.791002+0000","last_fullsized":"2024-03-17T23:59:42.791002+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":83,"num_read_kb":44834,"num_write":382,"num_write_kb":112569,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"23'288","reported_seq":518,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:42.705045+0000","last_change":"2024-03-17T23:56:00.686560+0000","last_active":"2024-03-17T23:59:42.705045+0000","last_peered":"2024-03-17T23:59:42.705045+0000","last_clean":"2024-03-17T23:59:42.705045+0000","last_became_active":"2024-03-17T23:56:00.686215+0000","last_became_peered":"2024-03-17T23:56:00.686215+0000","last_unstale":"2024-03-17T23:59:42.705045+0000","last_undegraded":"2024-03-17T23:59:42.705045+0000","last_fullsized":"2024-03-17T23:59:42.705045+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_clean_scrub_stamp":"2024-03-17T23:55:59.626739+0000","objects_scrubbed":0,"log_size":288,"log_dups_size":0,"ondisk_log_size":288,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1468046,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":210,"num_read_kb":1570,"num_write":217,"num_write_kb":1574,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"23'404","reported_seq":436,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:42.740225+0000","last_change":"2024-03-17T23:56:01.193197+0000","last_active":"2024-03-17T23:59:42.740225+0000","last_peered":"2024-03-17T23:59:42.740225+0000","last_clean":"2024-03-17T23:59:42.740225+0000","last_became_active":"2024-03-17T23:56:01.192117+0000","last_became_peered":"2024-03-17T23:56:01.192117+0000","last_unstale":"2024-03-17T23:59:42.740225+0000","last_undegraded":"2024-03-17T23:59:42.740225+0000","last_fullsized":"2024-03-17T23:59:42.740225+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":8404,"num_write":369,"num_write_kb":38222,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"23'564","reported_seq":584,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:37.410145+0000","last_change":"2024-03-17T23:56:00.696254+0000","last_active":"2024-03-17T23:59:37.410145+0000","last_peered":"2024-03-17T23:59:37.410145+0000","last_clean":"2024-03-17T23:59:37.410145+0000","last_became_active":"2024-03-17T23:56:00.694605+0000","last_became_peered":"2024-03-17T23:56:00.694605+0000","last_unstale":"2024-03-17T23:59:37.410145+0000","last_undegraded":"2024-03-17T23:59:37.410145+0000","last_fullsized":"2024-03-17T23:59:37.410145+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_clean_scrub_stamp":"2024-03-17T23:55:59.626739+0000","objects_scrubbed":0,"log_size":564,"log_dups_size":0,"ondisk_log_size":564,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389196,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":500,"num_write_kb":8435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"23'401","reported_seq":451,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:42.783026+0000","last_change":"2024-03-17T23:56:01.188278+0000","last_active":"2024-03-17T23:59:42.783026+0000","last_peered":"2024-03-17T23:59:42.783026+0000","last_clean":"2024-03-17T23:59:42.783026+0000","last_became_active":"2024-03-17T23:56:01.187571+0000","last_became_peered":"2024-03-17T23:56:01.187571+0000","last_unstale":"2024-03-17T23:59:42.783026+0000","last_undegraded":"2024-03-17T23:59:42.783026+0000","last_fullsized":"2024-03-17T23:59:42.783026+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":12494,"num_write":368,"num_write_kb":72170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"23'57","reported_seq":77,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:39.440196+0000","last_change":"2024-03-17T23:56:00.680290+0000","last_active":"2024-03-17T23:59:39.440196+0000","last_peered":"2024-03-17T23:59:39.440196+0000","last_clean":"2024-03-17T23:59:39.440196+0000","last_became_active":"2024-03-17T23:56:00.679981+0000","last_became_peered":"2024-03-17T23:56:00.679981+0000","last_unstale":"2024-03-17T23:59:39.440196+0000","last_undegraded":"2024-03-17T23:59:39.440196+0000","last_fullsized":"2024-03-17T23:59:39.440196+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_clean_scrub_stamp":"2024-03-17T23:55:59.626739+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"23'455","reported_seq":562,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:42.800482+0000","last_change":"2024-03-17T23:56:01.216640+0000","last_active":"2024-03-17T23:59:42.800482+0000","last_peered":"2024-03-17T23:59:42.800482+0000","last_clean":"2024-03-17T23:59:42.800482+0000","last_became_active":"2024-03-17T23:56:01.216145+0000","last_became_peered":"2024-03-17T23:56:01.216145+0000","last_unstale":"2024-03-17T23:59:42.800482+0000","last_undegraded":"2024-03-17T23:59:42.800482+0000","last_fullsized":"2024-03-17T23:59:42.800482+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":455,"log_dups_size":0,"ondisk_log_size":455,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":89,"num_read_kb":46763,"num_write":422,"num_write_kb":133395,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"23'223","reported_seq":242,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:39.393925+0000","last_change":"2024-03-17T23:56:00.692896+0000","last_active":"2024-03-17T23:59:39.393925+0000","last_peered":"2024-03-17T23:59:39.393925+0000","last_clean":"2024-03-17T23:59:39.393925+0000","last_became_active":"2024-03-17T23:56:00.692054+0000","last_became_peered":"2024-03-17T23:56:00.692054+0000","last_unstale":"2024-03-17T23:59:39.393925+0000","last_undegraded":"2024-03-17T23:59:39.393925+0000","last_fullsized":"2024-03-17T23:59:39.393925+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_clean_scrub_stamp":"2024-03-17T23:55:59.626739+0000","objects_scrubbed":0,"log_size":223,"log_dups_size":0,"ondisk_log_size":223,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T10:55:17.061099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194416,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":164,"num_write_kb":4176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"23'370","reported_seq":425,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:42.757737+0000","last_change":"2024-03-17T23:56:01.189102+0000","last_active":"2024-03-17T23:59:42.757737+0000","last_peered":"2024-03-17T23:59:42.757737+0000","last_clean":"2024-03-17T23:59:42.757737+0000","last_became_active":"2024-03-17T23:56:01.188353+0000","last_became_peered":"2024-03-17T23:56:01.188353+0000","last_unstale":"2024-03-17T23:59:42.757737+0000","last_undegraded":"2024-03-17T23:59:42.757737+0000","last_fullsized":"2024-03-17T23:59:42.757737+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":370,"log_dups_size":0,"ondisk_log_size":370,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":24684,"num_write":328,"num_write_kb":42609,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"23'207","reported_seq":227,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:41.794789+0000","last_change":"2024-03-17T23:56:00.689216+0000","last_active":"2024-03-17T23:59:41.794789+0000","last_peered":"2024-03-17T23:59:41.794789+0000","last_clean":"2024-03-17T23:59:41.794789+0000","last_became_active":"2024-03-17T23:56:00.688978+0000","last_became_peered":"2024-03-17T23:56:00.688978+0000","last_unstale":"2024-03-17T23:59:41.794789+0000","last_undegraded":"2024-03-17T23:59:41.794789+0000","last_fullsized":"2024-03-17T23:59:41.794789+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_clean_scrub_stamp":"2024-03-17T23:55:59.626739+0000","objects_scrubbed":0,"log_size":207,"log_dups_size":0,"ondisk_log_size":207,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":418,"num_write_kb":1562,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"23'361","reported_seq":445,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:42.799095+0000","last_change":"2024-03-17T23:56:01.212041+0000","last_active":"2024-03-17T23:59:42.799095+0000","last_peered":"2024-03-17T23:59:42.799095+0000","last_clean":"2024-03-17T23:59:42.799095+0000","last_became_active":"2024-03-17T23:56:01.211359+0000","last_became_peered":"2024-03-17T23:56:01.211359+0000","last_unstale":"2024-03-17T23:59:42.799095+0000","last_undegraded":"2024-03-17T23:59:42.799095+0000","last_fullsized":"2024-03-17T23:59:42.799095+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":361,"log_dups_size":0,"ondisk_log_size":361,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":37046,"num_write":339,"num_write_kb":87516,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"23'69","reported_seq":88,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:39.510095+0000","last_change":"2024-03-17T23:56:00.686768+0000","last_active":"2024-03-17T23:59:39.510095+0000","last_peered":"2024-03-17T23:59:39.510095+0000","last_clean":"2024-03-17T23:59:39.510095+0000","last_became_active":"2024-03-17T23:56:00.685461+0000","last_became_peered":"2024-03-17T23:56:00.685461+0000","last_unstale":"2024-03-17T23:59:39.510095+0000","last_undegraded":"2024-03-17T23:59:39.510095+0000","last_fullsized":"2024-03-17T23:59:39.510095+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_clean_scrub_stamp":"2024-03-17T23:55:59.626739+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T05:52:39.451210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"23'472","reported_seq":555,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:42.770844+0000","last_change":"2024-03-17T23:56:01.196364+0000","last_active":"2024-03-17T23:59:42.770844+0000","last_peered":"2024-03-17T23:59:42.770844+0000","last_clean":"2024-03-17T23:59:42.770844+0000","last_became_active":"2024-03-17T23:56:01.191450+0000","last_became_peered":"2024-03-17T23:56:01.191450+0000","last_unstale":"2024-03-17T23:59:42.770844+0000","last_undegraded":"2024-03-17T23:59:42.770844+0000","last_fullsized":"2024-03-17T23:59:42.770844+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":472,"log_dups_size":0,"ondisk_log_size":472,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":42881,"num_write":439,"num_write_kb":88369,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"23'498","reported_seq":517,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:39.392192+0000","last_change":"2024-03-17T23:56:00.691812+0000","last_active":"2024-03-17T23:59:39.392192+0000","last_peered":"2024-03-17T23:59:39.392192+0000","last_clean":"2024-03-17T23:59:39.392192+0000","last_became_active":"2024-03-17T23:56:00.691381+0000","last_became_peered":"2024-03-17T23:56:00.691381+0000","last_unstale":"2024-03-17T23:59:39.392192+0000","last_undegraded":"2024-03-17T23:59:39.392192+0000","last_fullsized":"2024-03-17T23:59:39.392192+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_clean_scrub_stamp":"2024-03-17T23:55:59.626739+0000","objects_scrubbed":0,"log_size":498,"log_dups_size":0,"ondisk_log_size":498,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T10:35:19.139554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":442,"num_write_kb":4310,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"23'444","reported_seq":510,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:42.783534+0000","last_change":"2024-03-17T23:56:01.195278+0000","last_active":"2024-03-17T23:59:42.783534+0000","last_peered":"2024-03-17T23:59:42.783534+0000","last_clean":"2024-03-17T23:59:42.783534+0000","last_became_active":"2024-03-17T23:56:01.192316+0000","last_became_peered":"2024-03-17T23:56:01.192316+0000","last_unstale":"2024-03-17T23:59:42.783534+0000","last_undegraded":"2024-03-17T23:59:42.783534+0000","last_fullsized":"2024-03-17T23:59:42.783534+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":444,"log_dups_size":0,"ondisk_log_size":444,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":21819,"num_write":413,"num_write_kb":30190,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"23'60","reported_seq":80,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:39.402198+0000","last_change":"2024-03-17T23:56:00.703680+0000","last_active":"2024-03-17T23:59:39.402198+0000","last_peered":"2024-03-17T23:59:39.402198+0000","last_clean":"2024-03-17T23:59:39.402198+0000","last_became_active":"2024-03-17T23:56:00.703439+0000","last_became_peered":"2024-03-17T23:56:00.703439+0000","last_unstale":"2024-03-17T23:59:39.402198+0000","last_undegraded":"2024-03-17T23:59:39.402198+0000","last_fullsized":"2024-03-17T23:59:39.402198+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_clean_scrub_stamp":"2024-03-17T23:55:59.626739+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"23'411","reported_seq":447,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:42.762396+0000","last_change":"2024-03-17T23:56:01.191678+0000","last_active":"2024-03-17T23:59:42.762396+0000","last_peered":"2024-03-17T23:59:42.762396+0000","last_clean":"2024-03-17T23:59:42.762396+0000","last_became_active":"2024-03-17T23:56:01.190681+0000","last_became_peered":"2024-03-17T23:56:01.190681+0000","last_unstale":"2024-03-17T23:59:42.762396+0000","last_undegraded":"2024-03-17T23:59:42.762396+0000","last_fullsized":"2024-03-17T23:59:42.762396+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":2591,"num_write":372,"num_write_kb":17971,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"23'151","reported_seq":171,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:38.449871+0000","last_change":"2024-03-17T23:56:00.679281+0000","last_active":"2024-03-17T23:59:38.449871+0000","last_peered":"2024-03-17T23:59:38.449871+0000","last_clean":"2024-03-17T23:59:38.449871+0000","last_became_active":"2024-03-17T23:56:00.678950+0000","last_became_peered":"2024-03-17T23:56:00.678950+0000","last_unstale":"2024-03-17T23:59:38.449871+0000","last_undegraded":"2024-03-17T23:59:38.449871+0000","last_fullsized":"2024-03-17T23:59:38.449871+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_clean_scrub_stamp":"2024-03-17T23:55:59.626739+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":92,"num_write_kb":4145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"23'431","reported_seq":496,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:42.777973+0000","last_change":"2024-03-17T23:56:01.215539+0000","last_active":"2024-03-17T23:59:42.777973+0000","last_peered":"2024-03-17T23:59:42.777973+0000","last_clean":"2024-03-17T23:59:42.777973+0000","last_became_active":"2024-03-17T23:56:01.211163+0000","last_became_peered":"2024-03-17T23:56:01.211163+0000","last_unstale":"2024-03-17T23:59:42.777973+0000","last_undegraded":"2024-03-17T23:59:42.777973+0000","last_fullsized":"2024-03-17T23:59:42.777973+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":431,"log_dups_size":0,"ondisk_log_size":431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":16100,"num_write":395,"num_write_kb":71500,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"23'122","reported_seq":141,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:38.372796+0000","last_change":"2024-03-17T23:56:00.692384+0000","last_active":"2024-03-17T23:59:38.372796+0000","last_peered":"2024-03-17T23:59:38.372796+0000","last_clean":"2024-03-17T23:59:38.372796+0000","last_became_active":"2024-03-17T23:56:00.684178+0000","last_became_peered":"2024-03-17T23:56:00.684178+0000","last_unstale":"2024-03-17T23:59:38.372796+0000","last_undegraded":"2024-03-17T23:59:38.372796+0000","last_fullsized":"2024-03-17T23:59:38.372796+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_clean_scrub_stamp":"2024-03-17T23:55:59.626739+0000","objects_scrubbed":0,"log_size":122,"log_dups_size":0,"ondisk_log_size":122,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T09:45:24.650866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":65,"num_write_kb":8221,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"23'446","reported_seq":538,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:42.790168+0000","last_change":"2024-03-17T23:56:01.193547+0000","last_active":"2024-03-17T23:59:42.790168+0000","last_peered":"2024-03-17T23:59:42.790168+0000","last_clean":"2024-03-17T23:59:42.790168+0000","last_became_active":"2024-03-17T23:56:01.192775+0000","last_became_peered":"2024-03-17T23:56:01.192775+0000","last_unstale":"2024-03-17T23:59:42.790168+0000","last_undegraded":"2024-03-17T23:59:42.790168+0000","last_fullsized":"2024-03-17T23:59:42.790168+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":446,"log_dups_size":0,"ondisk_log_size":446,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T02:15:18.353466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":28843,"num_write":412,"num_write_kb":84625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"23'388","reported_seq":456,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:42.800555+0000","last_change":"2024-03-17T23:56:01.178436+0000","last_active":"2024-03-17T23:59:42.800555+0000","last_peered":"2024-03-17T23:59:42.800555+0000","last_clean":"2024-03-17T23:59:42.800555+0000","last_became_active":"2024-03-17T23:56:01.177533+0000","last_became_peered":"2024-03-17T23:56:01.177533+0000","last_unstale":"2024-03-17T23:59:42.800555+0000","last_undegraded":"2024-03-17T23:59:42.800555+0000","last_fullsized":"2024-03-17T23:59:42.800555+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":388,"log_dups_size":0,"ondisk_log_size":388,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":28876,"num_write":348,"num_write_kb":79477,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"23'250","reported_seq":269,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:40.435836+0000","last_change":"2024-03-17T23:56:00.691483+0000","last_active":"2024-03-17T23:59:40.435836+0000","last_peered":"2024-03-17T23:59:40.435836+0000","last_clean":"2024-03-17T23:59:40.435836+0000","last_became_active":"2024-03-17T23:56:00.684714+0000","last_became_peered":"2024-03-17T23:56:00.684714+0000","last_unstale":"2024-03-17T23:59:40.435836+0000","last_undegraded":"2024-03-17T23:59:40.435836+0000","last_fullsized":"2024-03-17T23:59:40.435836+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_clean_scrub_stamp":"2024-03-17T23:55:59.626739+0000","objects_scrubbed":0,"log_size":250,"log_dups_size":0,"ondisk_log_size":250,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T09:57:49.282635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":200,"num_write_kb":4200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"23'366","reported_seq":421,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:42.798018+0000","last_change":"2024-03-17T23:56:01.194350+0000","last_active":"2024-03-17T23:59:42.798018+0000","last_peered":"2024-03-17T23:59:42.798018+0000","last_clean":"2024-03-17T23:59:42.798018+0000","last_became_active":"2024-03-17T23:56:01.193625+0000","last_became_peered":"2024-03-17T23:56:01.193625+0000","last_unstale":"2024-03-17T23:59:42.798018+0000","last_undegraded":"2024-03-17T23:59:42.798018+0000","last_fullsized":"2024-03-17T23:59:42.798018+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":17870,"num_write":332,"num_write_kb":22223,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"23'265","reported_seq":284,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:40.468483+0000","last_change":"2024-03-17T23:56:00.699785+0000","last_active":"2024-03-17T23:59:40.468483+0000","last_peered":"2024-03-17T23:59:40.468483+0000","last_clean":"2024-03-17T23:59:40.468483+0000","last_became_active":"2024-03-17T23:56:00.699049+0000","last_became_peered":"2024-03-17T23:56:00.699049+0000","last_unstale":"2024-03-17T23:59:40.468483+0000","last_undegraded":"2024-03-17T23:59:40.468483+0000","last_fullsized":"2024-03-17T23:59:40.468483+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_clean_scrub_stamp":"2024-03-17T23:55:59.626739+0000","objects_scrubbed":0,"log_size":265,"log_dups_size":0,"ondisk_log_size":265,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T01:56:01.336865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":190,"num_write_kb":12389,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"23'368","reported_seq":447,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:42.799900+0000","last_change":"2024-03-17T23:56:01.208117+0000","last_active":"2024-03-17T23:59:42.799900+0000","last_peered":"2024-03-17T23:59:42.799900+0000","last_clean":"2024-03-17T23:59:42.799900+0000","last_became_active":"2024-03-17T23:56:01.207342+0000","last_became_peered":"2024-03-17T23:56:01.207342+0000","last_unstale":"2024-03-17T23:59:42.799900+0000","last_undegraded":"2024-03-17T23:59:42.799900+0000","last_fullsized":"2024-03-17T23:59:42.799900+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":368,"log_dups_size":0,"ondisk_log_size":368,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":38707,"num_write":341,"num_write_kb":47027,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"23'59","reported_seq":79,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:39.408634+0000","last_change":"2024-03-17T23:56:00.691595+0000","last_active":"2024-03-17T23:59:39.408634+0000","last_peered":"2024-03-17T23:59:39.408634+0000","last_clean":"2024-03-17T23:59:39.408634+0000","last_became_active":"2024-03-17T23:56:00.690892+0000","last_became_peered":"2024-03-17T23:56:00.690892+0000","last_unstale":"2024-03-17T23:59:39.408634+0000","last_undegraded":"2024-03-17T23:59:39.408634+0000","last_fullsized":"2024-03-17T23:59:39.408634+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:55:59.626739+0000","last_clean_scrub_stamp":"2024-03-17T23:55:59.626739+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":4104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"23'416","reported_seq":459,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:42.794871+0000","last_change":"2024-03-17T23:56:01.212430+0000","last_active":"2024-03-17T23:59:42.794871+0000","last_peered":"2024-03-17T23:59:42.794871+0000","last_clean":"2024-03-17T23:59:42.794871+0000","last_became_active":"2024-03-17T23:56:01.204930+0000","last_became_peered":"2024-03-17T23:56:01.204930+0000","last_unstale":"2024-03-17T23:59:42.794871+0000","last_undegraded":"2024-03-17T23:59:42.794871+0000","last_fullsized":"2024-03-17T23:59:42.794871+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-17T23:56:00.629935+0000","last_clean_scrub_stamp":"2024-03-17T23:56:00.629935+0000","objects_scrubbed":0,"log_size":416,"log_dups_size":0,"ondisk_log_size":416,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":21060,"num_write":382,"num_write_kb":52186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"23'135","reported_seq":163,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:52.597080+0000","last_change":"2024-03-17T23:59:52.597142+0000","last_active":"2024-03-17T23:59:52.597080+0000","last_peered":"2024-03-17T23:59:52.597080+0000","last_clean":"2024-03-17T23:59:52.597080+0000","last_became_active":"2024-03-17T23:56:00.681938+0000","last_became_peered":"2024-03-17T23:56:00.681938+0000","last_unstale":"2024-03-17T23:59:52.597080+0000","last_undegraded":"2024-03-17T23:59:52.597080+0000","last_fullsized":"2024-03-17T23:59:52.597080+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'135","last_scrub_stamp":"2024-03-17T23:59:52.596976+0000","last_deep_scrub":"23'135","last_deep_scrub_stamp":"2024-03-17T23:59:52.596976+0000","last_clean_scrub_stamp":"2024-03-17T23:59:52.596976+0000","objects_scrubbed":7,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T05:17:44.201948+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":81,"num_write_kb":4133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2838,"num_read_kb":1533802,"num_write":24369,"num_write_kb":4275114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26399,"ondisk_log_size":26399,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":130818914,"num_objects":129,"num_object_clones":0,"num_object_copies":258,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":129,"num_whiteouts":0,"num_read":210,"num_read_kb":1570,"num_write":5949,"num_write_kb":132095,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":10000,"num_omap_keys":20,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":91545600,"data_stored":261637828,"data_compressed":38603034,"data_compressed_allocated":50184192,"data_compressed_original":220520448,"omap_allocated":0,"internal_metadata":0},"log_size":7517,"ondisk_log_size":7517,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66348,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574899,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":64480,"kb_used_data":15256,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94307360,"statfs":{"total":96636764160,"available":96570736640,"internally_reserved":0,"allocated":15622144,"data_stored":51012493,"data_compressed":7591170,"data_compressed_allocated":9641984,"data_compressed_original":45223936,"omap_allocated":1590,"internal_metadata":50395594},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574899,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":53036,"kb_used_data":13540,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94318804,"statfs":{"total":96636764160,"available":96582455296,"internally_reserved":0,"allocated":13864960,"data_stored":45545899,"data_compressed":7083231,"data_compressed_allocated":9031680,"data_compressed_original":40890368,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574898,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60172,"kb_used_data":10948,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94311668,"statfs":{"total":96636764160,"available":96575148032,"internally_reserved":0,"allocated":11210752,"data_stored":25258133,"data_compressed":3535502,"data_compressed_allocated":4878336,"data_compressed_original":19124224,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574900,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":70952,"kb_used_data":17568,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94300888,"statfs":{"total":96636764160,"available":96564109312,"internally_reserved":0,"allocated":17989632,"data_stored":46227051,"data_compressed":6636651,"data_compressed_allocated":8818688,"data_compressed_original":37232640,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574901,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41684,"kb_used_data":10508,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94330156,"statfs":{"total":96636764160,"available":96594079744,"internally_reserved":0,"allocated":10760192,"data_stored":34430955,"data_compressed":5296110,"data_compressed_allocated":6660096,"data_compressed_original":30515200,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574900,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33936,"kb_used_data":2760,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94337904,"statfs":{"total":96636764160,"available":96602013696,"internally_reserved":0,"allocated":2826240,"data_stored":5752077,"data_compressed":755556,"data_compressed_allocated":1044480,"data_compressed_original":4157440,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574899,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":67656,"kb_used_data":10112,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94304184,"statfs":{"total":96636764160,"available":96567484416,"internally_reserved":0,"allocated":10354688,"data_stored":25255151,"data_compressed":3481816,"data_compressed_allocated":4526080,"data_compressed_original":19607552,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574898,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59948,"kb_used_data":10724,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94311892,"statfs":{"total":96636764160,"available":96575377408,"internally_reserved":0,"allocated":10981376,"data_stored":30039165,"data_compressed":4289346,"data_compressed_allocated":5672960,"data_compressed_original":24915968,"omap_allocated":1592,"internal_metadata":50395592},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33174,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33174,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":10674176,"data_stored":29361002,"data_compressed":4256172,"data_compressed_allocated":5627904,"data_compressed_original":24342528,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":10113024,"data_stored":25167356,"data_compressed":3481816,"data_compressed_allocated":4526080,"data_compressed_original":19607552,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":2584576,"data_stored":5664282,"data_compressed":755556,"data_compressed_allocated":1044480,"data_compressed_original":4157440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":10518528,"data_stored":34343160,"data_compressed":5296110,"data_compressed_allocated":6660096,"data_compressed_original":30515200,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":17747968,"data_stored":46139256,"data_compressed":6636651,"data_compressed_allocated":8818688,"data_compressed_original":37232640,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":10969088,"data_stored":25170338,"data_compressed":3535502,"data_compressed_allocated":4878336,"data_compressed_original":19124224,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":13623296,"data_stored":45458104,"data_compressed":7083231,"data_compressed_allocated":9031680,"data_compressed_original":40890368,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":15314944,"data_stored":50334330,"data_compressed":7557996,"data_compressed_allocated":9596928,"data_compressed_original":44650496,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-17T23:59:56.439 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-03-17T23:56:00.629935+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=17, tm_hour=23, tm_min=56, tm_sec=0, tm_wday=6, tm_yday=77, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=17, tm_hour=23, tm_min=59, tm_sec=50, tm_wday=6, tm_yday=77, tm_isdst=0) 2024-03-17T23:59:56.440 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-03-17T23:56:00.629935+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=17, tm_hour=23, tm_min=56, tm_sec=0, tm_wday=6, tm_yday=77, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=17, tm_hour=23, tm_min=59, tm_sec=50, tm_wday=6, tm_yday=77, tm_isdst=0) 2024-03-17T23:59:56.440 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-03-17T23:56:00.629935+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=17, tm_hour=23, tm_min=56, tm_sec=0, tm_wday=6, tm_yday=77, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=17, tm_hour=23, tm_min=59, tm_sec=50, tm_wday=6, tm_yday=77, tm_isdst=0) 2024-03-17T23:59:56.440 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-03-17T23:56:00.629935+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=17, tm_hour=23, tm_min=56, tm_sec=0, tm_wday=6, tm_yday=77, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=17, tm_hour=23, tm_min=59, tm_sec=50, tm_wday=6, tm_yday=77, tm_isdst=0) 2024-03-17T23:59:56.440 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-03-17T23:56:00.629935+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=17, tm_hour=23, tm_min=56, tm_sec=0, tm_wday=6, tm_yday=77, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=17, tm_hour=23, tm_min=59, tm_sec=50, tm_wday=6, tm_yday=77, tm_isdst=0) 2024-03-17T23:59:56.440 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-03-17T23:56:00.629935+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=17, tm_hour=23, tm_min=56, tm_sec=0, tm_wday=6, tm_yday=77, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=17, tm_hour=23, tm_min=59, tm_sec=50, tm_wday=6, tm_yday=77, tm_isdst=0) 2024-03-17T23:59:56.440 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-03-17T23:56:00.629935+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=17, tm_hour=23, tm_min=56, tm_sec=0, tm_wday=6, tm_yday=77, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=17, tm_hour=23, tm_min=59, tm_sec=50, tm_wday=6, tm_yday=77, tm_isdst=0) 2024-03-17T23:59:56.440 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-03-17T23:56:00.629935+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=17, tm_hour=23, tm_min=56, tm_sec=0, tm_wday=6, tm_yday=77, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=17, tm_hour=23, tm_min=59, tm_sec=50, tm_wday=6, tm_yday=77, tm_isdst=0) 2024-03-17T23:59:56.440 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-03-17T23:56:00.629935+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=17, tm_hour=23, tm_min=56, tm_sec=0, tm_wday=6, tm_yday=77, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=17, tm_hour=23, tm_min=59, tm_sec=50, tm_wday=6, tm_yday=77, tm_isdst=0) 2024-03-17T23:59:56.441 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-03-17T23:56:00.629935+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=17, tm_hour=23, tm_min=56, tm_sec=0, tm_wday=6, tm_yday=77, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=17, tm_hour=23, tm_min=59, tm_sec=50, tm_wday=6, tm_yday=77, tm_isdst=0) 2024-03-17T23:59:56.441 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-03-17T23:56:00.629935+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=17, tm_hour=23, tm_min=56, tm_sec=0, tm_wday=6, tm_yday=77, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=17, tm_hour=23, tm_min=59, tm_sec=50, tm_wday=6, tm_yday=77, tm_isdst=0) 2024-03-17T23:59:56.441 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-03-17T23:56:00.629935+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=17, tm_hour=23, tm_min=56, tm_sec=0, tm_wday=6, tm_yday=77, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=17, tm_hour=23, tm_min=59, tm_sec=50, tm_wday=6, tm_yday=77, tm_isdst=0) 2024-03-17T23:59:56.441 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-03-17T23:56:00.629935+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=17, tm_hour=23, tm_min=56, tm_sec=0, tm_wday=6, tm_yday=77, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=17, tm_hour=23, tm_min=59, tm_sec=50, tm_wday=6, tm_yday=77, tm_isdst=0) 2024-03-17T23:59:56.441 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-03-17T23:56:00.629935+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=17, tm_hour=23, tm_min=56, tm_sec=0, tm_wday=6, tm_yday=77, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=17, tm_hour=23, tm_min=59, tm_sec=50, tm_wday=6, tm_yday=77, tm_isdst=0) 2024-03-17T23:59:56.441 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-03-17T23:56:00.629935+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=17, tm_hour=23, tm_min=56, tm_sec=0, tm_wday=6, tm_yday=77, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=17, tm_hour=23, tm_min=59, tm_sec=50, tm_wday=6, tm_yday=77, tm_isdst=0) 2024-03-17T23:59:56.441 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-03-17T23:56:00.629935+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=17, tm_hour=23, tm_min=56, tm_sec=0, tm_wday=6, tm_yday=77, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=17, tm_hour=23, tm_min=59, tm_sec=50, tm_wday=6, tm_yday=77, tm_isdst=0) 2024-03-17T23:59:56.441 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2024-03-17T23:56:00.629935+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=17, tm_hour=23, tm_min=56, tm_sec=0, tm_wday=6, tm_yday=77, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=17, tm_hour=23, tm_min=59, tm_sec=50, tm_wday=6, tm_yday=77, tm_isdst=0) 2024-03-17T23:59:56.441 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-03-17T23:56:00.629935+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=17, tm_hour=23, tm_min=56, tm_sec=0, tm_wday=6, tm_yday=77, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=17, tm_hour=23, tm_min=59, tm_sec=50, tm_wday=6, tm_yday=77, tm_isdst=0) 2024-03-17T23:59:56.442 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-03-17T23:56:00.629935+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=17, tm_hour=23, tm_min=56, tm_sec=0, tm_wday=6, tm_yday=77, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=17, tm_hour=23, tm_min=59, tm_sec=50, tm_wday=6, tm_yday=77, tm_isdst=0) 2024-03-17T23:59:56.442 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-03-17T23:56:00.629935+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=17, tm_hour=23, tm_min=56, tm_sec=0, tm_wday=6, tm_yday=77, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=17, tm_hour=23, tm_min=59, tm_sec=50, tm_wday=6, tm_yday=77, tm_isdst=0) 2024-03-17T23:59:56.442 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-03-17T23:56:00.629935+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=17, tm_hour=23, tm_min=56, tm_sec=0, tm_wday=6, tm_yday=77, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=17, tm_hour=23, tm_min=59, tm_sec=50, tm_wday=6, tm_yday=77, tm_isdst=0) 2024-03-17T23:59:56.442 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-03-17T23:56:00.629935+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=17, tm_hour=23, tm_min=56, tm_sec=0, tm_wday=6, tm_yday=77, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=17, tm_hour=23, tm_min=59, tm_sec=50, tm_wday=6, tm_yday=77, tm_isdst=0) 2024-03-17T23:59:56.442 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-03-17T23:56:00.629935+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=17, tm_hour=23, tm_min=56, tm_sec=0, tm_wday=6, tm_yday=77, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=17, tm_hour=23, tm_min=59, tm_sec=50, tm_wday=6, tm_yday=77, tm_isdst=0) 2024-03-17T23:59:56.442 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-03-17T23:56:00.629935+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=17, tm_hour=23, tm_min=56, tm_sec=0, tm_wday=6, tm_yday=77, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=17, tm_hour=23, tm_min=59, tm_sec=50, tm_wday=6, tm_yday=77, tm_isdst=0) 2024-03-17T23:59:56.442 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-03-17T23:56:00.629935+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=17, tm_hour=23, tm_min=56, tm_sec=0, tm_wday=6, tm_yday=77, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=17, tm_hour=23, tm_min=59, tm_sec=50, tm_wday=6, tm_yday=77, tm_isdst=0) 2024-03-17T23:59:56.442 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-03-17T23:56:00.629935+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=17, tm_hour=23, tm_min=56, tm_sec=0, tm_wday=6, tm_yday=77, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=17, tm_hour=23, tm_min=59, tm_sec=50, tm_wday=6, tm_yday=77, tm_isdst=0) 2024-03-17T23:59:56.443 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-03-17T23:56:00.629935+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=17, tm_hour=23, tm_min=56, tm_sec=0, tm_wday=6, tm_yday=77, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=17, tm_hour=23, tm_min=59, tm_sec=50, tm_wday=6, tm_yday=77, tm_isdst=0) 2024-03-17T23:59:56.443 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-03-17T23:56:00.629935+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=17, tm_hour=23, tm_min=56, tm_sec=0, tm_wday=6, tm_yday=77, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=17, tm_hour=23, tm_min=59, tm_sec=50, tm_wday=6, tm_yday=77, tm_isdst=0) 2024-03-17T23:59:56.443 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-03-17T23:56:00.629935+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=17, tm_hour=23, tm_min=56, tm_sec=0, tm_wday=6, tm_yday=77, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=17, tm_hour=23, tm_min=59, tm_sec=50, tm_wday=6, tm_yday=77, tm_isdst=0) 2024-03-17T23:59:56.443 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-03-17T23:56:00.629935+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=17, tm_hour=23, tm_min=56, tm_sec=0, tm_wday=6, tm_yday=77, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=17, tm_hour=23, tm_min=59, tm_sec=50, tm_wday=6, tm_yday=77, tm_isdst=0) 2024-03-17T23:59:56.443 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-03-17T23:56:00.629935+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=17, tm_hour=23, tm_min=56, tm_sec=0, tm_wday=6, tm_yday=77, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=17, tm_hour=23, tm_min=59, tm_sec=50, tm_wday=6, tm_yday=77, tm_isdst=0) 2024-03-17T23:59:56.443 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-03-17T23:56:00.629935+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=17, tm_hour=23, tm_min=56, tm_sec=0, tm_wday=6, tm_yday=77, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=17, tm_hour=23, tm_min=59, tm_sec=50, tm_wday=6, tm_yday=77, tm_isdst=0) 2024-03-17T23:59:56.443 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-03-17T23:56:00.629935+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=17, tm_hour=23, tm_min=56, tm_sec=0, tm_wday=6, tm_yday=77, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=17, tm_hour=23, tm_min=59, tm_sec=50, tm_wday=6, tm_yday=77, tm_isdst=0) 2024-03-17T23:59:56.443 INFO:tasks.ceph:pgid 2.1a last_scrub_stamp 2024-03-17T23:55:59.626739+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=17, tm_hour=23, tm_min=55, tm_sec=59, tm_wday=6, tm_yday=77, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=17, tm_hour=23, tm_min=59, tm_sec=50, tm_wday=6, tm_yday=77, tm_isdst=0) 2024-03-17T23:59:56.443 INFO:tasks.ceph:pgid 2.19 last_scrub_stamp 2024-03-17T23:55:59.626739+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=17, tm_hour=23, tm_min=55, tm_sec=59, tm_wday=6, tm_yday=77, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=17, tm_hour=23, tm_min=59, tm_sec=50, tm_wday=6, tm_yday=77, tm_isdst=0) 2024-03-17T23:59:56.444 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-03-17T23:56:00.629935+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=17, tm_hour=23, tm_min=56, tm_sec=0, tm_wday=6, tm_yday=77, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=17, tm_hour=23, tm_min=59, tm_sec=50, tm_wday=6, tm_yday=77, tm_isdst=0) 2024-03-17T23:59:56.444 INFO:tasks.ceph:pgid 2.18 last_scrub_stamp 2024-03-17T23:55:59.626739+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=17, tm_hour=23, tm_min=55, tm_sec=59, tm_wday=6, tm_yday=77, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=17, tm_hour=23, tm_min=59, tm_sec=50, tm_wday=6, tm_yday=77, tm_isdst=0) 2024-03-17T23:59:56.444 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-03-17T23:56:00.629935+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=17, tm_hour=23, tm_min=56, tm_sec=0, tm_wday=6, tm_yday=77, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=17, tm_hour=23, tm_min=59, tm_sec=50, tm_wday=6, tm_yday=77, tm_isdst=0) 2024-03-17T23:59:56.444 INFO:tasks.ceph:pgid 2.17 last_scrub_stamp 2024-03-17T23:55:59.626739+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=17, tm_hour=23, tm_min=55, tm_sec=59, tm_wday=6, tm_yday=77, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=17, tm_hour=23, tm_min=59, tm_sec=50, tm_wday=6, tm_yday=77, tm_isdst=0) 2024-03-17T23:59:56.444 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-03-17T23:56:00.629935+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=17, tm_hour=23, tm_min=56, tm_sec=0, tm_wday=6, tm_yday=77, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=17, tm_hour=23, tm_min=59, tm_sec=50, tm_wday=6, tm_yday=77, tm_isdst=0) 2024-03-17T23:59:56.444 INFO:tasks.ceph:pgid 2.16 last_scrub_stamp 2024-03-17T23:55:59.626739+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=17, tm_hour=23, tm_min=55, tm_sec=59, tm_wday=6, tm_yday=77, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=17, tm_hour=23, tm_min=59, tm_sec=50, tm_wday=6, tm_yday=77, tm_isdst=0) 2024-03-17T23:59:56.444 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-03-17T23:56:00.629935+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=17, tm_hour=23, tm_min=56, tm_sec=0, tm_wday=6, tm_yday=77, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=17, tm_hour=23, tm_min=59, tm_sec=50, tm_wday=6, tm_yday=77, tm_isdst=0) 2024-03-17T23:59:56.444 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-03-17T23:56:00.629935+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=17, tm_hour=23, tm_min=56, tm_sec=0, tm_wday=6, tm_yday=77, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=17, tm_hour=23, tm_min=59, tm_sec=50, tm_wday=6, tm_yday=77, tm_isdst=0) 2024-03-17T23:59:56.444 INFO:tasks.ceph:pgid 2.14 last_scrub_stamp 2024-03-17T23:55:59.626739+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=17, tm_hour=23, tm_min=55, tm_sec=59, tm_wday=6, tm_yday=77, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=17, tm_hour=23, tm_min=59, tm_sec=50, tm_wday=6, tm_yday=77, tm_isdst=0) 2024-03-17T23:59:56.445 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-03-17T23:56:00.629935+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=17, tm_hour=23, tm_min=56, tm_sec=0, tm_wday=6, tm_yday=77, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=17, tm_hour=23, tm_min=59, tm_sec=50, tm_wday=6, tm_yday=77, tm_isdst=0) 2024-03-17T23:59:56.445 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-03-17T23:56:00.629935+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=17, tm_hour=23, tm_min=56, tm_sec=0, tm_wday=6, tm_yday=77, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=17, tm_hour=23, tm_min=59, tm_sec=50, tm_wday=6, tm_yday=77, tm_isdst=0) 2024-03-17T23:59:56.445 INFO:tasks.ceph:pgid 2.12 last_scrub_stamp 2024-03-17T23:55:59.626739+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=17, tm_hour=23, tm_min=55, tm_sec=59, tm_wday=6, tm_yday=77, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=17, tm_hour=23, tm_min=59, tm_sec=50, tm_wday=6, tm_yday=77, tm_isdst=0) 2024-03-17T23:59:56.445 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-03-17T23:56:00.629935+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=17, tm_hour=23, tm_min=56, tm_sec=0, tm_wday=6, tm_yday=77, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=17, tm_hour=23, tm_min=59, tm_sec=50, tm_wday=6, tm_yday=77, tm_isdst=0) 2024-03-17T23:59:56.445 INFO:tasks.ceph:pgid 2.11 last_scrub_stamp 2024-03-17T23:55:59.626739+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=17, tm_hour=23, tm_min=55, tm_sec=59, tm_wday=6, tm_yday=77, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=17, tm_hour=23, tm_min=59, tm_sec=50, tm_wday=6, tm_yday=77, tm_isdst=0) 2024-03-17T23:59:56.445 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-03-17T23:56:00.629935+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=17, tm_hour=23, tm_min=56, tm_sec=0, tm_wday=6, tm_yday=77, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=17, tm_hour=23, tm_min=59, tm_sec=50, tm_wday=6, tm_yday=77, tm_isdst=0) 2024-03-17T23:59:56.445 INFO:tasks.ceph:pgid 2.10 last_scrub_stamp 2024-03-17T23:55:59.626739+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=17, tm_hour=23, tm_min=55, tm_sec=59, tm_wday=6, tm_yday=77, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=17, tm_hour=23, tm_min=59, tm_sec=50, tm_wday=6, tm_yday=77, tm_isdst=0) 2024-03-17T23:59:56.445 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-03-17T23:56:00.629935+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=17, tm_hour=23, tm_min=56, tm_sec=0, tm_wday=6, tm_yday=77, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=17, tm_hour=23, tm_min=59, tm_sec=50, tm_wday=6, tm_yday=77, tm_isdst=0) 2024-03-17T23:59:56.445 INFO:tasks.ceph:pgid 2.f last_scrub_stamp 2024-03-17T23:55:59.626739+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=17, tm_hour=23, tm_min=55, tm_sec=59, tm_wday=6, tm_yday=77, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=17, tm_hour=23, tm_min=59, tm_sec=50, tm_wday=6, tm_yday=77, tm_isdst=0) 2024-03-17T23:59:56.445 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-03-17T23:56:00.629935+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=17, tm_hour=23, tm_min=56, tm_sec=0, tm_wday=6, tm_yday=77, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=17, tm_hour=23, tm_min=59, tm_sec=50, tm_wday=6, tm_yday=77, tm_isdst=0) 2024-03-17T23:59:56.446 INFO:tasks.ceph:pgid 2.e last_scrub_stamp 2024-03-17T23:55:59.626739+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=17, tm_hour=23, tm_min=55, tm_sec=59, tm_wday=6, tm_yday=77, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=17, tm_hour=23, tm_min=59, tm_sec=50, tm_wday=6, tm_yday=77, tm_isdst=0) 2024-03-17T23:59:56.446 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-03-17T23:56:00.629935+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=17, tm_hour=23, tm_min=56, tm_sec=0, tm_wday=6, tm_yday=77, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=17, tm_hour=23, tm_min=59, tm_sec=50, tm_wday=6, tm_yday=77, tm_isdst=0) 2024-03-17T23:59:56.446 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-03-17T23:56:00.629935+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=17, tm_hour=23, tm_min=56, tm_sec=0, tm_wday=6, tm_yday=77, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=17, tm_hour=23, tm_min=59, tm_sec=50, tm_wday=6, tm_yday=77, tm_isdst=0) 2024-03-17T23:59:56.446 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-03-17T23:56:00.629935+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=17, tm_hour=23, tm_min=56, tm_sec=0, tm_wday=6, tm_yday=77, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=17, tm_hour=23, tm_min=59, tm_sec=50, tm_wday=6, tm_yday=77, tm_isdst=0) 2024-03-17T23:59:56.446 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-03-17T23:55:56.609001+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=17, tm_hour=23, tm_min=55, tm_sec=56, tm_wday=6, tm_yday=77, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=17, tm_hour=23, tm_min=59, tm_sec=50, tm_wday=6, tm_yday=77, tm_isdst=0) 2024-03-17T23:59:56.446 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-03-17T23:55:59.626739+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=17, tm_hour=23, tm_min=55, tm_sec=59, tm_wday=6, tm_yday=77, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=17, tm_hour=23, tm_min=59, tm_sec=50, tm_wday=6, tm_yday=77, tm_isdst=0) 2024-03-17T23:59:56.446 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-03-17T23:56:00.629935+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=17, tm_hour=23, tm_min=56, tm_sec=0, tm_wday=6, tm_yday=77, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=17, tm_hour=23, tm_min=59, tm_sec=50, tm_wday=6, tm_yday=77, tm_isdst=0) 2024-03-17T23:59:56.446 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-03-17T23:55:59.626739+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=17, tm_hour=23, tm_min=55, tm_sec=59, tm_wday=6, tm_yday=77, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=17, tm_hour=23, tm_min=59, tm_sec=50, tm_wday=6, tm_yday=77, tm_isdst=0) 2024-03-17T23:59:56.447 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-03-17T23:56:00.629935+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=17, tm_hour=23, tm_min=56, tm_sec=0, tm_wday=6, tm_yday=77, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=17, tm_hour=23, tm_min=59, tm_sec=50, tm_wday=6, tm_yday=77, tm_isdst=0) 2024-03-17T23:59:56.447 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-03-17T23:55:59.626739+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=17, tm_hour=23, tm_min=55, tm_sec=59, tm_wday=6, tm_yday=77, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=17, tm_hour=23, tm_min=59, tm_sec=50, tm_wday=6, tm_yday=77, tm_isdst=0) 2024-03-17T23:59:56.447 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-03-17T23:56:00.629935+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=17, tm_hour=23, tm_min=56, tm_sec=0, tm_wday=6, tm_yday=77, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=17, tm_hour=23, tm_min=59, tm_sec=50, tm_wday=6, tm_yday=77, tm_isdst=0) 2024-03-17T23:59:56.447 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-03-17T23:55:59.626739+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=17, tm_hour=23, tm_min=55, tm_sec=59, tm_wday=6, tm_yday=77, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=17, tm_hour=23, tm_min=59, tm_sec=50, tm_wday=6, tm_yday=77, tm_isdst=0) 2024-03-17T23:59:56.447 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-03-17T23:56:00.629935+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=17, tm_hour=23, tm_min=56, tm_sec=0, tm_wday=6, tm_yday=77, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=17, tm_hour=23, tm_min=59, tm_sec=50, tm_wday=6, tm_yday=77, tm_isdst=0) 2024-03-17T23:59:56.447 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-03-17T23:55:59.626739+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=17, tm_hour=23, tm_min=55, tm_sec=59, tm_wday=6, tm_yday=77, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=17, tm_hour=23, tm_min=59, tm_sec=50, tm_wday=6, tm_yday=77, tm_isdst=0) 2024-03-17T23:59:56.447 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-03-17T23:56:00.629935+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=17, tm_hour=23, tm_min=56, tm_sec=0, tm_wday=6, tm_yday=77, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=17, tm_hour=23, tm_min=59, tm_sec=50, tm_wday=6, tm_yday=77, tm_isdst=0) 2024-03-17T23:59:56.447 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-03-17T23:55:59.626739+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=17, tm_hour=23, tm_min=55, tm_sec=59, tm_wday=6, tm_yday=77, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=17, tm_hour=23, tm_min=59, tm_sec=50, tm_wday=6, tm_yday=77, tm_isdst=0) 2024-03-17T23:59:56.447 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-03-17T23:56:00.629935+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=17, tm_hour=23, tm_min=56, tm_sec=0, tm_wday=6, tm_yday=77, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=17, tm_hour=23, tm_min=59, tm_sec=50, tm_wday=6, tm_yday=77, tm_isdst=0) 2024-03-17T23:59:56.447 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-03-17T23:55:59.626739+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=17, tm_hour=23, tm_min=55, tm_sec=59, tm_wday=6, tm_yday=77, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=17, tm_hour=23, tm_min=59, tm_sec=50, tm_wday=6, tm_yday=77, tm_isdst=0) 2024-03-17T23:59:56.448 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-03-17T23:56:00.629935+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=17, tm_hour=23, tm_min=56, tm_sec=0, tm_wday=6, tm_yday=77, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=17, tm_hour=23, tm_min=59, tm_sec=50, tm_wday=6, tm_yday=77, tm_isdst=0) 2024-03-17T23:59:56.448 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-03-17T23:55:59.626739+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=17, tm_hour=23, tm_min=55, tm_sec=59, tm_wday=6, tm_yday=77, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=17, tm_hour=23, tm_min=59, tm_sec=50, tm_wday=6, tm_yday=77, tm_isdst=0) 2024-03-17T23:59:56.448 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-03-17T23:56:00.629935+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=17, tm_hour=23, tm_min=56, tm_sec=0, tm_wday=6, tm_yday=77, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=17, tm_hour=23, tm_min=59, tm_sec=50, tm_wday=6, tm_yday=77, tm_isdst=0) 2024-03-17T23:59:56.448 INFO:tasks.ceph:pgid 2.8 last_scrub_stamp 2024-03-17T23:55:59.626739+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=17, tm_hour=23, tm_min=55, tm_sec=59, tm_wday=6, tm_yday=77, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=17, tm_hour=23, tm_min=59, tm_sec=50, tm_wday=6, tm_yday=77, tm_isdst=0) 2024-03-17T23:59:56.448 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-03-17T23:56:00.629935+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=17, tm_hour=23, tm_min=56, tm_sec=0, tm_wday=6, tm_yday=77, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=17, tm_hour=23, tm_min=59, tm_sec=50, tm_wday=6, tm_yday=77, tm_isdst=0) 2024-03-17T23:59:56.448 INFO:tasks.ceph:pgid 2.9 last_scrub_stamp 2024-03-17T23:55:59.626739+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=17, tm_hour=23, tm_min=55, tm_sec=59, tm_wday=6, tm_yday=77, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=17, tm_hour=23, tm_min=59, tm_sec=50, tm_wday=6, tm_yday=77, tm_isdst=0) 2024-03-17T23:59:56.448 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-03-17T23:56:00.629935+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=17, tm_hour=23, tm_min=56, tm_sec=0, tm_wday=6, tm_yday=77, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=17, tm_hour=23, tm_min=59, tm_sec=50, tm_wday=6, tm_yday=77, tm_isdst=0) 2024-03-17T23:59:56.448 INFO:tasks.ceph:pgid 2.a last_scrub_stamp 2024-03-17T23:55:59.626739+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=17, tm_hour=23, tm_min=55, tm_sec=59, tm_wday=6, tm_yday=77, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=17, tm_hour=23, tm_min=59, tm_sec=50, tm_wday=6, tm_yday=77, tm_isdst=0) 2024-03-17T23:59:56.448 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-03-17T23:56:00.629935+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=17, tm_hour=23, tm_min=56, tm_sec=0, tm_wday=6, tm_yday=77, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=17, tm_hour=23, tm_min=59, tm_sec=50, tm_wday=6, tm_yday=77, tm_isdst=0) 2024-03-17T23:59:56.448 INFO:tasks.ceph:pgid 2.b last_scrub_stamp 2024-03-17T23:55:59.626739+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=17, tm_hour=23, tm_min=55, tm_sec=59, tm_wday=6, tm_yday=77, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=17, tm_hour=23, tm_min=59, tm_sec=50, tm_wday=6, tm_yday=77, tm_isdst=0) 2024-03-17T23:59:56.448 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-03-17T23:56:00.629935+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=17, tm_hour=23, tm_min=56, tm_sec=0, tm_wday=6, tm_yday=77, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=17, tm_hour=23, tm_min=59, tm_sec=50, tm_wday=6, tm_yday=77, tm_isdst=0) 2024-03-17T23:59:56.449 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-03-17T23:56:00.629935+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=17, tm_hour=23, tm_min=56, tm_sec=0, tm_wday=6, tm_yday=77, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=17, tm_hour=23, tm_min=59, tm_sec=50, tm_wday=6, tm_yday=77, tm_isdst=0) 2024-03-17T23:59:56.449 INFO:tasks.ceph:pgid 2.1c last_scrub_stamp 2024-03-17T23:55:59.626739+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=17, tm_hour=23, tm_min=55, tm_sec=59, tm_wday=6, tm_yday=77, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=17, tm_hour=23, tm_min=59, tm_sec=50, tm_wday=6, tm_yday=77, tm_isdst=0) 2024-03-17T23:59:56.449 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-03-17T23:56:00.629935+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=17, tm_hour=23, tm_min=56, tm_sec=0, tm_wday=6, tm_yday=77, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=17, tm_hour=23, tm_min=59, tm_sec=50, tm_wday=6, tm_yday=77, tm_isdst=0) 2024-03-17T23:59:56.449 INFO:tasks.ceph:pgid 2.1d last_scrub_stamp 2024-03-17T23:55:59.626739+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=17, tm_hour=23, tm_min=55, tm_sec=59, tm_wday=6, tm_yday=77, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=17, tm_hour=23, tm_min=59, tm_sec=50, tm_wday=6, tm_yday=77, tm_isdst=0) 2024-03-17T23:59:56.449 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-03-17T23:56:00.629935+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=17, tm_hour=23, tm_min=56, tm_sec=0, tm_wday=6, tm_yday=77, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=17, tm_hour=23, tm_min=59, tm_sec=50, tm_wday=6, tm_yday=77, tm_isdst=0) 2024-03-17T23:59:56.449 INFO:tasks.ceph:pgid 2.1e last_scrub_stamp 2024-03-17T23:55:59.626739+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=17, tm_hour=23, tm_min=55, tm_sec=59, tm_wday=6, tm_yday=77, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=17, tm_hour=23, tm_min=59, tm_sec=50, tm_wday=6, tm_yday=77, tm_isdst=0) 2024-03-17T23:59:56.449 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-03-17T23:56:00.629935+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=17, tm_hour=23, tm_min=56, tm_sec=0, tm_wday=6, tm_yday=77, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=17, tm_hour=23, tm_min=59, tm_sec=50, tm_wday=6, tm_yday=77, tm_isdst=0) 2024-03-17T23:59:56.449 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-03-18T00:00:07.468 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T00:00:07.470 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T00:00:11.400 INFO:tasks.ceph.mon.a.smithi196.stderr:2024-03-18T00:00:11.395+0000 7f2c6fa81640 -1 received signal: Hangup from killall -q -1 ceph-mon ceph-mgr ceph-mds ceph-osd ceph-fuse radosgw rbd-mirror cephfs-mirror (PID: 34612) UID: 0 2024-03-18T00:00:11.400 INFO:tasks.ceph.mon.a.smithi196.stderr:2024-03-18T00:00:11.395+0000 7f2c6fa81640 -1 mon.a@0(leader) e1 *** Got Signal Hangup *** 2024-03-18T00:00:11.400 INFO:tasks.ceph.mgr.y.smithi196.stderr:2024-03-18T00:00:11.395+0000 7f226f63f640 -1 received signal: Hangup from killall -q -1 ceph-mon ceph-mgr ceph-mds ceph-osd ceph-fuse radosgw rbd-mirror cephfs-mirror (PID: 34612) UID: 0 2024-03-18T00:00:11.401 INFO:tasks.ceph.osd.0.smithi196.stderr:2024-03-18T00:00:11.395+0000 7f3c12363640 -1 received signal: Hangup from killall -q -1 ceph-mon ceph-mgr ceph-mds ceph-osd ceph-fuse radosgw rbd-mirror cephfs-mirror (PID: 34612) UID: 0 2024-03-18T00:00:11.401 INFO:tasks.ceph.osd.3.smithi196.stderr:2024-03-18T00:00:11.395+0000 7fee5e0f0640 -1 received signal: Hangup from killall -q -1 ceph-mon ceph-mgr ceph-mds ceph-osd ceph-fuse radosgw rbd-mirror cephfs-mirror (PID: 34612) UID: 0 2024-03-18T00:00:11.401 INFO:tasks.ceph.osd.1.smithi196.stderr:2024-03-18T00:00:11.395+0000 7fae1b990640 -1 received signal: Hangup from killall -q -1 ceph-mon ceph-mgr ceph-mds ceph-osd ceph-fuse radosgw rbd-mirror cephfs-mirror (PID: 34612) UID: 0 2024-03-18T00:00:11.402 INFO:tasks.ceph.osd.2.smithi196.stderr:2024-03-18T00:00:11.395+0000 7f36a969c640 -1 received signal: Hangup from killall -q -1 ceph-mon ceph-mgr ceph-mds ceph-osd ceph-fuse radosgw rbd-mirror cephfs-mirror (PID: 34612) UID: 0 2024-03-18T00:00:11.402 INFO:tasks.ceph.mds.a.smithi196.stderr:2024-03-18T00:00:11.399+0000 7fe38bca8640 -1 received signal: Hangup from killall -q -1 ceph-mon ceph-mgr ceph-mds ceph-osd ceph-fuse radosgw rbd-mirror cephfs-mirror (PID: 34612) UID: 0 2024-03-18T00:00:11.403 INFO:tasks.ceph.mds.e.smithi196.stderr:2024-03-18T00:00:11.399+0000 7fc47bdfc640 -1 received signal: Hangup from killall -q -1 ceph-mon ceph-mgr ceph-mds ceph-osd ceph-fuse radosgw rbd-mirror cephfs-mirror (PID: 34612) UID: 0 2024-03-18T00:00:11.403 INFO:tasks.ceph.mds.c.smithi196.stderr:2024-03-18T00:00:11.399+0000 7f703bbad640 -1 received signal: Hangup from killall -q -1 ceph-mon ceph-mgr ceph-mds ceph-osd ceph-fuse radosgw rbd-mirror cephfs-mirror (PID: 34612) UID: 0 2024-03-18T00:00:11.429 INFO:tasks.ceph.osd.0.smithi196.stderr:2024-03-18T00:00:11.427+0000 7f3c12363640 -1 received signal: Hangup from pkill -1 -x ceph-mon|ceph-mgr|ceph-mds|ceph-osd|ceph-fuse|radosgw|rbd-mirror|cephfs-mirror (PID: 34640) UID: 0 2024-03-18T00:00:11.430 INFO:tasks.ceph.mds.e.smithi196.stderr:2024-03-18T00:00:11.427+0000 7fc47bdfc640 -1 received signal: Hangup from (PID: 34640) UID: 0 2024-03-18T00:00:11.430 INFO:tasks.ceph.mgr.y.smithi196.stderr:2024-03-18T00:00:11.427+0000 7f226f63f640 -1 received signal: Hangup from (PID: 34640) UID: 0 2024-03-18T00:00:11.430 INFO:tasks.ceph.osd.2.smithi196.stderr:2024-03-18T00:00:11.427+0000 7f36a969c640 -1 received signal: Hangup from (PID: 34640) UID: 0 2024-03-18T00:00:11.431 INFO:tasks.ceph.mon.a.smithi196.stderr:2024-03-18T00:00:11.427+0000 7f2c6fa81640 -1 received signal: Hangup from (PID: 34640) UID: 0 2024-03-18T00:00:11.431 INFO:tasks.ceph.mon.a.smithi196.stderr:2024-03-18T00:00:11.427+0000 7f2c6fa81640 -1 mon.a@0(leader) e1 *** Got Signal Hangup *** 2024-03-18T00:00:11.431 INFO:tasks.ceph.mds.a.smithi196.stderr:2024-03-18T00:00:11.427+0000 7fe38bca8640 -1 received signal: Hangup from (PID: 34640) UID: 0 2024-03-18T00:00:11.432 INFO:tasks.ceph.mds.c.smithi196.stderr:2024-03-18T00:00:11.427+0000 7f703bbad640 -1 received signal: Hangup from (PID: 34640) UID: 0 2024-03-18T00:00:11.432 INFO:tasks.ceph.osd.1.smithi196.stderr:2024-03-18T00:00:11.427+0000 7fae1b990640 -1 received signal: Hangup from (PID: 34640) UID: 0 2024-03-18T00:00:11.432 INFO:tasks.ceph.osd.3.smithi196.stderr:2024-03-18T00:00:11.427+0000 7fee5e0f0640 -1 received signal: Hangup from pkill -1 -x ceph-mon|ceph-mgr|ceph-mds|ceph-osd|ceph-fuse|radosgw|rbd-mirror|cephfs-mirror (PID: 34640) UID: 0 2024-03-18T00:00:16.450 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-18T00:00:16.557 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:16.555+0000 7fe331aa9640 1 Processor -- start 2024-03-18T00:00:16.557 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:16.555+0000 7fe331aa9640 1 -- start start 2024-03-18T00:00:16.559 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:16.555+0000 7fe331aa9640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fe32c151d60 0x7fe32c06fa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:00:16.559 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:16.555+0000 7fe331aa9640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe32c152140 0x7fe32c0ca160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:00:16.559 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:16.555+0000 7fe331aa9640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe32c0c3460 con 0x7fe32c157c10 2024-03-18T00:00:16.560 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:16.555+0000 7fe331aa9640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 -- 0x7fe32c0c3740 con 0x7fe32c151d60 2024-03-18T00:00:16.560 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:16.555+0000 7fe331aa9640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7fe32c0c3a20 con 0x7fe32c152140 2024-03-18T00:00:16.560 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:16.555+0000 7fe32b7fe640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fe32c151d60 0x7fe32c06fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:00:16.560 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:16.555+0000 7fe32b7fe640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fe32c151d60 0x7fe32c06fa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3300/0 says I am v2:172.21.15.196:44424/0 (socket says 172.21.15.196:44424) 2024-03-18T00:00:16.560 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:16.555+0000 7fe32b7fe640 1 -- 172.21.15.196:0/3216041189 learned_addr learned my addr 172.21.15.196:0/3216041189 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-03-18T00:00:16.560 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:16.555+0000 7fe32bfff640 1 --2- 172.21.15.196:0/3216041189 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe32c152140 0x7fe32c0ca160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:00:16.560 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:16.555+0000 7fe32b7fe640 1 -- 172.21.15.196:0/3216041189 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe32c152140 msgr2=0x7fe32c0ca160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T00:00:16.560 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:16.555+0000 7fe32b7fe640 1 --2- 172.21.15.196:0/3216041189 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe32c152140 0x7fe32c0ca160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:00:16.561 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:16.555+0000 7fe32b7fe640 1 -- 172.21.15.196:0/3216041189 >> v1:172.21.15.204:6789/0 conn(0x7fe32c157c10 legacy=0x7fe32c0c80d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:00:16.561 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:16.555+0000 7fe32b7fe640 1 -- 172.21.15.196:0/3216041189 --> v2:172.21.15.204:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe32c06f200 con 0x7fe32c151d60 2024-03-18T00:00:16.565 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:16.559+0000 7fe32b7fe640 1 --2- 172.21.15.196:0/3216041189 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe32c151d60 0x7fe32c06fa00 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fe31c009870 tx=0x7fe31c01ed50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=91b90174cb3babd7 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:00:16.566 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:16.559+0000 7fe32a7fc640 1 -- 172.21.15.196:0/3216041189 <== mon.1 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe31c0b5070 con 0x7fe32c151d60 2024-03-18T00:00:16.566 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:16.559+0000 7fe32a7fc640 1 -- 172.21.15.196:0/3216041189 <== mon.1 v2:172.21.15.204:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe31c0a8a50 con 0x7fe32c151d60 2024-03-18T00:00:16.566 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:16.559+0000 7fe32a7fc640 1 -- 172.21.15.196:0/3216041189 <== mon.1 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe31c0a8e20 con 0x7fe32c151d60 2024-03-18T00:00:16.566 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:16.559+0000 7fe331aa9640 1 -- 172.21.15.196:0/3216041189 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe32c151d60 msgr2=0x7fe32c06fa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:00:16.566 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:16.559+0000 7fe331aa9640 1 --2- 172.21.15.196:0/3216041189 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe32c151d60 0x7fe32c06fa00 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fe31c009870 tx=0x7fe31c01ed50 comp rx=0 tx=0).stop 2024-03-18T00:00:16.566 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:16.559+0000 7fe331aa9640 1 -- 172.21.15.196:0/3216041189 shutdown_connections 2024-03-18T00:00:16.566 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:16.559+0000 7fe331aa9640 1 --2- 172.21.15.196:0/3216041189 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe32c152140 0x7fe32c0ca160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:00:16.567 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:16.559+0000 7fe331aa9640 1 --2- 172.21.15.196:0/3216041189 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe32c151d60 0x7fe32c06fa00 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:00:16.567 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:16.559+0000 7fe331aa9640 1 -- 172.21.15.196:0/3216041189 >> 172.21.15.196:0/3216041189 conn(0x7fe32c071020 msgr2=0x7fe32c071430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:00:16.567 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:16.559+0000 7fe331aa9640 1 -- 172.21.15.196:0/3216041189 shutdown_connections 2024-03-18T00:00:16.567 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:16.559+0000 7fe331aa9640 1 -- 172.21.15.196:0/3216041189 wait complete. 2024-03-18T00:00:16.567 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:16.559+0000 7fe331aa9640 1 Processor -- start 2024-03-18T00:00:16.567 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:16.559+0000 7fe331aa9640 1 -- start start 2024-03-18T00:00:16.567 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:16.559+0000 7fe331aa9640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe32c151d60 0x7fe32c0cd5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:00:16.567 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:16.559+0000 7fe331aa9640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe32c152140 0x7fe32c06cd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:00:16.568 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:16.563+0000 7fe331aa9640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe32c155fd0 0x7fe32c06d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:00:16.568 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:16.563+0000 7fe331aa9640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fe32c06ff40 con 0x7fe32c155fd0 2024-03-18T00:00:16.568 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:16.563+0000 7fe331aa9640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7fe32c0c3d00 con 0x7fe32c152140 2024-03-18T00:00:16.568 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:16.563+0000 7fe331aa9640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7fe32c0c3100 con 0x7fe32c151d60 2024-03-18T00:00:16.568 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:16.563+0000 7fe32bfff640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe32c155fd0 0x7fe32c06d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:00:16.568 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:16.563+0000 7fe32affd640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe32c152140 0x7fe32c06cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:00:16.568 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:16.563+0000 7fe32bfff640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe32c155fd0 0x7fe32c06d2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.196:51416/0 (socket says 172.21.15.196:51416) 2024-03-18T00:00:16.568 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:16.563+0000 7fe32bfff640 1 -- 172.21.15.196:0/3162734284 learned_addr learned my addr 172.21.15.196:0/3162734284 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-03-18T00:00:16.568 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:16.563+0000 7fe32b7fe640 1 --2- 172.21.15.196:0/3162734284 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe32c151d60 0x7fe32c0cd5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:00:16.568 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:16.563+0000 7fe32bfff640 1 -- 172.21.15.196:0/3162734284 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe32c151d60 msgr2=0x7fe32c0cd5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:00:16.569 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:16.563+0000 7fe32bfff640 1 --2- 172.21.15.196:0/3162734284 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe32c151d60 0x7fe32c0cd5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:00:16.569 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:16.563+0000 7fe32bfff640 1 -- 172.21.15.196:0/3162734284 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe32c152140 msgr2=0x7fe32c06cd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:00:16.569 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:16.563+0000 7fe32bfff640 1 --2- 172.21.15.196:0/3162734284 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe32c152140 0x7fe32c06cd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:00:16.569 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:16.563+0000 7fe32bfff640 1 -- 172.21.15.196:0/3162734284 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe32c06e400 con 0x7fe32c155fd0 2024-03-18T00:00:16.569 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:16.563+0000 7fe32affd640 1 --2- 172.21.15.196:0/3162734284 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe32c152140 0x7fe32c06cd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T00:00:16.569 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:16.563+0000 7fe32bfff640 1 --2- 172.21.15.196:0/3162734284 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe32c155fd0 0x7fe32c06d2b0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fe32400efc0 tx=0x7fe32400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:00:16.569 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:16.563+0000 7fe313fff640 1 -- 172.21.15.196:0/3162734284 <== mon.0 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe324018020 con 0x7fe32c155fd0 2024-03-18T00:00:16.569 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:16.563+0000 7fe331aa9640 1 -- 172.21.15.196:0/3162734284 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe32c06de40 con 0x7fe32c155fd0 2024-03-18T00:00:16.569 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:16.563+0000 7fe313fff640 1 -- 172.21.15.196:0/3162734284 <== mon.0 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe324014480 con 0x7fe32c155fd0 2024-03-18T00:00:16.570 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:16.563+0000 7fe313fff640 1 -- 172.21.15.196:0/3162734284 <== mon.0 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe324014870 con 0x7fe32c155fd0 2024-03-18T00:00:16.570 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:16.563+0000 7fe331aa9640 1 -- 172.21.15.196:0/3162734284 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe32c0cb5e0 con 0x7fe32c155fd0 2024-03-18T00:00:16.570 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:16.563+0000 7fe311ffb640 1 -- 172.21.15.196:0/3162734284 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe3040052a0 con 0x7fe32c155fd0 2024-03-18T00:00:16.571 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:16.563+0000 7fe313fff640 1 -- 172.21.15.196:0/3162734284 <== mon.0 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 5) ==== 87083+0+0 (secure 0 0 0) 0x7fe32401b020 con 0x7fe32c155fd0 2024-03-18T00:00:16.571 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:16.563+0000 7fe313fff640 1 --2- 172.21.15.196:0/3162734284 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7fe318067660 0x7fe318069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:00:16.571 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:16.563+0000 7fe313fff640 1 -- 172.21.15.196:0/3162734284 <== mon.0 v2:172.21.15.196:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7fe324086260 con 0x7fe32c155fd0 2024-03-18T00:00:16.571 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:16.567+0000 7fe32b7fe640 1 --2- 172.21.15.196:0/3162734284 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7fe318067660 0x7fe318069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:00:16.571 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:16.567+0000 7fe32b7fe640 1 --2- 172.21.15.196:0/3162734284 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7fe318067660 0x7fe318069b20 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fe31c0b2000 tx=0x7fe31c009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:00:16.572 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:16.571+0000 7fe313fff640 1 -- 172.21.15.196:0/3162734284 <== mon.0 v2:172.21.15.196:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177849 (secure 0 0 0) 0x7fe324022070 con 0x7fe32c155fd0 2024-03-18T00:00:16.730 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:16.727+0000 7fe311ffb640 1 -- 172.21.15.196:0/3162734284 --> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fe304000bd0 con 0x7fe318067660 2024-03-18T00:00:16.748 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:16.743+0000 7fe313fff640 1 -- 172.21.15.196:0/3162734284 <== mgr.4099 v2:172.21.15.204:6832/2505201055 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+254711 (secure 0 0 0) 0x7fe304000bd0 con 0x7fe318067660 2024-03-18T00:00:16.751 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-03-18T00:00:16.753 INFO:teuthology.orchestra.run.smithi196.stderr:dumped all 2024-03-18T00:00:16.755 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:16.747+0000 7fe311ffb640 1 -- 172.21.15.196:0/3162734284 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7fe318067660 msgr2=0x7fe318069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:00:16.755 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:16.747+0000 7fe311ffb640 1 --2- 172.21.15.196:0/3162734284 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7fe318067660 0x7fe318069b20 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fe31c0b2000 tx=0x7fe31c009040 comp rx=0 tx=0).stop 2024-03-18T00:00:16.755 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:16.747+0000 7fe311ffb640 1 -- 172.21.15.196:0/3162734284 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe32c155fd0 msgr2=0x7fe32c06d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:00:16.755 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:16.747+0000 7fe311ffb640 1 --2- 172.21.15.196:0/3162734284 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe32c155fd0 0x7fe32c06d2b0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fe32400efc0 tx=0x7fe32400c490 comp rx=0 tx=0).stop 2024-03-18T00:00:16.755 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:16.747+0000 7fe311ffb640 1 -- 172.21.15.196:0/3162734284 shutdown_connections 2024-03-18T00:00:16.755 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:16.747+0000 7fe311ffb640 1 --2- 172.21.15.196:0/3162734284 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7fe318067660 0x7fe318069b20 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:00:16.755 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:16.747+0000 7fe311ffb640 1 --2- 172.21.15.196:0/3162734284 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe32c155fd0 0x7fe32c06d2b0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:00:16.755 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:16.747+0000 7fe311ffb640 1 --2- 172.21.15.196:0/3162734284 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe32c152140 0x7fe32c06cd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:00:16.756 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:16.747+0000 7fe311ffb640 1 --2- 172.21.15.196:0/3162734284 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe32c151d60 0x7fe32c0cd5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:00:16.756 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:16.747+0000 7fe311ffb640 1 -- 172.21.15.196:0/3162734284 >> 172.21.15.196:0/3162734284 conn(0x7fe32c071020 msgr2=0x7fe32c156ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:00:16.756 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:16.747+0000 7fe311ffb640 1 -- 172.21.15.196:0/3162734284 shutdown_connections 2024-03-18T00:00:16.756 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:16.747+0000 7fe311ffb640 1 -- 172.21.15.196:0/3162734284 wait complete. 2024-03-18T00:00:16.767 INFO:teuthology.orchestra.run.smithi196.stdout:{"pg_ready":true,"pg_map":{"version":147,"stamp":"2024-03-18T00:00:16.035121+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":131409282,"num_objects":131,"num_object_clones":0,"num_object_copies":262,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":131,"num_whiteouts":0,"num_read":3164,"num_read_kb":1535472,"num_write":30477,"num_write_kb":4409625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":25000,"num_omap_keys":50,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":34127,"ondisk_log_size":34127,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":451864,"kb_used_data":91416,"kb_used_omap":12,"kb_used_meta":360371,"kb_avail":754522856,"statfs":{"total":773094113280,"available":772631404544,"internally_reserved":0,"allocated":93609984,"data_stored":263520924,"data_compressed":38669382,"data_compressed_allocated":50274304,"data_compressed_original":221667328,"omap_allocated":12748,"internal_metadata":369020468},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002933"},"pg_stats":[{"pgid":"3.3f","version":"23'416","reported_seq":476,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:56.123680+0000","last_change":"2024-03-17T23:59:56.123680+0000","last_active":"2024-03-17T23:59:56.123680+0000","last_peered":"2024-03-17T23:59:56.123680+0000","last_clean":"2024-03-17T23:59:56.123680+0000","last_became_active":"2024-03-17T23:56:01.207533+0000","last_became_peered":"2024-03-17T23:56:01.207533+0000","last_unstale":"2024-03-17T23:59:56.123680+0000","last_undegraded":"2024-03-17T23:59:56.123680+0000","last_fullsized":"2024-03-17T23:59:56.123680+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'416","last_scrub_stamp":"2024-03-17T23:59:56.123434+0000","last_deep_scrub":"23'416","last_deep_scrub_stamp":"2024-03-17T23:59:56.123434+0000","last_clean_scrub_stamp":"2024-03-17T23:59:56.123434+0000","objects_scrubbed":0,"log_size":416,"log_dups_size":0,"ondisk_log_size":416,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T09:29:27.355585+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":22799,"num_write":382,"num_write_kb":63271,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"23'451","reported_seq":568,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-18T00:00:02.741250+0000","last_change":"2024-03-18T00:00:02.741250+0000","last_active":"2024-03-18T00:00:02.741250+0000","last_peered":"2024-03-18T00:00:02.741250+0000","last_clean":"2024-03-18T00:00:02.741250+0000","last_became_active":"2024-03-17T23:56:01.192736+0000","last_became_peered":"2024-03-17T23:56:01.192736+0000","last_unstale":"2024-03-18T00:00:02.741250+0000","last_undegraded":"2024-03-18T00:00:02.741250+0000","last_fullsized":"2024-03-18T00:00:02.741250+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'451","last_scrub_stamp":"2024-03-18T00:00:02.741070+0000","last_deep_scrub":"23'451","last_deep_scrub_stamp":"2024-03-18T00:00:02.741070+0000","last_clean_scrub_stamp":"2024-03-18T00:00:02.741070+0000","objects_scrubbed":0,"log_size":451,"log_dups_size":0,"ondisk_log_size":451,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T05:44:44.206452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":90,"num_read_kb":44601,"num_write":422,"num_write_kb":92038,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"23'361","reported_seq":405,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:54.538515+0000","last_change":"2024-03-17T23:59:54.538515+0000","last_active":"2024-03-17T23:59:54.538515+0000","last_peered":"2024-03-17T23:59:54.538515+0000","last_clean":"2024-03-17T23:59:54.538515+0000","last_became_active":"2024-03-17T23:56:01.188339+0000","last_became_peered":"2024-03-17T23:56:01.188339+0000","last_unstale":"2024-03-17T23:59:54.538515+0000","last_undegraded":"2024-03-17T23:59:54.538515+0000","last_fullsized":"2024-03-17T23:59:54.538515+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'361","last_scrub_stamp":"2024-03-17T23:59:54.538346+0000","last_deep_scrub":"23'361","last_deep_scrub_stamp":"2024-03-17T23:59:54.538346+0000","last_clean_scrub_stamp":"2024-03-17T23:59:54.538346+0000","objects_scrubbed":0,"log_size":361,"log_dups_size":0,"ondisk_log_size":361,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T02:27:37.261511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":9522,"num_write":340,"num_write_kb":42370,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"23'375","reported_seq":439,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-18T00:00:07.322477+0000","last_change":"2024-03-18T00:00:07.322513+0000","last_active":"2024-03-18T00:00:07.322477+0000","last_peered":"2024-03-18T00:00:07.322477+0000","last_clean":"2024-03-18T00:00:07.322477+0000","last_became_active":"2024-03-17T23:56:01.196978+0000","last_became_peered":"2024-03-17T23:56:01.196978+0000","last_unstale":"2024-03-18T00:00:07.322477+0000","last_undegraded":"2024-03-18T00:00:07.322477+0000","last_fullsized":"2024-03-18T00:00:07.322477+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'375","last_scrub_stamp":"2024-03-18T00:00:07.322395+0000","last_deep_scrub":"23'375","last_deep_scrub_stamp":"2024-03-18T00:00:07.322395+0000","last_clean_scrub_stamp":"2024-03-18T00:00:07.322395+0000","objects_scrubbed":0,"log_size":375,"log_dups_size":0,"ondisk_log_size":375,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T00:15:52.916824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":11889,"num_write":341,"num_write_kb":42361,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"23'410","reported_seq":474,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:57.092403+0000","last_change":"2024-03-17T23:59:57.092439+0000","last_active":"2024-03-17T23:59:57.092403+0000","last_peered":"2024-03-17T23:59:57.092403+0000","last_clean":"2024-03-17T23:59:57.092403+0000","last_became_active":"2024-03-17T23:56:01.194710+0000","last_became_peered":"2024-03-17T23:56:01.194710+0000","last_unstale":"2024-03-17T23:59:57.092403+0000","last_undegraded":"2024-03-17T23:59:57.092403+0000","last_fullsized":"2024-03-17T23:59:57.092403+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'410","last_scrub_stamp":"2024-03-17T23:59:57.092316+0000","last_deep_scrub":"23'410","last_deep_scrub_stamp":"2024-03-17T23:59:57.092316+0000","last_clean_scrub_stamp":"2024-03-17T23:59:57.092316+0000","objects_scrubbed":0,"log_size":410,"log_dups_size":0,"ondisk_log_size":410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T09:37:03.685324+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":20292,"num_write":376,"num_write_kb":22112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"23'379","reported_seq":429,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-18T00:00:05.300740+0000","last_change":"2024-03-18T00:00:05.300859+0000","last_active":"2024-03-18T00:00:05.300740+0000","last_peered":"2024-03-18T00:00:05.300740+0000","last_clean":"2024-03-18T00:00:05.300740+0000","last_became_active":"2024-03-17T23:56:01.192908+0000","last_became_peered":"2024-03-17T23:56:01.192908+0000","last_unstale":"2024-03-18T00:00:05.300740+0000","last_undegraded":"2024-03-18T00:00:05.300740+0000","last_fullsized":"2024-03-18T00:00:05.300740+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'379","last_scrub_stamp":"2024-03-18T00:00:05.300539+0000","last_deep_scrub":"23'379","last_deep_scrub_stamp":"2024-03-18T00:00:05.300539+0000","last_clean_scrub_stamp":"2024-03-18T00:00:05.300539+0000","objects_scrubbed":0,"log_size":379,"log_dups_size":0,"ondisk_log_size":379,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T04:33:31.370541+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":17487,"num_write":350,"num_write_kb":34234,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"23'439","reported_seq":533,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-18T00:00:07.012231+0000","last_change":"2024-03-18T00:00:07.012268+0000","last_active":"2024-03-18T00:00:07.012231+0000","last_peered":"2024-03-18T00:00:07.012231+0000","last_clean":"2024-03-18T00:00:07.012231+0000","last_became_active":"2024-03-17T23:56:01.199550+0000","last_became_peered":"2024-03-17T23:56:01.199550+0000","last_unstale":"2024-03-18T00:00:07.012231+0000","last_undegraded":"2024-03-18T00:00:07.012231+0000","last_fullsized":"2024-03-18T00:00:07.012231+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'439","last_scrub_stamp":"2024-03-18T00:00:07.012142+0000","last_deep_scrub":"23'439","last_deep_scrub_stamp":"2024-03-18T00:00:07.012142+0000","last_clean_scrub_stamp":"2024-03-18T00:00:07.012142+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T04:05:05.635943+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":32233,"num_write":412,"num_write_kb":77021,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"23'355","reported_seq":419,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-18T00:00:03.112055+0000","last_change":"2024-03-18T00:00:03.112116+0000","last_active":"2024-03-18T00:00:03.112055+0000","last_peered":"2024-03-18T00:00:03.112055+0000","last_clean":"2024-03-18T00:00:03.112055+0000","last_became_active":"2024-03-17T23:56:01.211860+0000","last_became_peered":"2024-03-17T23:56:01.211860+0000","last_unstale":"2024-03-18T00:00:03.112055+0000","last_undegraded":"2024-03-18T00:00:03.112055+0000","last_fullsized":"2024-03-18T00:00:03.112055+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'355","last_scrub_stamp":"2024-03-18T00:00:03.111850+0000","last_deep_scrub":"23'355","last_deep_scrub_stamp":"2024-03-18T00:00:03.111850+0000","last_clean_scrub_stamp":"2024-03-18T00:00:03.111850+0000","objects_scrubbed":0,"log_size":355,"log_dups_size":0,"ondisk_log_size":355,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T05:44:44.577232+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":19734,"num_write":322,"num_write_kb":51043,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"23'422","reported_seq":480,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-18T00:00:12.063241+0000","last_change":"2024-03-18T00:00:12.063277+0000","last_active":"2024-03-18T00:00:12.063241+0000","last_peered":"2024-03-18T00:00:12.063241+0000","last_clean":"2024-03-18T00:00:12.063241+0000","last_became_active":"2024-03-17T23:56:01.213795+0000","last_became_peered":"2024-03-17T23:56:01.213795+0000","last_unstale":"2024-03-18T00:00:12.063241+0000","last_undegraded":"2024-03-18T00:00:12.063241+0000","last_fullsized":"2024-03-18T00:00:12.063241+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'422","last_scrub_stamp":"2024-03-18T00:00:12.063135+0000","last_deep_scrub":"23'422","last_deep_scrub_stamp":"2024-03-18T00:00:12.063135+0000","last_clean_scrub_stamp":"2024-03-18T00:00:12.063135+0000","objects_scrubbed":0,"log_size":422,"log_dups_size":0,"ondisk_log_size":422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T10:57:31.364762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":22221,"num_write":389,"num_write_kb":59485,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"23'402","reported_seq":464,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-18T00:00:05.860926+0000","last_change":"2024-03-18T00:00:05.860986+0000","last_active":"2024-03-18T00:00:05.860926+0000","last_peered":"2024-03-18T00:00:05.860926+0000","last_clean":"2024-03-18T00:00:05.860926+0000","last_became_active":"2024-03-17T23:56:01.211620+0000","last_became_peered":"2024-03-17T23:56:01.211620+0000","last_unstale":"2024-03-18T00:00:05.860926+0000","last_undegraded":"2024-03-18T00:00:05.860926+0000","last_fullsized":"2024-03-18T00:00:05.860926+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'402","last_scrub_stamp":"2024-03-18T00:00:05.860748+0000","last_deep_scrub":"23'402","last_deep_scrub_stamp":"2024-03-18T00:00:05.860748+0000","last_clean_scrub_stamp":"2024-03-18T00:00:05.860748+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T05:44:47.326130+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":18482,"num_write":357,"num_write_kb":55072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"23'371","reported_seq":434,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-18T00:00:06.892344+0000","last_change":"2024-03-18T00:00:06.892405+0000","last_active":"2024-03-18T00:00:06.892344+0000","last_peered":"2024-03-18T00:00:06.892344+0000","last_clean":"2024-03-18T00:00:06.892344+0000","last_became_active":"2024-03-17T23:56:01.211561+0000","last_became_peered":"2024-03-17T23:56:01.211561+0000","last_unstale":"2024-03-18T00:00:06.892344+0000","last_undegraded":"2024-03-18T00:00:06.892344+0000","last_fullsized":"2024-03-18T00:00:06.892344+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'371","last_scrub_stamp":"2024-03-18T00:00:06.892140+0000","last_deep_scrub":"23'371","last_deep_scrub_stamp":"2024-03-18T00:00:06.892140+0000","last_clean_scrub_stamp":"2024-03-18T00:00:06.892140+0000","objects_scrubbed":0,"log_size":371,"log_dups_size":0,"ondisk_log_size":371,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T11:37:54.876672+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":21281,"num_write":349,"num_write_kb":38541,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"23'389","reported_seq":440,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:57.362001+0000","last_change":"2024-03-17T23:59:57.362038+0000","last_active":"2024-03-17T23:59:57.362001+0000","last_peered":"2024-03-17T23:59:57.362001+0000","last_clean":"2024-03-17T23:59:57.362001+0000","last_became_active":"2024-03-17T23:56:01.186012+0000","last_became_peered":"2024-03-17T23:56:01.186012+0000","last_unstale":"2024-03-17T23:59:57.362001+0000","last_undegraded":"2024-03-17T23:59:57.362001+0000","last_fullsized":"2024-03-17T23:59:57.362001+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'389","last_scrub_stamp":"2024-03-17T23:59:57.361916+0000","last_deep_scrub":"23'389","last_deep_scrub_stamp":"2024-03-17T23:59:57.361916+0000","last_clean_scrub_stamp":"2024-03-17T23:59:57.361916+0000","objects_scrubbed":0,"log_size":389,"log_dups_size":0,"ondisk_log_size":389,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T11:10:52.008125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":10579,"num_write":363,"num_write_kb":91649,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"23'398","reported_seq":472,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-18T00:00:06.122679+0000","last_change":"2024-03-18T00:00:06.122716+0000","last_active":"2024-03-18T00:00:06.122679+0000","last_peered":"2024-03-18T00:00:06.122679+0000","last_clean":"2024-03-18T00:00:06.122679+0000","last_became_active":"2024-03-17T23:56:01.205058+0000","last_became_peered":"2024-03-17T23:56:01.205058+0000","last_unstale":"2024-03-18T00:00:06.122679+0000","last_undegraded":"2024-03-18T00:00:06.122679+0000","last_fullsized":"2024-03-18T00:00:06.122679+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'398","last_scrub_stamp":"2024-03-18T00:00:06.122584+0000","last_deep_scrub":"23'398","last_deep_scrub_stamp":"2024-03-18T00:00:06.122584+0000","last_clean_scrub_stamp":"2024-03-18T00:00:06.122584+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T04:33:32.192587+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":19128,"num_write":366,"num_write_kb":47322,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"23'424","reported_seq":503,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:56.461266+0000","last_change":"2024-03-17T23:59:56.461311+0000","last_active":"2024-03-17T23:59:56.461266+0000","last_peered":"2024-03-17T23:59:56.461266+0000","last_clean":"2024-03-17T23:59:56.461266+0000","last_became_active":"2024-03-17T23:56:01.195960+0000","last_became_peered":"2024-03-17T23:56:01.195960+0000","last_unstale":"2024-03-17T23:59:56.461266+0000","last_undegraded":"2024-03-17T23:59:56.461266+0000","last_fullsized":"2024-03-17T23:59:56.461266+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'424","last_scrub_stamp":"2024-03-17T23:59:56.461157+0000","last_deep_scrub":"23'424","last_deep_scrub_stamp":"2024-03-17T23:59:56.461157+0000","last_clean_scrub_stamp":"2024-03-17T23:59:56.461157+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T01:25:56.559926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":28789,"num_write":400,"num_write_kb":133401,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"23'431","reported_seq":497,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:59.778735+0000","last_change":"2024-03-17T23:59:59.778774+0000","last_active":"2024-03-17T23:59:59.778735+0000","last_peered":"2024-03-17T23:59:59.778735+0000","last_clean":"2024-03-17T23:59:59.778735+0000","last_became_active":"2024-03-17T23:56:01.181405+0000","last_became_peered":"2024-03-17T23:56:01.181405+0000","last_unstale":"2024-03-17T23:59:59.778735+0000","last_undegraded":"2024-03-17T23:59:59.778735+0000","last_fullsized":"2024-03-17T23:59:59.778735+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'431","last_scrub_stamp":"2024-03-17T23:59:59.778649+0000","last_deep_scrub":"23'431","last_deep_scrub_stamp":"2024-03-17T23:59:59.778649+0000","last_clean_scrub_stamp":"2024-03-17T23:59:59.778649+0000","objects_scrubbed":0,"log_size":431,"log_dups_size":0,"ondisk_log_size":431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T01:22:18.756831+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":18708,"num_write":399,"num_write_kb":108829,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"23'444","reported_seq":501,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-18T00:00:03.263031+0000","last_change":"2024-03-18T00:00:03.263087+0000","last_active":"2024-03-18T00:00:03.263031+0000","last_peered":"2024-03-18T00:00:03.263031+0000","last_clean":"2024-03-18T00:00:03.263031+0000","last_became_active":"2024-03-17T23:56:01.193384+0000","last_became_peered":"2024-03-17T23:56:01.193384+0000","last_unstale":"2024-03-18T00:00:03.263031+0000","last_undegraded":"2024-03-18T00:00:03.263031+0000","last_fullsized":"2024-03-18T00:00:03.263031+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'444","last_scrub_stamp":"2024-03-18T00:00:03.262945+0000","last_deep_scrub":"23'444","last_deep_scrub_stamp":"2024-03-18T00:00:03.262945+0000","last_clean_scrub_stamp":"2024-03-18T00:00:03.262945+0000","objects_scrubbed":0,"log_size":444,"log_dups_size":0,"ondisk_log_size":444,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T10:11:08.202412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":15377,"num_write":410,"num_write_kb":59358,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"23'402","reported_seq":451,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-18T00:00:01.212488+0000","last_change":"2024-03-18T00:00:01.212526+0000","last_active":"2024-03-18T00:00:01.212488+0000","last_peered":"2024-03-18T00:00:01.212488+0000","last_clean":"2024-03-18T00:00:01.212488+0000","last_became_active":"2024-03-17T23:56:49.201243+0000","last_became_peered":"2024-03-17T23:56:49.201243+0000","last_unstale":"2024-03-18T00:00:01.212488+0000","last_undegraded":"2024-03-18T00:00:01.212488+0000","last_fullsized":"2024-03-18T00:00:01.212488+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'402","last_scrub_stamp":"2024-03-18T00:00:01.212414+0000","last_deep_scrub":"23'402","last_deep_scrub_stamp":"2024-03-18T00:00:01.212414+0000","last_clean_scrub_stamp":"2024-03-18T00:00:01.212414+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T01:26:01.311183+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":17500,"num_write":362,"num_write_kb":30628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"23'423","reported_seq":533,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:58.115480+0000","last_change":"2024-03-17T23:59:58.115541+0000","last_active":"2024-03-17T23:59:58.115480+0000","last_peered":"2024-03-17T23:59:58.115480+0000","last_clean":"2024-03-17T23:59:58.115480+0000","last_became_active":"2024-03-17T23:56:01.186001+0000","last_became_peered":"2024-03-17T23:56:01.186001+0000","last_unstale":"2024-03-17T23:59:58.115480+0000","last_undegraded":"2024-03-17T23:59:58.115480+0000","last_fullsized":"2024-03-17T23:59:58.115480+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'423","last_scrub_stamp":"2024-03-17T23:59:58.115313+0000","last_deep_scrub":"23'423","last_deep_scrub_stamp":"2024-03-17T23:59:58.115313+0000","last_clean_scrub_stamp":"2024-03-17T23:59:58.115313+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T09:05:32.852197+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":84,"num_read_kb":38931,"num_write":386,"num_write_kb":103946,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"23'421","reported_seq":502,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-18T00:00:05.053277+0000","last_change":"2024-03-18T00:00:05.053314+0000","last_active":"2024-03-18T00:00:05.053277+0000","last_peered":"2024-03-18T00:00:05.053277+0000","last_clean":"2024-03-18T00:00:05.053277+0000","last_became_active":"2024-03-17T23:56:01.194579+0000","last_became_peered":"2024-03-17T23:56:01.194579+0000","last_unstale":"2024-03-18T00:00:05.053277+0000","last_undegraded":"2024-03-18T00:00:05.053277+0000","last_fullsized":"2024-03-18T00:00:05.053277+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'421","last_scrub_stamp":"2024-03-18T00:00:05.053189+0000","last_deep_scrub":"23'421","last_deep_scrub_stamp":"2024-03-18T00:00:05.053189+0000","last_clean_scrub_stamp":"2024-03-18T00:00:05.053189+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T01:23:21.654856+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":55,"num_read_kb":28885,"num_write":381,"num_write_kb":71633,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"23'457","reported_seq":561,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-18T00:00:00.935718+0000","last_change":"2024-03-18T00:00:00.935757+0000","last_active":"2024-03-18T00:00:00.935718+0000","last_peered":"2024-03-18T00:00:00.935718+0000","last_clean":"2024-03-18T00:00:00.935718+0000","last_became_active":"2024-03-17T23:56:01.192711+0000","last_became_peered":"2024-03-17T23:56:01.192711+0000","last_unstale":"2024-03-18T00:00:00.935718+0000","last_undegraded":"2024-03-18T00:00:00.935718+0000","last_fullsized":"2024-03-18T00:00:00.935718+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'457","last_scrub_stamp":"2024-03-18T00:00:00.935622+0000","last_deep_scrub":"23'457","last_deep_scrub_stamp":"2024-03-18T00:00:00.935622+0000","last_clean_scrub_stamp":"2024-03-18T00:00:00.935622+0000","objects_scrubbed":0,"log_size":457,"log_dups_size":0,"ondisk_log_size":457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T11:43:30.841112+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":48668,"num_write":427,"num_write_kb":117132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"23'407","reported_seq":469,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:59.444505+0000","last_change":"2024-03-17T23:59:59.444542+0000","last_active":"2024-03-17T23:59:59.444505+0000","last_peered":"2024-03-17T23:59:59.444505+0000","last_clean":"2024-03-17T23:59:59.444505+0000","last_became_active":"2024-03-17T23:56:01.202491+0000","last_became_peered":"2024-03-17T23:56:01.202491+0000","last_unstale":"2024-03-17T23:59:59.444505+0000","last_undegraded":"2024-03-17T23:59:59.444505+0000","last_fullsized":"2024-03-17T23:59:59.444505+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'407","last_scrub_stamp":"2024-03-17T23:59:59.444416+0000","last_deep_scrub":"23'407","last_deep_scrub_stamp":"2024-03-17T23:59:59.444416+0000","last_clean_scrub_stamp":"2024-03-17T23:59:59.444416+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T01:22:18.422598+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":19175,"num_write":379,"num_write_kb":50742,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"23'423","reported_seq":488,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-18T00:00:00.176141+0000","last_change":"2024-03-18T00:00:00.176181+0000","last_active":"2024-03-18T00:00:00.176141+0000","last_peered":"2024-03-18T00:00:00.176141+0000","last_clean":"2024-03-18T00:00:00.176141+0000","last_became_active":"2024-03-17T23:56:49.199410+0000","last_became_peered":"2024-03-17T23:56:49.199410+0000","last_unstale":"2024-03-18T00:00:00.176141+0000","last_undegraded":"2024-03-18T00:00:00.176141+0000","last_fullsized":"2024-03-18T00:00:00.176141+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'423","last_scrub_stamp":"2024-03-18T00:00:00.176044+0000","last_deep_scrub":"23'423","last_deep_scrub_stamp":"2024-03-18T00:00:00.176044+0000","last_clean_scrub_stamp":"2024-03-18T00:00:00.176044+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T00:57:12.914135+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":41103,"num_write":390,"num_write_kb":67292,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.29","version":"23'406","reported_seq":472,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-18T00:00:05.076225+0000","last_change":"2024-03-18T00:00:05.076262+0000","last_active":"2024-03-18T00:00:05.076225+0000","last_peered":"2024-03-18T00:00:05.076225+0000","last_clean":"2024-03-18T00:00:05.076225+0000","last_became_active":"2024-03-17T23:56:01.205601+0000","last_became_peered":"2024-03-17T23:56:01.205601+0000","last_unstale":"2024-03-18T00:00:05.076225+0000","last_undegraded":"2024-03-18T00:00:05.076225+0000","last_fullsized":"2024-03-18T00:00:05.076225+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'406","last_scrub_stamp":"2024-03-18T00:00:05.076135+0000","last_deep_scrub":"23'406","last_deep_scrub_stamp":"2024-03-18T00:00:05.076135+0000","last_clean_scrub_stamp":"2024-03-18T00:00:05.076135+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T11:50:18.484909+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":19558,"num_write":374,"num_write_kb":63755,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"23'448","reported_seq":544,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-18T00:00:04.281249+0000","last_change":"2024-03-18T00:00:04.281328+0000","last_active":"2024-03-18T00:00:04.281249+0000","last_peered":"2024-03-18T00:00:04.281249+0000","last_clean":"2024-03-18T00:00:04.281249+0000","last_became_active":"2024-03-17T23:56:01.194290+0000","last_became_peered":"2024-03-17T23:56:01.194290+0000","last_unstale":"2024-03-18T00:00:04.281249+0000","last_undegraded":"2024-03-18T00:00:04.281249+0000","last_fullsized":"2024-03-18T00:00:04.281249+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'448","last_scrub_stamp":"2024-03-18T00:00:04.281062+0000","last_deep_scrub":"23'448","last_deep_scrub_stamp":"2024-03-18T00:00:04.281062+0000","last_clean_scrub_stamp":"2024-03-18T00:00:04.281062+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T11:50:17.689836+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":70,"num_read_kb":26782,"num_write":421,"num_write_kb":88405,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"23'403","reported_seq":465,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:58.126062+0000","last_change":"2024-03-17T23:59:58.126098+0000","last_active":"2024-03-17T23:59:58.126062+0000","last_peered":"2024-03-17T23:59:58.126062+0000","last_clean":"2024-03-17T23:59:58.126062+0000","last_became_active":"2024-03-17T23:56:01.204456+0000","last_became_peered":"2024-03-17T23:56:01.204456+0000","last_unstale":"2024-03-17T23:59:58.126062+0000","last_undegraded":"2024-03-17T23:59:58.126062+0000","last_fullsized":"2024-03-17T23:59:58.126062+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'403","last_scrub_stamp":"2024-03-17T23:59:58.125976+0000","last_deep_scrub":"23'403","last_deep_scrub_stamp":"2024-03-17T23:59:58.125976+0000","last_clean_scrub_stamp":"2024-03-17T23:59:58.125976+0000","objects_scrubbed":0,"log_size":403,"log_dups_size":0,"ondisk_log_size":403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T09:29:29.358126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":21212,"num_write":389,"num_write_kb":62665,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"23'456","reported_seq":526,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-18T00:00:04.874640+0000","last_change":"2024-03-18T00:00:04.874706+0000","last_active":"2024-03-18T00:00:04.874640+0000","last_peered":"2024-03-18T00:00:04.874640+0000","last_clean":"2024-03-18T00:00:04.874640+0000","last_became_active":"2024-03-17T23:56:01.210025+0000","last_became_peered":"2024-03-17T23:56:01.210025+0000","last_unstale":"2024-03-18T00:00:04.874640+0000","last_undegraded":"2024-03-18T00:00:04.874640+0000","last_fullsized":"2024-03-18T00:00:04.874640+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'456","last_scrub_stamp":"2024-03-18T00:00:04.874456+0000","last_deep_scrub":"23'456","last_deep_scrub_stamp":"2024-03-18T00:00:04.874456+0000","last_clean_scrub_stamp":"2024-03-18T00:00:04.874456+0000","objects_scrubbed":0,"log_size":456,"log_dups_size":0,"ondisk_log_size":456,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T05:18:04.192120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":24179,"num_write":417,"num_write_kb":68058,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"23'406","reported_seq":497,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-18T00:00:03.704267+0000","last_change":"2024-03-18T00:00:03.704306+0000","last_active":"2024-03-18T00:00:03.704267+0000","last_peered":"2024-03-18T00:00:03.704267+0000","last_clean":"2024-03-18T00:00:03.704267+0000","last_became_active":"2024-03-17T23:56:01.204676+0000","last_became_peered":"2024-03-17T23:56:01.204676+0000","last_unstale":"2024-03-18T00:00:03.704267+0000","last_undegraded":"2024-03-18T00:00:03.704267+0000","last_fullsized":"2024-03-18T00:00:03.704267+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'406","last_scrub_stamp":"2024-03-18T00:00:03.704167+0000","last_deep_scrub":"23'406","last_deep_scrub_stamp":"2024-03-18T00:00:03.704167+0000","last_clean_scrub_stamp":"2024-03-18T00:00:03.704167+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T11:37:51.688699+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":32120,"num_write":380,"num_write_kb":55330,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"23'390","reported_seq":479,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:59.081294+0000","last_change":"2024-03-17T23:59:59.081415+0000","last_active":"2024-03-17T23:59:59.081294+0000","last_peered":"2024-03-17T23:59:59.081294+0000","last_clean":"2024-03-17T23:59:59.081294+0000","last_became_active":"2024-03-17T23:56:01.204637+0000","last_became_peered":"2024-03-17T23:56:01.204637+0000","last_unstale":"2024-03-17T23:59:59.081294+0000","last_undegraded":"2024-03-17T23:59:59.081294+0000","last_fullsized":"2024-03-17T23:59:59.081294+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'390","last_scrub_stamp":"2024-03-17T23:59:59.080999+0000","last_deep_scrub":"23'390","last_deep_scrub_stamp":"2024-03-17T23:59:59.080999+0000","last_clean_scrub_stamp":"2024-03-17T23:59:59.080999+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T09:37:05.674008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":33745,"num_write":363,"num_write_kb":72094,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"23'405","reported_seq":493,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-18T00:00:00.487022+0000","last_change":"2024-03-18T00:00:00.487022+0000","last_active":"2024-03-18T00:00:00.487022+0000","last_peered":"2024-03-18T00:00:00.487022+0000","last_clean":"2024-03-18T00:00:00.487022+0000","last_became_active":"2024-03-17T23:56:01.206466+0000","last_became_peered":"2024-03-17T23:56:01.206466+0000","last_unstale":"2024-03-18T00:00:00.487022+0000","last_undegraded":"2024-03-18T00:00:00.487022+0000","last_fullsized":"2024-03-18T00:00:00.487022+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'405","last_scrub_stamp":"2024-03-18T00:00:00.486871+0000","last_deep_scrub":"23'405","last_deep_scrub_stamp":"2024-03-18T00:00:00.486871+0000","last_clean_scrub_stamp":"2024-03-18T00:00:00.486871+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T03:11:43.443092+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":31525,"num_write":373,"num_write_kb":67528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"23'457","reported_seq":529,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-18T00:00:08.366075+0000","last_change":"2024-03-18T00:00:08.366075+0000","last_active":"2024-03-18T00:00:08.366075+0000","last_peered":"2024-03-18T00:00:08.366075+0000","last_clean":"2024-03-18T00:00:08.366075+0000","last_became_active":"2024-03-17T23:56:01.204418+0000","last_became_peered":"2024-03-17T23:56:01.204418+0000","last_unstale":"2024-03-18T00:00:08.366075+0000","last_undegraded":"2024-03-18T00:00:08.366075+0000","last_fullsized":"2024-03-18T00:00:08.366075+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'457","last_scrub_stamp":"2024-03-18T00:00:08.365811+0000","last_deep_scrub":"23'457","last_deep_scrub_stamp":"2024-03-18T00:00:08.365811+0000","last_clean_scrub_stamp":"2024-03-18T00:00:08.365811+0000","objects_scrubbed":0,"log_size":457,"log_dups_size":0,"ondisk_log_size":457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T04:05:06.989612+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":20620,"num_write":418,"num_write_kb":58690,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"23'455","reported_seq":538,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:59.156595+0000","last_change":"2024-03-17T23:59:59.156595+0000","last_active":"2024-03-17T23:59:59.156595+0000","last_peered":"2024-03-17T23:59:59.156595+0000","last_clean":"2024-03-17T23:59:59.156595+0000","last_became_active":"2024-03-17T23:56:01.212456+0000","last_became_peered":"2024-03-17T23:56:01.212456+0000","last_unstale":"2024-03-17T23:59:59.156595+0000","last_undegraded":"2024-03-17T23:59:59.156595+0000","last_fullsized":"2024-03-17T23:59:59.156595+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'455","last_scrub_stamp":"2024-03-17T23:59:59.156212+0000","last_deep_scrub":"23'455","last_deep_scrub_stamp":"2024-03-17T23:59:59.156212+0000","last_clean_scrub_stamp":"2024-03-17T23:59:59.156212+0000","objects_scrubbed":0,"log_size":455,"log_dups_size":0,"ondisk_log_size":455,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T10:52:28.148974+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":21571,"num_write":428,"num_write_kb":105002,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"23'449","reported_seq":521,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-18T00:00:03.882635+0000","last_change":"2024-03-18T00:00:03.882635+0000","last_active":"2024-03-18T00:00:03.882635+0000","last_peered":"2024-03-18T00:00:03.882635+0000","last_clean":"2024-03-18T00:00:03.882635+0000","last_became_active":"2024-03-17T23:56:01.196672+0000","last_became_peered":"2024-03-17T23:56:01.196672+0000","last_unstale":"2024-03-18T00:00:03.882635+0000","last_undegraded":"2024-03-18T00:00:03.882635+0000","last_fullsized":"2024-03-18T00:00:03.882635+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'449","last_scrub_stamp":"2024-03-18T00:00:03.882483+0000","last_deep_scrub":"23'449","last_deep_scrub_stamp":"2024-03-18T00:00:03.882483+0000","last_clean_scrub_stamp":"2024-03-18T00:00:03.882483+0000","objects_scrubbed":0,"log_size":449,"log_dups_size":0,"ondisk_log_size":449,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T03:11:46.838703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":29527,"num_write":419,"num_write_kb":89588,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"23'417","reported_seq":489,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:56.319609+0000","last_change":"2024-03-17T23:59:56.319646+0000","last_active":"2024-03-17T23:59:56.319609+0000","last_peered":"2024-03-17T23:59:56.319609+0000","last_clean":"2024-03-17T23:59:56.319609+0000","last_became_active":"2024-03-17T23:56:01.168199+0000","last_became_peered":"2024-03-17T23:56:01.168199+0000","last_unstale":"2024-03-17T23:59:56.319609+0000","last_undegraded":"2024-03-17T23:59:56.319609+0000","last_fullsized":"2024-03-17T23:59:56.319609+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'417","last_scrub_stamp":"2024-03-17T23:59:56.319520+0000","last_deep_scrub":"23'417","last_deep_scrub_stamp":"2024-03-17T23:59:56.319520+0000","last_clean_scrub_stamp":"2024-03-17T23:59:56.319520+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T07:19:15.687099+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":34411,"num_write":387,"num_write_kb":91588,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"23'78","reported_seq":106,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:54.199480+0000","last_change":"2024-03-17T23:59:54.199523+0000","last_active":"2024-03-17T23:59:54.199480+0000","last_peered":"2024-03-17T23:59:54.199480+0000","last_clean":"2024-03-17T23:59:54.199480+0000","last_became_active":"2024-03-17T23:56:00.674772+0000","last_became_peered":"2024-03-17T23:56:00.674772+0000","last_unstale":"2024-03-17T23:59:54.199480+0000","last_undegraded":"2024-03-17T23:59:54.199480+0000","last_fullsized":"2024-03-17T23:59:54.199480+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'78","last_scrub_stamp":"2024-03-17T23:59:54.199388+0000","last_deep_scrub":"23'78","last_deep_scrub_stamp":"2024-03-17T23:59:54.199388+0000","last_clean_scrub_stamp":"2024-03-17T23:59:54.199388+0000","objects_scrubbed":3,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T09:59:35.071392+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4195508,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33,"num_write_kb":4113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"23'387","reported_seq":437,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:57.481899+0000","last_change":"2024-03-17T23:59:57.481923+0000","last_active":"2024-03-17T23:59:57.481899+0000","last_peered":"2024-03-17T23:59:57.481899+0000","last_clean":"2024-03-17T23:59:57.481899+0000","last_became_active":"2024-03-17T23:56:01.199084+0000","last_became_peered":"2024-03-17T23:56:01.199084+0000","last_unstale":"2024-03-17T23:59:57.481899+0000","last_undegraded":"2024-03-17T23:59:57.481899+0000","last_fullsized":"2024-03-17T23:59:57.481899+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'387","last_scrub_stamp":"2024-03-17T23:59:57.481813+0000","last_deep_scrub":"23'387","last_deep_scrub_stamp":"2024-03-17T23:59:57.481813+0000","last_clean_scrub_stamp":"2024-03-17T23:59:57.481813+0000","objects_scrubbed":0,"log_size":387,"log_dups_size":0,"ondisk_log_size":387,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T11:43:27.387304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":13388,"num_write":363,"num_write_kb":66558,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"23'381","reported_seq":409,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:55.999425+0000","last_change":"2024-03-17T23:59:55.999476+0000","last_active":"2024-03-17T23:59:55.999425+0000","last_peered":"2024-03-17T23:59:55.999425+0000","last_clean":"2024-03-17T23:59:55.999425+0000","last_became_active":"2024-03-17T23:56:00.682487+0000","last_became_peered":"2024-03-17T23:56:00.682487+0000","last_unstale":"2024-03-17T23:59:55.999425+0000","last_undegraded":"2024-03-17T23:59:55.999425+0000","last_fullsized":"2024-03-17T23:59:55.999425+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'381","last_scrub_stamp":"2024-03-17T23:59:55.999329+0000","last_deep_scrub":"23'381","last_deep_scrub_stamp":"2024-03-17T23:59:55.999329+0000","last_clean_scrub_stamp":"2024-03-17T23:59:55.999329+0000","objects_scrubbed":6,"log_size":381,"log_dups_size":0,"ondisk_log_size":381,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T05:17:47.604301+0000","scrub_duration":55,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":319,"num_write_kb":12441,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"23'249","reported_seq":277,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:55.186440+0000","last_change":"2024-03-17T23:59:55.186486+0000","last_active":"2024-03-17T23:59:55.186440+0000","last_peered":"2024-03-17T23:59:55.186440+0000","last_clean":"2024-03-17T23:59:55.186440+0000","last_became_active":"2024-03-17T23:56:00.688016+0000","last_became_peered":"2024-03-17T23:56:00.688016+0000","last_unstale":"2024-03-17T23:59:55.186440+0000","last_undegraded":"2024-03-17T23:59:55.186440+0000","last_fullsized":"2024-03-17T23:59:55.186440+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'249","last_scrub_stamp":"2024-03-17T23:59:55.186337+0000","last_deep_scrub":"23'249","last_deep_scrub_stamp":"2024-03-17T23:59:55.186337+0000","last_clean_scrub_stamp":"2024-03-17T23:59:55.186337+0000","objects_scrubbed":3,"log_size":249,"log_dups_size":0,"ondisk_log_size":249,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T02:27:37.909503+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":201,"num_write_kb":4204,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"23'436","reported_seq":497,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-18T00:00:00.126577+0000","last_change":"2024-03-18T00:00:00.126617+0000","last_active":"2024-03-18T00:00:00.126577+0000","last_peered":"2024-03-18T00:00:00.126577+0000","last_clean":"2024-03-18T00:00:00.126577+0000","last_became_active":"2024-03-17T23:56:01.205709+0000","last_became_peered":"2024-03-17T23:56:01.205709+0000","last_unstale":"2024-03-18T00:00:00.126577+0000","last_undegraded":"2024-03-18T00:00:00.126577+0000","last_fullsized":"2024-03-18T00:00:00.126577+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'436","last_scrub_stamp":"2024-03-18T00:00:00.126468+0000","last_deep_scrub":"23'436","last_deep_scrub_stamp":"2024-03-18T00:00:00.126468+0000","last_clean_scrub_stamp":"2024-03-18T00:00:00.126468+0000","objects_scrubbed":0,"log_size":436,"log_dups_size":0,"ondisk_log_size":436,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T01:22:19.104650+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":21447,"num_write":401,"num_write_kb":58853,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"23'780","reported_seq":808,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:57.271758+0000","last_change":"2024-03-17T23:59:57.271878+0000","last_active":"2024-03-17T23:59:57.271758+0000","last_peered":"2024-03-17T23:59:57.271758+0000","last_clean":"2024-03-17T23:59:57.271758+0000","last_became_active":"2024-03-17T23:56:00.689202+0000","last_became_peered":"2024-03-17T23:56:00.689202+0000","last_unstale":"2024-03-17T23:59:57.271758+0000","last_undegraded":"2024-03-17T23:59:57.271758+0000","last_fullsized":"2024-03-17T23:59:57.271758+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'780","last_scrub_stamp":"2024-03-17T23:59:57.271616+0000","last_deep_scrub":"23'780","last_deep_scrub_stamp":"2024-03-17T23:59:57.271616+0000","last_clean_scrub_stamp":"2024-03-17T23:59:57.271616+0000","objects_scrubbed":3,"log_size":780,"log_dups_size":0,"ondisk_log_size":780,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T11:43:27.177106+0000","scrub_duration":51,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389190,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":707,"num_write_kb":8542,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"23'416","reported_seq":467,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-18T00:00:04.678868+0000","last_change":"2024-03-18T00:00:04.678927+0000","last_active":"2024-03-18T00:00:04.678868+0000","last_peered":"2024-03-18T00:00:04.678868+0000","last_clean":"2024-03-18T00:00:04.678868+0000","last_became_active":"2024-03-17T23:56:49.077645+0000","last_became_peered":"2024-03-17T23:56:49.077645+0000","last_unstale":"2024-03-18T00:00:04.678868+0000","last_undegraded":"2024-03-18T00:00:04.678868+0000","last_fullsized":"2024-03-18T00:00:04.678868+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'416","last_scrub_stamp":"2024-03-18T00:00:04.678711+0000","last_deep_scrub":"23'416","last_deep_scrub_stamp":"2024-03-18T00:00:04.678711+0000","last_clean_scrub_stamp":"2024-03-18T00:00:04.678711+0000","objects_scrubbed":0,"log_size":416,"log_dups_size":0,"ondisk_log_size":416,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T11:50:18.087485+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":16384,"num_write":381,"num_write_kb":66829,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"23'57","reported_seq":85,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:59.892209+0000","last_change":"2024-03-17T23:59:59.892252+0000","last_active":"2024-03-17T23:59:59.892209+0000","last_peered":"2024-03-17T23:59:59.892209+0000","last_clean":"2024-03-17T23:59:59.892209+0000","last_became_active":"2024-03-17T23:56:00.696307+0000","last_became_peered":"2024-03-17T23:56:00.696307+0000","last_unstale":"2024-03-17T23:59:59.892209+0000","last_undegraded":"2024-03-17T23:59:59.892209+0000","last_fullsized":"2024-03-17T23:59:59.892209+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'57","last_scrub_stamp":"2024-03-17T23:59:59.892117+0000","last_deep_scrub":"23'57","last_deep_scrub_stamp":"2024-03-17T23:59:59.892117+0000","last_clean_scrub_stamp":"2024-03-17T23:59:59.892117+0000","objects_scrubbed":3,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T01:25:59.990886+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"23'399","reported_seq":435,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-18T00:00:01.216707+0000","last_change":"2024-03-18T00:00:01.216744+0000","last_active":"2024-03-18T00:00:01.216707+0000","last_peered":"2024-03-18T00:00:01.216707+0000","last_clean":"2024-03-18T00:00:01.216707+0000","last_became_active":"2024-03-17T23:56:01.193354+0000","last_became_peered":"2024-03-17T23:56:01.193354+0000","last_unstale":"2024-03-18T00:00:01.216707+0000","last_undegraded":"2024-03-18T00:00:01.216707+0000","last_fullsized":"2024-03-18T00:00:01.216707+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'399","last_scrub_stamp":"2024-03-18T00:00:01.216613+0000","last_deep_scrub":"23'399","last_deep_scrub_stamp":"2024-03-18T00:00:01.216613+0000","last_clean_scrub_stamp":"2024-03-18T00:00:01.216613+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T05:18:00.534277+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":5056,"num_write":368,"num_write_kb":26036,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"23'218","reported_seq":246,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:56.240987+0000","last_change":"2024-03-17T23:59:56.241086+0000","last_active":"2024-03-17T23:59:56.240987+0000","last_peered":"2024-03-17T23:59:56.240987+0000","last_clean":"2024-03-17T23:59:56.240987+0000","last_became_active":"2024-03-17T23:56:00.688667+0000","last_became_peered":"2024-03-17T23:56:00.688667+0000","last_unstale":"2024-03-17T23:59:56.240987+0000","last_undegraded":"2024-03-17T23:59:56.240987+0000","last_fullsized":"2024-03-17T23:59:56.240987+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'218","last_scrub_stamp":"2024-03-17T23:59:56.240808+0000","last_deep_scrub":"23'218","last_deep_scrub_stamp":"2024-03-17T23:59:56.240808+0000","last_clean_scrub_stamp":"2024-03-17T23:59:56.240808+0000","objects_scrubbed":3,"log_size":218,"log_dups_size":0,"ondisk_log_size":218,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T01:25:56.339577+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":150,"num_write_kb":4172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"23'399","reported_seq":440,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-18T00:00:03.420652+0000","last_change":"2024-03-18T00:00:03.420689+0000","last_active":"2024-03-18T00:00:03.420652+0000","last_peered":"2024-03-18T00:00:03.420652+0000","last_clean":"2024-03-18T00:00:03.420652+0000","last_became_active":"2024-03-17T23:56:49.085029+0000","last_became_peered":"2024-03-17T23:56:49.085029+0000","last_unstale":"2024-03-18T00:00:03.420652+0000","last_undegraded":"2024-03-18T00:00:03.420652+0000","last_fullsized":"2024-03-18T00:00:03.420652+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'399","last_scrub_stamp":"2024-03-18T00:00:03.420562+0000","last_deep_scrub":"23'399","last_deep_scrub_stamp":"2024-03-18T00:00:03.420562+0000","last_clean_scrub_stamp":"2024-03-18T00:00:03.420562+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T11:37:51.405095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":4310,"num_write":367,"num_write_kb":43629,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"23'142","reported_seq":170,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:54.759261+0000","last_change":"2024-03-17T23:59:54.759287+0000","last_active":"2024-03-17T23:59:54.759261+0000","last_peered":"2024-03-17T23:59:54.759261+0000","last_clean":"2024-03-17T23:59:54.759261+0000","last_became_active":"2024-03-17T23:56:00.677165+0000","last_became_peered":"2024-03-17T23:56:00.677165+0000","last_unstale":"2024-03-17T23:59:54.759261+0000","last_undegraded":"2024-03-17T23:59:54.759261+0000","last_fullsized":"2024-03-17T23:59:54.759261+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'142","last_scrub_stamp":"2024-03-17T23:59:54.759204+0000","last_deep_scrub":"23'142","last_deep_scrub_stamp":"2024-03-17T23:59:54.759204+0000","last_clean_scrub_stamp":"2024-03-17T23:59:54.759204+0000","objects_scrubbed":4,"log_size":142,"log_dups_size":0,"ondisk_log_size":142,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T02:27:37.482369+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":91,"num_write_kb":92,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"23'391","reported_seq":461,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:59.298710+0000","last_change":"2024-03-17T23:59:59.298746+0000","last_active":"2024-03-17T23:59:59.298710+0000","last_peered":"2024-03-17T23:59:59.298710+0000","last_clean":"2024-03-17T23:59:59.298710+0000","last_became_active":"2024-03-17T23:56:01.190191+0000","last_became_peered":"2024-03-17T23:56:01.190191+0000","last_unstale":"2024-03-17T23:59:59.298710+0000","last_undegraded":"2024-03-17T23:59:59.298710+0000","last_fullsized":"2024-03-17T23:59:59.298710+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'391","last_scrub_stamp":"2024-03-17T23:59:59.298609+0000","last_deep_scrub":"23'391","last_deep_scrub_stamp":"2024-03-17T23:59:59.298609+0000","last_clean_scrub_stamp":"2024-03-17T23:59:59.298609+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T05:32:20.985103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":22035,"num_write":358,"num_write_kb":71462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"23'267","reported_seq":295,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:57.933619+0000","last_change":"2024-03-17T23:59:57.933726+0000","last_active":"2024-03-17T23:59:57.933619+0000","last_peered":"2024-03-17T23:59:57.933619+0000","last_clean":"2024-03-17T23:59:57.933619+0000","last_became_active":"2024-03-17T23:56:00.685757+0000","last_became_peered":"2024-03-17T23:56:00.685757+0000","last_unstale":"2024-03-17T23:59:57.933619+0000","last_undegraded":"2024-03-17T23:59:57.933619+0000","last_fullsized":"2024-03-17T23:59:57.933619+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'267","last_scrub_stamp":"2024-03-17T23:59:57.933464+0000","last_deep_scrub":"23'267","last_deep_scrub_stamp":"2024-03-17T23:59:57.933464+0000","last_clean_scrub_stamp":"2024-03-17T23:59:57.933464+0000","objects_scrubbed":8,"log_size":267,"log_dups_size":0,"ondisk_log_size":267,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T02:27:40.656630+0000","scrub_duration":39,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11902300,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":217,"num_write_kb":11743,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"23'404","reported_seq":478,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-18T00:00:13.036465+0000","last_change":"2024-03-18T00:00:13.036503+0000","last_active":"2024-03-18T00:00:13.036465+0000","last_peered":"2024-03-18T00:00:13.036465+0000","last_clean":"2024-03-18T00:00:13.036465+0000","last_became_active":"2024-03-17T23:56:01.215526+0000","last_became_peered":"2024-03-17T23:56:01.215526+0000","last_unstale":"2024-03-18T00:00:13.036465+0000","last_undegraded":"2024-03-18T00:00:13.036465+0000","last_fullsized":"2024-03-18T00:00:13.036465+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'404","last_scrub_stamp":"2024-03-18T00:00:13.036371+0000","last_deep_scrub":"23'404","last_deep_scrub_stamp":"2024-03-18T00:00:13.036371+0000","last_clean_scrub_stamp":"2024-03-18T00:00:13.036371+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T08:34:16.235073+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":29805,"num_write":370,"num_write_kb":75602,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"23'551","reported_seq":579,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:53.581285+0000","last_change":"2024-03-17T23:59:53.581345+0000","last_active":"2024-03-17T23:59:53.581285+0000","last_peered":"2024-03-17T23:59:53.581285+0000","last_clean":"2024-03-17T23:59:53.581285+0000","last_became_active":"2024-03-17T23:56:00.682392+0000","last_became_peered":"2024-03-17T23:56:00.682392+0000","last_unstale":"2024-03-17T23:59:53.581285+0000","last_undegraded":"2024-03-17T23:59:53.581285+0000","last_fullsized":"2024-03-17T23:59:53.581285+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'551","last_scrub_stamp":"2024-03-17T23:59:53.581203+0000","last_deep_scrub":"23'551","last_deep_scrub_stamp":"2024-03-17T23:59:53.581203+0000","last_clean_scrub_stamp":"2024-03-17T23:59:53.581203+0000","objects_scrubbed":8,"log_size":551,"log_dups_size":0,"ondisk_log_size":551,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T09:59:34.453208+0000","scrub_duration":35,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388676,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":488,"num_write_kb":8403,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"23'418","reported_seq":489,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-18T00:00:02.405277+0000","last_change":"2024-03-18T00:00:02.405314+0000","last_active":"2024-03-18T00:00:02.405277+0000","last_peered":"2024-03-18T00:00:02.405277+0000","last_clean":"2024-03-18T00:00:02.405277+0000","last_became_active":"2024-03-17T23:56:01.217434+0000","last_became_peered":"2024-03-17T23:56:01.217434+0000","last_unstale":"2024-03-18T00:00:02.405277+0000","last_undegraded":"2024-03-18T00:00:02.405277+0000","last_fullsized":"2024-03-18T00:00:02.405277+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'418","last_scrub_stamp":"2024-03-18T00:00:02.405191+0000","last_deep_scrub":"23'418","last_deep_scrub_stamp":"2024-03-18T00:00:02.405191+0000","last_clean_scrub_stamp":"2024-03-18T00:00:02.405191+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T05:44:43.870573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":24728,"num_write":388,"num_write_kb":63632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"23'72","reported_seq":100,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:59.195791+0000","last_change":"2024-03-17T23:59:59.195855+0000","last_active":"2024-03-17T23:59:59.195791+0000","last_peered":"2024-03-17T23:59:59.195791+0000","last_clean":"2024-03-17T23:59:59.195791+0000","last_became_active":"2024-03-17T23:56:00.695592+0000","last_became_peered":"2024-03-17T23:56:00.695592+0000","last_unstale":"2024-03-17T23:59:59.195791+0000","last_undegraded":"2024-03-17T23:59:59.195791+0000","last_fullsized":"2024-03-17T23:59:59.195791+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'72","last_scrub_stamp":"2024-03-17T23:59:59.195612+0000","last_deep_scrub":"23'72","last_deep_scrub_stamp":"2024-03-17T23:59:59.195612+0000","last_clean_scrub_stamp":"2024-03-17T23:59:59.195612+0000","objects_scrubbed":3,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T01:22:18.173794+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"23'401","reported_seq":476,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-18T00:00:06.056893+0000","last_change":"2024-03-18T00:00:06.056955+0000","last_active":"2024-03-18T00:00:06.056893+0000","last_peered":"2024-03-18T00:00:06.056893+0000","last_clean":"2024-03-18T00:00:06.056893+0000","last_became_active":"2024-03-17T23:56:01.207791+0000","last_became_peered":"2024-03-17T23:56:01.207791+0000","last_unstale":"2024-03-18T00:00:06.056893+0000","last_undegraded":"2024-03-18T00:00:06.056893+0000","last_fullsized":"2024-03-18T00:00:06.056893+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'401","last_scrub_stamp":"2024-03-18T00:00:06.056718+0000","last_deep_scrub":"23'401","last_deep_scrub_stamp":"2024-03-18T00:00:06.056718+0000","last_clean_scrub_stamp":"2024-03-18T00:00:06.056718+0000","objects_scrubbed":0,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T03:07:51.942428+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":27500,"num_write":363,"num_write_kb":68441,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"23'72","reported_seq":100,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:56.906942+0000","last_change":"2024-03-17T23:59:56.907007+0000","last_active":"2024-03-17T23:59:56.906942+0000","last_peered":"2024-03-17T23:59:56.906942+0000","last_clean":"2024-03-17T23:59:56.906942+0000","last_became_active":"2024-03-17T23:56:00.685354+0000","last_became_peered":"2024-03-17T23:56:00.685354+0000","last_unstale":"2024-03-17T23:59:56.906942+0000","last_undegraded":"2024-03-17T23:59:56.906942+0000","last_fullsized":"2024-03-17T23:59:56.906942+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'72","last_scrub_stamp":"2024-03-17T23:59:56.906785+0000","last_deep_scrub":"23'72","last_deep_scrub_stamp":"2024-03-17T23:59:56.906785+0000","last_clean_scrub_stamp":"2024-03-17T23:59:56.906785+0000","objects_scrubbed":3,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T09:59:37.778789+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"23'449","reported_seq":512,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-18T00:00:02.902904+0000","last_change":"2024-03-18T00:00:02.902989+0000","last_active":"2024-03-18T00:00:02.902904+0000","last_peered":"2024-03-18T00:00:02.902904+0000","last_clean":"2024-03-18T00:00:02.902904+0000","last_became_active":"2024-03-17T23:56:01.196356+0000","last_became_peered":"2024-03-17T23:56:01.196356+0000","last_unstale":"2024-03-18T00:00:02.902904+0000","last_undegraded":"2024-03-18T00:00:02.902904+0000","last_fullsized":"2024-03-18T00:00:02.902904+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'449","last_scrub_stamp":"2024-03-18T00:00:02.902711+0000","last_deep_scrub":"23'449","last_deep_scrub_stamp":"2024-03-18T00:00:02.902711+0000","last_clean_scrub_stamp":"2024-03-18T00:00:02.902711+0000","objects_scrubbed":0,"log_size":449,"log_dups_size":0,"ondisk_log_size":449,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T01:22:21.880893+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":24107,"num_write":423,"num_write_kb":92187,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"23'84","reported_seq":112,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:55.146782+0000","last_change":"2024-03-17T23:59:55.146835+0000","last_active":"2024-03-17T23:59:55.146782+0000","last_peered":"2024-03-17T23:59:55.146782+0000","last_clean":"2024-03-17T23:59:55.146782+0000","last_became_active":"2024-03-17T23:56:00.682469+0000","last_became_peered":"2024-03-17T23:56:00.682469+0000","last_unstale":"2024-03-17T23:59:55.146782+0000","last_undegraded":"2024-03-17T23:59:55.146782+0000","last_fullsized":"2024-03-17T23:59:55.146782+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'84","last_scrub_stamp":"2024-03-17T23:59:55.146683+0000","last_deep_scrub":"23'84","last_deep_scrub_stamp":"2024-03-17T23:59:55.146683+0000","last_clean_scrub_stamp":"2024-03-17T23:59:55.146683+0000","objects_scrubbed":8,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T04:26:18.620768+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"23'486","reported_seq":571,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-18T00:00:08.043746+0000","last_change":"2024-03-18T00:00:08.043783+0000","last_active":"2024-03-18T00:00:08.043746+0000","last_peered":"2024-03-18T00:00:08.043746+0000","last_clean":"2024-03-18T00:00:08.043746+0000","last_became_active":"2024-03-17T23:56:01.208381+0000","last_became_peered":"2024-03-17T23:56:01.208381+0000","last_unstale":"2024-03-18T00:00:08.043746+0000","last_undegraded":"2024-03-18T00:00:08.043746+0000","last_fullsized":"2024-03-18T00:00:08.043746+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'486","last_scrub_stamp":"2024-03-18T00:00:08.043636+0000","last_deep_scrub":"23'486","last_deep_scrub_stamp":"2024-03-18T00:00:08.043636+0000","last_clean_scrub_stamp":"2024-03-18T00:00:08.043636+0000","objects_scrubbed":0,"log_size":486,"log_dups_size":0,"ondisk_log_size":486,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T11:47:26.874941+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":26966,"num_write":455,"num_write_kb":93532,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"23'180","reported_seq":208,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:55.364689+0000","last_change":"2024-03-17T23:59:55.364805+0000","last_active":"2024-03-17T23:59:55.364689+0000","last_peered":"2024-03-17T23:59:55.364689+0000","last_clean":"2024-03-17T23:59:55.364689+0000","last_became_active":"2024-03-17T23:56:00.681338+0000","last_became_peered":"2024-03-17T23:56:00.681338+0000","last_unstale":"2024-03-17T23:59:55.364689+0000","last_undegraded":"2024-03-17T23:59:55.364689+0000","last_fullsized":"2024-03-17T23:59:55.364689+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'180","last_scrub_stamp":"2024-03-17T23:59:55.364428+0000","last_deep_scrub":"23'180","last_deep_scrub_stamp":"2024-03-17T23:59:55.364428+0000","last_clean_scrub_stamp":"2024-03-17T23:59:55.364428+0000","objects_scrubbed":3,"log_size":180,"log_dups_size":0,"ondisk_log_size":180,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T03:58:54.498326+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":124,"num_write_kb":4160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"23'378","reported_seq":428,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-18T00:00:09.067268+0000","last_change":"2024-03-18T00:00:09.067306+0000","last_active":"2024-03-18T00:00:09.067268+0000","last_peered":"2024-03-18T00:00:09.067268+0000","last_clean":"2024-03-18T00:00:09.067268+0000","last_became_active":"2024-03-17T23:56:01.206691+0000","last_became_peered":"2024-03-17T23:56:01.206691+0000","last_unstale":"2024-03-18T00:00:09.067268+0000","last_undegraded":"2024-03-18T00:00:09.067268+0000","last_fullsized":"2024-03-18T00:00:09.067268+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'378","last_scrub_stamp":"2024-03-18T00:00:09.067164+0000","last_deep_scrub":"23'378","last_deep_scrub_stamp":"2024-03-18T00:00:09.067164+0000","last_clean_scrub_stamp":"2024-03-18T00:00:09.067164+0000","objects_scrubbed":0,"log_size":378,"log_dups_size":0,"ondisk_log_size":378,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T06:59:42.349685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":10737,"num_write":348,"num_write_kb":63025,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"23'329","reported_seq":357,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:57.128317+0000","last_change":"2024-03-17T23:59:57.128371+0000","last_active":"2024-03-17T23:59:57.128317+0000","last_peered":"2024-03-17T23:59:57.128317+0000","last_clean":"2024-03-17T23:59:57.128317+0000","last_became_active":"2024-03-17T23:56:00.690516+0000","last_became_peered":"2024-03-17T23:56:00.690516+0000","last_unstale":"2024-03-17T23:59:57.128317+0000","last_undegraded":"2024-03-17T23:59:57.128317+0000","last_fullsized":"2024-03-17T23:59:57.128317+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'329","last_scrub_stamp":"2024-03-17T23:59:57.128205+0000","last_deep_scrub":"23'329","last_deep_scrub_stamp":"2024-03-17T23:59:57.128205+0000","last_clean_scrub_stamp":"2024-03-17T23:59:57.128205+0000","objects_scrubbed":3,"log_size":329,"log_dups_size":0,"ondisk_log_size":329,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T05:32:18.814699+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":276,"num_write_kb":4244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"23'384","reported_seq":461,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-18T00:00:10.097587+0000","last_change":"2024-03-18T00:00:10.097625+0000","last_active":"2024-03-18T00:00:10.097587+0000","last_peered":"2024-03-18T00:00:10.097587+0000","last_clean":"2024-03-18T00:00:10.097587+0000","last_became_active":"2024-03-17T23:56:01.213095+0000","last_became_peered":"2024-03-17T23:56:01.213095+0000","last_unstale":"2024-03-18T00:00:10.097587+0000","last_undegraded":"2024-03-18T00:00:10.097587+0000","last_fullsized":"2024-03-18T00:00:10.097587+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'384","last_scrub_stamp":"2024-03-18T00:00:10.097495+0000","last_deep_scrub":"23'384","last_deep_scrub_stamp":"2024-03-18T00:00:10.097495+0000","last_clean_scrub_stamp":"2024-03-18T00:00:10.097495+0000","objects_scrubbed":0,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T09:08:05.427280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":39304,"num_write":347,"num_write_kb":50502,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"23'574","reported_seq":602,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:53.751204+0000","last_change":"2024-03-17T23:59:53.751249+0000","last_active":"2024-03-17T23:59:53.751204+0000","last_peered":"2024-03-17T23:59:53.751204+0000","last_clean":"2024-03-17T23:59:53.751204+0000","last_became_active":"2024-03-17T23:56:00.671655+0000","last_became_peered":"2024-03-17T23:56:00.671655+0000","last_unstale":"2024-03-17T23:59:53.751204+0000","last_undegraded":"2024-03-17T23:59:53.751204+0000","last_fullsized":"2024-03-17T23:59:53.751204+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'574","last_scrub_stamp":"2024-03-17T23:59:53.751108+0000","last_deep_scrub":"23'574","last_deep_scrub_stamp":"2024-03-17T23:59:53.751108+0000","last_clean_scrub_stamp":"2024-03-17T23:59:53.751108+0000","objects_scrubbed":2,"log_size":574,"log_dups_size":0,"ondisk_log_size":574,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T09:59:34.623112+0000","scrub_duration":31,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":517,"num_write_kb":4347,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"23'451","reported_seq":506,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-18T00:00:06.333474+0000","last_change":"2024-03-18T00:00:06.333511+0000","last_active":"2024-03-18T00:00:06.333474+0000","last_peered":"2024-03-18T00:00:06.333474+0000","last_clean":"2024-03-18T00:00:06.333474+0000","last_became_active":"2024-03-17T23:56:01.196002+0000","last_became_peered":"2024-03-17T23:56:01.196002+0000","last_unstale":"2024-03-18T00:00:06.333474+0000","last_undegraded":"2024-03-18T00:00:06.333474+0000","last_fullsized":"2024-03-18T00:00:06.333474+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'451","last_scrub_stamp":"2024-03-18T00:00:06.333387+0000","last_deep_scrub":"23'451","last_deep_scrub_stamp":"2024-03-18T00:00:06.333387+0000","last_clean_scrub_stamp":"2024-03-18T00:00:06.333387+0000","objects_scrubbed":0,"log_size":451,"log_dups_size":0,"ondisk_log_size":451,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T01:23:22.935055+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":21931,"num_write":417,"num_write_kb":63333,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"23'72","reported_seq":100,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:54.139546+0000","last_change":"2024-03-17T23:59:54.139573+0000","last_active":"2024-03-17T23:59:54.139546+0000","last_peered":"2024-03-17T23:59:54.139546+0000","last_clean":"2024-03-17T23:59:54.139546+0000","last_became_active":"2024-03-17T23:56:00.677831+0000","last_became_peered":"2024-03-17T23:56:00.677831+0000","last_unstale":"2024-03-17T23:59:54.139546+0000","last_undegraded":"2024-03-17T23:59:54.139546+0000","last_fullsized":"2024-03-17T23:59:54.139546+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'72","last_scrub_stamp":"2024-03-17T23:59:54.139486+0000","last_deep_scrub":"23'72","last_deep_scrub_stamp":"2024-03-17T23:59:54.139486+0000","last_clean_scrub_stamp":"2024-03-17T23:59:54.139486+0000","objects_scrubbed":3,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T06:06:22.263462+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1752,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"23'407","reported_seq":475,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-18T00:00:11.051008+0000","last_change":"2024-03-18T00:00:11.051045+0000","last_active":"2024-03-18T00:00:11.051008+0000","last_peered":"2024-03-18T00:00:11.051008+0000","last_clean":"2024-03-18T00:00:11.051008+0000","last_became_active":"2024-03-17T23:56:01.213960+0000","last_became_peered":"2024-03-17T23:56:01.213960+0000","last_unstale":"2024-03-18T00:00:11.051008+0000","last_undegraded":"2024-03-18T00:00:11.051008+0000","last_fullsized":"2024-03-18T00:00:11.051008+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'407","last_scrub_stamp":"2024-03-18T00:00:11.050916+0000","last_deep_scrub":"23'407","last_deep_scrub_stamp":"2024-03-18T00:00:11.050916+0000","last_clean_scrub_stamp":"2024-03-18T00:00:11.050916+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T08:13:27.137010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":22422,"num_write":380,"num_write_kb":66960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"23'119","reported_seq":187,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:58.089745+0000","last_change":"2024-03-17T23:59:58.089745+0000","last_active":"2024-03-17T23:59:58.089745+0000","last_peered":"2024-03-17T23:59:58.089745+0000","last_clean":"2024-03-17T23:59:58.089745+0000","last_became_active":"2024-03-17T23:55:58.104493+0000","last_became_peered":"2024-03-17T23:55:58.104493+0000","last_unstale":"2024-03-17T23:59:58.089745+0000","last_undegraded":"2024-03-17T23:59:58.089745+0000","last_fullsized":"2024-03-17T23:59:58.089745+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'119","last_scrub_stamp":"2024-03-17T23:59:58.089612+0000","last_deep_scrub":"23'119","last_deep_scrub_stamp":"2024-03-17T23:59:58.089612+0000","last_clean_scrub_stamp":"2024-03-17T23:59:58.089612+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T01:22:17.067794+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"23'87","reported_seq":116,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:55.192145+0000","last_change":"2024-03-17T23:59:55.192145+0000","last_active":"2024-03-17T23:59:55.192145+0000","last_peered":"2024-03-17T23:59:55.192145+0000","last_clean":"2024-03-17T23:59:55.192145+0000","last_became_active":"2024-03-17T23:56:00.677660+0000","last_became_peered":"2024-03-17T23:56:00.677660+0000","last_unstale":"2024-03-17T23:59:55.192145+0000","last_undegraded":"2024-03-17T23:59:55.192145+0000","last_fullsized":"2024-03-17T23:59:55.192145+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'87","last_scrub_stamp":"2024-03-17T23:59:55.192009+0000","last_deep_scrub":"23'87","last_deep_scrub_stamp":"2024-03-17T23:59:55.192009+0000","last_clean_scrub_stamp":"2024-03-17T23:59:55.192009+0000","objects_scrubbed":5,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T10:54:58.402703+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"23'360","reported_seq":406,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-18T00:00:04.098488+0000","last_change":"2024-03-18T00:00:04.098488+0000","last_active":"2024-03-18T00:00:04.098488+0000","last_peered":"2024-03-18T00:00:04.098488+0000","last_clean":"2024-03-18T00:00:04.098488+0000","last_became_active":"2024-03-17T23:56:01.212434+0000","last_became_peered":"2024-03-17T23:56:01.212434+0000","last_unstale":"2024-03-18T00:00:04.098488+0000","last_undegraded":"2024-03-18T00:00:04.098488+0000","last_fullsized":"2024-03-18T00:00:04.098488+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'360","last_scrub_stamp":"2024-03-18T00:00:04.098229+0000","last_deep_scrub":"23'360","last_deep_scrub_stamp":"2024-03-18T00:00:04.098229+0000","last_clean_scrub_stamp":"2024-03-18T00:00:04.098229+0000","objects_scrubbed":0,"log_size":360,"log_dups_size":0,"ondisk_log_size":360,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T10:11:09.037695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":8076,"num_write":326,"num_write_kb":42301,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"23'423","reported_seq":452,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-18T00:00:04.038853+0000","last_change":"2024-03-18T00:00:04.038896+0000","last_active":"2024-03-18T00:00:04.038853+0000","last_peered":"2024-03-18T00:00:04.038853+0000","last_clean":"2024-03-18T00:00:04.038853+0000","last_became_active":"2024-03-17T23:56:00.691617+0000","last_became_peered":"2024-03-17T23:56:00.691617+0000","last_unstale":"2024-03-18T00:00:04.038853+0000","last_undegraded":"2024-03-18T00:00:04.038853+0000","last_fullsized":"2024-03-18T00:00:04.038853+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'423","last_scrub_stamp":"2024-03-18T00:00:04.038766+0000","last_deep_scrub":"23'423","last_deep_scrub_stamp":"2024-03-18T00:00:04.038766+0000","last_clean_scrub_stamp":"2024-03-18T00:00:04.038766+0000","objects_scrubbed":3,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T04:33:30.108768+0000","scrub_duration":35,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":366,"num_write_kb":8360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"23'408","reported_seq":518,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:58.449158+0000","last_change":"2024-03-17T23:59:58.449158+0000","last_active":"2024-03-17T23:59:58.449158+0000","last_peered":"2024-03-17T23:59:58.449158+0000","last_clean":"2024-03-17T23:59:58.449158+0000","last_became_active":"2024-03-17T23:56:01.199121+0000","last_became_peered":"2024-03-17T23:56:01.199121+0000","last_unstale":"2024-03-17T23:59:58.449158+0000","last_undegraded":"2024-03-17T23:59:58.449158+0000","last_fullsized":"2024-03-17T23:59:58.449158+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'408","last_scrub_stamp":"2024-03-17T23:59:58.449016+0000","last_deep_scrub":"23'408","last_deep_scrub_stamp":"2024-03-17T23:59:58.449016+0000","last_clean_scrub_stamp":"2024-03-17T23:59:58.449016+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T09:37:05.042024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":83,"num_read_kb":44834,"num_write":382,"num_write_kb":112569,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"23'290","reported_seq":529,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:56.105567+0000","last_change":"2024-03-17T23:59:56.105567+0000","last_active":"2024-03-17T23:59:56.105567+0000","last_peered":"2024-03-17T23:59:56.105567+0000","last_clean":"2024-03-17T23:59:56.105567+0000","last_became_active":"2024-03-17T23:56:00.686215+0000","last_became_peered":"2024-03-17T23:56:00.686215+0000","last_unstale":"2024-03-17T23:59:56.105567+0000","last_undegraded":"2024-03-17T23:59:56.105567+0000","last_fullsized":"2024-03-17T23:59:56.105567+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'290","last_scrub_stamp":"2024-03-17T23:59:56.105440+0000","last_deep_scrub":"23'290","last_deep_scrub_stamp":"2024-03-17T23:59:56.105440+0000","last_clean_scrub_stamp":"2024-03-17T23:59:56.105440+0000","objects_scrubbed":4,"log_size":290,"log_dups_size":0,"ondisk_log_size":290,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T00:12:21.529661+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1468046,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":210,"num_read_kb":1570,"num_write":217,"num_write_kb":1574,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"23'404","reported_seq":445,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-18T00:00:01.774069+0000","last_change":"2024-03-18T00:00:01.774069+0000","last_active":"2024-03-18T00:00:01.774069+0000","last_peered":"2024-03-18T00:00:01.774069+0000","last_clean":"2024-03-18T00:00:01.774069+0000","last_became_active":"2024-03-17T23:56:01.192117+0000","last_became_peered":"2024-03-17T23:56:01.192117+0000","last_unstale":"2024-03-18T00:00:01.774069+0000","last_undegraded":"2024-03-18T00:00:01.774069+0000","last_fullsized":"2024-03-18T00:00:01.774069+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'404","last_scrub_stamp":"2024-03-18T00:00:01.773939+0000","last_deep_scrub":"23'404","last_deep_scrub_stamp":"2024-03-18T00:00:01.773939+0000","last_clean_scrub_stamp":"2024-03-18T00:00:01.773939+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T05:18:01.091603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":8404,"num_write":369,"num_write_kb":38222,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"23'568","reported_seq":597,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:58.248219+0000","last_change":"2024-03-17T23:59:58.248219+0000","last_active":"2024-03-17T23:59:58.248219+0000","last_peered":"2024-03-17T23:59:58.248219+0000","last_clean":"2024-03-17T23:59:58.248219+0000","last_became_active":"2024-03-17T23:56:00.694605+0000","last_became_peered":"2024-03-17T23:56:00.694605+0000","last_unstale":"2024-03-17T23:59:58.248219+0000","last_undegraded":"2024-03-17T23:59:58.248219+0000","last_fullsized":"2024-03-17T23:59:58.248219+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'568","last_scrub_stamp":"2024-03-17T23:59:58.248082+0000","last_deep_scrub":"23'568","last_deep_scrub_stamp":"2024-03-17T23:59:58.248082+0000","last_clean_scrub_stamp":"2024-03-17T23:59:58.248082+0000","objects_scrubbed":4,"log_size":568,"log_dups_size":0,"ondisk_log_size":568,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T09:37:04.841090+0000","scrub_duration":35,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389196,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":500,"num_write_kb":8435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"23'401","reported_seq":460,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:58.320578+0000","last_change":"2024-03-17T23:59:58.320578+0000","last_active":"2024-03-17T23:59:58.320578+0000","last_peered":"2024-03-17T23:59:58.320578+0000","last_clean":"2024-03-17T23:59:58.320578+0000","last_became_active":"2024-03-17T23:56:01.187571+0000","last_became_peered":"2024-03-17T23:56:01.187571+0000","last_unstale":"2024-03-17T23:59:58.320578+0000","last_undegraded":"2024-03-17T23:59:58.320578+0000","last_fullsized":"2024-03-17T23:59:58.320578+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'401","last_scrub_stamp":"2024-03-17T23:59:58.320443+0000","last_deep_scrub":"23'401","last_deep_scrub_stamp":"2024-03-17T23:59:58.320443+0000","last_clean_scrub_stamp":"2024-03-17T23:59:58.320443+0000","objects_scrubbed":0,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T00:12:23.744664+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":12494,"num_write":368,"num_write_kb":72170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"23'57","reported_seq":86,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:56.757991+0000","last_change":"2024-03-17T23:59:56.757991+0000","last_active":"2024-03-17T23:59:56.757991+0000","last_peered":"2024-03-17T23:59:56.757991+0000","last_clean":"2024-03-17T23:59:56.757991+0000","last_became_active":"2024-03-17T23:56:00.679981+0000","last_became_peered":"2024-03-17T23:56:00.679981+0000","last_unstale":"2024-03-17T23:59:56.757991+0000","last_undegraded":"2024-03-17T23:59:56.757991+0000","last_fullsized":"2024-03-17T23:59:56.757991+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'57","last_scrub_stamp":"2024-03-17T23:59:56.757854+0000","last_deep_scrub":"23'57","last_deep_scrub_stamp":"2024-03-17T23:59:56.757854+0000","last_clean_scrub_stamp":"2024-03-17T23:59:56.757854+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T01:25:56.856623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"23'455","reported_seq":571,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-18T00:00:09.343322+0000","last_change":"2024-03-18T00:00:09.343322+0000","last_active":"2024-03-18T00:00:09.343322+0000","last_peered":"2024-03-18T00:00:09.343322+0000","last_clean":"2024-03-18T00:00:09.343322+0000","last_became_active":"2024-03-17T23:56:01.216145+0000","last_became_peered":"2024-03-17T23:56:01.216145+0000","last_unstale":"2024-03-18T00:00:09.343322+0000","last_undegraded":"2024-03-18T00:00:09.343322+0000","last_fullsized":"2024-03-18T00:00:09.343322+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'455","last_scrub_stamp":"2024-03-18T00:00:09.343195+0000","last_deep_scrub":"23'455","last_deep_scrub_stamp":"2024-03-18T00:00:09.343195+0000","last_clean_scrub_stamp":"2024-03-18T00:00:09.343195+0000","objects_scrubbed":0,"log_size":455,"log_dups_size":0,"ondisk_log_size":455,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T05:31:08.065785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":89,"num_read_kb":46763,"num_write":422,"num_write_kb":133395,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"23'227","reported_seq":256,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-18T00:00:02.082031+0000","last_change":"2024-03-18T00:00:02.082031+0000","last_active":"2024-03-18T00:00:02.082031+0000","last_peered":"2024-03-18T00:00:02.082031+0000","last_clean":"2024-03-18T00:00:02.082031+0000","last_became_active":"2024-03-17T23:56:00.692054+0000","last_became_peered":"2024-03-17T23:56:00.692054+0000","last_unstale":"2024-03-18T00:00:02.082031+0000","last_undegraded":"2024-03-18T00:00:02.082031+0000","last_fullsized":"2024-03-18T00:00:02.082031+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'227","last_scrub_stamp":"2024-03-18T00:00:02.081904+0000","last_deep_scrub":"23'227","last_deep_scrub_stamp":"2024-03-18T00:00:02.081904+0000","last_clean_scrub_stamp":"2024-03-18T00:00:02.081904+0000","objects_scrubbed":4,"log_size":227,"log_dups_size":0,"ondisk_log_size":227,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T11:37:50.066437+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194416,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":164,"num_write_kb":4176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"23'370","reported_seq":434,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-18T00:00:00.776285+0000","last_change":"2024-03-18T00:00:00.776285+0000","last_active":"2024-03-18T00:00:00.776285+0000","last_peered":"2024-03-18T00:00:00.776285+0000","last_clean":"2024-03-18T00:00:00.776285+0000","last_became_active":"2024-03-17T23:56:01.188353+0000","last_became_peered":"2024-03-17T23:56:01.188353+0000","last_unstale":"2024-03-18T00:00:00.776285+0000","last_undegraded":"2024-03-18T00:00:00.776285+0000","last_fullsized":"2024-03-18T00:00:00.776285+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'370","last_scrub_stamp":"2024-03-18T00:00:00.776137+0000","last_deep_scrub":"23'370","last_deep_scrub_stamp":"2024-03-18T00:00:00.776137+0000","last_clean_scrub_stamp":"2024-03-18T00:00:00.776137+0000","objects_scrubbed":0,"log_size":370,"log_dups_size":0,"ondisk_log_size":370,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T03:11:43.732358+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":24684,"num_write":328,"num_write_kb":42609,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"23'210","reported_seq":238,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:57.737386+0000","last_change":"2024-03-17T23:59:57.737517+0000","last_active":"2024-03-17T23:59:57.737386+0000","last_peered":"2024-03-17T23:59:57.737386+0000","last_clean":"2024-03-17T23:59:57.737386+0000","last_became_active":"2024-03-17T23:56:00.688978+0000","last_became_peered":"2024-03-17T23:56:00.688978+0000","last_unstale":"2024-03-17T23:59:57.737386+0000","last_undegraded":"2024-03-17T23:59:57.737386+0000","last_fullsized":"2024-03-17T23:59:57.737386+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'210","last_scrub_stamp":"2024-03-17T23:59:57.737134+0000","last_deep_scrub":"23'210","last_deep_scrub_stamp":"2024-03-17T23:59:57.737134+0000","last_clean_scrub_stamp":"2024-03-17T23:59:57.737134+0000","objects_scrubbed":4,"log_size":210,"log_dups_size":0,"ondisk_log_size":210,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T11:43:27.642625+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":418,"num_write_kb":1562,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"23'361","reported_seq":453,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-18T00:00:01.107265+0000","last_change":"2024-03-18T00:00:01.107290+0000","last_active":"2024-03-18T00:00:01.107265+0000","last_peered":"2024-03-18T00:00:01.107265+0000","last_clean":"2024-03-18T00:00:01.107265+0000","last_became_active":"2024-03-17T23:56:01.211359+0000","last_became_peered":"2024-03-17T23:56:01.211359+0000","last_unstale":"2024-03-18T00:00:01.107265+0000","last_undegraded":"2024-03-18T00:00:01.107265+0000","last_fullsized":"2024-03-18T00:00:01.107265+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'361","last_scrub_stamp":"2024-03-18T00:00:01.107178+0000","last_deep_scrub":"23'361","last_deep_scrub_stamp":"2024-03-18T00:00:01.107178+0000","last_clean_scrub_stamp":"2024-03-18T00:00:01.107178+0000","objects_scrubbed":0,"log_size":361,"log_dups_size":0,"ondisk_log_size":361,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T03:11:44.063399+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":37046,"num_write":339,"num_write_kb":87516,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"23'73","reported_seq":101,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:58.903065+0000","last_change":"2024-03-17T23:59:58.903113+0000","last_active":"2024-03-17T23:59:58.903065+0000","last_peered":"2024-03-17T23:59:58.903065+0000","last_clean":"2024-03-17T23:59:58.903065+0000","last_became_active":"2024-03-17T23:56:00.685461+0000","last_became_peered":"2024-03-17T23:56:00.685461+0000","last_unstale":"2024-03-17T23:59:58.903065+0000","last_undegraded":"2024-03-17T23:59:58.903065+0000","last_fullsized":"2024-03-17T23:59:58.903065+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'73","last_scrub_stamp":"2024-03-17T23:59:58.902977+0000","last_deep_scrub":"23'73","last_deep_scrub_stamp":"2024-03-17T23:59:58.902977+0000","last_clean_scrub_stamp":"2024-03-17T23:59:58.902977+0000","objects_scrubbed":4,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T10:55:02.113671+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"23'472","reported_seq":563,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:55.506459+0000","last_change":"2024-03-17T23:59:55.506500+0000","last_active":"2024-03-17T23:59:55.506459+0000","last_peered":"2024-03-17T23:59:55.506459+0000","last_clean":"2024-03-17T23:59:55.506459+0000","last_became_active":"2024-03-17T23:56:01.191450+0000","last_became_peered":"2024-03-17T23:56:01.191450+0000","last_unstale":"2024-03-17T23:59:55.506459+0000","last_undegraded":"2024-03-17T23:59:55.506459+0000","last_fullsized":"2024-03-17T23:59:55.506459+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'472","last_scrub_stamp":"2024-03-17T23:59:55.506346+0000","last_deep_scrub":"23'472","last_deep_scrub_stamp":"2024-03-17T23:59:55.506346+0000","last_clean_scrub_stamp":"2024-03-17T23:59:55.506346+0000","objects_scrubbed":0,"log_size":472,"log_dups_size":0,"ondisk_log_size":472,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T10:54:58.717040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":42881,"num_write":439,"num_write_kb":88369,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"23'500","reported_seq":528,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-18T00:00:00.085001+0000","last_change":"2024-03-18T00:00:00.085043+0000","last_active":"2024-03-18T00:00:00.085001+0000","last_peered":"2024-03-18T00:00:00.085001+0000","last_clean":"2024-03-18T00:00:00.085001+0000","last_became_active":"2024-03-17T23:56:00.691381+0000","last_became_peered":"2024-03-17T23:56:00.691381+0000","last_unstale":"2024-03-18T00:00:00.085001+0000","last_undegraded":"2024-03-18T00:00:00.085001+0000","last_fullsized":"2024-03-18T00:00:00.085001+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'500","last_scrub_stamp":"2024-03-18T00:00:00.084909+0000","last_deep_scrub":"23'500","last_deep_scrub_stamp":"2024-03-18T00:00:00.084909+0000","last_clean_scrub_stamp":"2024-03-18T00:00:00.084909+0000","objects_scrubbed":2,"log_size":500,"log_dups_size":0,"ondisk_log_size":500,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T05:17:59.402573+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":442,"num_write_kb":4310,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"23'444","reported_seq":518,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-18T00:00:00.259361+0000","last_change":"2024-03-18T00:00:00.259398+0000","last_active":"2024-03-18T00:00:00.259361+0000","last_peered":"2024-03-18T00:00:00.259361+0000","last_clean":"2024-03-18T00:00:00.259361+0000","last_became_active":"2024-03-17T23:56:01.192316+0000","last_became_peered":"2024-03-17T23:56:01.192316+0000","last_unstale":"2024-03-18T00:00:00.259361+0000","last_undegraded":"2024-03-18T00:00:00.259361+0000","last_fullsized":"2024-03-18T00:00:00.259361+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'444","last_scrub_stamp":"2024-03-18T00:00:00.259273+0000","last_deep_scrub":"23'444","last_deep_scrub_stamp":"2024-03-18T00:00:00.259273+0000","last_clean_scrub_stamp":"2024-03-18T00:00:00.259273+0000","objects_scrubbed":0,"log_size":444,"log_dups_size":0,"ondisk_log_size":444,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T05:41:00.372747+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":21819,"num_write":413,"num_write_kb":30190,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"23'64","reported_seq":92,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:58.743447+0000","last_change":"2024-03-17T23:59:58.743500+0000","last_active":"2024-03-17T23:59:58.743447+0000","last_peered":"2024-03-17T23:59:58.743447+0000","last_clean":"2024-03-17T23:59:58.743447+0000","last_became_active":"2024-03-17T23:56:00.703439+0000","last_became_peered":"2024-03-17T23:56:00.703439+0000","last_unstale":"2024-03-17T23:59:58.743447+0000","last_undegraded":"2024-03-17T23:59:58.743447+0000","last_fullsized":"2024-03-17T23:59:58.743447+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'64","last_scrub_stamp":"2024-03-17T23:59:58.743316+0000","last_deep_scrub":"23'64","last_deep_scrub_stamp":"2024-03-17T23:59:58.743316+0000","last_clean_scrub_stamp":"2024-03-17T23:59:58.743316+0000","objects_scrubbed":4,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T09:37:05.336325+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"23'411","reported_seq":455,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:57.117593+0000","last_change":"2024-03-17T23:59:57.117631+0000","last_active":"2024-03-17T23:59:57.117593+0000","last_peered":"2024-03-17T23:59:57.117593+0000","last_clean":"2024-03-17T23:59:57.117593+0000","last_became_active":"2024-03-17T23:56:01.190681+0000","last_became_peered":"2024-03-17T23:56:01.190681+0000","last_unstale":"2024-03-17T23:59:57.117593+0000","last_undegraded":"2024-03-17T23:59:57.117593+0000","last_fullsized":"2024-03-17T23:59:57.117593+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'411","last_scrub_stamp":"2024-03-17T23:59:57.117485+0000","last_deep_scrub":"23'411","last_deep_scrub_stamp":"2024-03-17T23:59:57.117485+0000","last_clean_scrub_stamp":"2024-03-17T23:59:57.117485+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T07:48:41.594903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":2591,"num_write":372,"num_write_kb":17971,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"23'154","reported_seq":182,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:55.811042+0000","last_change":"2024-03-17T23:59:55.811067+0000","last_active":"2024-03-17T23:59:55.811042+0000","last_peered":"2024-03-17T23:59:55.811042+0000","last_clean":"2024-03-17T23:59:55.811042+0000","last_became_active":"2024-03-17T23:56:00.678950+0000","last_became_peered":"2024-03-17T23:56:00.678950+0000","last_unstale":"2024-03-17T23:59:55.811042+0000","last_undegraded":"2024-03-17T23:59:55.811042+0000","last_fullsized":"2024-03-17T23:59:55.811042+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'154","last_scrub_stamp":"2024-03-17T23:59:55.810980+0000","last_deep_scrub":"23'154","last_deep_scrub_stamp":"2024-03-17T23:59:55.810980+0000","last_clean_scrub_stamp":"2024-03-17T23:59:55.810980+0000","objects_scrubbed":3,"log_size":154,"log_dups_size":0,"ondisk_log_size":154,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T10:54:59.021674+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":92,"num_write_kb":4145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"23'431","reported_seq":504,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-18T00:00:07.169557+0000","last_change":"2024-03-18T00:00:07.169608+0000","last_active":"2024-03-18T00:00:07.169557+0000","last_peered":"2024-03-18T00:00:07.169557+0000","last_clean":"2024-03-18T00:00:07.169557+0000","last_became_active":"2024-03-17T23:56:01.211163+0000","last_became_peered":"2024-03-17T23:56:01.211163+0000","last_unstale":"2024-03-18T00:00:07.169557+0000","last_undegraded":"2024-03-18T00:00:07.169557+0000","last_fullsized":"2024-03-18T00:00:07.169557+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'431","last_scrub_stamp":"2024-03-18T00:00:07.169426+0000","last_deep_scrub":"23'431","last_deep_scrub_stamp":"2024-03-18T00:00:07.169426+0000","last_clean_scrub_stamp":"2024-03-18T00:00:07.169426+0000","objects_scrubbed":0,"log_size":431,"log_dups_size":0,"ondisk_log_size":431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T01:23:23.771093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":16100,"num_write":395,"num_write_kb":71500,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"23'126","reported_seq":154,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-18T00:00:01.065057+0000","last_change":"2024-03-18T00:00:01.065105+0000","last_active":"2024-03-18T00:00:01.065057+0000","last_peered":"2024-03-18T00:00:01.065057+0000","last_clean":"2024-03-18T00:00:01.065057+0000","last_became_active":"2024-03-17T23:56:00.684178+0000","last_became_peered":"2024-03-17T23:56:00.684178+0000","last_unstale":"2024-03-18T00:00:01.065057+0000","last_undegraded":"2024-03-18T00:00:01.065057+0000","last_fullsized":"2024-03-18T00:00:01.065057+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'126","last_scrub_stamp":"2024-03-18T00:00:01.064966+0000","last_deep_scrub":"23'126","last_deep_scrub_stamp":"2024-03-18T00:00:01.064966+0000","last_clean_scrub_stamp":"2024-03-18T00:00:01.064966+0000","objects_scrubbed":4,"log_size":126,"log_dups_size":0,"ondisk_log_size":126,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T05:44:42.530348+0000","scrub_duration":35,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":65,"num_write_kb":8221,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"23'446","reported_seq":547,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-18T00:00:01.941389+0000","last_change":"2024-03-18T00:00:01.941428+0000","last_active":"2024-03-18T00:00:01.941389+0000","last_peered":"2024-03-18T00:00:01.941389+0000","last_clean":"2024-03-18T00:00:01.941389+0000","last_became_active":"2024-03-17T23:56:01.192775+0000","last_became_peered":"2024-03-17T23:56:01.192775+0000","last_unstale":"2024-03-18T00:00:01.941389+0000","last_undegraded":"2024-03-18T00:00:01.941389+0000","last_fullsized":"2024-03-18T00:00:01.941389+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'446","last_scrub_stamp":"2024-03-18T00:00:01.941295+0000","last_deep_scrub":"23'446","last_deep_scrub_stamp":"2024-03-18T00:00:01.941295+0000","last_clean_scrub_stamp":"2024-03-18T00:00:01.941295+0000","objects_scrubbed":0,"log_size":446,"log_dups_size":0,"ondisk_log_size":446,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T09:37:08.534303+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":28843,"num_write":412,"num_write_kb":84625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"23'388","reported_seq":464,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-18T00:00:00.189465+0000","last_change":"2024-03-18T00:00:00.189502+0000","last_active":"2024-03-18T00:00:00.189465+0000","last_peered":"2024-03-18T00:00:00.189465+0000","last_clean":"2024-03-18T00:00:00.189465+0000","last_became_active":"2024-03-17T23:56:01.177533+0000","last_became_peered":"2024-03-17T23:56:01.177533+0000","last_unstale":"2024-03-18T00:00:00.189465+0000","last_undegraded":"2024-03-18T00:00:00.189465+0000","last_fullsized":"2024-03-18T00:00:00.189465+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'388","last_scrub_stamp":"2024-03-18T00:00:00.189376+0000","last_deep_scrub":"23'388","last_deep_scrub_stamp":"2024-03-18T00:00:00.189376+0000","last_clean_scrub_stamp":"2024-03-18T00:00:00.189376+0000","objects_scrubbed":0,"log_size":388,"log_dups_size":0,"ondisk_log_size":388,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T03:11:43.145597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":28876,"num_write":348,"num_write_kb":79477,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"23'254","reported_seq":282,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:59.127129+0000","last_change":"2024-03-17T23:59:59.127276+0000","last_active":"2024-03-17T23:59:59.127129+0000","last_peered":"2024-03-17T23:59:59.127129+0000","last_clean":"2024-03-17T23:59:59.127129+0000","last_became_active":"2024-03-17T23:56:00.684714+0000","last_became_peered":"2024-03-17T23:56:00.684714+0000","last_unstale":"2024-03-17T23:59:59.127129+0000","last_undegraded":"2024-03-17T23:59:59.127129+0000","last_fullsized":"2024-03-17T23:59:59.127129+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'254","last_scrub_stamp":"2024-03-17T23:59:59.126876+0000","last_deep_scrub":"23'254","last_deep_scrub_stamp":"2024-03-17T23:59:59.126876+0000","last_clean_scrub_stamp":"2024-03-17T23:59:59.126876+0000","objects_scrubbed":4,"log_size":254,"log_dups_size":0,"ondisk_log_size":254,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T03:11:42.083096+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":200,"num_write_kb":4200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"23'366","reported_seq":429,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-18T00:00:02.257908+0000","last_change":"2024-03-18T00:00:02.257944+0000","last_active":"2024-03-18T00:00:02.257908+0000","last_peered":"2024-03-18T00:00:02.257908+0000","last_clean":"2024-03-18T00:00:02.257908+0000","last_became_active":"2024-03-17T23:56:01.193625+0000","last_became_peered":"2024-03-17T23:56:01.193625+0000","last_unstale":"2024-03-18T00:00:02.257908+0000","last_undegraded":"2024-03-18T00:00:02.257908+0000","last_fullsized":"2024-03-18T00:00:02.257908+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'366","last_scrub_stamp":"2024-03-18T00:00:02.257814+0000","last_deep_scrub":"23'366","last_deep_scrub_stamp":"2024-03-18T00:00:02.257814+0000","last_clean_scrub_stamp":"2024-03-18T00:00:02.257814+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T05:44:43.723196+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":17870,"num_write":332,"num_write_kb":22223,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"23'275","reported_seq":303,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-18T00:00:03.094241+0000","last_change":"2024-03-18T00:00:03.094297+0000","last_active":"2024-03-18T00:00:03.094241+0000","last_peered":"2024-03-18T00:00:03.094241+0000","last_clean":"2024-03-18T00:00:03.094241+0000","last_became_active":"2024-03-17T23:56:00.699049+0000","last_became_peered":"2024-03-17T23:56:00.699049+0000","last_unstale":"2024-03-18T00:00:03.094241+0000","last_undegraded":"2024-03-18T00:00:03.094241+0000","last_fullsized":"2024-03-18T00:00:03.094241+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'275","last_scrub_stamp":"2024-03-18T00:00:03.094143+0000","last_deep_scrub":"23'275","last_deep_scrub_stamp":"2024-03-18T00:00:03.094143+0000","last_clean_scrub_stamp":"2024-03-18T00:00:03.094143+0000","objects_scrubbed":10,"log_size":275,"log_dups_size":0,"ondisk_log_size":275,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T11:50:16.502917+0000","scrub_duration":59,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":190,"num_write_kb":12389,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"23'368","reported_seq":456,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-18T00:00:01.450190+0000","last_change":"2024-03-18T00:00:01.450190+0000","last_active":"2024-03-18T00:00:01.450190+0000","last_peered":"2024-03-18T00:00:01.450190+0000","last_clean":"2024-03-18T00:00:01.450190+0000","last_became_active":"2024-03-17T23:56:01.207342+0000","last_became_peered":"2024-03-17T23:56:01.207342+0000","last_unstale":"2024-03-18T00:00:01.450190+0000","last_undegraded":"2024-03-18T00:00:01.450190+0000","last_fullsized":"2024-03-18T00:00:01.450190+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'368","last_scrub_stamp":"2024-03-18T00:00:01.450062+0000","last_deep_scrub":"23'368","last_deep_scrub_stamp":"2024-03-18T00:00:01.450062+0000","last_clean_scrub_stamp":"2024-03-18T00:00:01.450062+0000","objects_scrubbed":0,"log_size":368,"log_dups_size":0,"ondisk_log_size":368,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T05:18:00.767727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":38707,"num_write":341,"num_write_kb":47027,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"23'60","reported_seq":89,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:56.130520+0000","last_change":"2024-03-17T23:59:56.130520+0000","last_active":"2024-03-17T23:59:56.130520+0000","last_peered":"2024-03-17T23:59:56.130520+0000","last_clean":"2024-03-17T23:59:56.130520+0000","last_became_active":"2024-03-17T23:56:00.690892+0000","last_became_peered":"2024-03-17T23:56:00.690892+0000","last_unstale":"2024-03-17T23:59:56.130520+0000","last_undegraded":"2024-03-17T23:59:56.130520+0000","last_fullsized":"2024-03-17T23:59:56.130520+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'60","last_scrub_stamp":"2024-03-17T23:59:56.130361+0000","last_deep_scrub":"23'60","last_deep_scrub_stamp":"2024-03-17T23:59:56.130361+0000","last_clean_scrub_stamp":"2024-03-17T23:59:56.130361+0000","objects_scrubbed":1,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T07:40:31.431615+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":4104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"23'416","reported_seq":468,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-18T00:00:02.146625+0000","last_change":"2024-03-18T00:00:02.146625+0000","last_active":"2024-03-18T00:00:02.146625+0000","last_peered":"2024-03-18T00:00:02.146625+0000","last_clean":"2024-03-18T00:00:02.146625+0000","last_became_active":"2024-03-17T23:56:01.204930+0000","last_became_peered":"2024-03-17T23:56:01.204930+0000","last_unstale":"2024-03-18T00:00:02.146625+0000","last_undegraded":"2024-03-18T00:00:02.146625+0000","last_fullsized":"2024-03-18T00:00:02.146625+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'416","last_scrub_stamp":"2024-03-18T00:00:02.146289+0000","last_deep_scrub":"23'416","last_deep_scrub_stamp":"2024-03-18T00:00:02.146289+0000","last_clean_scrub_stamp":"2024-03-18T00:00:02.146289+0000","objects_scrubbed":0,"log_size":416,"log_dups_size":0,"ondisk_log_size":416,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T05:18:01.463953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":21060,"num_write":382,"num_write_kb":52186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"23'135","reported_seq":164,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-03-17T23:59:52.597142+0000","last_change":"2024-03-17T23:59:52.597142+0000","last_active":"2024-03-17T23:59:52.597142+0000","last_peered":"2024-03-17T23:59:52.597142+0000","last_clean":"2024-03-17T23:59:52.597142+0000","last_became_active":"2024-03-17T23:56:00.681938+0000","last_became_peered":"2024-03-17T23:56:00.681938+0000","last_unstale":"2024-03-17T23:59:52.597142+0000","last_undegraded":"2024-03-17T23:59:52.597142+0000","last_fullsized":"2024-03-17T23:59:52.597142+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'135","last_scrub_stamp":"2024-03-17T23:59:52.596976+0000","last_deep_scrub":"23'135","last_deep_scrub_stamp":"2024-03-17T23:59:52.596976+0000","last_clean_scrub_stamp":"2024-03-17T23:59:52.596976+0000","objects_scrubbed":7,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T05:17:44.201948+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":81,"num_write_kb":4133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2838,"num_read_kb":1533802,"num_write":24369,"num_write_kb":4275114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26399,"ondisk_log_size":26399,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":130818914,"num_objects":129,"num_object_clones":0,"num_object_copies":258,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":129,"num_whiteouts":0,"num_read":210,"num_read_kb":1570,"num_write":5949,"num_write_kb":132095,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":25000,"num_omap_keys":50,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":91545600,"data_stored":261637828,"data_compressed":38603034,"data_compressed_allocated":50184192,"data_compressed_original":220520448,"omap_allocated":0,"internal_metadata":0},"log_size":7609,"ondisk_log_size":7609,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66348,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574903,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":64480,"kb_used_data":15256,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94307360,"statfs":{"total":96636764160,"available":96570736640,"internally_reserved":0,"allocated":15622144,"data_stored":51012493,"data_compressed":7591170,"data_compressed_allocated":9641984,"data_compressed_original":45223936,"omap_allocated":1590,"internal_metadata":50395594},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574903,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":53036,"kb_used_data":13540,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94318804,"statfs":{"total":96636764160,"available":96582455296,"internally_reserved":0,"allocated":13864960,"data_stored":45545899,"data_compressed":7083231,"data_compressed_allocated":9031680,"data_compressed_original":40890368,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574902,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60172,"kb_used_data":10948,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94311668,"statfs":{"total":96636764160,"available":96575148032,"internally_reserved":0,"allocated":11210752,"data_stored":25258133,"data_compressed":3535502,"data_compressed_allocated":4878336,"data_compressed_original":19124224,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574904,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":70952,"kb_used_data":17568,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94300888,"statfs":{"total":96636764160,"available":96564109312,"internally_reserved":0,"allocated":17989632,"data_stored":46227051,"data_compressed":6636651,"data_compressed_allocated":8818688,"data_compressed_original":37232640,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574905,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41684,"kb_used_data":10508,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94330156,"statfs":{"total":96636764160,"available":96594079744,"internally_reserved":0,"allocated":10760192,"data_stored":34430955,"data_compressed":5296110,"data_compressed_allocated":6660096,"data_compressed_original":30515200,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574904,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33936,"kb_used_data":2760,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94337904,"statfs":{"total":96636764160,"available":96602013696,"internally_reserved":0,"allocated":2826240,"data_stored":5752077,"data_compressed":755556,"data_compressed_allocated":1044480,"data_compressed_original":4157440,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574903,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":67656,"kb_used_data":10112,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94304184,"statfs":{"total":96636764160,"available":96567484416,"internally_reserved":0,"allocated":10354688,"data_stored":25255151,"data_compressed":3481816,"data_compressed_allocated":4526080,"data_compressed_original":19607552,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574902,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59948,"kb_used_data":10724,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94311892,"statfs":{"total":96636764160,"available":96575377408,"internally_reserved":0,"allocated":10981376,"data_stored":30039165,"data_compressed":4289346,"data_compressed_allocated":5672960,"data_compressed_original":24915968,"omap_allocated":1592,"internal_metadata":50395592},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33174,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33174,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":10674176,"data_stored":29361002,"data_compressed":4256172,"data_compressed_allocated":5627904,"data_compressed_original":24342528,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":10113024,"data_stored":25167356,"data_compressed":3481816,"data_compressed_allocated":4526080,"data_compressed_original":19607552,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":2584576,"data_stored":5664282,"data_compressed":755556,"data_compressed_allocated":1044480,"data_compressed_original":4157440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":10518528,"data_stored":34343160,"data_compressed":5296110,"data_compressed_allocated":6660096,"data_compressed_original":30515200,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":17747968,"data_stored":46139256,"data_compressed":6636651,"data_compressed_allocated":8818688,"data_compressed_original":37232640,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":10969088,"data_stored":25170338,"data_compressed":3535502,"data_compressed_allocated":4878336,"data_compressed_original":19124224,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":13623296,"data_stored":45458104,"data_compressed":7083231,"data_compressed_allocated":9031680,"data_compressed_original":40890368,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":15314944,"data_stored":50334330,"data_compressed":7557996,"data_compressed_allocated":9596928,"data_compressed_original":44650496,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-18T00:00:16.773 DEBUG:teuthology.orchestra.run.smithi196:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-03-18T00:00:16.964 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:16.959+0000 7ff0e7e1c640 1 Processor -- start 2024-03-18T00:00:16.964 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:16.959+0000 7ff0e7e1c640 1 -- start start 2024-03-18T00:00:16.965 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:16.963+0000 7ff0e7e1c640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7ff0e0071bd0 0x7ff0e006b2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:00:16.965 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:16.963+0000 7ff0e7e1c640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7ff0e006e2f0 0x7ff0e01589d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:00:16.965 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:16.963+0000 7ff0e7e1c640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff0e00731e0 con 0x7ff0e0151fc0 2024-03-18T00:00:16.965 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:16.963+0000 7ff0e7e1c640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7ff0e0157f30 con 0x7ff0e0071bd0 2024-03-18T00:00:16.965 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:16.963+0000 7ff0e7e1c640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 -- 0x7ff0e0073450 con 0x7ff0e006e2f0 2024-03-18T00:00:16.965 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:16.963+0000 7ff0e53b7640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7ff0e0071bd0 0x7ff0e006b2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:00:16.966 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:16.963+0000 7ff0e53b7640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7ff0e0071bd0 0x7ff0e006b2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.196:51428/0 (socket says 172.21.15.196:51428) 2024-03-18T00:00:16.966 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:16.963+0000 7ff0e53b7640 1 -- 172.21.15.196:0/3774138942 learned_addr learned my addr 172.21.15.196:0/3774138942 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-03-18T00:00:16.966 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:16.963+0000 7ff0e63b9640 1 --2- 172.21.15.196:0/3774138942 >> v2:172.21.15.204:3300/0 conn(0x7ff0e006e2f0 0x7ff0e01589d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:00:16.966 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:16.963+0000 7ff0e53b7640 1 -- 172.21.15.196:0/3774138942 >> v2:172.21.15.204:3300/0 conn(0x7ff0e006e2f0 msgr2=0x7ff0e01589d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T00:00:16.966 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:16.963+0000 7ff0e53b7640 1 --2- 172.21.15.196:0/3774138942 >> v2:172.21.15.204:3300/0 conn(0x7ff0e006e2f0 0x7ff0e01589d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:00:16.966 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:16.963+0000 7ff0e53b7640 1 -- 172.21.15.196:0/3774138942 >> v1:172.21.15.196:6789/0 conn(0x7ff0e0151fc0 legacy=0x7ff0e006d240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T00:00:16.966 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:16.963+0000 7ff0e53b7640 1 -- 172.21.15.196:0/3774138942 --> v2:172.21.15.196:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0e01581d0 con 0x7ff0e0071bd0 2024-03-18T00:00:16.967 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:16.963+0000 7ff0e53b7640 1 --2- 172.21.15.196:0/3774138942 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff0e0071bd0 0x7ff0e006b2b0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7ff0e00c8870 tx=0x7ff0d0023120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd7b0924bb41633f server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:00:16.967 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:16.963+0000 7ff0e4bb6640 1 -- 172.21.15.196:0/3774138942 <== mon.0 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0d00b9070 con 0x7ff0e0071bd0 2024-03-18T00:00:16.967 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:16.963+0000 7ff0e4bb6640 1 -- 172.21.15.196:0/3774138942 <== mon.0 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0d00ace20 con 0x7ff0e0071bd0 2024-03-18T00:00:16.968 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:16.963+0000 7ff0e4bb6640 1 -- 172.21.15.196:0/3774138942 <== mon.0 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0d00b4660 con 0x7ff0e0071bd0 2024-03-18T00:00:16.968 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:16.963+0000 7ff0e7e1c640 1 -- 172.21.15.196:0/3774138942 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff0e0071bd0 msgr2=0x7ff0e006b2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:00:16.968 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:16.963+0000 7ff0e7e1c640 1 --2- 172.21.15.196:0/3774138942 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff0e0071bd0 0x7ff0e006b2b0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7ff0e00c8870 tx=0x7ff0d0023120 comp rx=0 tx=0).stop 2024-03-18T00:00:16.968 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:16.967+0000 7ff0e7e1c640 1 -- 172.21.15.196:0/3774138942 shutdown_connections 2024-03-18T00:00:16.969 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:16.967+0000 7ff0e7e1c640 1 --2- 172.21.15.196:0/3774138942 >> v2:172.21.15.204:3300/0 conn(0x7ff0e006e2f0 0x7ff0e01589d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:00:16.969 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:16.967+0000 7ff0e7e1c640 1 --2- 172.21.15.196:0/3774138942 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff0e0071bd0 0x7ff0e006b2b0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:00:16.969 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:16.967+0000 7ff0e7e1c640 1 -- 172.21.15.196:0/3774138942 >> 172.21.15.196:0/3774138942 conn(0x7ff0e00c8b70 msgr2=0x7ff0e00c8f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:00:16.969 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:16.967+0000 7ff0e7e1c640 1 -- 172.21.15.196:0/3774138942 shutdown_connections 2024-03-18T00:00:16.969 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:16.967+0000 7ff0e7e1c640 1 -- 172.21.15.196:0/3774138942 wait complete. 2024-03-18T00:00:16.969 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:16.967+0000 7ff0e7e1c640 1 Processor -- start 2024-03-18T00:00:16.969 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:16.967+0000 7ff0e7e1c640 1 -- start start 2024-03-18T00:00:16.971 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:16.967+0000 7ff0e7e1c640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff0e006e2f0 0x7ff0e014d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:00:16.971 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:16.967+0000 7ff0e7e1c640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff0e0071bd0 0x7ff0e01e2530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:00:16.971 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:16.967+0000 7ff0e7e1c640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff0e0151fc0 0x7ff0e01e2a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:00:16.972 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:16.967+0000 7ff0e7e1c640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7ff0e00c72b0 con 0x7ff0e006e2f0 2024-03-18T00:00:16.972 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:16.967+0000 7ff0e7e1c640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7ff0e0073730 con 0x7ff0e0151fc0 2024-03-18T00:00:16.972 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:16.967+0000 7ff0e7e1c640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7ff0e00c7430 con 0x7ff0e0071bd0 2024-03-18T00:00:16.972 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:16.967+0000 7ff0e5bb8640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff0e006e2f0 0x7ff0e014d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:00:16.972 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:16.967+0000 7ff0e5bb8640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff0e006e2f0 0x7ff0e014d390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.196:51438/0 (socket says 172.21.15.196:51438) 2024-03-18T00:00:16.972 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:16.967+0000 7ff0e5bb8640 1 -- 172.21.15.196:0/2173072761 learned_addr learned my addr 172.21.15.196:0/2173072761 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-03-18T00:00:16.972 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:16.967+0000 7ff0e63b9640 1 --2- 172.21.15.196:0/2173072761 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff0e0151fc0 0x7ff0e01e2a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:00:16.972 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:16.967+0000 7ff0e53b7640 1 --2- 172.21.15.196:0/2173072761 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff0e0071bd0 0x7ff0e01e2530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:00:16.972 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:16.967+0000 7ff0e5bb8640 1 -- 172.21.15.196:0/2173072761 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff0e0071bd0 msgr2=0x7ff0e01e2530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:00:16.972 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:16.967+0000 7ff0e5bb8640 1 --2- 172.21.15.196:0/2173072761 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff0e0071bd0 0x7ff0e01e2530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:00:16.972 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:16.967+0000 7ff0e5bb8640 1 -- 172.21.15.196:0/2173072761 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff0e0151fc0 msgr2=0x7ff0e01e2a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:00:16.972 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:16.967+0000 7ff0e5bb8640 1 --2- 172.21.15.196:0/2173072761 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff0e0151fc0 0x7ff0e01e2a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:00:16.972 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:16.967+0000 7ff0e5bb8640 1 -- 172.21.15.196:0/2173072761 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0e014d8d0 con 0x7ff0e006e2f0 2024-03-18T00:00:16.973 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:16.967+0000 7ff0e5bb8640 1 --2- 172.21.15.196:0/2173072761 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff0e006e2f0 0x7ff0e014d390 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7ff0dc00c3a0 tx=0x7ff0dc00c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:00:16.973 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:16.967+0000 7ff0d67fc640 1 -- 172.21.15.196:0/2173072761 <== mon.0 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0dc0052d0 con 0x7ff0e006e2f0 2024-03-18T00:00:16.973 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:16.967+0000 7ff0d67fc640 1 -- 172.21.15.196:0/2173072761 <== mon.0 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0dc005470 con 0x7ff0e006e2f0 2024-03-18T00:00:16.973 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:16.967+0000 7ff0d67fc640 1 -- 172.21.15.196:0/2173072761 <== mon.0 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0dc007260 con 0x7ff0e006e2f0 2024-03-18T00:00:16.973 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:16.967+0000 7ff0e7e1c640 1 -- 172.21.15.196:0/2173072761 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0e014db40 con 0x7ff0e006e2f0 2024-03-18T00:00:16.973 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:16.967+0000 7ff0e7e1c640 1 -- 172.21.15.196:0/2173072761 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0e01ef690 con 0x7ff0e006e2f0 2024-03-18T00:00:16.974 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:16.971+0000 7ff0e7e1c640 1 -- 172.21.15.196:0/2173072761 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff0e00689a0 con 0x7ff0e006e2f0 2024-03-18T00:00:16.974 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:16.971+0000 7ff0d67fc640 1 -- 172.21.15.196:0/2173072761 <== mon.0 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 5) ==== 87083+0+0 (secure 0 0 0) 0x7ff0dc007400 con 0x7ff0e006e2f0 2024-03-18T00:00:16.974 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:16.971+0000 7ff0d67fc640 1 --2- 172.21.15.196:0/2173072761 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7ff0c4067690 0x7ff0c4069b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:00:16.974 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:16.971+0000 7ff0d67fc640 1 -- 172.21.15.196:0/2173072761 <== mon.0 v2:172.21.15.196:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7ff0dc084dd0 con 0x7ff0e006e2f0 2024-03-18T00:00:16.974 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:16.971+0000 7ff0e53b7640 1 --2- 172.21.15.196:0/2173072761 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7ff0c4067690 0x7ff0c4069b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:00:16.974 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:16.971+0000 7ff0e53b7640 1 --2- 172.21.15.196:0/2173072761 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7ff0c4067690 0x7ff0c4069b50 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7ff0d00b6000 tx=0x7ff0d00ae070 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:00:16.982 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:16.979+0000 7ff0d67fc640 1 -- 172.21.15.196:0/2173072761 <== mon.0 v2:172.21.15.196:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177849 (secure 0 0 0) 0x7ff0dc0552f0 con 0x7ff0e006e2f0 2024-03-18T00:00:17.280 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:17.279+0000 7ff0e7e1c640 1 -- 172.21.15.196:0/2173072761 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) -- 0x7ff0e006c9f0 con 0x7ff0e006e2f0 2024-03-18T00:00:17.284 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:17.283+0000 7ff0d67fc640 1 -- 172.21.15.196:0/2173072761 <== mon.0 v2:172.21.15.196:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v10)=0 v10) ==== 123+0+0 (secure 0 0 0) 0x7ff0dc086020 con 0x7ff0e006e2f0 2024-03-18T00:00:17.289 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:17.287+0000 7ff0d67fc640 1 -- 172.21.15.196:0/2173072761 <== mon.0 v2:172.21.15.196:3300/0 8 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7ff0dc059390 con 0x7ff0e006e2f0 2024-03-18T00:00:17.289 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:17.287+0000 7ff0e7e1c640 1 -- 172.21.15.196:0/2173072761 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7ff0c4067690 msgr2=0x7ff0c4069b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:00:17.290 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:17.287+0000 7ff0e7e1c640 1 --2- 172.21.15.196:0/2173072761 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7ff0c4067690 0x7ff0c4069b50 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7ff0d00b6000 tx=0x7ff0d00ae070 comp rx=0 tx=0).stop 2024-03-18T00:00:17.290 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:17.287+0000 7ff0e7e1c640 1 -- 172.21.15.196:0/2173072761 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff0e006e2f0 msgr2=0x7ff0e014d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:00:17.290 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:17.287+0000 7ff0e7e1c640 1 --2- 172.21.15.196:0/2173072761 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff0e006e2f0 0x7ff0e014d390 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7ff0dc00c3a0 tx=0x7ff0dc00c860 comp rx=0 tx=0).stop 2024-03-18T00:00:17.290 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:17.287+0000 7ff0e7e1c640 1 -- 172.21.15.196:0/2173072761 shutdown_connections 2024-03-18T00:00:17.290 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:17.287+0000 7ff0e7e1c640 1 --2- 172.21.15.196:0/2173072761 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7ff0c4067690 0x7ff0c4069b50 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:00:17.290 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:17.287+0000 7ff0e7e1c640 1 --2- 172.21.15.196:0/2173072761 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff0e0071bd0 0x7ff0e01e2530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:00:17.290 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:17.287+0000 7ff0e7e1c640 1 --2- 172.21.15.196:0/2173072761 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff0e0151fc0 0x7ff0e01e2a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:00:17.290 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:17.287+0000 7ff0e7e1c640 1 --2- 172.21.15.196:0/2173072761 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff0e006e2f0 0x7ff0e014d390 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:00:17.290 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:17.287+0000 7ff0e7e1c640 1 -- 172.21.15.196:0/2173072761 >> 172.21.15.196:0/2173072761 conn(0x7ff0e00c8b70 msgr2=0x7ff0e006d240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:00:17.290 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:17.287+0000 7ff0e7e1c640 1 -- 172.21.15.196:0/2173072761 shutdown_connections 2024-03-18T00:00:17.290 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:17.287+0000 7ff0e7e1c640 1 -- 172.21.15.196:0/2173072761 wait complete. 2024-03-18T00:00:17.310 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-03-18T00:00:17.310 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-18T00:00:17.413 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:17.411+0000 7f8cdf2be640 1 Processor -- start 2024-03-18T00:00:17.413 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:17.411+0000 7f8cdf2be640 1 -- start start 2024-03-18T00:00:17.415 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:17.411+0000 7f8cdf2be640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f8cd81589f0 0x7f8cd80c8240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:00:17.415 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:17.411+0000 7f8cdf2be640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8cd8157c50 con 0x7f8cd80c8780 2024-03-18T00:00:17.415 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:17.411+0000 7f8cdf2be640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8cd80c2c30 con 0x7f8cd8151e40 2024-03-18T00:00:17.415 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:17.411+0000 7f8cdf2be640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 -- 0x7f8cd80c2f10 con 0x7f8cd81589f0 2024-03-18T00:00:17.415 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:17.411+0000 7f8cdd85b640 1 --1- >> v1:172.21.15.196:6789/0 conn(0x7f8cd80c8780 0x7f8cd806fe70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.196:6789/0 says I am v1:172.21.15.196:35956/0 (socket says 172.21.15.196:35956) 2024-03-18T00:00:17.415 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:17.411+0000 7f8cdd85b640 1 -- 172.21.15.196:0/1542152334 learned_addr learned my addr 172.21.15.196:0/1542152334 (peer_addr_for_me v1:172.21.15.196:0/0) 2024-03-18T00:00:17.415 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:17.411+0000 7f8cdc859640 1 --2- 172.21.15.196:0/1542152334 >> v2:172.21.15.204:3300/0 conn(0x7f8cd81589f0 0x7f8cd80c8240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:00:17.415 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:17.411+0000 7f8ccffff640 1 -- 172.21.15.196:0/1542152334 <== mon.0 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1963151627 0 0) 0x7f8cd8157c50 con 0x7f8cd80c8780 2024-03-18T00:00:17.415 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:17.411+0000 7f8ccffff640 1 -- 172.21.15.196:0/1542152334 --> v1:172.21.15.196:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8cc4003530 con 0x7f8cd80c8780 2024-03-18T00:00:17.415 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:17.411+0000 7f8cdc859640 1 -- 172.21.15.196:0/1542152334 >> v1:172.21.15.204:6789/0 conn(0x7f8cd8151e40 legacy=0x7f8cd8070de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:00:17.415 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:17.411+0000 7f8cdc859640 1 -- 172.21.15.196:0/1542152334 >> v1:172.21.15.196:6789/0 conn(0x7f8cd80c8780 legacy=0x7f8cd806fe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:00:17.416 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:17.411+0000 7f8ccffff640 1 -- 172.21.15.196:0/1542152334 <== mon.0 v1:172.21.15.196:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1408553170 0 0) 0x7f8cc4003530 con 0x7f8cd80c8780 2024-03-18T00:00:17.416 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:17.411+0000 7f8cdc859640 1 -- 172.21.15.196:0/1542152334 --> v2:172.21.15.204:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8cd8157f10 con 0x7f8cd81589f0 2024-03-18T00:00:17.418 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:17.415+0000 7f8cdc859640 1 --2- 172.21.15.196:0/1542152334 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8cd81589f0 0x7f8cd80c8240 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f8cc80097c0 tx=0x7f8cc801c390 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5d7a8dfebc17ef32 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:00:17.418 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:17.415+0000 7f8ccffff640 1 -- 172.21.15.196:0/1542152334 <== mon.1 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cc80b1070 con 0x7f8cd81589f0 2024-03-18T00:00:17.418 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:17.415+0000 7f8ccffff640 1 -- 172.21.15.196:0/1542152334 <== mon.1 v2:172.21.15.204:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f8cc80ac440 con 0x7f8cd81589f0 2024-03-18T00:00:17.418 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:17.415+0000 7f8ccffff640 1 -- 172.21.15.196:0/1542152334 <== mon.1 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cd0001a00 con 0x7f8cd81589f0 2024-03-18T00:00:17.419 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:17.415+0000 7f8cdf2be640 1 -- 172.21.15.196:0/1542152334 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8cd81589f0 msgr2=0x7f8cd80c8240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:00:17.419 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:17.415+0000 7f8cdf2be640 1 --2- 172.21.15.196:0/1542152334 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8cd81589f0 0x7f8cd80c8240 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f8cc80097c0 tx=0x7f8cc801c390 comp rx=0 tx=0).stop 2024-03-18T00:00:17.419 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:17.415+0000 7f8cdf2be640 1 -- 172.21.15.196:0/1542152334 shutdown_connections 2024-03-18T00:00:17.419 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:17.415+0000 7f8cdf2be640 1 --2- 172.21.15.196:0/1542152334 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8cd81589f0 0x7f8cd80c8240 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:00:17.419 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:17.415+0000 7f8cdf2be640 1 -- 172.21.15.196:0/1542152334 >> 172.21.15.196:0/1542152334 conn(0x7f8cd806b2b0 msgr2=0x7f8cd806b6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:00:17.419 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:17.415+0000 7f8cdf2be640 1 -- 172.21.15.196:0/1542152334 shutdown_connections 2024-03-18T00:00:17.419 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:17.415+0000 7f8cdf2be640 1 -- 172.21.15.196:0/1542152334 wait complete. 2024-03-18T00:00:17.420 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:17.419+0000 7f8cdf2be640 1 Processor -- start 2024-03-18T00:00:17.420 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:17.419+0000 7f8cdf2be640 1 -- start start 2024-03-18T00:00:17.423 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:17.419+0000 7f8cdf2be640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8cd80c8780 0x7f8cd806d7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:00:17.423 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:17.419+0000 7f8cdf2be640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8cd8151e40 0x7f8cd806d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:00:17.423 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:17.419+0000 7f8cdf2be640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8cd81589f0 0x7f8cd8156ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:00:17.423 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:17.419+0000 7f8cdf2be640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f8cd80c4a40 con 0x7f8cd81589f0 2024-03-18T00:00:17.423 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:17.419+0000 7f8cdf2be640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f8cd80c48c0 con 0x7f8cd80c8780 2024-03-18T00:00:17.423 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:17.419+0000 7f8cdf2be640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f8cd8152220 con 0x7f8cd8151e40 2024-03-18T00:00:17.424 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:17.419+0000 7f8cdd85b640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8cd81589f0 0x7f8cd8156ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:00:17.424 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:17.419+0000 7f8cdd85b640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8cd81589f0 0x7f8cd8156ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.196:51442/0 (socket says 172.21.15.196:51442) 2024-03-18T00:00:17.424 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:17.419+0000 7f8cdd85b640 1 -- 172.21.15.196:0/1395519224 learned_addr learned my addr 172.21.15.196:0/1395519224 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-03-18T00:00:17.424 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:17.419+0000 7f8cdc859640 1 --2- 172.21.15.196:0/1395519224 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8cd8151e40 0x7f8cd806d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:00:17.424 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:17.419+0000 7f8cdd05a640 1 --2- 172.21.15.196:0/1395519224 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8cd80c8780 0x7f8cd806d7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:00:17.424 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:17.419+0000 7f8cdd85b640 1 -- 172.21.15.196:0/1395519224 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8cd8151e40 msgr2=0x7f8cd806d0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:00:17.424 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:17.419+0000 7f8cdd85b640 1 --2- 172.21.15.196:0/1395519224 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8cd8151e40 0x7f8cd806d0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:00:17.424 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:17.419+0000 7f8cdd85b640 1 -- 172.21.15.196:0/1395519224 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8cd80c8780 msgr2=0x7f8cd806d7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:00:17.424 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:17.419+0000 7f8cdd85b640 1 --2- 172.21.15.196:0/1395519224 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8cd80c8780 0x7f8cd806d7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:00:17.424 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:17.419+0000 7f8cdd85b640 1 -- 172.21.15.196:0/1395519224 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8cd81420b0 con 0x7f8cd81589f0 2024-03-18T00:00:17.424 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:17.419+0000 7f8cdc859640 1 --2- 172.21.15.196:0/1395519224 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8cd8151e40 0x7f8cd806d0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T00:00:17.424 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:17.419+0000 7f8cdd85b640 1 --2- 172.21.15.196:0/1395519224 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8cd81589f0 0x7f8cd8156ad0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f8cd00018a0 tx=0x7f8cd000a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:00:17.424 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:17.419+0000 7f8ccdffb640 1 -- 172.21.15.196:0/1395519224 <== mon.0 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cd0012400 con 0x7f8cd81589f0 2024-03-18T00:00:17.425 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:17.419+0000 7f8ccdffb640 1 -- 172.21.15.196:0/1395519224 <== mon.0 v2:172.21.15.196:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f8cd00125c0 con 0x7f8cd81589f0 2024-03-18T00:00:17.425 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:17.419+0000 7f8cdf2be640 1 -- 172.21.15.196:0/1395519224 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8cd806c4c0 con 0x7f8cd81589f0 2024-03-18T00:00:17.425 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:17.419+0000 7f8ccdffb640 1 -- 172.21.15.196:0/1395519224 <== mon.0 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cd00129d0 con 0x7f8cd81589f0 2024-03-18T00:00:17.425 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:17.419+0000 7f8cdf2be640 1 -- 172.21.15.196:0/1395519224 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8cd8142600 con 0x7f8cd81589f0 2024-03-18T00:00:17.426 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:17.419+0000 7f8cc37fe640 1 -- 172.21.15.196:0/1395519224 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8cb00052a0 con 0x7f8cd81589f0 2024-03-18T00:00:17.426 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:17.423+0000 7f8ccdffb640 1 -- 172.21.15.196:0/1395519224 <== mon.0 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 5) ==== 87083+0+0 (secure 0 0 0) 0x7f8cd0012b70 con 0x7f8cd81589f0 2024-03-18T00:00:17.426 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:17.423+0000 7f8ccdffb640 1 --2- 172.21.15.196:0/1395519224 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f8cbc067690 0x7f8cbc069b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:00:17.426 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:17.423+0000 7f8ccdffb640 1 -- 172.21.15.196:0/1395519224 <== mon.0 v2:172.21.15.196:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7f8cd0086140 con 0x7f8cd81589f0 2024-03-18T00:00:17.426 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:17.423+0000 7f8cdd05a640 1 --2- 172.21.15.196:0/1395519224 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f8cbc067690 0x7f8cbc069b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:00:17.427 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:17.423+0000 7f8cdd05a640 1 --2- 172.21.15.196:0/1395519224 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f8cbc067690 0x7f8cbc069b50 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f8cd4007fd0 tx=0x7f8cd4009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:00:17.434 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:17.431+0000 7f8ccdffb640 1 -- 172.21.15.196:0/1395519224 <== mon.0 v2:172.21.15.196:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177849 (secure 0 0 0) 0x7f8cd0056660 con 0x7f8cd81589f0 2024-03-18T00:00:17.643 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:17.639+0000 7f8cc37fe640 1 -- 172.21.15.196:0/1395519224 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8cb0005860 con 0x7f8cd81589f0 2024-03-18T00:00:17.644 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:17.639+0000 7f8ccdffb640 1 -- 172.21.15.196:0/1395519224 <== mon.0 v2:172.21.15.196:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) ==== 94+0+6922 (secure 0 0 0) 0x7f8cd005a700 con 0x7f8cd81589f0 2024-03-18T00:00:17.644 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-03-18T00:00:17.644 INFO:teuthology.orchestra.run.smithi196.stdout:{"epoch":14,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4211,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6835/1901351791","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6834","nonce":1901351791},{"type":"v1","addr":"172.21.15.204:6835","nonce":1901351791}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-17T23:56:01.019247+0000","modified":"2024-03-17T23:56:07.696894+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4284,"mds_1":4281,"mds_2":4275,"mds_3":4264,"mds_4":4261},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4261":{"gid":4261,"name":"d","rank":4,"incarnation":13,"state":"up:active","state_seq":5,"addr":"172.21.15.204:6837/3888512151","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6836","nonce":3888512151},{"type":"v1","addr":"172.21.15.204:6837","nonce":3888512151}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4264":{"gid":4264,"name":"f","rank":3,"incarnation":11,"state":"up:active","state_seq":4,"addr":"172.21.15.204:6839/2849161202","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6838","nonce":2849161202},{"type":"v1","addr":"172.21.15.204:6839","nonce":2849161202}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4275":{"gid":4275,"name":"a","rank":2,"incarnation":9,"state":"up:active","state_seq":4,"addr":"172.21.15.196:6833/2075619627","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6832","nonce":2075619627},{"type":"v1","addr":"172.21.15.196:6833","nonce":2075619627}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4281":{"gid":4281,"name":"e","rank":1,"incarnation":7,"state":"up:active","state_seq":4,"addr":"172.21.15.196:6835/1837184297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6834","nonce":1837184297},{"type":"v1","addr":"172.21.15.196:6835","nonce":1837184297}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4284":{"gid":4284,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.196:6837/2436120950","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6836","nonce":2436120950},{"type":"v1","addr":"172.21.15.196:6837","nonce":2436120950}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4284,"qdb_cluster":[4261,4264,4275,4281,4284]},"id":1}]} 2024-03-18T00:00:17.645 INFO:teuthology.orchestra.run.smithi196.stderr:dumped fsmap epoch 14 2024-03-18T00:00:17.646 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:17.643+0000 7f8cc37fe640 1 -- 172.21.15.196:0/1395519224 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f8cbc067690 msgr2=0x7f8cbc069b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:00:17.647 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:17.643+0000 7f8cc37fe640 1 --2- 172.21.15.196:0/1395519224 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f8cbc067690 0x7f8cbc069b50 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f8cd4007fd0 tx=0x7f8cd4009040 comp rx=0 tx=0).stop 2024-03-18T00:00:17.647 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:17.643+0000 7f8cc37fe640 1 -- 172.21.15.196:0/1395519224 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8cd81589f0 msgr2=0x7f8cd8156ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:00:17.647 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:17.643+0000 7f8cc37fe640 1 --2- 172.21.15.196:0/1395519224 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8cd81589f0 0x7f8cd8156ad0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f8cd00018a0 tx=0x7f8cd000a430 comp rx=0 tx=0).stop 2024-03-18T00:00:17.647 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:17.643+0000 7f8cc37fe640 1 -- 172.21.15.196:0/1395519224 shutdown_connections 2024-03-18T00:00:17.647 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:17.643+0000 7f8cc37fe640 1 --2- 172.21.15.196:0/1395519224 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f8cbc067690 0x7f8cbc069b50 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:00:17.647 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:17.643+0000 7f8cc37fe640 1 --2- 172.21.15.196:0/1395519224 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8cd8151e40 0x7f8cd806d0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:00:17.647 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:17.643+0000 7f8cc37fe640 1 --2- 172.21.15.196:0/1395519224 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8cd81589f0 0x7f8cd8156ad0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:00:17.647 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:17.643+0000 7f8cc37fe640 1 --2- 172.21.15.196:0/1395519224 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8cd80c8780 0x7f8cd806d7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:00:17.647 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:17.643+0000 7f8cc37fe640 1 -- 172.21.15.196:0/1395519224 >> 172.21.15.196:0/1395519224 conn(0x7f8cd806b2b0 msgr2=0x7f8cd80ce090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:00:17.647 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:17.643+0000 7f8cc37fe640 1 -- 172.21.15.196:0/1395519224 shutdown_connections 2024-03-18T00:00:17.647 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:17.643+0000 7f8cc37fe640 1 -- 172.21.15.196:0/1395519224 wait complete. 2024-03-18T00:00:17.662 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-18T00:00:17.773 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:17.771+0000 7f05032ed640 1 Processor -- start 2024-03-18T00:00:17.773 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:17.771+0000 7f05032ed640 1 -- start start 2024-03-18T00:00:17.783 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:17.771+0000 7f05032ed640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f04fc151e80 0x7f04fc072fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:00:17.784 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:17.771+0000 7f05032ed640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f04fc157e90 con 0x7f04fc15bd20 2024-03-18T00:00:17.784 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:17.771+0000 7f05032ed640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f04fc158130 con 0x7f04fc0c5ba0 2024-03-18T00:00:17.784 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:17.771+0000 7f05032ed640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 -- 0x7f04fc158410 con 0x7f04fc151e80 2024-03-18T00:00:17.784 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:17.771+0000 7f050188a640 1 --1- >> v1:172.21.15.196:6789/0 conn(0x7f04fc15bd20 0x7f04fc1625c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.196:6789/0 says I am v1:172.21.15.196:35960/0 (socket says 172.21.15.196:35960) 2024-03-18T00:00:17.784 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:17.771+0000 7f050188a640 1 -- 172.21.15.196:0/3201930347 learned_addr learned my addr 172.21.15.196:0/3201930347 (peer_addr_for_me v1:172.21.15.196:0/0) 2024-03-18T00:00:17.784 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:17.771+0000 7f0501089640 1 --2- 172.21.15.196:0/3201930347 >> v2:172.21.15.204:3300/0 conn(0x7f04fc151e80 0x7f04fc072fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:00:17.784 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:17.771+0000 7f04f3fff640 1 -- 172.21.15.196:0/3201930347 <== mon.0 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 626747285 0 0) 0x7f04fc157e90 con 0x7f04fc15bd20 2024-03-18T00:00:17.784 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:17.771+0000 7f04f3fff640 1 -- 172.21.15.196:0/3201930347 --> v1:172.21.15.196:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f04e8003530 con 0x7f04fc15bd20 2024-03-18T00:00:17.784 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:17.771+0000 7f04f3fff640 1 -- 172.21.15.196:0/3201930347 <== mon.1 v1:172.21.15.204:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 358271643 0 0) 0x7f04fc158130 con 0x7f04fc0c5ba0 2024-03-18T00:00:17.784 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:17.771+0000 7f04f3fff640 1 -- 172.21.15.196:0/3201930347 --> v1:172.21.15.204:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f04fc157e90 con 0x7f04fc0c5ba0 2024-03-18T00:00:17.784 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:17.771+0000 7f04f3fff640 1 -- 172.21.15.196:0/3201930347 <== mon.0 v1:172.21.15.196:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3332588067 0 0) 0x7f04e8003530 con 0x7f04fc15bd20 2024-03-18T00:00:17.785 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:17.771+0000 7f04f3fff640 1 -- 172.21.15.196:0/3201930347 >> v2:172.21.15.204:3300/0 conn(0x7f04fc151e80 msgr2=0x7f04fc072fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T00:00:17.785 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:17.771+0000 7f04f3fff640 1 --2- 172.21.15.196:0/3201930347 >> v2:172.21.15.204:3300/0 conn(0x7f04fc151e80 0x7f04fc072fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:00:17.785 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:17.771+0000 7f04f3fff640 1 -- 172.21.15.196:0/3201930347 >> v1:172.21.15.204:6789/0 conn(0x7f04fc0c5ba0 legacy=0x7f04fc15b610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:00:17.785 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:17.771+0000 7f04f3fff640 1 -- 172.21.15.196:0/3201930347 --> v1:172.21.15.196:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04fc1586f0 con 0x7f04fc15bd20 2024-03-18T00:00:17.785 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:17.771+0000 7f04f3fff640 1 -- 172.21.15.196:0/3201930347 <== mon.0 v1:172.21.15.196:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 981458915 0 0) 0x7f04f4001a00 con 0x7f04fc15bd20 2024-03-18T00:00:17.785 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:17.771+0000 7f04f3fff640 1 -- 172.21.15.196:0/3201930347 >> v1:172.21.15.196:6789/0 conn(0x7f04fc15bd20 legacy=0x7f04fc1625c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:00:17.785 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:17.771+0000 7f04f3fff640 1 --2- 172.21.15.196:0/3201930347 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f04e8003ba0 0x7f04e8003fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:00:17.785 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:17.771+0000 7f04f3fff640 1 --2- 172.21.15.196:0/3201930347 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f04e8004810 0x7f04e8004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:00:17.785 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:17.771+0000 7f04f3fff640 1 --2- 172.21.15.196:0/3201930347 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f04e80051d0 0x7f04e800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:00:17.785 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:17.771+0000 7f04f3fff640 1 -- 172.21.15.196:0/3201930347 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f04fc158410 con 0x7f04e8003ba0 2024-03-18T00:00:17.785 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:17.771+0000 7f04f3fff640 1 -- 172.21.15.196:0/3201930347 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f04e800c0a0 con 0x7f04e8004810 2024-03-18T00:00:17.785 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:17.771+0000 7f04f3fff640 1 -- 172.21.15.196:0/3201930347 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f04e800c2a0 con 0x7f04e80051d0 2024-03-18T00:00:17.785 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:17.771+0000 7f0501089640 1 --2- 172.21.15.196:0/3201930347 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f04e8003ba0 0x7f04e8003fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:00:17.785 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:17.771+0000 7f050188a640 1 --2- 172.21.15.196:0/3201930347 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f04e80051d0 0x7f04e800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:00:17.786 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:17.771+0000 7f0500888640 1 --2- 172.21.15.196:0/3201930347 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f04e8004810 0x7f04e8004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:00:17.786 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:17.771+0000 7f0501089640 1 -- 172.21.15.196:0/3201930347 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f04e80051d0 msgr2=0x7f04e800b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T00:00:17.786 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:17.771+0000 7f0501089640 1 --2- 172.21.15.196:0/3201930347 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f04e80051d0 0x7f04e800b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:00:17.786 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:17.771+0000 7f0501089640 1 -- 172.21.15.196:0/3201930347 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f04e8004810 msgr2=0x7f04e8004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T00:00:17.786 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:17.771+0000 7f0501089640 1 --2- 172.21.15.196:0/3201930347 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f04e8004810 0x7f04e8004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:00:17.786 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:17.771+0000 7f0501089640 1 -- 172.21.15.196:0/3201930347 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04e8003530 con 0x7f04e8003ba0 2024-03-18T00:00:17.786 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:17.771+0000 7f050188a640 1 -- 172.21.15.196:0/3201930347 reap_dead start 2024-03-18T00:00:17.786 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:17.771+0000 7f0500888640 1 --2- 172.21.15.196:0/3201930347 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f04e8004810 0x7f04e8004c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-18T00:00:17.786 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:17.775+0000 7f0501089640 1 --2- 172.21.15.196:0/3201930347 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f04e8003ba0 0x7f04e8003fa0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f04f8009ae0 tx=0x7f04f801ca70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4246ead372e9338 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:00:17.786 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:17.775+0000 7f04f3fff640 1 -- 172.21.15.196:0/3201930347 <== mon.0 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04f80b2070 con 0x7f04e8003ba0 2024-03-18T00:00:17.786 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:17.775+0000 7f04f3fff640 1 -- 172.21.15.196:0/3201930347 <== mon.0 v2:172.21.15.196:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f04f80a5550 con 0x7f04e8003ba0 2024-03-18T00:00:17.786 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:17.775+0000 7f04f3fff640 1 -- 172.21.15.196:0/3201930347 <== mon.0 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04f80096b0 con 0x7f04e8003ba0 2024-03-18T00:00:17.786 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:17.775+0000 7f05032ed640 1 -- 172.21.15.196:0/3201930347 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f04e8003ba0 msgr2=0x7f04e8003fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:00:17.787 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:17.775+0000 7f05032ed640 1 --2- 172.21.15.196:0/3201930347 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f04e8003ba0 0x7f04e8003fa0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f04f8009ae0 tx=0x7f04f801ca70 comp rx=0 tx=0).stop 2024-03-18T00:00:17.787 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:17.775+0000 7f05032ed640 1 -- 172.21.15.196:0/3201930347 shutdown_connections 2024-03-18T00:00:17.787 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:17.775+0000 7f05032ed640 1 --2- 172.21.15.196:0/3201930347 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f04e8003ba0 0x7f04e8003fa0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:00:17.787 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:17.775+0000 7f05032ed640 1 -- 172.21.15.196:0/3201930347 >> 172.21.15.196:0/3201930347 conn(0x7f04fc0675f0 msgr2=0x7f04fc0cc490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:00:17.787 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:17.775+0000 7f05032ed640 1 -- 172.21.15.196:0/3201930347 shutdown_connections 2024-03-18T00:00:17.787 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:17.775+0000 7f05032ed640 1 -- 172.21.15.196:0/3201930347 wait complete. 2024-03-18T00:00:17.787 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:17.779+0000 7f05032ed640 1 Processor -- start 2024-03-18T00:00:17.787 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:17.779+0000 7f05032ed640 1 -- start start 2024-03-18T00:00:17.787 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:17.779+0000 7f05032ed640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f04e8003ba0 0x7f04fc154ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:00:17.787 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:17.779+0000 7f05032ed640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f04fc0cc6a0 0x7f04fc1f3530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:00:17.787 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:17.779+0000 7f05032ed640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f04fc1f3a70 0x7f04fc147d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:00:17.787 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:17.779+0000 7f05032ed640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f04fc15bba0 con 0x7f04fc1f3a70 2024-03-18T00:00:17.787 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:17.779+0000 7f05032ed640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f04fc15ba20 con 0x7f04fc0cc6a0 2024-03-18T00:00:17.788 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:17.779+0000 7f05032ed640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f04fc152260 con 0x7f04e8003ba0 2024-03-18T00:00:17.788 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:17.779+0000 7f050188a640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f04fc1f3a70 0x7f04fc147d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:00:17.788 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:17.779+0000 7f050188a640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f04fc1f3a70 0x7f04fc147d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.196:51470/0 (socket says 172.21.15.196:51470) 2024-03-18T00:00:17.788 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:17.779+0000 7f050188a640 1 -- 172.21.15.196:0/4251542820 learned_addr learned my addr 172.21.15.196:0/4251542820 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-03-18T00:00:17.788 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:17.779+0000 7f0500888640 1 --2- 172.21.15.196:0/4251542820 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f04fc0cc6a0 0x7f04fc1f3530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:00:17.788 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:17.779+0000 7f0501089640 1 --2- 172.21.15.196:0/4251542820 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f04e8003ba0 0x7f04fc154ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:00:17.788 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:17.779+0000 7f050188a640 1 -- 172.21.15.196:0/4251542820 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f04e8003ba0 msgr2=0x7f04fc154ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:00:17.788 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:17.779+0000 7f050188a640 1 --2- 172.21.15.196:0/4251542820 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f04e8003ba0 0x7f04fc154ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:00:17.788 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:17.779+0000 7f050188a640 1 -- 172.21.15.196:0/4251542820 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f04fc0cc6a0 msgr2=0x7f04fc1f3530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:00:17.788 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:17.779+0000 7f050188a640 1 --2- 172.21.15.196:0/4251542820 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f04fc0cc6a0 0x7f04fc1f3530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:00:17.788 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:17.779+0000 7f050188a640 1 -- 172.21.15.196:0/4251542820 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04fc1f3ef0 con 0x7f04fc1f3a70 2024-03-18T00:00:17.788 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:17.779+0000 7f050188a640 1 --2- 172.21.15.196:0/4251542820 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f04fc1f3a70 0x7f04fc147d10 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f04fc072580 tx=0x7f04f400a5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:00:17.788 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:17.779+0000 7f04f1ffb640 1 -- 172.21.15.196:0/4251542820 <== mon.0 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04f400abf0 con 0x7f04fc1f3a70 2024-03-18T00:00:17.789 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:17.779+0000 7f04f1ffb640 1 -- 172.21.15.196:0/4251542820 <== mon.0 v2:172.21.15.196:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f04f4018070 con 0x7f04fc1f3a70 2024-03-18T00:00:17.789 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:17.779+0000 7f05032ed640 1 -- 172.21.15.196:0/4251542820 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04fc1f6a90 con 0x7f04fc1f3a70 2024-03-18T00:00:17.789 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:17.779+0000 7f04f1ffb640 1 -- 172.21.15.196:0/4251542820 <== mon.0 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04f40133f0 con 0x7f04fc1f3a70 2024-03-18T00:00:17.789 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:17.779+0000 7f05032ed640 1 -- 172.21.15.196:0/4251542820 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04fc1f7050 con 0x7f04fc1f3a70 2024-03-18T00:00:17.789 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:17.779+0000 7f04e77fe640 1 -- 172.21.15.196:0/4251542820 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f04d40052a0 con 0x7f04fc1f3a70 2024-03-18T00:00:17.789 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:17.779+0000 7f04f1ffb640 1 -- 172.21.15.196:0/4251542820 <== mon.0 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 5) ==== 87083+0+0 (secure 0 0 0) 0x7f04f4013590 con 0x7f04fc1f3a70 2024-03-18T00:00:17.790 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:17.783+0000 7f04f1ffb640 1 --2- 172.21.15.196:0/4251542820 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f04e0067690 0x7f04e0069b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:00:17.790 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:17.783+0000 7f04f1ffb640 1 -- 172.21.15.196:0/4251542820 <== mon.0 v2:172.21.15.196:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7f04f4085ed0 con 0x7f04fc1f3a70 2024-03-18T00:00:17.790 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:17.783+0000 7f0501089640 1 --2- 172.21.15.196:0/4251542820 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f04e0067690 0x7f04e0069b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:00:17.790 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:17.783+0000 7f0501089640 1 --2- 172.21.15.196:0/4251542820 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f04e0067690 0x7f04e0069b50 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f04f80af000 tx=0x7f04f8008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:00:17.791 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:17.787+0000 7f04f1ffb640 1 -- 172.21.15.196:0/4251542820 <== mon.0 v2:172.21.15.196:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177849 (secure 0 0 0) 0x7f04fc1f3ef0 con 0x7f04fc1f3a70 2024-03-18T00:00:17.987 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:17.983+0000 7f04e77fe640 1 -- 172.21.15.196:0/4251542820 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f04d4005860 con 0x7f04fc1f3a70 2024-03-18T00:00:17.988 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:17.983+0000 7f04f1ffb640 1 -- 172.21.15.196:0/4251542820 <== mon.0 v2:172.21.15.196:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) ==== 94+0+6922 (secure 0 0 0) 0x7f04f4056a40 con 0x7f04fc1f3a70 2024-03-18T00:00:17.989 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-03-18T00:00:17.989 INFO:teuthology.orchestra.run.smithi196.stdout:{"epoch":14,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4211,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6835/1901351791","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6834","nonce":1901351791},{"type":"v1","addr":"172.21.15.204:6835","nonce":1901351791}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-17T23:56:01.019247+0000","modified":"2024-03-17T23:56:07.696894+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4284,"mds_1":4281,"mds_2":4275,"mds_3":4264,"mds_4":4261},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4261":{"gid":4261,"name":"d","rank":4,"incarnation":13,"state":"up:active","state_seq":5,"addr":"172.21.15.204:6837/3888512151","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6836","nonce":3888512151},{"type":"v1","addr":"172.21.15.204:6837","nonce":3888512151}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4264":{"gid":4264,"name":"f","rank":3,"incarnation":11,"state":"up:active","state_seq":4,"addr":"172.21.15.204:6839/2849161202","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6838","nonce":2849161202},{"type":"v1","addr":"172.21.15.204:6839","nonce":2849161202}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4275":{"gid":4275,"name":"a","rank":2,"incarnation":9,"state":"up:active","state_seq":4,"addr":"172.21.15.196:6833/2075619627","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6832","nonce":2075619627},{"type":"v1","addr":"172.21.15.196:6833","nonce":2075619627}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4281":{"gid":4281,"name":"e","rank":1,"incarnation":7,"state":"up:active","state_seq":4,"addr":"172.21.15.196:6835/1837184297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6834","nonce":1837184297},{"type":"v1","addr":"172.21.15.196:6835","nonce":1837184297}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4284":{"gid":4284,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.196:6837/2436120950","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6836","nonce":2436120950},{"type":"v1","addr":"172.21.15.196:6837","nonce":2436120950}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4284,"qdb_cluster":[4261,4264,4275,4281,4284]},"id":1}]} 2024-03-18T00:00:17.989 INFO:teuthology.orchestra.run.smithi196.stderr:dumped fsmap epoch 14 2024-03-18T00:00:17.990 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:17.987+0000 7f04e77fe640 1 -- 172.21.15.196:0/4251542820 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f04e0067690 msgr2=0x7f04e0069b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:00:17.990 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:17.987+0000 7f04e77fe640 1 --2- 172.21.15.196:0/4251542820 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f04e0067690 0x7f04e0069b50 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f04f80af000 tx=0x7f04f8008040 comp rx=0 tx=0).stop 2024-03-18T00:00:17.990 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:17.987+0000 7f04e77fe640 1 -- 172.21.15.196:0/4251542820 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f04fc1f3a70 msgr2=0x7f04fc147d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:00:17.990 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:17.987+0000 7f04e77fe640 1 --2- 172.21.15.196:0/4251542820 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f04fc1f3a70 0x7f04fc147d10 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f04fc072580 tx=0x7f04f400a5c0 comp rx=0 tx=0).stop 2024-03-18T00:00:17.991 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:17.987+0000 7f04e77fe640 1 -- 172.21.15.196:0/4251542820 shutdown_connections 2024-03-18T00:00:17.991 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:17.987+0000 7f04e77fe640 1 --2- 172.21.15.196:0/4251542820 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f04e0067690 0x7f04e0069b50 secure :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f04f80af000 tx=0x7f04f8008040 comp rx=0 tx=0).stop 2024-03-18T00:00:17.991 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:17.987+0000 7f04e77fe640 1 --2- 172.21.15.196:0/4251542820 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f04fc1f3a70 0x7f04fc147d10 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:00:17.991 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:17.987+0000 7f04e77fe640 1 --2- 172.21.15.196:0/4251542820 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f04fc0cc6a0 0x7f04fc1f3530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:00:17.991 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:17.987+0000 7f04e77fe640 1 --2- 172.21.15.196:0/4251542820 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f04e8003ba0 0x7f04fc154ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:00:17.992 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:17.987+0000 7f04e77fe640 1 -- 172.21.15.196:0/4251542820 >> 172.21.15.196:0/4251542820 conn(0x7f04fc0675f0 msgr2=0x7f04fc06fe00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:00:17.992 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:17.987+0000 7f04e77fe640 1 -- 172.21.15.196:0/4251542820 shutdown_connections 2024-03-18T00:00:17.992 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:17.987+0000 7f04e77fe640 1 -- 172.21.15.196:0/4251542820 wait complete. 2024-03-18T00:00:18.010 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-18T00:00:18.125 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:18.123+0000 7f07cb224640 1 Processor -- start 2024-03-18T00:00:18.125 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:18.123+0000 7f07cb224640 1 -- start start 2024-03-18T00:00:18.127 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:18.123+0000 7f07cb224640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f07c4154340 0x7f07c40c8d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:00:18.127 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:18.123+0000 7f07cb224640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f07c415d5d0 con 0x7f07c4153f60 2024-03-18T00:00:18.127 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:18.123+0000 7f07c8fc0640 1 --1- >> v1:172.21.15.196:6789/0 conn(0x7f07c4153f60 0x7f07c40705f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.196:6789/0 says I am v1:172.21.15.196:35962/0 (socket says 172.21.15.196:35962) 2024-03-18T00:00:18.127 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:18.123+0000 7f07c8fc0640 1 -- 172.21.15.196:0/3323866205 learned_addr learned my addr 172.21.15.196:0/3323866205 (peer_addr_for_me v1:172.21.15.196:0/0) 2024-03-18T00:00:18.127 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:18.123+0000 7f07cb224640 1 -- 172.21.15.196:0/3323866205 --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f07c415d8b0 con 0x7f07c415aa70 2024-03-18T00:00:18.127 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:18.123+0000 7f07cb224640 1 -- 172.21.15.196:0/3323866205 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f07c4072770 con 0x7f07c4154340 2024-03-18T00:00:18.127 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:18.123+0000 7f07c3fff640 1 --2- 172.21.15.196:0/3323866205 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f07c4154340 0x7f07c40c8d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:00:18.128 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:18.123+0000 7f07c37fe640 1 -- 172.21.15.196:0/3323866205 <== mon.0 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 689218357 0 0) 0x7f07c415d5d0 con 0x7f07c4153f60 2024-03-18T00:00:18.128 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:18.123+0000 7f07c37fe640 1 -- 172.21.15.196:0/3323866205 --> v1:172.21.15.196:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f07b4003530 con 0x7f07c4153f60 2024-03-18T00:00:18.128 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:18.123+0000 7f07c3fff640 1 -- 172.21.15.196:0/3323866205 >> v1:172.21.15.204:6789/0 conn(0x7f07c415aa70 legacy=0x7f07c4072c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:00:18.128 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:18.123+0000 7f07c3fff640 1 -- 172.21.15.196:0/3323866205 >> v1:172.21.15.196:6789/0 conn(0x7f07c4153f60 legacy=0x7f07c40705f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:00:18.128 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:18.123+0000 7f07c3fff640 1 -- 172.21.15.196:0/3323866205 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07c415db90 con 0x7f07c4154340 2024-03-18T00:00:18.129 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:18.127+0000 7f07c3fff640 1 --2- 172.21.15.196:0/3323866205 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f07c4154340 0x7f07c40c8d60 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f07b00097f0 tx=0x7f07b001ecd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9b1070293c281319 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:00:18.129 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:18.127+0000 7f07c37fe640 1 -- 172.21.15.196:0/3323866205 <== mon.2 v2:172.21.15.204:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07b00b5070 con 0x7f07c4154340 2024-03-18T00:00:18.129 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:18.127+0000 7f07c37fe640 1 -- 172.21.15.196:0/3323866205 <== mon.2 v2:172.21.15.204:3301/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f07b00a89d0 con 0x7f07c4154340 2024-03-18T00:00:18.129 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:18.127+0000 7f07c37fe640 1 -- 172.21.15.196:0/3323866205 <== mon.2 v2:172.21.15.204:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07b00a8d80 con 0x7f07c4154340 2024-03-18T00:00:18.130 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:18.127+0000 7f07cb224640 1 -- 172.21.15.196:0/3323866205 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f07c4154340 msgr2=0x7f07c40c8d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:00:18.130 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:18.127+0000 7f07cb224640 1 --2- 172.21.15.196:0/3323866205 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f07c4154340 0x7f07c40c8d60 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f07b00097f0 tx=0x7f07b001ecd0 comp rx=0 tx=0).stop 2024-03-18T00:00:18.130 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:18.127+0000 7f07cb224640 1 -- 172.21.15.196:0/3323866205 shutdown_connections 2024-03-18T00:00:18.130 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:18.127+0000 7f07cb224640 1 --2- 172.21.15.196:0/3323866205 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f07c4154340 0x7f07c40c8d60 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:00:18.130 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:18.127+0000 7f07cb224640 1 -- 172.21.15.196:0/3323866205 >> 172.21.15.196:0/3323866205 conn(0x7f07c406c3c0 msgr2=0x7f07c406c7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:00:18.130 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:18.127+0000 7f07cb224640 1 -- 172.21.15.196:0/3323866205 shutdown_connections 2024-03-18T00:00:18.130 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:18.127+0000 7f07cb224640 1 -- 172.21.15.196:0/3323866205 wait complete. 2024-03-18T00:00:18.131 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:18.127+0000 7f07cb224640 1 Processor -- start 2024-03-18T00:00:18.131 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:18.127+0000 7f07cb224640 1 -- start start 2024-03-18T00:00:18.133 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:18.131+0000 7f07cb224640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f07c4153f60 0x7f07c40c3540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:00:18.133 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:18.131+0000 7f07cb224640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f07c4154340 0x7f07c414f1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:00:18.133 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:18.131+0000 7f07cb224640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f07c415aa70 0x7f07c4072e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:00:18.134 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:18.131+0000 7f07cb224640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f07c415e150 con 0x7f07c415aa70 2024-03-18T00:00:18.134 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:18.131+0000 7f07cb224640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f07c415d380 con 0x7f07c4153f60 2024-03-18T00:00:18.134 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:18.131+0000 7f07cb224640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f07c4070d00 con 0x7f07c4154340 2024-03-18T00:00:18.134 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:18.131+0000 7f07c97c1640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f07c415aa70 0x7f07c4072e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:00:18.134 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:18.131+0000 7f07c3fff640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f07c4154340 0x7f07c414f1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:00:18.134 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:18.131+0000 7f07c97c1640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f07c415aa70 0x7f07c4072e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.196:51486/0 (socket says 172.21.15.196:51486) 2024-03-18T00:00:18.134 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:18.131+0000 7f07c97c1640 1 -- 172.21.15.196:0/3066880530 learned_addr learned my addr 172.21.15.196:0/3066880530 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-03-18T00:00:18.134 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:18.131+0000 7f07c8fc0640 1 --2- 172.21.15.196:0/3066880530 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f07c4153f60 0x7f07c40c3540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:00:18.134 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:18.131+0000 7f07c97c1640 1 -- 172.21.15.196:0/3066880530 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f07c4154340 msgr2=0x7f07c414f1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:00:18.134 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:18.131+0000 7f07c97c1640 1 --2- 172.21.15.196:0/3066880530 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f07c4154340 0x7f07c414f1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:00:18.134 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:18.131+0000 7f07c97c1640 1 -- 172.21.15.196:0/3066880530 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f07c4153f60 msgr2=0x7f07c40c3540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:00:18.134 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:18.131+0000 7f07c97c1640 1 --2- 172.21.15.196:0/3066880530 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f07c4153f60 0x7f07c40c3540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:00:18.135 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:18.131+0000 7f07c97c1640 1 -- 172.21.15.196:0/3066880530 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07c41e44d0 con 0x7f07c415aa70 2024-03-18T00:00:18.135 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:18.131+0000 7f07c3fff640 1 --2- 172.21.15.196:0/3066880530 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f07c4154340 0x7f07c414f1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T00:00:18.135 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:18.131+0000 7f07c97c1640 1 --2- 172.21.15.196:0/3066880530 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f07c415aa70 0x7f07c4072e60 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f07bc00c760 tx=0x7f07bc00cb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:00:18.135 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:18.131+0000 7f07c17fa640 1 -- 172.21.15.196:0/3066880530 <== mon.0 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07bc016020 con 0x7f07c415aa70 2024-03-18T00:00:18.135 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:18.131+0000 7f07c17fa640 1 -- 172.21.15.196:0/3066880530 <== mon.0 v2:172.21.15.196:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f07bc006d60 con 0x7f07c415aa70 2024-03-18T00:00:18.135 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:18.131+0000 7f07cb224640 1 -- 172.21.15.196:0/3066880530 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f07c41e51a0 con 0x7f07c415aa70 2024-03-18T00:00:18.135 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:18.131+0000 7f07c17fa640 1 -- 172.21.15.196:0/3066880530 <== mon.0 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07bc003be0 con 0x7f07c415aa70 2024-03-18T00:00:18.135 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:18.131+0000 7f07cb224640 1 -- 172.21.15.196:0/3066880530 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07c414da70 con 0x7f07c415aa70 2024-03-18T00:00:18.136 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:18.131+0000 7f07aeffd640 1 -- 172.21.15.196:0/3066880530 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f079c0052a0 con 0x7f07c415aa70 2024-03-18T00:00:18.136 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:18.131+0000 7f07c17fa640 1 -- 172.21.15.196:0/3066880530 <== mon.0 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 5) ==== 87083+0+0 (secure 0 0 0) 0x7f07bc0050d0 con 0x7f07c415aa70 2024-03-18T00:00:18.136 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:18.135+0000 7f07c17fa640 1 --2- 172.21.15.196:0/3066880530 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f07a8067690 0x7f07a8069b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:00:18.136 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:18.135+0000 7f07c17fa640 1 -- 172.21.15.196:0/3066880530 <== mon.0 v2:172.21.15.196:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7f07bc085510 con 0x7f07c415aa70 2024-03-18T00:00:18.136 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:18.135+0000 7f07c8fc0640 1 --2- 172.21.15.196:0/3066880530 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f07a8067690 0x7f07a8069b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:00:18.137 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:18.135+0000 7f07c8fc0640 1 --2- 172.21.15.196:0/3066880530 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f07a8067690 0x7f07a8069b50 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f07b80011f0 tx=0x7f07b8007d40 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:00:18.144 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:18.143+0000 7f07c17fa640 1 -- 172.21.15.196:0/3066880530 <== mon.0 v2:172.21.15.196:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177849 (secure 0 0 0) 0x7f07bc020020 con 0x7f07c415aa70 2024-03-18T00:00:18.394 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:18.387+0000 7f07aeffd640 1 -- 172.21.15.196:0/3066880530 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f079c005860 con 0x7f07c415aa70 2024-03-18T00:00:18.394 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:18.391+0000 7f07c17fa640 1 -- 172.21.15.196:0/3066880530 <== mon.0 v2:172.21.15.196:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) ==== 74+0+16891 (secure 0 0 0) 0x7f07bc055a10 con 0x7f07c415aa70 2024-03-18T00:00:18.395 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-03-18T00:00:18.395 INFO:teuthology.orchestra.run.smithi196.stdout:{"epoch":23,"fsid":"b80f9c80-17ad-4126-8957-4c0c46f5b803","created":"2024-03-17T23:55:43.368838+0000","modified":"2024-03-17T23:56:49.062022+0000","last_up_change":"2024-03-17T23:55:54.132187+0000","last_in_change":"2024-03-17T23:55:46.016435+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-17T23:55:56.030640+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-17T23:55:58.658234+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-17T23:56:00.003208+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"224d699f-bc10-4661-a8b5-6ca73290ffa0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6806","nonce":1194547591},{"type":"v1","addr":"172.21.15.196:6807","nonce":1194547591}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6809","nonce":1194547591},{"type":"v1","addr":"172.21.15.196:6811","nonce":1194547591}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6814","nonce":1194547591},{"type":"v1","addr":"172.21.15.196:6815","nonce":1194547591}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6812","nonce":1194547591},{"type":"v1","addr":"172.21.15.196:6813","nonce":1194547591}]},"public_addr":"172.21.15.196:6807/1194547591","cluster_addr":"172.21.15.196:6811/1194547591","heartbeat_back_addr":"172.21.15.196:6815/1194547591","heartbeat_front_addr":"172.21.15.196:6813/1194547591","state":["exists","up"]},{"osd":1,"uuid":"d8d6a0b0-450b-4ab5-b143-d4f36286e81e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6800","nonce":1901246986},{"type":"v1","addr":"172.21.15.196:6801","nonce":1901246986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6802","nonce":1901246986},{"type":"v1","addr":"172.21.15.196:6803","nonce":1901246986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6808","nonce":1901246986},{"type":"v1","addr":"172.21.15.196:6810","nonce":1901246986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6804","nonce":1901246986},{"type":"v1","addr":"172.21.15.196:6805","nonce":1901246986}]},"public_addr":"172.21.15.196:6801/1901246986","cluster_addr":"172.21.15.196:6803/1901246986","heartbeat_back_addr":"172.21.15.196:6810/1901246986","heartbeat_front_addr":"172.21.15.196:6805/1901246986","state":["exists","up"]},{"osd":2,"uuid":"d732ba94-1db0-41ed-930a-5abb6188980a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6824","nonce":673819559},{"type":"v1","addr":"172.21.15.196:6825","nonce":673819559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6826","nonce":673819559},{"type":"v1","addr":"172.21.15.196:6827","nonce":673819559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6830","nonce":673819559},{"type":"v1","addr":"172.21.15.196:6831","nonce":673819559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6828","nonce":673819559},{"type":"v1","addr":"172.21.15.196:6829","nonce":673819559}]},"public_addr":"172.21.15.196:6825/673819559","cluster_addr":"172.21.15.196:6827/673819559","heartbeat_back_addr":"172.21.15.196:6831/673819559","heartbeat_front_addr":"172.21.15.196:6829/673819559","state":["exists","up"]},{"osd":3,"uuid":"b79cab98-a49f-4544-b6b0-546dcfbd47a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6816","nonce":1104340623},{"type":"v1","addr":"172.21.15.196:6817","nonce":1104340623}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6818","nonce":1104340623},{"type":"v1","addr":"172.21.15.196:6819","nonce":1104340623}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6822","nonce":1104340623},{"type":"v1","addr":"172.21.15.196:6823","nonce":1104340623}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6820","nonce":1104340623},{"type":"v1","addr":"172.21.15.196:6821","nonce":1104340623}]},"public_addr":"172.21.15.196:6817/1104340623","cluster_addr":"172.21.15.196:6819/1104340623","heartbeat_back_addr":"172.21.15.196:6823/1104340623","heartbeat_front_addr":"172.21.15.196:6821/1104340623","state":["exists","up"]},{"osd":4,"uuid":"d5892856-6eb4-4188-beb0-368f64169af1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6816","nonce":658561863},{"type":"v1","addr":"172.21.15.204:6818","nonce":658561863}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6819","nonce":658561863},{"type":"v1","addr":"172.21.15.204:6821","nonce":658561863}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6826","nonce":658561863},{"type":"v1","addr":"172.21.15.204:6828","nonce":658561863}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6823","nonce":658561863},{"type":"v1","addr":"172.21.15.204:6825","nonce":658561863}]},"public_addr":"172.21.15.204:6818/658561863","cluster_addr":"172.21.15.204:6821/658561863","heartbeat_back_addr":"172.21.15.204:6828/658561863","heartbeat_front_addr":"172.21.15.204:6825/658561863","state":["exists","up"]},{"osd":5,"uuid":"89d6b48d-aa8a-4cb8-aa2e-e0aae04928b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6817","nonce":3367327749},{"type":"v1","addr":"172.21.15.204:6820","nonce":3367327749}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6822","nonce":3367327749},{"type":"v1","addr":"172.21.15.204:6824","nonce":3367327749}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6830","nonce":3367327749},{"type":"v1","addr":"172.21.15.204:6831","nonce":3367327749}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6827","nonce":3367327749},{"type":"v1","addr":"172.21.15.204:6829","nonce":3367327749}]},"public_addr":"172.21.15.204:6820/3367327749","cluster_addr":"172.21.15.204:6824/3367327749","heartbeat_back_addr":"172.21.15.204:6831/3367327749","heartbeat_front_addr":"172.21.15.204:6829/3367327749","state":["exists","up"]},{"osd":6,"uuid":"ff7d0949-2836-42a6-a63d-bc5a4269e080","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6805","nonce":2586742078},{"type":"v1","addr":"172.21.15.204:6807","nonce":2586742078}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6809","nonce":2586742078},{"type":"v1","addr":"172.21.15.204:6811","nonce":2586742078}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6814","nonce":2586742078},{"type":"v1","addr":"172.21.15.204:6815","nonce":2586742078}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6812","nonce":2586742078},{"type":"v1","addr":"172.21.15.204:6813","nonce":2586742078}]},"public_addr":"172.21.15.204:6807/2586742078","cluster_addr":"172.21.15.204:6811/2586742078","heartbeat_back_addr":"172.21.15.204:6815/2586742078","heartbeat_front_addr":"172.21.15.204:6813/2586742078","state":["exists","up"]},{"osd":7,"uuid":"42bcc14b-70b3-4c59-bf81-41436e4eb272","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6800","nonce":3361860686},{"type":"v1","addr":"172.21.15.204:6801","nonce":3361860686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6802","nonce":3361860686},{"type":"v1","addr":"172.21.15.204:6803","nonce":3361860686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6808","nonce":3361860686},{"type":"v1","addr":"172.21.15.204:6810","nonce":3361860686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6804","nonce":3361860686},{"type":"v1","addr":"172.21.15.204:6806","nonce":3361860686}]},"public_addr":"172.21.15.204:6801/3361860686","cluster_addr":"172.21.15.204:6803/3361860686","heartbeat_back_addr":"172.21.15.204:6810/3361860686","heartbeat_front_addr":"172.21.15.204:6806/3361860686","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-17T23:55:51.372683+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-17T23:55:51.466291+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-17T23:55:51.608084+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-17T23:55:51.680819+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-17T23:55:51.528198+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-17T23:55:51.537065+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-17T23:55:51.558146+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-17T23:55:51.382540+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.17","mappings":[{"from":5,"to":1}]},{"pgid":"3.19","mappings":[{"from":3,"to":2}]},{"pgid":"3.2a","mappings":[{"from":5,"to":2}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-18T00:00:18.396 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:18.391+0000 7f07aeffd640 1 -- 172.21.15.196:0/3066880530 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f07a8067690 msgr2=0x7f07a8069b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:00:18.396 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:18.391+0000 7f07aeffd640 1 --2- 172.21.15.196:0/3066880530 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f07a8067690 0x7f07a8069b50 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f07b80011f0 tx=0x7f07b8007d40 comp rx=0 tx=0).stop 2024-03-18T00:00:18.396 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:18.391+0000 7f07aeffd640 1 -- 172.21.15.196:0/3066880530 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f07c415aa70 msgr2=0x7f07c4072e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:00:18.396 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:18.391+0000 7f07aeffd640 1 --2- 172.21.15.196:0/3066880530 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f07c415aa70 0x7f07c4072e60 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f07bc00c760 tx=0x7f07bc00cb60 comp rx=0 tx=0).stop 2024-03-18T00:00:18.396 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:18.391+0000 7f07aeffd640 1 -- 172.21.15.196:0/3066880530 shutdown_connections 2024-03-18T00:00:18.396 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:18.391+0000 7f07aeffd640 1 --2- 172.21.15.196:0/3066880530 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f07a8067690 0x7f07a8069b50 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:00:18.396 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:18.391+0000 7f07aeffd640 1 --2- 172.21.15.196:0/3066880530 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f07c4154340 0x7f07c414f1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:00:18.396 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:18.391+0000 7f07aeffd640 1 --2- 172.21.15.196:0/3066880530 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f07c415aa70 0x7f07c4072e60 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:00:18.396 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:18.391+0000 7f07aeffd640 1 --2- 172.21.15.196:0/3066880530 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f07c4153f60 0x7f07c40c3540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:00:18.396 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:18.391+0000 7f07aeffd640 1 -- 172.21.15.196:0/3066880530 >> 172.21.15.196:0/3066880530 conn(0x7f07c406c3c0 msgr2=0x7f07c4158080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:00:18.396 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:18.391+0000 7f07aeffd640 1 -- 172.21.15.196:0/3066880530 shutdown_connections 2024-03-18T00:00:18.397 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:18.391+0000 7f07aeffd640 1 -- 172.21.15.196:0/3066880530 wait complete. 2024-03-18T00:00:18.411 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-03-18T00:00:18.577 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:18.571+0000 7f7e4b662640 1 Processor -- start 2024-03-18T00:00:18.577 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:18.575+0000 7f7e4b662640 1 -- start start 2024-03-18T00:00:18.578 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:18.575+0000 7f7e4b662640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7e44150e80 0x7f7e4415a120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:00:18.578 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:18.575+0000 7f7e4b662640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f7e440c6fe0 0x7f7e44072b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:00:18.578 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:18.575+0000 7f7e4b662640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7e440c44c0 con 0x7f7e440c8310 2024-03-18T00:00:18.578 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:18.575+0000 7f7e4b662640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7f7e441573b0 con 0x7f7e440c6fe0 2024-03-18T00:00:18.578 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:18.575+0000 7f7e4b662640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f7e440c3f00 con 0x7f7e44150e80 2024-03-18T00:00:18.578 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:18.575+0000 7f7e48bfd640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f7e440c6fe0 0x7f7e44072b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:00:18.578 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:18.575+0000 7f7e48bfd640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f7e440c6fe0 0x7f7e44072b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.196:51498/0 (socket says 172.21.15.196:51498) 2024-03-18T00:00:18.578 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:18.575+0000 7f7e48bfd640 1 -- 172.21.15.196:0/189612297 learned_addr learned my addr 172.21.15.196:0/189612297 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-03-18T00:00:18.578 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:18.575+0000 7f7e493fe640 1 --2- 172.21.15.196:0/189612297 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7e44150e80 0x7f7e4415a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:00:18.579 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:18.575+0000 7f7e48bfd640 1 -- 172.21.15.196:0/189612297 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7e44150e80 msgr2=0x7f7e4415a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T00:00:18.579 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:18.575+0000 7f7e48bfd640 1 --2- 172.21.15.196:0/189612297 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7e44150e80 0x7f7e4415a120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:00:18.579 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:18.575+0000 7f7e48bfd640 1 -- 172.21.15.196:0/189612297 >> v1:172.21.15.204:6789/0 conn(0x7f7e440c8310 legacy=0x7f7e4406fb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:00:18.579 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:18.575+0000 7f7e48bfd640 1 -- 172.21.15.196:0/189612297 --> v2:172.21.15.196:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e440c41e0 con 0x7f7e440c6fe0 2024-03-18T00:00:18.580 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:18.575+0000 7f7e48bfd640 1 --2- 172.21.15.196:0/189612297 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7e440c6fe0 0x7f7e44072b30 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f7e34009870 tx=0x7f7e3401ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef07b66d8a988b79 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:00:18.580 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:18.579+0000 7f7e3bfff640 1 -- 172.21.15.196:0/189612297 <== mon.0 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e340b5070 con 0x7f7e440c6fe0 2024-03-18T00:00:18.580 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:18.579+0000 7f7e3bfff640 1 -- 172.21.15.196:0/189612297 <== mon.0 v2:172.21.15.196:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f7e340a8a50 con 0x7f7e440c6fe0 2024-03-18T00:00:18.580 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:18.579+0000 7f7e3bfff640 1 -- 172.21.15.196:0/189612297 <== mon.0 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e340a8e40 con 0x7f7e440c6fe0 2024-03-18T00:00:18.581 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:18.579+0000 7f7e4b662640 1 -- 172.21.15.196:0/189612297 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7e440c6fe0 msgr2=0x7f7e44072b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:00:18.581 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:18.579+0000 7f7e4b662640 1 --2- 172.21.15.196:0/189612297 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7e440c6fe0 0x7f7e44072b30 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f7e34009870 tx=0x7f7e3401ed50 comp rx=0 tx=0).stop 2024-03-18T00:00:18.581 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:18.579+0000 7f7e4b662640 1 -- 172.21.15.196:0/189612297 shutdown_connections 2024-03-18T00:00:18.581 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:18.579+0000 7f7e4b662640 1 --2- 172.21.15.196:0/189612297 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7e440c6fe0 0x7f7e44072b30 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:00:18.581 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:18.579+0000 7f7e4b662640 1 --2- 172.21.15.196:0/189612297 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7e44150e80 0x7f7e4415a120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:00:18.581 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:18.579+0000 7f7e4b662640 1 -- 172.21.15.196:0/189612297 >> 172.21.15.196:0/189612297 conn(0x7f7e4406c3c0 msgr2=0x7f7e4406c7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:00:18.581 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:18.579+0000 7f7e4b662640 1 -- 172.21.15.196:0/189612297 shutdown_connections 2024-03-18T00:00:18.581 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:18.579+0000 7f7e4b662640 1 -- 172.21.15.196:0/189612297 wait complete. 2024-03-18T00:00:18.582 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:18.579+0000 7f7e4b662640 1 Processor -- start 2024-03-18T00:00:18.582 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:18.579+0000 7f7e4b662640 1 -- start start 2024-03-18T00:00:18.584 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:18.579+0000 7f7e4b662640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7e440c6fe0 0x7f7e4414b130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:00:18.584 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:18.579+0000 7f7e4b662640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7e440c8310 0x7f7e4414bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:00:18.584 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:18.579+0000 7f7e4b662640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7e44150e80 0x7f7e441395e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:00:18.584 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:18.579+0000 7f7e4b662640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f7e44151260 con 0x7f7e440c8310 2024-03-18T00:00:18.584 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:18.579+0000 7f7e4b662640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f7e44157040 con 0x7f7e44150e80 2024-03-18T00:00:18.584 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:18.579+0000 7f7e4b662640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f7e4415a660 con 0x7f7e440c6fe0 2024-03-18T00:00:18.584 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:18.579+0000 7f7e48bfd640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7e440c8310 0x7f7e4414bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:00:18.584 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:18.579+0000 7f7e48bfd640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7e440c8310 0x7f7e4414bbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.196:51500/0 (socket says 172.21.15.196:51500) 2024-03-18T00:00:18.585 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:18.579+0000 7f7e48bfd640 1 -- 172.21.15.196:0/2600113309 learned_addr learned my addr 172.21.15.196:0/2600113309 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-03-18T00:00:18.585 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:18.579+0000 7f7e49bff640 1 --2- 172.21.15.196:0/2600113309 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7e44150e80 0x7f7e441395e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:00:18.585 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:18.579+0000 7f7e493fe640 1 --2- 172.21.15.196:0/2600113309 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7e440c6fe0 0x7f7e4414b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:00:18.585 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:18.579+0000 7f7e48bfd640 1 -- 172.21.15.196:0/2600113309 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7e440c6fe0 msgr2=0x7f7e4414b130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:00:18.585 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:18.579+0000 7f7e48bfd640 1 --2- 172.21.15.196:0/2600113309 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7e440c6fe0 0x7f7e4414b130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:00:18.585 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:18.579+0000 7f7e48bfd640 1 -- 172.21.15.196:0/2600113309 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7e44150e80 msgr2=0x7f7e441395e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:00:18.585 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:18.579+0000 7f7e48bfd640 1 --2- 172.21.15.196:0/2600113309 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7e44150e80 0x7f7e441395e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:00:18.585 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:18.579+0000 7f7e48bfd640 1 -- 172.21.15.196:0/2600113309 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e4414b8d0 con 0x7f7e440c8310 2024-03-18T00:00:18.585 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:18.579+0000 7f7e493fe640 1 --2- 172.21.15.196:0/2600113309 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7e440c6fe0 0x7f7e4414b130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-18T00:00:18.585 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:18.579+0000 7f7e48bfd640 1 --2- 172.21.15.196:0/2600113309 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7e440c8310 0x7f7e4414bbf0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f7e340b3040 tx=0x7f7e3401baf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:00:18.585 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:18.583+0000 7f7e39ffb640 1 -- 172.21.15.196:0/2600113309 <== mon.0 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e340c0070 con 0x7f7e440c8310 2024-03-18T00:00:18.585 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:18.583+0000 7f7e39ffb640 1 -- 172.21.15.196:0/2600113309 <== mon.0 v2:172.21.15.196:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f7e340ae770 con 0x7f7e440c8310 2024-03-18T00:00:18.585 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:18.583+0000 7f7e4b662640 1 -- 172.21.15.196:0/2600113309 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e441406e0 con 0x7f7e440c8310 2024-03-18T00:00:18.586 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:18.583+0000 7f7e39ffb640 1 -- 172.21.15.196:0/2600113309 <== mon.0 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e340b5070 con 0x7f7e440c8310 2024-03-18T00:00:18.586 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:18.583+0000 7f7e4b662640 1 -- 172.21.15.196:0/2600113309 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e44138840 con 0x7f7e440c8310 2024-03-18T00:00:18.586 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:18.583+0000 7f7e4b662640 1 -- 172.21.15.196:0/2600113309 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7e440689a0 con 0x7f7e440c8310 2024-03-18T00:00:18.586 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:18.583+0000 7f7e39ffb640 1 -- 172.21.15.196:0/2600113309 <== mon.0 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 5) ==== 87083+0+0 (secure 0 0 0) 0x7f7e340c3070 con 0x7f7e440c8310 2024-03-18T00:00:18.586 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:18.583+0000 7f7e39ffb640 1 --2- 172.21.15.196:0/2600113309 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f7e280675d0 0x7f7e28069a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:00:18.587 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:18.583+0000 7f7e39ffb640 1 -- 172.21.15.196:0/2600113309 <== mon.0 v2:172.21.15.196:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7f7e34123400 con 0x7f7e440c8310 2024-03-18T00:00:18.587 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:18.583+0000 7f7e493fe640 1 --2- 172.21.15.196:0/2600113309 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f7e280675d0 0x7f7e28069a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:00:18.587 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:18.583+0000 7f7e493fe640 1 --2- 172.21.15.196:0/2600113309 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f7e280675d0 0x7f7e28069a90 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f7e400097a0 tx=0x7f7e40008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:00:18.590 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:18.587+0000 7f7e39ffb640 1 -- 172.21.15.196:0/2600113309 <== mon.0 v2:172.21.15.196:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177849 (secure 0 0 0) 0x7f7e340188b0 con 0x7f7e440c8310 2024-03-18T00:00:18.780 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:18.775+0000 7f7e4b662640 1 -- 172.21.15.196:0/2600113309 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f7e441547a0 con 0x7f7e440c8310 2024-03-18T00:00:18.782 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:18.779+0000 7f7e39ffb640 1 -- 172.21.15.196:0/2600113309 <== mon.0 v2:172.21.15.196:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v15) ==== 161+0+0 (secure 0 0 0) 0x7f7e340f3920 con 0x7f7e440c8310 2024-03-18T00:00:18.782 INFO:teuthology.orchestra.run.smithi196.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-03-18T00:00:18.789 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:18.787+0000 7f7e4b662640 1 -- 172.21.15.196:0/2600113309 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f7e280675d0 msgr2=0x7f7e28069a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:00:18.789 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:18.787+0000 7f7e4b662640 1 --2- 172.21.15.196:0/2600113309 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f7e280675d0 0x7f7e28069a90 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f7e400097a0 tx=0x7f7e40008040 comp rx=0 tx=0).stop 2024-03-18T00:00:18.789 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:18.787+0000 7f7e4b662640 1 -- 172.21.15.196:0/2600113309 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7e440c8310 msgr2=0x7f7e4414bbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:00:18.789 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:18.787+0000 7f7e4b662640 1 --2- 172.21.15.196:0/2600113309 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7e440c8310 0x7f7e4414bbf0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f7e340b3040 tx=0x7f7e3401baf0 comp rx=0 tx=0).stop 2024-03-18T00:00:18.789 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:18.787+0000 7f7e4b662640 1 -- 172.21.15.196:0/2600113309 shutdown_connections 2024-03-18T00:00:18.789 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:18.787+0000 7f7e4b662640 1 --2- 172.21.15.196:0/2600113309 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f7e280675d0 0x7f7e28069a90 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:00:18.789 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:18.787+0000 7f7e4b662640 1 --2- 172.21.15.196:0/2600113309 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7e44150e80 0x7f7e441395e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:00:18.789 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:18.787+0000 7f7e4b662640 1 --2- 172.21.15.196:0/2600113309 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7e440c8310 0x7f7e4414bbf0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:00:18.789 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:18.787+0000 7f7e4b662640 1 --2- 172.21.15.196:0/2600113309 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7e440c6fe0 0x7f7e4414b130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:00:18.789 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:18.787+0000 7f7e4b662640 1 -- 172.21.15.196:0/2600113309 >> 172.21.15.196:0/2600113309 conn(0x7f7e4406c3c0 msgr2=0x7f7e440c7750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:00:18.789 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:18.787+0000 7f7e4b662640 1 -- 172.21.15.196:0/2600113309 shutdown_connections 2024-03-18T00:00:18.789 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:18.787+0000 7f7e4b662640 1 -- 172.21.15.196:0/2600113309 wait complete. 2024-03-18T00:00:18.813 INFO:tasks.ceph.mds.e.smithi196.stderr: -208> 2024-03-18T00:00:11.399+0000 7fc47bdfc640 -1 received signal: Hangup from killall -q -1 ceph-mon ceph-mgr ceph-mds ceph-osd ceph-fuse radosgw rbd-mirror cephfs-mirror (PID: 34612) UID: 0 2024-03-18T00:00:18.813 INFO:tasks.ceph.mds.e.smithi196.stderr: -207> 2024-03-18T00:00:11.427+0000 7fc47bdfc640 -1 received signal: Hangup from (PID: 34640) UID: 0 2024-03-18T00:00:18.814 INFO:tasks.ceph.mds.c.smithi196.stderr: -322> 2024-03-18T00:00:11.399+0000 7f703bbad640 -1 received signal: Hangup from killall -q -1 ceph-mon ceph-mgr ceph-mds ceph-osd ceph-fuse radosgw rbd-mirror cephfs-mirror (PID: 34612) UID: 0 2024-03-18T00:00:18.814 INFO:tasks.ceph.mds.c.smithi196.stderr: -321> 2024-03-18T00:00:11.427+0000 7f703bbad640 -1 received signal: Hangup from (PID: 34640) UID: 0 2024-03-18T00:00:18.815 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-03-18T00:00:18.820 INFO:tasks.ceph.mds.a.smithi196.stderr: -208> 2024-03-18T00:00:11.399+0000 7fe38bca8640 -1 received signal: Hangup from killall -q -1 ceph-mon ceph-mgr ceph-mds ceph-osd ceph-fuse radosgw rbd-mirror cephfs-mirror (PID: 34612) UID: 0 2024-03-18T00:00:18.820 INFO:tasks.ceph.mds.a.smithi196.stderr: -207> 2024-03-18T00:00:11.427+0000 7fe38bca8640 -1 received signal: Hangup from (PID: 34640) UID: 0 2024-03-18T00:00:18.837 INFO:tasks.ceph.mds.f.smithi204.stdout:starting mds.f at 2024-03-18T00:00:18.845 INFO:tasks.ceph.mds.c.smithi196.stdout:starting mds.c at 2024-03-18T00:00:18.847 INFO:tasks.ceph.mds.a.smithi196.stdout:starting mds.a at 2024-03-18T00:00:18.848 INFO:tasks.ceph.mds.e.smithi196.stdout:starting mds.e at 2024-03-18T00:00:18.861 INFO:tasks.ceph.mds.d.smithi204.stdout:starting mds.d at 2024-03-18T00:00:18.929 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:18.927+0000 7f3dd912f640 1 Processor -- start 2024-03-18T00:00:19.038 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:18.927+0000 7f3dd912f640 1 -- start start 2024-03-18T00:00:19.044 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:18.927+0000 7f3dd912f640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3dd406bea0 0x7f3dd41518c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:00:19.044 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:18.927+0000 7f3dd912f640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3dd415b280 con 0x7f3dd40c6330 2024-03-18T00:00:19.044 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:18.927+0000 7f3dd912f640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3dd415b540 con 0x7f3dd40c5f50 2024-03-18T00:00:19.044 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:18.927+0000 7f3dd912f640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f3dd415b820 con 0x7f3dd406bea0 2024-03-18T00:00:19.044 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:18.927+0000 7f3dcbfff640 1 --1- >> v1:172.21.15.196:6789/0 conn(0x7f3dd40c6330 0x7f3dd4157f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.196:6789/0 says I am v1:172.21.15.196:36000/0 (socket says 172.21.15.196:36000) 2024-03-18T00:00:19.044 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:18.927+0000 7f3dcbfff640 1 -- 172.21.15.196:0/1363981117 learned_addr learned my addr 172.21.15.196:0/1363981117 (peer_addr_for_me v1:172.21.15.196:0/0) 2024-03-18T00:00:19.045 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:18.927+0000 7f3dd359e640 1 --2- 172.21.15.196:0/1363981117 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3dd406bea0 0x7f3dd41518c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:00:19.045 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:18.927+0000 7f3dd259c640 1 -- 172.21.15.196:0/1363981117 <== mon.0 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 42582608 0 0) 0x7f3dd415b280 con 0x7f3dd40c6330 2024-03-18T00:00:19.045 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:18.927+0000 7f3dd259c640 1 -- 172.21.15.196:0/1363981117 --> v1:172.21.15.196:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3dc0003530 con 0x7f3dd40c6330 2024-03-18T00:00:19.045 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:18.927+0000 7f3dd359e640 1 -- 172.21.15.196:0/1363981117 >> v1:172.21.15.204:6789/0 conn(0x7f3dd40c5f50 legacy=0x7f3dd40c6fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:00:19.045 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:18.927+0000 7f3dd359e640 1 -- 172.21.15.196:0/1363981117 >> v1:172.21.15.196:6789/0 conn(0x7f3dd40c6330 legacy=0x7f3dd4157f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:00:19.045 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:18.927+0000 7f3dd259c640 1 -- 172.21.15.196:0/1363981117 <== mon.0 v1:172.21.15.196:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 760224099 0 0) 0x7f3dc0003530 con 0x7f3dd40c6330 2024-03-18T00:00:19.045 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:18.927+0000 7f3dd359e640 1 -- 172.21.15.196:0/1363981117 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3dd415bb00 con 0x7f3dd406bea0 2024-03-18T00:00:19.045 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:18.931+0000 7f3dd359e640 1 --2- 172.21.15.196:0/1363981117 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3dd406bea0 0x7f3dd41518c0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f3dcc009dc0 tx=0x7f3dcc01f0a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=daed1ed21f541167 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:00:19.045 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:18.931+0000 7f3dd259c640 1 -- 172.21.15.196:0/1363981117 <== mon.2 v2:172.21.15.204:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dcc0b5070 con 0x7f3dd406bea0 2024-03-18T00:00:19.045 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:18.931+0000 7f3dd259c640 1 -- 172.21.15.196:0/1363981117 <== mon.2 v2:172.21.15.204:3301/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f3dcc0a8c30 con 0x7f3dd406bea0 2024-03-18T00:00:19.046 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:18.931+0000 7f3dd259c640 1 -- 172.21.15.196:0/1363981117 <== mon.2 v2:172.21.15.204:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dbc001680 con 0x7f3dd406bea0 2024-03-18T00:00:19.046 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:18.931+0000 7f3dd912f640 1 -- 172.21.15.196:0/1363981117 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3dd406bea0 msgr2=0x7f3dd41518c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:00:19.046 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:18.931+0000 7f3dd912f640 1 --2- 172.21.15.196:0/1363981117 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3dd406bea0 0x7f3dd41518c0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f3dcc009dc0 tx=0x7f3dcc01f0a0 comp rx=0 tx=0).stop 2024-03-18T00:00:19.046 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:18.931+0000 7f3dd912f640 1 -- 172.21.15.196:0/1363981117 shutdown_connections 2024-03-18T00:00:19.046 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:18.931+0000 7f3dd912f640 1 --2- 172.21.15.196:0/1363981117 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3dd406bea0 0x7f3dd41518c0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:00:19.046 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:18.931+0000 7f3dd912f640 1 -- 172.21.15.196:0/1363981117 >> 172.21.15.196:0/1363981117 conn(0x7f3dd406e7f0 msgr2=0x7f3dd4070020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:00:19.046 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:18.931+0000 7f3dd912f640 1 -- 172.21.15.196:0/1363981117 shutdown_connections 2024-03-18T00:00:19.046 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:18.931+0000 7f3dd912f640 1 -- 172.21.15.196:0/1363981117 wait complete. 2024-03-18T00:00:19.046 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:18.931+0000 7f3dd912f640 1 Processor -- start 2024-03-18T00:00:19.046 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:18.931+0000 7f3dd912f640 1 -- start start 2024-03-18T00:00:19.046 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:18.931+0000 7f3dd912f640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3dd406bea0 0x7f3dd4148b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:00:19.046 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:18.931+0000 7f3dd912f640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3dd40c5f50 0x7f3dd40ca3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:00:19.046 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:18.931+0000 7f3dd912f640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3dd40c6330 0x7f3dd41ef1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:00:19.047 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:18.931+0000 7f3dd912f640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f3dd40c76f0 con 0x7f3dd40c6330 2024-03-18T00:00:19.047 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:18.931+0000 7f3dd912f640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f3dd415c0c0 con 0x7f3dd406bea0 2024-03-18T00:00:19.047 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:18.931+0000 7f3dd912f640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f3dd4158650 con 0x7f3dd40c5f50 2024-03-18T00:00:19.047 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:18.931+0000 7f3dd359e640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3dd40c6330 0x7f3dd41ef1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:00:19.047 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:18.931+0000 7f3dd359e640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3dd40c6330 0x7f3dd41ef1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.196:51532/0 (socket says 172.21.15.196:51532) 2024-03-18T00:00:19.047 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:18.931+0000 7f3dd359e640 1 -- 172.21.15.196:0/3962310024 learned_addr learned my addr 172.21.15.196:0/3962310024 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-03-18T00:00:19.047 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:18.931+0000 7f3dd2d9d640 1 --2- 172.21.15.196:0/3962310024 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3dd406bea0 0x7f3dd4148b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:00:19.047 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:18.931+0000 7f3dcbfff640 1 --2- 172.21.15.196:0/3962310024 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3dd40c5f50 0x7f3dd40ca3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:00:19.047 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:18.931+0000 7f3dd359e640 1 -- 172.21.15.196:0/3962310024 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3dd40c5f50 msgr2=0x7f3dd40ca3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:00:19.047 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:18.931+0000 7f3dd359e640 1 --2- 172.21.15.196:0/3962310024 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3dd40c5f50 0x7f3dd40ca3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:00:19.047 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:18.931+0000 7f3dd359e640 1 -- 172.21.15.196:0/3962310024 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3dd406bea0 msgr2=0x7f3dd4148b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:00:19.048 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:18.931+0000 7f3dd359e640 1 --2- 172.21.15.196:0/3962310024 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3dd406bea0 0x7f3dd4148b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:00:19.048 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:18.931+0000 7f3dd359e640 1 -- 172.21.15.196:0/3962310024 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3dd41f12f0 con 0x7f3dd40c6330 2024-03-18T00:00:19.048 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:18.931+0000 7f3dd359e640 1 --2- 172.21.15.196:0/3962310024 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3dd40c6330 0x7f3dd41ef1c0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f3dcc01ccd0 tx=0x7f3dcc01be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:00:19.048 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:18.931+0000 7f3dcb7fe640 1 -- 172.21.15.196:0/3962310024 <== mon.0 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dcc0b5050 con 0x7f3dd40c6330 2024-03-18T00:00:19.048 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:18.931+0000 7f3dcb7fe640 1 -- 172.21.15.196:0/3962310024 <== mon.0 v2:172.21.15.196:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f3dcc0c1070 con 0x7f3dd40c6330 2024-03-18T00:00:19.048 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:18.931+0000 7f3dd912f640 1 -- 172.21.15.196:0/3962310024 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3dd41f15d0 con 0x7f3dd40c6330 2024-03-18T00:00:19.048 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:18.931+0000 7f3dcb7fe640 1 -- 172.21.15.196:0/3962310024 <== mon.0 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dcc004690 con 0x7f3dd40c6330 2024-03-18T00:00:19.048 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:18.931+0000 7f3dd912f640 1 -- 172.21.15.196:0/3962310024 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3dd41f1b90 con 0x7f3dd40c6330 2024-03-18T00:00:19.048 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:18.935+0000 7f3dd912f640 1 -- 172.21.15.196:0/3962310024 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3dd40689a0 con 0x7f3dd40c6330 2024-03-18T00:00:19.048 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:18.935+0000 7f3dcb7fe640 1 -- 172.21.15.196:0/3962310024 <== mon.0 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 5) ==== 87083+0+0 (secure 0 0 0) 0x7f3dcc0c6460 con 0x7f3dd40c6330 2024-03-18T00:00:19.048 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:18.935+0000 7f3dcb7fe640 1 --2- 172.21.15.196:0/3962310024 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f3db4067690 0x7f3db4069b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:00:19.048 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:18.935+0000 7f3dcb7fe640 1 -- 172.21.15.196:0/3962310024 <== mon.0 v2:172.21.15.196:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6255+0+0 (secure 0 0 0) 0x7f3dcc1242a0 con 0x7f3dd40c6330 2024-03-18T00:00:19.048 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:18.935+0000 7f3dd2d9d640 1 --2- 172.21.15.196:0/3962310024 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f3db4067690 0x7f3db4069b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:00:19.048 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:18.935+0000 7f3dd2d9d640 1 --2- 172.21.15.196:0/3962310024 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f3db4067690 0x7f3db4069b50 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f3dc4000f70 tx=0x7f3dc4009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:00:19.048 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:18.939+0000 7f3dcb7fe640 1 -- 172.21.15.196:0/3962310024 <== mon.0 v2:172.21.15.196:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177849 (secure 0 0 0) 0x7f3dcc018c00 con 0x7f3dd40c6330 2024-03-18T00:00:19.130 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:19.127+0000 7f3dd912f640 1 -- 172.21.15.196:0/3962310024 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f3dd4070380 con 0x7f3dd40c6330 2024-03-18T00:00:19.784 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:19.783+0000 7f3dcb7fe640 1 -- 172.21.15.196:0/3962310024 <== mon.0 v2:172.21.15.196:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v16) ==== 104+0+0 (secure 0 0 0) 0x7f3dcc004830 con 0x7f3dd40c6330 2024-03-18T00:00:19.788 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:19.783+0000 7f3dd912f640 1 -- 172.21.15.196:0/3962310024 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f3db4067690 msgr2=0x7f3db4069b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:00:19.788 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:19.783+0000 7f3dd912f640 1 --2- 172.21.15.196:0/3962310024 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f3db4067690 0x7f3db4069b50 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f3dc4000f70 tx=0x7f3dc4009040 comp rx=0 tx=0).stop 2024-03-18T00:00:19.788 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:19.783+0000 7f3dd912f640 1 -- 172.21.15.196:0/3962310024 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3dd40c6330 msgr2=0x7f3dd41ef1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:00:19.788 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:19.783+0000 7f3dd912f640 1 --2- 172.21.15.196:0/3962310024 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3dd40c6330 0x7f3dd41ef1c0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f3dcc01ccd0 tx=0x7f3dcc01be40 comp rx=0 tx=0).stop 2024-03-18T00:00:19.788 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:19.783+0000 7f3dd912f640 1 -- 172.21.15.196:0/3962310024 shutdown_connections 2024-03-18T00:00:19.788 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:19.783+0000 7f3dd912f640 1 --2- 172.21.15.196:0/3962310024 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f3db4067690 0x7f3db4069b50 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:00:19.788 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:19.783+0000 7f3dd912f640 1 --2- 172.21.15.196:0/3962310024 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3dd40c5f50 0x7f3dd40ca3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:00:19.788 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:19.783+0000 7f3dd912f640 1 --2- 172.21.15.196:0/3962310024 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3dd40c6330 0x7f3dd41ef1c0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:00:19.788 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:19.783+0000 7f3dd912f640 1 --2- 172.21.15.196:0/3962310024 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3dd406bea0 0x7f3dd4148b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:00:19.789 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:19.783+0000 7f3dd912f640 1 -- 172.21.15.196:0/3962310024 >> 172.21.15.196:0/3962310024 conn(0x7f3dd406e7f0 msgr2=0x7f3dd4148190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:00:19.789 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:19.783+0000 7f3dd912f640 1 -- 172.21.15.196:0/3962310024 shutdown_connections 2024-03-18T00:00:19.789 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:19.783+0000 7f3dd912f640 1 -- 172.21.15.196:0/3962310024 wait complete. 2024-03-18T00:00:19.808 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-03-18T00:00:19.965 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:19.963+0000 7f5fed3ec640 1 Processor -- start 2024-03-18T00:00:19.966 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:19.963+0000 7f5fed3ec640 1 -- start start 2024-03-18T00:00:19.968 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:19.963+0000 7f5fed3ec640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5fe80c5c10 0x7f5fe80c6050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:00:19.968 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:19.963+0000 7f5fed3ec640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5fe80c7320 con 0x7f5fe8151ed0 2024-03-18T00:00:19.969 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:19.963+0000 7f5fed3ec640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5fe80c7600 con 0x7f5fe8157f10 2024-03-18T00:00:19.969 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:19.963+0000 7f5fed3ec640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f5fe806b640 con 0x7f5fe80c5c10 2024-03-18T00:00:19.969 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:19.963+0000 7f5fe6ffd640 1 --1- >> v1:172.21.15.196:6789/0 conn(0x7f5fe8151ed0 0x7f5fe80730b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.196:6789/0 says I am v1:172.21.15.196:36012/0 (socket says 172.21.15.196:36012) 2024-03-18T00:00:19.969 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:19.963+0000 7f5fe6ffd640 1 -- 172.21.15.196:0/841941300 learned_addr learned my addr 172.21.15.196:0/841941300 (peer_addr_for_me v1:172.21.15.196:0/0) 2024-03-18T00:00:19.969 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:19.963+0000 7f5fe67fc640 1 -- 172.21.15.196:0/841941300 <== mon.0 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3107268603 0 0) 0x7f5fe80c7320 con 0x7f5fe8151ed0 2024-03-18T00:00:19.969 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:19.963+0000 7f5fe67fc640 1 -- 172.21.15.196:0/841941300 --> v1:172.21.15.196:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5fd4003530 con 0x7f5fe8151ed0 2024-03-18T00:00:19.969 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:19.963+0000 7f5fdffff640 1 --2- 172.21.15.196:0/841941300 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5fe80c5c10 0x7f5fe80c6050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:00:19.969 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:19.963+0000 7f5fe67fc640 1 -- 172.21.15.196:0/841941300 <== mon.0 v1:172.21.15.196:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 708344135 0 0) 0x7f5fd4003530 con 0x7f5fe8151ed0 2024-03-18T00:00:19.969 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:19.963+0000 7f5fe67fc640 1 -- 172.21.15.196:0/841941300 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5fe80c5c10 msgr2=0x7f5fe80c6050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T00:00:19.969 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:19.963+0000 7f5fe67fc640 1 --2- 172.21.15.196:0/841941300 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5fe80c5c10 0x7f5fe80c6050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:00:19.969 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:19.963+0000 7f5fe67fc640 1 -- 172.21.15.196:0/841941300 >> v1:172.21.15.204:6789/0 conn(0x7f5fe8157f10 legacy=0x7f5fe81583a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:00:19.969 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:19.963+0000 7f5fe67fc640 1 -- 172.21.15.196:0/841941300 --> v1:172.21.15.196:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5fe806b890 con 0x7f5fe8151ed0 2024-03-18T00:00:19.970 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:19.963+0000 7f5fe67fc640 1 -- 172.21.15.196:0/841941300 <== mon.0 v1:172.21.15.196:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 981458915 0 0) 0x7f5fd8001680 con 0x7f5fe8151ed0 2024-03-18T00:00:19.970 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:19.963+0000 7f5fe67fc640 1 -- 172.21.15.196:0/841941300 >> v1:172.21.15.196:6789/0 conn(0x7f5fe8151ed0 legacy=0x7f5fe80730b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:00:19.970 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:19.963+0000 7f5fe67fc640 1 --2- 172.21.15.196:0/841941300 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5fd40039f0 0x7f5fd4003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:00:19.970 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:19.963+0000 7f5fe67fc640 1 --2- 172.21.15.196:0/841941300 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5fe80c5c10 0x7f5fd4004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:00:19.970 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:19.963+0000 7f5fe67fc640 1 --2- 172.21.15.196:0/841941300 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5fd4004d50 0x7f5fd40051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:00:19.970 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:19.963+0000 7f5fe67fc640 1 -- 172.21.15.196:0/841941300 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f5fe806b640 con 0x7f5fd4004d50 2024-03-18T00:00:19.970 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:19.963+0000 7f5fe67fc640 1 -- 172.21.15.196:0/841941300 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f5fd400bb10 con 0x7f5fd40039f0 2024-03-18T00:00:19.970 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:19.963+0000 7f5fe67fc640 1 -- 172.21.15.196:0/841941300 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f5fd400bd10 con 0x7f5fe80c5c10 2024-03-18T00:00:19.970 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:19.963+0000 7f5fe77fe640 1 --2- 172.21.15.196:0/841941300 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5fd4004d50 0x7f5fd40051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:00:19.970 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:19.963+0000 7f5fe6ffd640 1 --2- 172.21.15.196:0/841941300 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5fd40039f0 0x7f5fd4003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:00:19.971 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:19.967+0000 7f5fe77fe640 1 -- 172.21.15.196:0/841941300 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5fe80c5c10 msgr2=0x7f5fd4004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T00:00:19.971 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:19.967+0000 7f5fdffff640 1 --2- 172.21.15.196:0/841941300 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5fe80c5c10 0x7f5fd4004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:00:19.971 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:19.967+0000 7f5fe77fe640 1 --2- 172.21.15.196:0/841941300 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5fe80c5c10 0x7f5fd4004810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:00:19.971 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:19.967+0000 7f5fe77fe640 1 -- 172.21.15.196:0/841941300 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5fd40039f0 msgr2=0x7f5fd4003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T00:00:19.971 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:19.967+0000 7f5fe77fe640 1 --2- 172.21.15.196:0/841941300 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5fd40039f0 0x7f5fd4003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:00:19.971 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:19.967+0000 7f5fe77fe640 1 -- 172.21.15.196:0/841941300 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5fd4003530 con 0x7f5fd4004d50 2024-03-18T00:00:19.971 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:19.967+0000 7f5fe6ffd640 1 --2- 172.21.15.196:0/841941300 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5fd40039f0 0x7f5fd4003e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-18T00:00:19.974 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:19.967+0000 7f5fe77fe640 1 --2- 172.21.15.196:0/841941300 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5fd4004d50 0x7f5fd40051d0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f5fe0001e40 tx=0x7f5fe001c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0f74358aef283cb server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:00:19.974 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:19.967+0000 7f5fe67fc640 1 -- 172.21.15.196:0/841941300 <== mon.0 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fe0001a90 con 0x7f5fd4004d50 2024-03-18T00:00:19.974 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:19.967+0000 7f5fe67fc640 1 -- 172.21.15.196:0/841941300 <== mon.0 v2:172.21.15.196:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f5fe0003b80 con 0x7f5fd4004d50 2024-03-18T00:00:19.974 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:19.967+0000 7f5fe67fc640 1 -- 172.21.15.196:0/841941300 <== mon.0 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fe0005080 con 0x7f5fd4004d50 2024-03-18T00:00:19.974 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:19.967+0000 7f5fed3ec640 1 -- 172.21.15.196:0/841941300 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5fd4004d50 msgr2=0x7f5fd40051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:00:19.974 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:19.967+0000 7f5fed3ec640 1 --2- 172.21.15.196:0/841941300 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5fd4004d50 0x7f5fd40051d0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f5fe0001e40 tx=0x7f5fe001c760 comp rx=0 tx=0).stop 2024-03-18T00:00:19.974 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:19.967+0000 7f5fe77fe640 1 -- 172.21.15.196:0/841941300 reap_dead start 2024-03-18T00:00:19.974 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:19.967+0000 7f5fed3ec640 1 -- 172.21.15.196:0/841941300 shutdown_connections 2024-03-18T00:00:19.975 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:19.967+0000 7f5fed3ec640 1 -- 172.21.15.196:0/841941300 >> 172.21.15.196:0/841941300 conn(0x7f5fe8067680 msgr2=0x7f5fe80cc500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:00:19.975 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:19.967+0000 7f5fed3ec640 1 -- 172.21.15.196:0/841941300 shutdown_connections 2024-03-18T00:00:19.975 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:19.967+0000 7f5fed3ec640 1 -- 172.21.15.196:0/841941300 wait complete. 2024-03-18T00:00:19.975 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:19.971+0000 7f5fed3ec640 1 Processor -- start 2024-03-18T00:00:19.975 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:19.971+0000 7f5fed3ec640 1 -- start start 2024-03-18T00:00:19.975 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:19.971+0000 7f5fed3ec640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5fd4004d50 0x7f5fe814cb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:00:19.975 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:19.971+0000 7f5fed3ec640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5fe8155810 0x7f5fe814d520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:00:19.975 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:19.971+0000 7f5fed3ec640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5fe80cbef0 0x7f5fe814da60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:00:19.975 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:19.971+0000 7f5fed3ec640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f5fe80737c0 con 0x7f5fe8155810 2024-03-18T00:00:19.975 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:19.971+0000 7f5fed3ec640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f5fe806be50 con 0x7f5fe80cbef0 2024-03-18T00:00:19.975 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:19.971+0000 7f5fed3ec640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f5fe81522b0 con 0x7f5fd4004d50 2024-03-18T00:00:19.975 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:19.971+0000 7f5fdffff640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5fe8155810 0x7f5fe814d520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:00:19.976 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:19.971+0000 7f5fdffff640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5fe8155810 0x7f5fe814d520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.196:51546/0 (socket says 172.21.15.196:51546) 2024-03-18T00:00:19.976 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:19.971+0000 7f5fdffff640 1 -- 172.21.15.196:0/3077206515 learned_addr learned my addr 172.21.15.196:0/3077206515 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-03-18T00:00:19.976 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:19.971+0000 7f5fe6ffd640 1 --2- 172.21.15.196:0/3077206515 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5fd4004d50 0x7f5fe814cb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:00:19.976 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:19.971+0000 7f5fe77fe640 1 --2- 172.21.15.196:0/3077206515 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5fe80cbef0 0x7f5fe814da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:00:19.976 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:19.971+0000 7f5fdffff640 1 -- 172.21.15.196:0/3077206515 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5fd4004d50 msgr2=0x7f5fe814cb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:00:19.976 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:19.971+0000 7f5fdffff640 1 --2- 172.21.15.196:0/3077206515 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5fd4004d50 0x7f5fe814cb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:00:19.976 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:19.971+0000 7f5fdffff640 1 -- 172.21.15.196:0/3077206515 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5fe80cbef0 msgr2=0x7f5fe814da60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:00:19.976 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:19.971+0000 7f5fdffff640 1 --2- 172.21.15.196:0/3077206515 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5fe80cbef0 0x7f5fe814da60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:00:19.976 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:19.971+0000 7f5fdffff640 1 -- 172.21.15.196:0/3077206515 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5fe80ca9c0 con 0x7f5fe8155810 2024-03-18T00:00:19.976 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:19.971+0000 7f5fdffff640 1 --2- 172.21.15.196:0/3077206515 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5fe8155810 0x7f5fe814d520 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f5fd0010890 tx=0x7f5fd0010d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:00:19.976 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:19.971+0000 7f5fdf7fe640 1 -- 172.21.15.196:0/3077206515 <== mon.0 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fd000f040 con 0x7f5fe8155810 2024-03-18T00:00:19.976 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:19.971+0000 7f5fdf7fe640 1 -- 172.21.15.196:0/3077206515 <== mon.0 v2:172.21.15.196:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f5fd000eb60 con 0x7f5fe8155810 2024-03-18T00:00:19.976 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:19.971+0000 7f5fdf7fe640 1 -- 172.21.15.196:0/3077206515 <== mon.0 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fd001c400 con 0x7f5fe8155810 2024-03-18T00:00:19.976 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:19.971+0000 7f5fed3ec640 1 -- 172.21.15.196:0/3077206515 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5fe80caca0 con 0x7f5fe8155810 2024-03-18T00:00:19.977 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:19.971+0000 7f5fed3ec640 1 -- 172.21.15.196:0/3077206515 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5fe814c460 con 0x7f5fe8155810 2024-03-18T00:00:19.977 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:19.971+0000 7f5fed3ec640 1 -- 172.21.15.196:0/3077206515 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5fe80689a0 con 0x7f5fe8155810 2024-03-18T00:00:19.978 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:19.971+0000 7f5fdf7fe640 1 -- 172.21.15.196:0/3077206515 <== mon.0 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 5) ==== 87083+0+0 (secure 0 0 0) 0x7f5fd001c5a0 con 0x7f5fe8155810 2024-03-18T00:00:19.978 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:19.971+0000 7f5fdf7fe640 1 --2- 172.21.15.196:0/3077206515 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f5fc8067660 0x7f5fc8069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:00:19.978 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:19.971+0000 7f5fdf7fe640 1 -- 172.21.15.196:0/3077206515 <== mon.0 v2:172.21.15.196:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6255+0+0 (secure 0 0 0) 0x7f5fd0086310 con 0x7f5fe8155810 2024-03-18T00:00:19.978 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:19.971+0000 7f5fe6ffd640 1 --2- 172.21.15.196:0/3077206515 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f5fc8067660 0x7f5fc8069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:00:19.978 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:19.975+0000 7f5fe6ffd640 1 --2- 172.21.15.196:0/3077206515 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f5fc8067660 0x7f5fc8069b20 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f5fd8001210 tx=0x7f5fd8009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:00:19.979 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:19.975+0000 7f5fdf7fe640 1 -- 172.21.15.196:0/3077206515 <== mon.0 v2:172.21.15.196:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177849 (secure 0 0 0) 0x7f5fd0018030 con 0x7f5fe8155810 2024-03-18T00:00:20.134 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:20.131+0000 7f5fed3ec640 1 -- 172.21.15.196:0/3077206515 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f5fe8072bd0 con 0x7f5fe8155810 2024-03-18T00:00:20.793 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:20.790+0000 7f5fdf7fe640 1 -- 172.21.15.196:0/3077206515 <== mon.0 v2:172.21.15.196:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v25) ==== 181+0+0 (secure 0 0 0) 0x7f5fd0056ce0 con 0x7f5fe8155810 2024-03-18T00:00:20.793 INFO:teuthology.orchestra.run.smithi196.stderr:pool 'cephfs_metadata' removed 2024-03-18T00:00:20.795 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:20.790+0000 7f5fed3ec640 1 -- 172.21.15.196:0/3077206515 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f5fc8067660 msgr2=0x7f5fc8069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:00:20.795 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:20.790+0000 7f5fed3ec640 1 --2- 172.21.15.196:0/3077206515 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f5fc8067660 0x7f5fc8069b20 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f5fd8001210 tx=0x7f5fd8009040 comp rx=0 tx=0).stop 2024-03-18T00:00:20.795 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:20.790+0000 7f5fed3ec640 1 -- 172.21.15.196:0/3077206515 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5fe8155810 msgr2=0x7f5fe814d520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:00:20.795 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:20.790+0000 7f5fed3ec640 1 --2- 172.21.15.196:0/3077206515 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5fe8155810 0x7f5fe814d520 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f5fd0010890 tx=0x7f5fd0010d50 comp rx=0 tx=0).stop 2024-03-18T00:00:20.795 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:20.790+0000 7f5fed3ec640 1 -- 172.21.15.196:0/3077206515 shutdown_connections 2024-03-18T00:00:20.795 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:20.790+0000 7f5fed3ec640 1 --2- 172.21.15.196:0/3077206515 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f5fc8067660 0x7f5fc8069b20 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:00:20.795 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:20.790+0000 7f5fed3ec640 1 --2- 172.21.15.196:0/3077206515 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5fe80cbef0 0x7f5fe814da60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:00:20.795 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:20.790+0000 7f5fed3ec640 1 --2- 172.21.15.196:0/3077206515 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5fe8155810 0x7f5fe814d520 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:00:20.796 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:20.790+0000 7f5fed3ec640 1 --2- 172.21.15.196:0/3077206515 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5fd4004d50 0x7f5fe814cb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:00:20.796 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:20.790+0000 7f5fed3ec640 1 -- 172.21.15.196:0/3077206515 >> 172.21.15.196:0/3077206515 conn(0x7f5fe8067680 msgr2=0x7f5fe80740d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:00:20.796 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:20.794+0000 7f5fed3ec640 1 -- 172.21.15.196:0/3077206515 shutdown_connections 2024-03-18T00:00:20.797 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:20.794+0000 7f5fed3ec640 1 -- 172.21.15.196:0/3077206515 wait complete. 2024-03-18T00:00:20.819 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-03-18T00:00:20.937 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:20.934+0000 7f41512d4640 1 Processor -- start 2024-03-18T00:00:20.938 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:20.934+0000 7f41512d4640 1 -- start start 2024-03-18T00:00:20.940 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:20.934+0000 7f41512d4640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f414c0c5c10 0x7f414c0c6050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:00:20.940 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:20.934+0000 7f41512d4640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f414c0c7320 con 0x7f414c157f10 2024-03-18T00:00:20.940 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:20.934+0000 7f41512d4640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f414c0c7600 con 0x7f414c151ed0 2024-03-18T00:00:20.940 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:20.934+0000 7f41512d4640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 -- 0x7f414c06b640 con 0x7f414c0c5c10 2024-03-18T00:00:20.940 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:20.934+0000 7f414b7fe640 1 --1- >> v1:172.21.15.196:6789/0 conn(0x7f414c157f10 0x7f414c158330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.196:6789/0 says I am v1:172.21.15.196:36016/0 (socket says 172.21.15.196:36016) 2024-03-18T00:00:20.940 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:20.934+0000 7f414b7fe640 1 -- 172.21.15.196:0/3129062677 learned_addr learned my addr 172.21.15.196:0/3129062677 (peer_addr_for_me v1:172.21.15.196:0/0) 2024-03-18T00:00:20.940 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:20.934+0000 7f4149ffb640 1 -- 172.21.15.196:0/3129062677 <== mon.0 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1762170150 0 0) 0x7f414c0c7320 con 0x7f414c157f10 2024-03-18T00:00:20.940 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:20.934+0000 7f414a7fc640 1 --2- 172.21.15.196:0/3129062677 >> v2:172.21.15.204:3300/0 conn(0x7f414c0c5c10 0x7f414c0c6050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:00:20.941 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:20.934+0000 7f4149ffb640 1 -- 172.21.15.196:0/3129062677 --> v1:172.21.15.196:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4138003530 con 0x7f414c157f10 2024-03-18T00:00:20.941 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:20.934+0000 7f4149ffb640 1 -- 172.21.15.196:0/3129062677 <== mon.0 v1:172.21.15.196:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2861625874 0 0) 0x7f4138003530 con 0x7f414c157f10 2024-03-18T00:00:20.941 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:20.934+0000 7f4149ffb640 1 -- 172.21.15.196:0/3129062677 >> v2:172.21.15.204:3300/0 conn(0x7f414c0c5c10 msgr2=0x7f414c0c6050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T00:00:20.941 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:20.934+0000 7f4149ffb640 1 --2- 172.21.15.196:0/3129062677 >> v2:172.21.15.204:3300/0 conn(0x7f414c0c5c10 0x7f414c0c6050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:00:20.941 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:20.934+0000 7f4149ffb640 1 -- 172.21.15.196:0/3129062677 >> v1:172.21.15.204:6789/0 conn(0x7f414c151ed0 legacy=0x7f414c0730b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:00:20.941 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:20.934+0000 7f4149ffb640 1 -- 172.21.15.196:0/3129062677 --> v1:172.21.15.196:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f414c06b890 con 0x7f414c157f10 2024-03-18T00:00:20.941 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:20.934+0000 7f4149ffb640 1 -- 172.21.15.196:0/3129062677 <== mon.0 v1:172.21.15.196:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 981458915 0 0) 0x7f4134001680 con 0x7f414c157f10 2024-03-18T00:00:20.941 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:20.934+0000 7f4149ffb640 1 -- 172.21.15.196:0/3129062677 >> v1:172.21.15.196:6789/0 conn(0x7f414c157f10 legacy=0x7f414c158330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:00:20.941 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:20.934+0000 7f4149ffb640 1 --2- 172.21.15.196:0/3129062677 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f41380039c0 0x7f4138003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:00:20.941 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:20.934+0000 7f4149ffb640 1 --2- 172.21.15.196:0/3129062677 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4138004810 0x7f4138004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:00:20.941 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:20.934+0000 7f4149ffb640 1 --2- 172.21.15.196:0/3129062677 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f41380051d0 0x7f413800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:00:20.941 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:20.934+0000 7f4149ffb640 1 -- 172.21.15.196:0/3129062677 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f414c06b640 con 0x7f4138004810 2024-03-18T00:00:20.941 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:20.934+0000 7f4149ffb640 1 -- 172.21.15.196:0/3129062677 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f413800c080 con 0x7f41380039c0 2024-03-18T00:00:20.942 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:20.934+0000 7f4149ffb640 1 -- 172.21.15.196:0/3129062677 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f413800c280 con 0x7f41380051d0 2024-03-18T00:00:20.942 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:20.934+0000 7f414a7fc640 1 --2- 172.21.15.196:0/3129062677 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4138004810 0x7f4138004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:00:20.942 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:20.934+0000 7f414affd640 1 --2- 172.21.15.196:0/3129062677 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f41380039c0 0x7f4138003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:00:20.942 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:20.934+0000 7f414a7fc640 1 -- 172.21.15.196:0/3129062677 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f41380051d0 msgr2=0x7f413800b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T00:00:20.942 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:20.934+0000 7f414a7fc640 1 --2- 172.21.15.196:0/3129062677 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f41380051d0 0x7f413800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:00:20.942 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:20.934+0000 7f414a7fc640 1 -- 172.21.15.196:0/3129062677 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f41380039c0 msgr2=0x7f4138003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T00:00:20.942 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:20.934+0000 7f414a7fc640 1 --2- 172.21.15.196:0/3129062677 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f41380039c0 0x7f4138003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:00:20.942 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:20.934+0000 7f414a7fc640 1 -- 172.21.15.196:0/3129062677 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4138003530 con 0x7f4138004810 2024-03-18T00:00:20.942 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:20.934+0000 7f414b7fe640 1 -- 172.21.15.196:0/3129062677 reap_dead start 2024-03-18T00:00:20.944 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:20.938+0000 7f414a7fc640 1 --2- 172.21.15.196:0/3129062677 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4138004810 0x7f4138004c90 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f413c009ae0 tx=0x7f413c01ca70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e199a9c4d84e59d8 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:00:20.944 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:20.938+0000 7f4149ffb640 1 -- 172.21.15.196:0/3129062677 <== mon.0 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f413c0b2070 con 0x7f4138004810 2024-03-18T00:00:20.944 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:20.938+0000 7f4149ffb640 1 -- 172.21.15.196:0/3129062677 <== mon.0 v2:172.21.15.196:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f413c0a5660 con 0x7f4138004810 2024-03-18T00:00:20.944 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:20.938+0000 7f4149ffb640 1 -- 172.21.15.196:0/3129062677 <== mon.0 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f413c0096b0 con 0x7f4138004810 2024-03-18T00:00:20.944 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:20.938+0000 7f41512d4640 1 -- 172.21.15.196:0/3129062677 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4138004810 msgr2=0x7f4138004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:00:20.944 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:20.938+0000 7f41512d4640 1 --2- 172.21.15.196:0/3129062677 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4138004810 0x7f4138004c90 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f413c009ae0 tx=0x7f413c01ca70 comp rx=0 tx=0).stop 2024-03-18T00:00:20.944 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:20.938+0000 7f41512d4640 1 -- 172.21.15.196:0/3129062677 shutdown_connections 2024-03-18T00:00:20.944 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:20.938+0000 7f41512d4640 1 --2- 172.21.15.196:0/3129062677 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4138004810 0x7f4138004c90 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:00:20.944 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:20.938+0000 7f41512d4640 1 -- 172.21.15.196:0/3129062677 >> 172.21.15.196:0/3129062677 conn(0x7f414c067680 msgr2=0x7f414c0cc500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:00:20.944 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:20.938+0000 7f41512d4640 1 -- 172.21.15.196:0/3129062677 shutdown_connections 2024-03-18T00:00:20.944 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:20.938+0000 7f41512d4640 1 -- 172.21.15.196:0/3129062677 wait complete. 2024-03-18T00:00:20.944 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:20.938+0000 7f41512d4640 1 Processor -- start 2024-03-18T00:00:20.945 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:20.938+0000 7f41512d4640 1 -- start start 2024-03-18T00:00:20.946 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:20.942+0000 7f41512d4640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4138004810 0x7f414c14f960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:00:20.947 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:20.942+0000 7f41512d4640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f414c0cbaf0 0x7f414c1ed8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:00:20.947 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:20.942+0000 7f41512d4640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f414c1eddf0 0x7f414c1454a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:00:20.947 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:20.942+0000 7f41512d4640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f414c1522b0 con 0x7f4138004810 2024-03-18T00:00:20.947 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:20.942+0000 7f41512d4640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 -- 0x7f414c06be50 con 0x7f414c1eddf0 2024-03-18T00:00:20.947 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:20.942+0000 7f41512d4640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 -- 0x7f414c152430 con 0x7f414c0cbaf0 2024-03-18T00:00:20.947 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:20.942+0000 7f414affd640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4138004810 0x7f414c14f960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:00:20.947 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:20.942+0000 7f414affd640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4138004810 0x7f414c14f960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.196:51560/0 (socket says 172.21.15.196:51560) 2024-03-18T00:00:20.947 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:20.942+0000 7f414affd640 1 -- 172.21.15.196:0/1690379740 learned_addr learned my addr 172.21.15.196:0/1690379740 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-03-18T00:00:20.947 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:20.942+0000 7f414a7fc640 1 --2- 172.21.15.196:0/1690379740 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f414c0cbaf0 0x7f414c1ed8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:00:20.947 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:20.942+0000 7f414b7fe640 1 --2- 172.21.15.196:0/1690379740 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f414c1eddf0 0x7f414c1454a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:00:20.947 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:20.942+0000 7f414affd640 1 -- 172.21.15.196:0/1690379740 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f414c0cbaf0 msgr2=0x7f414c1ed8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:00:20.947 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:20.942+0000 7f414affd640 1 --2- 172.21.15.196:0/1690379740 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f414c0cbaf0 0x7f414c1ed8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:00:20.948 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:20.942+0000 7f414affd640 1 -- 172.21.15.196:0/1690379740 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f414c1eddf0 msgr2=0x7f414c1454a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:00:20.948 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:20.942+0000 7f414affd640 1 --2- 172.21.15.196:0/1690379740 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f414c1eddf0 0x7f414c1454a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:00:20.948 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:20.942+0000 7f414affd640 1 -- 172.21.15.196:0/1690379740 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f414c1f0dc0 con 0x7f4138004810 2024-03-18T00:00:20.948 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:20.942+0000 7f414b7fe640 1 --2- 172.21.15.196:0/1690379740 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f414c1eddf0 0x7f414c1454a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-18T00:00:20.948 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:20.942+0000 7f414affd640 1 --2- 172.21.15.196:0/1690379740 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4138004810 0x7f414c14f960 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f414400e8f0 tx=0x7f414400edb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:00:20.948 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:20.942+0000 7f41437fe640 1 -- 172.21.15.196:0/1690379740 <== mon.0 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4144003b90 con 0x7f4138004810 2024-03-18T00:00:20.948 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:20.942+0000 7f41437fe640 1 -- 172.21.15.196:0/1690379740 <== mon.0 v2:172.21.15.196:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f4144018070 con 0x7f4138004810 2024-03-18T00:00:20.948 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:20.942+0000 7f41437fe640 1 -- 172.21.15.196:0/1690379740 <== mon.0 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41440050d0 con 0x7f4138004810 2024-03-18T00:00:20.948 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:20.942+0000 7f41512d4640 1 -- 172.21.15.196:0/1690379740 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f414c1f10a0 con 0x7f4138004810 2024-03-18T00:00:20.948 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:20.942+0000 7f41512d4640 1 -- 172.21.15.196:0/1690379740 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f414c1f1660 con 0x7f4138004810 2024-03-18T00:00:20.948 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:20.942+0000 7f41512d4640 1 -- 172.21.15.196:0/1690379740 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f414c0689a0 con 0x7f4138004810 2024-03-18T00:00:20.948 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:20.942+0000 7f41437fe640 1 -- 172.21.15.196:0/1690379740 <== mon.0 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 5) ==== 87083+0+0 (secure 0 0 0) 0x7f4144005270 con 0x7f4138004810 2024-03-18T00:00:20.948 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:20.942+0000 7f41437fe640 1 --2- 172.21.15.196:0/1690379740 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f412c067690 0x7f412c069b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:00:20.949 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:20.942+0000 7f41437fe640 1 -- 172.21.15.196:0/1690379740 <== mon.0 v2:172.21.15.196:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5817+0+0 (secure 0 0 0) 0x7f4144085a70 con 0x7f4138004810 2024-03-18T00:00:20.949 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:20.942+0000 7f414a7fc640 1 --2- 172.21.15.196:0/1690379740 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f412c067690 0x7f412c069b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:00:20.949 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:20.946+0000 7f414a7fc640 1 --2- 172.21.15.196:0/1690379740 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f412c067690 0x7f412c069b50 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f413c0af000 tx=0x7f413c008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:00:20.951 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:20.946+0000 7f41437fe640 1 -- 172.21.15.196:0/1690379740 <== mon.0 v2:172.21.15.196:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177849 (secure 0 0 0) 0x7f41440565f0 con 0x7f4138004810 2024-03-18T00:00:21.139 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:21.134+0000 7f41512d4640 1 -- 172.21.15.196:0/1690379740 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f414c072bd0 con 0x7f4138004810 2024-03-18T00:00:21.804 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:21.802+0000 7f41437fe640 1 -- 172.21.15.196:0/1690379740 <== mon.0 v2:172.21.15.196:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v26) ==== 169+0+0 (secure 0 0 0) 0x7f4144055ef0 con 0x7f4138004810 2024-03-18T00:00:21.804 INFO:teuthology.orchestra.run.smithi196.stderr:pool 'cephfs_data' removed 2024-03-18T00:00:21.807 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:21.802+0000 7f41512d4640 1 -- 172.21.15.196:0/1690379740 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f412c067690 msgr2=0x7f412c069b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:00:21.807 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:21.802+0000 7f41512d4640 1 --2- 172.21.15.196:0/1690379740 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f412c067690 0x7f412c069b50 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f413c0af000 tx=0x7f413c008040 comp rx=0 tx=0).stop 2024-03-18T00:00:21.807 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:21.802+0000 7f41512d4640 1 -- 172.21.15.196:0/1690379740 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4138004810 msgr2=0x7f414c14f960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:00:21.807 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:21.802+0000 7f41512d4640 1 --2- 172.21.15.196:0/1690379740 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4138004810 0x7f414c14f960 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f414400e8f0 tx=0x7f414400edb0 comp rx=0 tx=0).stop 2024-03-18T00:00:21.807 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:21.802+0000 7f41512d4640 1 -- 172.21.15.196:0/1690379740 shutdown_connections 2024-03-18T00:00:21.807 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:21.802+0000 7f41512d4640 1 --2- 172.21.15.196:0/1690379740 >> [v2:172.21.15.204:6832/2505201055,v1:172.21.15.204:6833/2505201055] conn(0x7f412c067690 0x7f412c069b50 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:00:21.807 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:21.802+0000 7f41512d4640 1 --2- 172.21.15.196:0/1690379740 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f414c0cbaf0 0x7f414c1ed8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:00:21.807 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:21.802+0000 7f41512d4640 1 --2- 172.21.15.196:0/1690379740 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f414c1eddf0 0x7f414c1454a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:00:21.807 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:21.802+0000 7f41512d4640 1 --2- 172.21.15.196:0/1690379740 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4138004810 0x7f414c14f960 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:00:21.807 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:21.802+0000 7f41512d4640 1 -- 172.21.15.196:0/1690379740 >> 172.21.15.196:0/1690379740 conn(0x7f414c067680 msgr2=0x7f414c1e35e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:00:21.808 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:21.802+0000 7f41512d4640 1 -- 172.21.15.196:0/1690379740 shutdown_connections 2024-03-18T00:00:21.808 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-18T00:00:21.802+0000 7f41512d4640 1 -- 172.21.15.196:0/1690379740 wait complete. 2024-03-18T00:00:21.829 INFO:teuthology.misc:Shutting down mds daemons... 2024-03-18T00:00:21.829 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-03-18T00:00:21.829 INFO:teuthology.orchestra.run:waiting for 300 2024-03-18T00:00:21.830 INFO:tasks.ceph.mds.a.smithi196.stderr:2024-03-18T00:00:21.826+0000 7fd7a6f17640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term ceph-mds -f --cluster ceph -i a (PID: 31189) UID: 0 2024-03-18T00:00:21.830 INFO:tasks.ceph.mds.a.smithi196.stderr:2024-03-18T00:00:21.826+0000 7fd7a6f17640 -1 mds.a *** got signal Terminated *** 2024-03-18T00:00:24.651 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~0s 2024-03-18T00:00:27.931 INFO:tasks.ceph.mds.a:Stopped 2024-03-18T00:00:27.932 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-03-18T00:00:27.932 INFO:teuthology.orchestra.run:waiting for 300 2024-03-18T00:00:27.933 INFO:tasks.ceph.mds.c.smithi196.stderr:2024-03-18T00:00:27.930+0000 7f9426fa7640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term ceph-mds -f --cluster ceph -i c (PID: 31191) UID: 0 2024-03-18T00:00:27.933 INFO:tasks.ceph.mds.c.smithi196.stderr:2024-03-18T00:00:27.930+0000 7f9426fa7640 -1 mds.c *** got signal Terminated *** 2024-03-18T00:00:31.465 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a has been restored 2024-03-18T00:00:33.680 INFO:tasks.ceph.mon.b.smithi204.stderr:2024-03-18T00:00:33.676+0000 7f4d441c4640 -1 received signal: Hangup from killall -q -1 ceph-mon ceph-mgr ceph-mds ceph-osd ceph-fuse radosgw rbd-mirror cephfs-mirror (PID: 31733) UID: 0 2024-03-18T00:00:33.681 INFO:tasks.ceph.mon.b.smithi204.stderr:2024-03-18T00:00:33.676+0000 7f4d441c4640 -1 mon.b@1(peon) e1 *** Got Signal Hangup *** 2024-03-18T00:00:33.681 INFO:tasks.ceph.mon.c.smithi204.stderr:2024-03-18T00:00:33.676+0000 7f391b87f640 -1 received signal: Hangup from killall -q -1 ceph-mon ceph-mgr ceph-mds ceph-osd ceph-fuse radosgw rbd-mirror cephfs-mirror (PID: 31733) UID: 0 2024-03-18T00:00:33.681 INFO:tasks.ceph.mon.c.smithi204.stderr:2024-03-18T00:00:33.676+0000 7f391b87f640 -1 mon.c@2(peon) e1 *** Got Signal Hangup *** 2024-03-18T00:00:33.681 INFO:tasks.ceph.mgr.x.smithi204.stderr:2024-03-18T00:00:33.676+0000 7f85ef6c1640 -1 received signal: Hangup from killall -q -1 ceph-mon ceph-mgr ceph-mds ceph-osd ceph-fuse radosgw rbd-mirror cephfs-mirror (PID: 31733) UID: 0 2024-03-18T00:00:33.682 INFO:tasks.ceph.osd.5.smithi204.stderr:2024-03-18T00:00:33.676+0000 7f0370f7a640 -1 received signal: Hangup from killall -q -1 ceph-mon ceph-mgr ceph-mds ceph-osd ceph-fuse radosgw rbd-mirror cephfs-mirror (PID: 31733) UID: 0 2024-03-18T00:00:33.682 INFO:tasks.ceph.osd.4.smithi204.stderr:2024-03-18T00:00:33.676+0000 7efc5056f640 -1 received signal: Hangup from killall -q -1 ceph-mon ceph-mgr ceph-mds ceph-osd ceph-fuse radosgw rbd-mirror cephfs-mirror (PID: 31733) UID: 0 2024-03-18T00:00:33.682 INFO:tasks.ceph.osd.6.smithi204.stderr:2024-03-18T00:00:33.676+0000 7f32621ee640 -1 received signal: Hangup from killall -q -1 ceph-mon ceph-mgr ceph-mds ceph-osd ceph-fuse radosgw rbd-mirror cephfs-mirror (PID: 31733) UID: 0 2024-03-18T00:00:33.682 INFO:tasks.ceph.osd.7.smithi204.stderr:2024-03-18T00:00:33.676+0000 7fa15061c640 -1 received signal: Hangup from killall -q -1 ceph-mon ceph-mgr ceph-mds ceph-osd ceph-fuse radosgw rbd-mirror cephfs-mirror (PID: 31733) UID: 0 2024-03-18T00:00:33.683 INFO:tasks.ceph.mds.b.smithi204.stderr:2024-03-18T00:00:33.680+0000 7fe6c9e98640 -1 received signal: Hangup from killall -q -1 ceph-mon ceph-mgr ceph-mds ceph-osd ceph-fuse radosgw rbd-mirror cephfs-mirror (PID: 31733) UID: 0 2024-03-18T00:00:33.683 INFO:tasks.ceph.mds.d.smithi204.stderr:2024-03-18T00:00:33.680+0000 7f61ed4fb640 -1 received signal: Hangup from killall -q -1 ceph-mon ceph-mgr ceph-mds ceph-osd ceph-fuse radosgw rbd-mirror cephfs-mirror (PID: 31733) UID: 0 2024-03-18T00:00:33.684 INFO:tasks.ceph.mds.f.smithi204.stderr:2024-03-18T00:00:33.680+0000 7fbca30fe640 -1 received signal: Hangup from killall -q -1 ceph-mon ceph-mgr ceph-mds ceph-osd ceph-fuse radosgw rbd-mirror cephfs-mirror (PID: 31733) UID: 0 2024-03-18T00:00:33.714 INFO:tasks.ceph.osd.5.smithi204.stderr:2024-03-18T00:00:33.712+0000 7f0370f7a640 -1 received signal: Hangup from (PID: 31759) UID: 0 2024-03-18T00:00:33.715 INFO:tasks.ceph.mds.b.smithi204.stderr:2024-03-18T00:00:33.712+0000 7fe6c9e98640 -1 received signal: Hangup from (PID: 31759) UID: 0 2024-03-18T00:00:33.717 INFO:tasks.ceph.mds.f.smithi204.stderr:2024-03-18T00:00:33.712+0000 7fbca30fe640 -1 received signal: Hangup from (PID: 31759) UID: 0 2024-03-18T00:00:33.717 INFO:tasks.ceph.mon.b.smithi204.stderr:2024-03-18T00:00:33.712+0000 7f4d441c4640 -1 received signal: Hangup from (PID: 31759) UID: 0 2024-03-18T00:00:33.717 INFO:tasks.ceph.mon.b.smithi204.stderr:2024-03-18T00:00:33.712+0000 7f4d441c4640 -1 mon.b@1(peon) e1 *** Got Signal Hangup *** 2024-03-18T00:00:33.717 INFO:tasks.ceph.mds.d.smithi204.stderr:2024-03-18T00:00:33.712+0000 7f61ed4fb640 -1 received signal: Hangup from (PID: 31759) UID: 0 2024-03-18T00:00:33.718 INFO:tasks.ceph.mon.c.smithi204.stderr:2024-03-18T00:00:33.712+0000 7f391b87f640 -1 received signal: Hangup from (PID: 31759) UID: 0 2024-03-18T00:00:33.718 INFO:tasks.ceph.mon.c.smithi204.stderr:2024-03-18T00:00:33.712+0000 7f391b87f640 -1 mon.c@2(peon) e1 *** Got Signal Hangup *** 2024-03-18T00:00:33.718 INFO:tasks.ceph.mgr.x.smithi204.stderr:2024-03-18T00:00:33.712+0000 7f85ef6c1640 -1 received signal: Hangup from (PID: 31759) UID: 0 2024-03-18T00:00:33.718 INFO:tasks.ceph.osd.7.smithi204.stderr:2024-03-18T00:00:33.712+0000 7fa15061c640 -1 received signal: Hangup from (PID: 31759) UID: 0 2024-03-18T00:00:33.719 INFO:tasks.ceph.osd.4.smithi204.stderr:2024-03-18T00:00:33.712+0000 7efc5056f640 -1 received signal: Hangup from (PID: 31759) UID: 0 2024-03-18T00:00:33.719 INFO:tasks.ceph.osd.6.smithi204.stderr:2024-03-18T00:00:33.712+0000 7f32621ee640 -1 Fail to open '/proc/31759/cmdline' error = (2) No such file or directory 2024-03-18T00:00:33.719 INFO:tasks.ceph.osd.6.smithi204.stderr:2024-03-18T00:00:33.712+0000 7f32621ee640 -1 received signal: Hangup from (PID: 31759) UID: 0 2024-03-18T00:00:34.034 INFO:tasks.ceph.mds.c:Stopped 2024-03-18T00:00:34.034 DEBUG:tasks.ceph.mds.e:waiting for process to exit 2024-03-18T00:00:34.035 INFO:teuthology.orchestra.run:waiting for 300 2024-03-18T00:00:34.036 INFO:tasks.ceph.mds.e.smithi196.stderr:2024-03-18T00:00:34.030+0000 7fbc854fd640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term ceph-mds -f --cluster ceph -i e (PID: 31193) UID: 0 2024-03-18T00:00:34.036 INFO:tasks.ceph.mds.e.smithi196.stderr:2024-03-18T00:00:34.030+0000 7fbc854fd640 -1 mds.e *** got signal Terminated *** 2024-03-18T00:00:37.630 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T00:00:37.633 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T00:00:37.642 INFO:teuthology.orchestra.run.smithi196.stderr:error: state file /var/lib/logrotate/status is already locked 2024-03-18T00:00:37.642 INFO:teuthology.orchestra.run.smithi196.stderr:logrotate does not support parallel execution on the same set of logfiles. 2024-03-18T00:00:37.643 DEBUG:teuthology.orchestra.run:got remote process result: 3 2024-03-18T00:00:37.643 ERROR:teuthology:Uncaught exception (Hub) Traceback (most recent call last): File "src/gevent/greenlet.py", line 908, in gevent._gevent_cgreenlet.Greenlet.run File "/home/teuthworker/src/github.com_batrick_ceph_c382027d5c66ef4e0aa1131ea3e8080c658d3184/qa/tasks/ceph.py", line 189, in invoke_logrotate run.wait(procs) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi196 with status 3: 'sudo logrotate /etc/logrotate.d/ceph-test.conf' 2024-03-18T00:00:37.645 INFO:teuthology.orchestra.run.smithi204.stderr:error: state file /var/lib/logrotate/status is already locked 2024-03-18T00:00:37.645 INFO:teuthology.orchestra.run.smithi204.stderr:logrotate does not support parallel execution on the same set of logfiles. 2024-03-18T00:00:40.136 INFO:tasks.ceph.mds.e:Stopped 2024-03-18T00:00:40.137 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-03-18T00:00:40.137 INFO:teuthology.orchestra.run:waiting for 300 2024-03-18T00:00:40.137 INFO:tasks.ceph.mds.b.smithi204.stderr:2024-03-18T00:00:40.136+0000 7fe6c9e98640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term ceph-mds -f --cluster ceph -i b (PID: 31367) UID: 0 2024-03-18T00:00:40.138 INFO:tasks.ceph.mds.b.smithi204.stderr:2024-03-18T00:00:40.136+0000 7fe6c9e98640 -1 mds.b *** got signal Terminated *** 2024-03-18T00:00:44.697 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~0s 2024-03-18T00:00:46.238 INFO:tasks.ceph.mds.b:Stopped 2024-03-18T00:00:46.239 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-03-18T00:00:46.239 INFO:teuthology.orchestra.run:waiting for 300 2024-03-18T00:00:46.240 INFO:tasks.ceph.mds.d.smithi204.stderr:2024-03-18T00:00:46.236+0000 7f61ed4fb640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term ceph-mds -f --cluster ceph -i d (PID: 31369) UID: 0 2024-03-18T00:00:46.240 INFO:tasks.ceph.mds.d.smithi204.stderr:2024-03-18T00:00:46.236+0000 7f61ed4fb640 -1 mds.d *** got signal Terminated *** 2024-03-18T00:00:51.110 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~0s 2024-03-18T00:00:51.110 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b has been restored 2024-03-18T00:00:52.340 INFO:tasks.ceph.mds.d:Stopped 2024-03-18T00:00:52.341 DEBUG:tasks.ceph.mds.f:waiting for process to exit 2024-03-18T00:00:52.341 INFO:teuthology.orchestra.run:waiting for 300 2024-03-18T00:00:52.342 INFO:tasks.ceph.mds.f.smithi204.stderr:2024-03-18T00:00:52.340+0000 7fbca30fe640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term ceph-mds -f --cluster ceph -i f (PID: 31371) UID: 0 2024-03-18T00:00:52.342 INFO:tasks.ceph.mds.f.smithi204.stderr:2024-03-18T00:00:52.340+0000 7fbca30fe640 -1 mds.f *** got signal Terminated *** 2024-03-18T00:00:57.421 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.f is failed for ~0s 2024-03-18T00:00:57.421 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d has been restored 2024-03-18T00:00:58.442 INFO:tasks.ceph.mds.f:Stopped 2024-03-18T00:00:58.443 INFO:teuthology.misc:Shutting down osd daemons... 2024-03-18T00:00:58.443 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-03-18T00:00:58.443 INFO:teuthology.orchestra.run:waiting for 300 2024-03-18T00:00:58.444 INFO:tasks.ceph.osd.0.smithi196.stderr:2024-03-18T00:00:58.442+0000 7f3c12363640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term ceph-osd -f --cluster ceph -i 0 (PID: 27561) UID: 0 2024-03-18T00:00:58.444 INFO:tasks.ceph.osd.0.smithi196.stderr:2024-03-18T00:00:58.442+0000 7f3c12363640 -1 osd.0 32 *** Got signal Terminated *** 2024-03-18T00:00:58.444 INFO:tasks.ceph.osd.0.smithi196.stderr:2024-03-18T00:00:58.442+0000 7f3c12363640 -1 osd.0 32 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-03-18T00:01:03.631 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~0s 2024-03-18T00:01:03.631 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.f has been restored 2024-03-18T00:01:04.545 INFO:tasks.ceph.osd.0:Stopped 2024-03-18T00:01:04.545 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-03-18T00:01:04.545 INFO:teuthology.orchestra.run:waiting for 300 2024-03-18T00:01:04.546 INFO:tasks.ceph.osd.1.smithi196.stderr:2024-03-18T00:01:04.546+0000 7fae1b990640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term ceph-osd -f --cluster ceph -i 1 (PID: 27557) UID: 0 2024-03-18T00:01:04.546 INFO:tasks.ceph.osd.1.smithi196.stderr:2024-03-18T00:01:04.546+0000 7fae1b990640 -1 osd.1 34 *** Got signal Terminated *** 2024-03-18T00:01:04.547 INFO:tasks.ceph.osd.1.smithi196.stderr:2024-03-18T00:01:04.546+0000 7fae1b990640 -1 osd.1 34 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-03-18T00:01:09.742 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~0s 2024-03-18T00:01:09.742 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 has been restored 2024-03-18T00:01:10.647 INFO:tasks.ceph.osd.1:Stopped 2024-03-18T00:01:10.648 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-03-18T00:01:10.648 INFO:teuthology.orchestra.run:waiting for 300 2024-03-18T00:01:10.649 INFO:tasks.ceph.osd.2.smithi196.stderr:2024-03-18T00:01:10.650+0000 7f36a969c640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term ceph-osd -f --cluster ceph -i 2 (PID: 27560) UID: 0 2024-03-18T00:01:10.649 INFO:tasks.ceph.osd.2.smithi196.stderr:2024-03-18T00:01:10.650+0000 7f36a969c640 -1 osd.2 35 *** Got signal Terminated *** 2024-03-18T00:01:10.649 INFO:tasks.ceph.osd.2.smithi196.stderr:2024-03-18T00:01:10.650+0000 7f36a969c640 -1 osd.2 35 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-03-18T00:01:15.751 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~0s 2024-03-18T00:01:15.751 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 has been restored 2024-03-18T00:01:16.750 INFO:tasks.ceph.osd.2:Stopped 2024-03-18T00:01:16.751 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-03-18T00:01:16.751 INFO:teuthology.orchestra.run:waiting for 300 2024-03-18T00:01:16.752 INFO:tasks.ceph.osd.3.smithi196.stderr:2024-03-18T00:01:16.754+0000 7fee5e0f0640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term ceph-osd -f --cluster ceph -i 3 (PID: 27559) UID: 0 2024-03-18T00:01:16.752 INFO:tasks.ceph.osd.3.smithi196.stderr:2024-03-18T00:01:16.754+0000 7fee5e0f0640 -1 osd.3 36 *** Got signal Terminated *** 2024-03-18T00:01:16.752 INFO:tasks.ceph.osd.3.smithi196.stderr:2024-03-18T00:01:16.754+0000 7fee5e0f0640 -1 osd.3 36 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-03-18T00:01:21.659 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~0s 2024-03-18T00:01:21.660 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 has been restored 2024-03-18T00:01:22.852 INFO:tasks.ceph.osd.3:Stopped 2024-03-18T00:01:22.852 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-03-18T00:01:22.852 INFO:teuthology.orchestra.run:waiting for 300 2024-03-18T00:01:22.854 INFO:tasks.ceph.osd.4.smithi204.stderr:2024-03-18T00:01:22.852+0000 7efc5056f640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term ceph-osd -f --cluster ceph -i 4 (PID: 27754) UID: 0 2024-03-18T00:01:22.854 INFO:tasks.ceph.osd.4.smithi204.stderr:2024-03-18T00:01:22.852+0000 7efc5056f640 -1 osd.4 37 *** Got signal Terminated *** 2024-03-18T00:01:22.854 INFO:tasks.ceph.osd.4.smithi204.stderr:2024-03-18T00:01:22.852+0000 7efc5056f640 -1 osd.4 37 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-03-18T00:01:27.467 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~0s 2024-03-18T00:01:27.467 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 has been restored 2024-03-18T00:01:28.954 INFO:tasks.ceph.osd.4:Stopped 2024-03-18T00:01:28.954 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-03-18T00:01:28.954 INFO:teuthology.orchestra.run:waiting for 300 2024-03-18T00:01:28.955 INFO:tasks.ceph.osd.5.smithi204.stderr:2024-03-18T00:01:28.952+0000 7f0370f7a640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term ceph-osd -f --cluster ceph -i 5 (PID: 27755) UID: 0 2024-03-18T00:01:28.955 INFO:tasks.ceph.osd.5.smithi204.stderr:2024-03-18T00:01:28.952+0000 7f0370f7a640 -1 osd.5 38 *** Got signal Terminated *** 2024-03-18T00:01:28.956 INFO:tasks.ceph.osd.5.smithi204.stderr:2024-03-18T00:01:28.952+0000 7f0370f7a640 -1 osd.5 38 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-03-18T00:01:33.173 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~0s 2024-03-18T00:01:33.173 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 has been restored 2024-03-18T00:01:35.056 INFO:tasks.ceph.osd.5:Stopped 2024-03-18T00:01:35.057 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-03-18T00:01:35.057 INFO:teuthology.orchestra.run:waiting for 300 2024-03-18T00:01:35.058 INFO:tasks.ceph.osd.6.smithi204.stderr:2024-03-18T00:01:35.060+0000 7f32621ee640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term ceph-osd -f --cluster ceph -i 6 (PID: 27758) UID: 0 2024-03-18T00:01:35.058 INFO:tasks.ceph.osd.6.smithi204.stderr:2024-03-18T00:01:35.060+0000 7f32621ee640 -1 osd.6 39 *** Got signal Terminated *** 2024-03-18T00:01:35.058 INFO:tasks.ceph.osd.6.smithi204.stderr:2024-03-18T00:01:35.060+0000 7f32621ee640 -1 osd.6 39 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-03-18T00:01:38.778 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~0s 2024-03-18T00:01:38.778 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 has been restored 2024-03-18T00:01:41.159 INFO:tasks.ceph.osd.6:Stopped 2024-03-18T00:01:41.159 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-03-18T00:01:41.159 INFO:teuthology.orchestra.run:waiting for 300 2024-03-18T00:01:41.161 INFO:tasks.ceph.osd.7.smithi204.stderr:2024-03-18T00:01:41.156+0000 7fa15061c640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term ceph-osd -f --cluster ceph -i 7 (PID: 27760) UID: 0 2024-03-18T00:01:41.161 INFO:tasks.ceph.osd.7.smithi204.stderr:2024-03-18T00:01:41.156+0000 7fa15061c640 -1 osd.7 39 *** Got signal Terminated *** 2024-03-18T00:01:41.161 INFO:tasks.ceph.osd.7.smithi204.stderr:2024-03-18T00:01:41.156+0000 7fa15061c640 -1 osd.7 39 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-03-18T00:01:44.282 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~0s 2024-03-18T00:01:44.283 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 has been restored 2024-03-18T00:01:47.261 INFO:tasks.ceph.osd.7:Stopped 2024-03-18T00:01:47.262 INFO:teuthology.misc:Shutting down mgr daemons... 2024-03-18T00:01:47.263 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-03-18T00:01:47.263 INFO:teuthology.orchestra.run:waiting for 300 2024-03-18T00:01:47.296 INFO:tasks.ceph.mgr.y:Stopped 2024-03-18T00:01:47.296 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-03-18T00:01:47.296 INFO:teuthology.orchestra.run:waiting for 300 2024-03-18T00:01:47.298 INFO:tasks.ceph.mgr.x.smithi204.stderr:2024-03-18T00:01:47.296+0000 7f85ef6c1640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term ceph-mgr -f --cluster ceph -i x (PID: 27438) UID: 0 2024-03-18T00:01:47.298 INFO:tasks.ceph.mgr.x.smithi204.stderr:2024-03-18T00:01:47.296+0000 7f85ef6c1640 -1 mgr handle_mgr_signal *** Got signal Terminated *** 2024-03-18T00:01:47.327 INFO:tasks.ceph.mgr.x:Stopped 2024-03-18T00:01:47.327 INFO:teuthology.misc:Shutting down mon daemons... 2024-03-18T00:01:47.327 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-03-18T00:01:47.327 INFO:teuthology.orchestra.run:waiting for 300 2024-03-18T00:01:47.340 INFO:tasks.ceph.mon.a.smithi196.stderr:2024-03-18T00:01:47.341+0000 7f2c6fa81640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term ceph-mon -f --cluster ceph -i a (PID: 27444) UID: 0 2024-03-18T00:01:47.340 INFO:tasks.ceph.mon.a.smithi196.stderr:2024-03-18T00:01:47.341+0000 7f2c6fa81640 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2024-03-18T00:01:49.485 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~0s 2024-03-18T00:01:49.485 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 has been restored 2024-03-18T00:01:53.429 INFO:tasks.ceph.mon.a:Stopped 2024-03-18T00:01:53.430 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-03-18T00:01:53.430 INFO:teuthology.orchestra.run:waiting for 300 2024-03-18T00:01:53.431 INFO:tasks.ceph.mon.b.smithi204.stderr:2024-03-18T00:01:53.431+0000 7f4d441c4640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term ceph-mon -f --cluster ceph -i b (PID: 27434) UID: 0 2024-03-18T00:01:53.431 INFO:tasks.ceph.mon.b.smithi204.stderr:2024-03-18T00:01:53.431+0000 7f4d441c4640 -1 mon.b@1(peon) e1 *** Got Signal Terminated *** 2024-03-18T00:01:53.469 INFO:tasks.ceph.mon.b:Stopped 2024-03-18T00:01:53.470 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-03-18T00:01:53.470 INFO:teuthology.orchestra.run:waiting for 300 2024-03-18T00:01:53.513 INFO:tasks.ceph.mon.c.smithi204.stderr:2024-03-18T00:01:53.511+0000 7f391b87f640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term ceph-mon -f --cluster ceph -i c (PID: 27436) UID: 0 2024-03-18T00:01:53.513 INFO:tasks.ceph.mon.c.smithi204.stderr:2024-03-18T00:01:53.511+0000 7f391b87f640 -1 mon.c@2(peon) e1 *** Got Signal Terminated *** 2024-03-18T00:01:53.554 INFO:tasks.ceph.mon.c:Stopped 2024-03-18T00:01:53.554 INFO:tasks.ceph:Checking cluster log for badness... 2024-03-18T00:01:53.555 DEBUG:teuthology.orchestra.run.smithi196:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'mons down, quorum' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v MON_DOWN | head -n 1 2024-03-18T00:01:53.573 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi196.front.sepia.ceph.com 2024-03-18T00:01:53.573 DEBUG:teuthology.orchestra.run.smithi196:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-03-18T00:01:53.986 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi196.front.sepia.ceph.com 2024-03-18T00:01:53.987 DEBUG:teuthology.orchestra.run.smithi196:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-03-18T00:01:54.219 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi196.front.sepia.ceph.com 2024-03-18T00:01:54.219 DEBUG:teuthology.orchestra.run.smithi196:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-03-18T00:01:54.403 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi196.front.sepia.ceph.com 2024-03-18T00:01:54.403 DEBUG:teuthology.orchestra.run.smithi196:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-03-18T00:01:54.486 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a has been restored 2024-03-18T00:01:54.569 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi204.front.sepia.ceph.com 2024-03-18T00:01:54.569 DEBUG:teuthology.orchestra.run.smithi204:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-03-18T00:01:54.765 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi204.front.sepia.ceph.com 2024-03-18T00:01:54.766 DEBUG:teuthology.orchestra.run.smithi204:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-03-18T00:01:54.942 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi204.front.sepia.ceph.com 2024-03-18T00:01:54.942 DEBUG:teuthology.orchestra.run.smithi204:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-03-18T00:01:55.125 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi204.front.sepia.ceph.com 2024-03-18T00:01:55.126 DEBUG:teuthology.orchestra.run.smithi204:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-03-18T00:01:55.299 INFO:tasks.ceph:Archiving mon data... 2024-03-18T00:01:55.300 DEBUG:teuthology.misc:Transferring archived files from smithi196:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/pdonnell-2024-03-17_23:17:27-fs-wip-batrick-testing-20240314.183243-distro-default-smithi/7608502/data/mon.a.tgz 2024-03-18T00:01:55.300 DEBUG:teuthology.orchestra.run.smithi196:> mktemp 2024-03-18T00:01:55.307 INFO:teuthology.orchestra.run.smithi196.stdout:/tmp/tmp.77sobh2lz0 2024-03-18T00:01:55.307 DEBUG:teuthology.orchestra.run.smithi196:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.77sobh2lz0 2024-03-18T00:01:55.430 DEBUG:teuthology.orchestra.run.smithi196:> sudo chmod 0666 /tmp/tmp.77sobh2lz0 2024-03-18T00:01:55.493 DEBUG:teuthology.orchestra.remote:smithi196:/tmp/tmp.77sobh2lz0 is 331KB 2024-03-18T00:01:55.553 DEBUG:teuthology.orchestra.run.smithi196:> rm -fr /tmp/tmp.77sobh2lz0 2024-03-18T00:01:55.559 DEBUG:teuthology.misc:Transferring archived files from smithi204:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/pdonnell-2024-03-17_23:17:27-fs-wip-batrick-testing-20240314.183243-distro-default-smithi/7608502/data/mon.b.tgz 2024-03-18T00:01:55.559 DEBUG:teuthology.orchestra.run.smithi204:> mktemp 2024-03-18T00:01:55.566 INFO:teuthology.orchestra.run.smithi204.stdout:/tmp/tmp.7B8GmO8erH 2024-03-18T00:01:55.566 DEBUG:teuthology.orchestra.run.smithi204:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.7B8GmO8erH 2024-03-18T00:01:55.711 DEBUG:teuthology.orchestra.run.smithi204:> sudo chmod 0666 /tmp/tmp.7B8GmO8erH 2024-03-18T00:01:55.772 DEBUG:teuthology.orchestra.remote:smithi204:/tmp/tmp.7B8GmO8erH is 447KB 2024-03-18T00:01:55.831 DEBUG:teuthology.orchestra.run.smithi204:> rm -fr /tmp/tmp.7B8GmO8erH 2024-03-18T00:01:55.835 DEBUG:teuthology.misc:Transferring archived files from smithi204:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/pdonnell-2024-03-17_23:17:27-fs-wip-batrick-testing-20240314.183243-distro-default-smithi/7608502/data/mon.c.tgz 2024-03-18T00:01:55.835 DEBUG:teuthology.orchestra.run.smithi204:> mktemp 2024-03-18T00:01:55.881 INFO:teuthology.orchestra.run.smithi204.stdout:/tmp/tmp.IlYo1NIz4f 2024-03-18T00:01:55.881 DEBUG:teuthology.orchestra.run.smithi204:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.IlYo1NIz4f 2024-03-18T00:01:56.029 DEBUG:teuthology.orchestra.run.smithi204:> sudo chmod 0666 /tmp/tmp.IlYo1NIz4f 2024-03-18T00:01:56.092 DEBUG:teuthology.orchestra.remote:smithi204:/tmp/tmp.IlYo1NIz4f is 447KB 2024-03-18T00:01:56.150 DEBUG:teuthology.orchestra.run.smithi204:> rm -fr /tmp/tmp.IlYo1NIz4f 2024-03-18T00:01:56.155 INFO:tasks.ceph:Cleaning ceph cluster... 2024-03-18T00:01:56.155 DEBUG:teuthology.orchestra.run.smithi196:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-03-18T00:01:56.157 DEBUG:teuthology.orchestra.run.smithi204:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-03-18T00:01:56.216 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-03-18T00:01:56.252 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-03-18T00:01:56.252 INFO:tasks.ceph:Archiving crash dumps... 2024-03-18T00:01:56.254 DEBUG:teuthology.misc:Transferring archived files from smithi196:/var/lib/ceph/crash to /home/teuthworker/archive/pdonnell-2024-03-17_23:17:27-fs-wip-batrick-testing-20240314.183243-distro-default-smithi/7608502/remote/smithi196/crash 2024-03-18T00:01:56.255 DEBUG:teuthology.orchestra.run.smithi196:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-03-18T00:01:56.275 DEBUG:teuthology.misc:Transferring archived files from smithi204:/var/lib/ceph/crash to /home/teuthworker/archive/pdonnell-2024-03-17_23:17:27-fs-wip-batrick-testing-20240314.183243-distro-default-smithi/7608502/remote/smithi204/crash 2024-03-18T00:01:56.276 DEBUG:teuthology.orchestra.run.smithi204:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-03-18T00:01:56.309 INFO:tasks.ceph:Shutting down logrotate 2024-03-18T00:01:56.310 ERROR:teuthology.run_tasks:Manager failed: ceph Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_batrick_ceph_c382027d5c66ef4e0aa1131ea3e8080c658d3184/qa/tasks/ceph.py", line 1935, in task mon0_remote.run( File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/contextutil.py", line 54, in nested raise exc[1] File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_batrick_ceph_c382027d5c66ef4e0aa1131ea3e8080c658d3184/qa/tasks/ceph.py", line 257, in ceph_log logrotater.end() File "/home/teuthworker/src/github.com_batrick_ceph_c382027d5c66ef4e0aa1131ea3e8080c658d3184/qa/tasks/ceph.py", line 222, in end self.thread.get() File "src/gevent/greenlet.py", line 805, in gevent._gevent_cgreenlet.Greenlet.get File "src/gevent/greenlet.py", line 373, in gevent._gevent_cgreenlet.Greenlet._raise_exception File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/virtualenv/lib/python3.8/site-packages/gevent/_compat.py", line 49, in reraise raise value.with_traceback(tb) File "src/gevent/greenlet.py", line 908, in gevent._gevent_cgreenlet.Greenlet.run File "/home/teuthworker/src/github.com_batrick_ceph_c382027d5c66ef4e0aa1131ea3e8080c658d3184/qa/tasks/ceph.py", line 189, in invoke_logrotate run.wait(procs) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi196 with status 3: 'sudo logrotate /etc/logrotate.d/ceph-test.conf' 2024-03-18T00:01:56.312 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-03-18T00:01:56.322 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/task/install/__init__.py", line 626, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_batrick_ceph_c382027d5c66ef4e0aa1131ea3e8080c658d3184/qa/tasks/ceph.py", line 1935, in task mon0_remote.run( File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/contextutil.py", line 54, in nested raise exc[1] File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_batrick_ceph_c382027d5c66ef4e0aa1131ea3e8080c658d3184/qa/tasks/ceph.py", line 257, in ceph_log logrotater.end() File "/home/teuthworker/src/github.com_batrick_ceph_c382027d5c66ef4e0aa1131ea3e8080c658d3184/qa/tasks/ceph.py", line 222, in end self.thread.get() File "src/gevent/greenlet.py", line 805, in gevent._gevent_cgreenlet.Greenlet.get File "src/gevent/greenlet.py", line 373, in gevent._gevent_cgreenlet.Greenlet._raise_exception File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/virtualenv/lib/python3.8/site-packages/gevent/_compat.py", line 49, in reraise raise value.with_traceback(tb) File "src/gevent/greenlet.py", line 908, in gevent._gevent_cgreenlet.Greenlet.run File "/home/teuthworker/src/github.com_batrick_ceph_c382027d5c66ef4e0aa1131ea3e8080c658d3184/qa/tasks/ceph.py", line 189, in invoke_logrotate run.wait(procs) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi196 with status 3: 'sudo logrotate /etc/logrotate.d/ceph-test.conf' 2024-03-18T00:01:56.323 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-03-18T00:01:56.323 DEBUG:teuthology.orchestra.run.smithi196:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-03-18T00:01:56.326 DEBUG:teuthology.orchestra.run.smithi204:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-03-18T00:01:56.421 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-03-18T00:01:56.431 INFO:teuthology.task.clock:Checking final clock skew... 2024-03-18T00:01:56.431 DEBUG:teuthology.orchestra.run.smithi196:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-03-18T00:01:56.433 DEBUG:teuthology.orchestra.run.smithi204:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-03-18T00:01:56.445 INFO:teuthology.orchestra.run.smithi196.stdout: remote refid st t when poll reach delay offset jitter 2024-03-18T00:01:56.445 INFO:teuthology.orchestra.run.smithi196.stdout:============================================================================== 2024-03-18T00:01:56.445 INFO:teuthology.orchestra.run.smithi196.stdout:*hv01.front.sepi 44.4.53.2 2 u 50 64 377 0.065 -1.989 0.649 2024-03-18T00:01:56.446 INFO:teuthology.orchestra.run.smithi196.stdout:+hv02.front.sepi 96.245.170.99 3 u 49 64 377 0.070 -0.366 1.177 2024-03-18T00:01:56.446 INFO:teuthology.orchestra.run.smithi196.stdout:+hv03.front.sepi 74.6.168.72 3 u 54 64 377 0.073 +0.160 1.170 2024-03-18T00:01:56.446 INFO:teuthology.orchestra.run.smithi196.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-03-18T00:01:56.447 INFO:teuthology.orchestra.run.smithi204.stdout: remote refid st t when poll reach delay offset jitter 2024-03-18T00:01:56.447 INFO:teuthology.orchestra.run.smithi204.stdout:============================================================================== 2024-03-18T00:01:56.447 INFO:teuthology.orchestra.run.smithi204.stdout:*hv01.front.sepi 44.4.53.2 2 u 45 64 377 0.077 -1.297 0.720 2024-03-18T00:01:56.447 INFO:teuthology.orchestra.run.smithi204.stdout:+hv02.front.sepi 96.245.170.99 3 u 50 64 377 0.080 -0.121 0.716 2024-03-18T00:01:56.448 INFO:teuthology.orchestra.run.smithi204.stdout:+hv03.front.sepi 74.6.168.72 3 u 44 64 377 0.094 +0.134 0.662 2024-03-18T00:01:56.448 INFO:teuthology.orchestra.run.smithi204.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-03-18T00:01:56.448 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-03-18T00:01:56.458 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-03-18T00:01:56.458 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-03-18T00:01:56.467 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-03-18T00:01:56.477 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-03-18T00:01:56.486 INFO:teuthology.task.internal:Duration was 1008.110950 seconds 2024-03-18T00:01:56.486 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-03-18T00:01:56.499 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-03-18T00:01:56.499 DEBUG:teuthology.orchestra.run.smithi196:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-03-18T00:01:56.501 DEBUG:teuthology.orchestra.run.smithi204:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-03-18T00:01:56.537 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-03-18T00:01:56.537 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi196.front.sepia.ceph.com 2024-03-18T00:01:56.537 DEBUG:teuthology.orchestra.run.smithi196:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-03-18T00:01:56.588 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi204.front.sepia.ceph.com 2024-03-18T00:01:56.589 DEBUG:teuthology.orchestra.run.smithi204:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-03-18T00:01:56.599 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-03-18T00:01:56.599 DEBUG:teuthology.orchestra.run.smithi196:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-03-18T00:01:56.632 DEBUG:teuthology.orchestra.run.smithi204:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-03-18T00:01:56.831 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-03-18T00:01:56.832 DEBUG:teuthology.orchestra.run.smithi196:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-03-18T00:01:56.834 DEBUG:teuthology.orchestra.run.smithi204:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-03-18T00:01:56.901 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-03-18T00:01:57.010 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-03-18T00:01:57.011 DEBUG:teuthology.orchestra.run.smithi196:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-03-18T00:01:57.025 DEBUG:teuthology.orchestra.run.smithi204:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-03-18T00:01:57.039 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-03-18T00:01:57.051 DEBUG:teuthology.orchestra.run.smithi196:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-03-18T00:01:57.069 DEBUG:teuthology.orchestra.run.smithi204:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-03-18T00:01:57.078 INFO:teuthology.orchestra.run.smithi196.stdout:kernel.core_pattern = core 2024-03-18T00:01:57.092 INFO:teuthology.orchestra.run.smithi204.stdout:kernel.core_pattern = core 2024-03-18T00:01:57.121 DEBUG:teuthology.orchestra.run.smithi196:> test -e /home/ubuntu/cephtest/archive/coredump 2024-03-18T00:01:57.135 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-18T00:01:57.135 DEBUG:teuthology.orchestra.run.smithi204:> test -e /home/ubuntu/cephtest/archive/coredump 2024-03-18T00:01:57.168 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-18T00:01:57.169 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-03-18T00:01:57.197 INFO:teuthology.task.internal:Transferring archived files... 2024-03-18T00:01:57.197 DEBUG:teuthology.misc:Transferring archived files from smithi196:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2024-03-17_23:17:27-fs-wip-batrick-testing-20240314.183243-distro-default-smithi/7608502/remote/smithi196 2024-03-18T00:01:57.198 DEBUG:teuthology.orchestra.run.smithi196:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-03-18T00:01:57.218 DEBUG:teuthology.misc:Transferring archived files from smithi204:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2024-03-17_23:17:27-fs-wip-batrick-testing-20240314.183243-distro-default-smithi/7608502/remote/smithi204 2024-03-18T00:01:57.218 DEBUG:teuthology.orchestra.run.smithi204:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-03-18T00:01:57.237 INFO:teuthology.task.internal:Removing archive directory... 2024-03-18T00:01:57.237 DEBUG:teuthology.orchestra.run.smithi196:> rm -rf -- /home/ubuntu/cephtest/archive 2024-03-18T00:01:57.257 DEBUG:teuthology.orchestra.run.smithi204:> rm -rf -- /home/ubuntu/cephtest/archive 2024-03-18T00:01:57.281 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-03-18T00:01:57.304 INFO:teuthology.task.internal:Not uploading archives. 2024-03-18T00:01:57.304 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-03-18T00:01:57.315 INFO:teuthology.task.internal:Tidying up after the test... 2024-03-18T00:01:57.315 DEBUG:teuthology.orchestra.run.smithi196:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-03-18T00:01:57.318 DEBUG:teuthology.orchestra.run.smithi204:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-03-18T00:01:57.321 INFO:teuthology.orchestra.run.smithi196.stdout: 658642 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 18 00:01 /home/ubuntu/cephtest 2024-03-18T00:01:57.329 INFO:teuthology.orchestra.run.smithi204.stdout: 658463 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 18 00:01 /home/ubuntu/cephtest 2024-03-18T00:01:57.331 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-03-18T00:01:57.345 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-03-18T00:01:57.358 DEBUG:teuthology.run_tasks:Exception was not quenched, exiting: CommandFailedError: Command failed on smithi196 with status 3: 'sudo logrotate /etc/logrotate.d/ceph-test.conf' 2024-03-18T00:01:57.358 INFO:teuthology.nuke:Checking targets against current locks 2024-03-18T00:01:57.384 DEBUG:teuthology.nuke:shortname: smithi196 2024-03-18T00:01:57.385 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-03-18T00:01:57.404 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi196.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-03-17_23:17:27-fs-wip-batrick-testing-20240314.183243-distro-default-smithi/7608502', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-03-17 23:35:50.401004', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAs0844wV6QQUoZJ+C60WiQCEh8h2X7JIthXaWrQMx9UwB8G87CQJrnIGKrPS1OwgRcON83HyicicbCIye/y7/E='} 2024-03-18T00:01:57.411 DEBUG:teuthology.nuke:shortname: smithi204 2024-03-18T00:01:57.412 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-03-18T00:01:57.432 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi204.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-03-17_23:17:27-fs-wip-batrick-testing-20240314.183243-distro-default-smithi/7608502', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-03-17 23:35:50.399409', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBjRRYU3IlO5bGPT4dvCXd6tMqE52fMlYdvmWFVwJYCtALiTKQQTvQwrt03hevR32GVaaGTAWUPB6arxujLXlTI='} 2024-03-18T00:01:57.456 INFO:teuthology.orchestra.console.smithi196:Power off 2024-03-18T00:01:57.456 DEBUG:teuthology.orchestra.console.smithi196:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-18T00:01:57.481 DEBUG:teuthology.orchestra.console.smithi196:power off output: Chassis Power Control: Down/Off 2024-03-18T00:01:57.481 DEBUG:teuthology.orchestra.console.smithi196:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-18T00:01:57.499 INFO:teuthology.orchestra.console.smithi204:Power off 2024-03-18T00:01:57.499 DEBUG:teuthology.orchestra.console.smithi204:pexpect command: ipmitool -H smithi204.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-18T00:01:57.511 DEBUG:teuthology.orchestra.console.smithi196:check power output: Chassis Power is on 2024-03-18T00:01:57.525 DEBUG:teuthology.orchestra.console.smithi204:power off output: Chassis Power Control: Down/Off 2024-03-18T00:01:57.526 DEBUG:teuthology.orchestra.console.smithi204:pexpect command: ipmitool -H smithi204.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-18T00:01:57.550 DEBUG:teuthology.orchestra.console.smithi204:check power output: Chassis Power is on 2024-03-18T00:02:01.513 DEBUG:teuthology.orchestra.console.smithi196:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-18T00:02:01.551 DEBUG:teuthology.orchestra.console.smithi204:pexpect command: ipmitool -H smithi204.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-18T00:02:01.623 DEBUG:teuthology.orchestra.console.smithi196:check power output: Chassis Power is on 2024-03-18T00:02:01.661 DEBUG:teuthology.orchestra.console.smithi204:check power output: Chassis Power is on 2024-03-18T00:02:05.626 DEBUG:teuthology.orchestra.console.smithi196:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-18T00:02:05.664 DEBUG:teuthology.orchestra.console.smithi204:pexpect command: ipmitool -H smithi204.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-18T00:02:05.736 DEBUG:teuthology.orchestra.console.smithi196:check power output: Chassis Power is on 2024-03-18T00:02:05.774 DEBUG:teuthology.orchestra.console.smithi204:check power output: Chassis Power is on 2024-03-18T00:02:09.738 DEBUG:teuthology.orchestra.console.smithi196:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-18T00:02:09.775 DEBUG:teuthology.orchestra.console.smithi204:pexpect command: ipmitool -H smithi204.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-18T00:02:09.849 DEBUG:teuthology.orchestra.console.smithi196:check power output: Chassis Power is off 2024-03-18T00:02:09.888 DEBUG:teuthology.orchestra.console.smithi204:check power output: Chassis Power is off 2024-03-18T00:02:09.950 INFO:teuthology.orchestra.console.smithi196:Power off completed 2024-03-18T00:02:09.989 INFO:teuthology.orchestra.console.smithi204:Power off completed 2024-03-18T00:02:10.094 INFO:teuthology.run:Summary data: description: fs/verify/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu/{overrides ubuntu_latest}} mount/fuse objectstore-ec/bluestore-comp overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug session_timeout} ranks/5 tasks/fsstress validater/lockdep} duration: 1008.1109502315521 failure_reason: 'Command failed on smithi196 with status 3: ''sudo logrotate /etc/logrotate.d/ceph-test.conf''' flavor: default owner: scheduled_pdonnell@teuthology status: fail success: false 2024-03-18T00:02:10.095 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-18T00:02:10.176 INFO:teuthology.run:FAIL